Skip to content

Add dynamic batching, FP16, and /metrics to the mBERT API#177

Closed
ajamous wants to merge 2 commits into
mainfrom
feat/mbert-dynamic-batching
Closed

Add dynamic batching, FP16, and /metrics to the mBERT API#177
ajamous wants to merge 2 commits into
mainfrom
feat/mbert-dynamic-batching

Add unit tests for dynamic batcher and /metrics endpoint

f76d885
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs