PrototypeCommon
mixedbread-ai/batched
The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching of inference workloads.
- Owner
- mixedbread-ai (organization)
- Stars
- Stars: 161
- Forks
- Forks: 13
- Language
- Python
- License
- Apache-2.0
- Created
- 2024
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by mixedbread-ai
All 3 repos by mixedbread-ai- mixedbread-ai/mgrepStars: 4,429TypeScriptRC
- mixedbread-ai/baguetterStars: 213PythonPrototype
Nearby in Python
All Python repos- shootthesound/ComfyUI-Fizgig-H3-StillStars: 161PythonPrototype
- d4ncboz/museaiStars: 161PythonPrototype
- aa1143/NamiGPTStars: 161PythonPrototype
- lilspikey/django-batch-selectStars: 161PythonPrototype
- benosteen/FaceRecognitionStars: 161PythonPrototype
- defnull/multipartStars: 161PythonPrototype