# microsoft/batch-inference

<https://repo.masters-masters.com/en/repos/microsoft/batch-inference>

[Home](https://repo.masters-masters.com/en) › [microsoft](https://repo.masters-masters.com/en/owners/microsoft) › [batch-inference](https://repo.masters-masters.com/en/repos/microsoft/batch-inference)

microsoft/batch-inference has 106 stars on GitHub. Its RepoMasters card: Prototype tier. Dynamic batching library for Deep Learning inference. Tutorials for…

| Field | Value |
| --- | --- |
| Owner | [microsoft](https://repo.masters-masters.com/en/owners/microsoft) |
| Stars | 106 |
| Forks | 6 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2023 |
| Topics | deep-learning, inference, performance-optimization, dynamic-batching, python, gpt, llm |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [microsoft/batch-inference](https://github.com/microsoft/batch-inference) |

## Repository

Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by microsoft

- [microsoft/vscode · ★ 194,462 · TypeScript · LTS](https://repo.masters-masters.com/en/repos/microsoft/vscode)
- [microsoft/markitdown · ★ 193,456 · Python · LTS](https://repo.masters-masters.com/en/repos/microsoft/markitdown)
- [microsoft/PowerToys · ★ 140,398 · C · LTS](https://repo.masters-masters.com/en/repos/microsoft/PowerToys)
- [microsoft/generative-ai-for-beginners · ★ 122,788 · Jupyter Notebook · LTS](https://repo.masters-masters.com/en/repos/microsoft/generative-ai-for-beginners)
- [microsoft/TypeScript · ★ 111,714 · Go · LTS](https://repo.masters-masters.com/en/repos/microsoft/TypeScript)
- [microsoft/terminal · ★ 105,311 · C++ · LTS](https://repo.masters-masters.com/en/repos/microsoft/terminal)

## Nearby in Python

- [Ta0p1/ResolveLab · ★ 106 · Python · Prototype](https://repo.masters-masters.com/en/repos/Ta0p1/ResolveLab)
- [PlusF666/mctaste-lab · ★ 106 · Python · Prototype](https://repo.masters-masters.com/en/repos/PlusF666/mctaste-lab)
- [sdua078/teleopro · ★ 106 · Python · Prototype](https://repo.masters-masters.com/en/repos/sdua078/teleopro)
- [mkelly12/google\_closure\_compiler · ★ 106 · Python · Prototype](https://repo.masters-masters.com/en/repos/mkelly12/google_closure_compiler)
- [alex/django-admin-histograms · ★ 106 · Python · Prototype](https://repo.masters-masters.com/en/repos/alex/django-admin-histograms)
- [bretth/woven · ★ 106 · Python · Prototype](https://repo.masters-masters.com/en/repos/bretth/woven)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.