# bentoml/OpenLLM

<https://repo.masters-masters.com/en/repos/bentoml/OpenLLM>

[Home](https://repo.masters-masters.com/en) › [bentoml](https://repo.masters-masters.com/en/owners/bentoml) › [OpenLLM](https://repo.masters-masters.com/en/repos/bentoml/OpenLLM)

bentoml/OpenLLM has 12,581 stars on GitHub. Its RepoMasters card: Stable tier. Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API…

| Field | Value |
| --- | --- |
| Owner | [bentoml](https://repo.masters-masters.com/en/owners/bentoml) |
| Stars | 12,581 |
| Forks | 849 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | llm, llmops, model-inference, fine-tuning, llm-serving, llama, vicuna, bentoml, llama2, llm-inference |
| Tier | [Stable (5,000 to 19,999 ★)](https://repo.masters-masters.com/en/ranks/cult) |
| View on GitHub | [bentoml/OpenLLM](https://github.com/bentoml/OpenLLM) |

## Repository

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

The tier for repos with 5,000 to 19,999 ★. Published odds per card pulled: 0.9%. Rarity: Very rare.

## More repos by bentoml

- [bentoml/BentoML · ★ 8,933 · Python · Stable](https://repo.masters-masters.com/en/repos/bentoml/BentoML)
- [bentoml/Yatai · ★ 839 · TypeScript · Beta](https://repo.masters-masters.com/en/repos/bentoml/Yatai)
- [bentoml/BentoDiffusion · ★ 390 · Python · Alpha](https://repo.masters-masters.com/en/repos/bentoml/BentoDiffusion)
- [bentoml/comfy-pack · ★ 215 · Python · Prototype](https://repo.masters-masters.com/en/repos/bentoml/comfy-pack)
- [bentoml/llm-optimizer · ★ 203 · Python · Prototype](https://repo.masters-masters.com/en/repos/bentoml/llm-optimizer)
- [bentoml/stable-diffusion-server · ★ 201 · Python · Prototype](https://repo.masters-masters.com/en/repos/bentoml/stable-diffusion-server)

## Nearby in Python

- [bmaltais/kohya\_ss · ★ 12,652 · Python · Stable](https://repo.masters-masters.com/en/repos/bmaltais/kohya_ss)
- [microsoft/TRELLIS.2 · ★ 12,629 · Python · Stable](https://repo.masters-masters.com/en/repos/microsoft/TRELLIS.2)
- [jopohl/urh · ★ 12,594 · Python · Stable](https://repo.masters-masters.com/en/repos/jopohl/urh)
- [elebumm/RedditVideoMakerBot · ★ 12,557 · Python · Stable](https://repo.masters-masters.com/en/repos/elebumm/RedditVideoMakerBot)
- [g1879/DrissionPage · ★ 12,555 · Python · Stable](https://repo.masters-masters.com/en/repos/g1879/DrissionPage)
- [ostris/ai-toolkit · ★ 12,545 · Python · Stable](https://repo.masters-masters.com/en/repos/ostris/ai-toolkit)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.