StableVery rare
bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
- Owner
- bentoml (organization)
- Stars
- Stars: 12,576
- Forks
- Forks: 848
- Language
- Python
- License
- Apache-2.0
- Created
- 2023
- Topics
- llmllmopsmodel-inferencefine-tuningllm-servingllamavicunabentomlllama2llm-inference
- Tier
- Stable (5,000 to 19,999 ★) What this tier means
More repos by bentoml
All 11 repos by bentoml- bentoml/BentoMLStars: 8,930PythonStable
- bentoml/YataiStars: 839TypeScriptBeta
- bentoml/BentoDiffusionStars: 390PythonAlpha
- bentoml/comfy-packStars: 215PythonPrototype
- bentoml/llm-optimizerStars: 203PythonPrototype
- bentoml/stable-diffusion-serverStars: 201PythonPrototype
Nearby in Python
All Python repos- bmaltais/kohya_ssStars: 12,648PythonStable
- microsoft/TRELLIS.2Stars: 12,601PythonStable
- jopohl/urhStars: 12,593PythonStable
- elebumm/RedditVideoMakerBotStars: 12,557PythonStable
- g1879/DrissionPageStars: 12,554PythonStable
- ostris/ai-toolkitStars: 12,541PythonStable