AlphaUncommon
runpod-workers/worker-vllm
The Runpod worker template for serving our large language model endpoints. Powered by vLLM.
- Owner
- runpod-workers (organization)
- Stars
- Stars: 474
- Forks
- Forks: 395
- Language
- Python
- License
- MIT
- Created
- 2023
- Topics
- language-modelllmrunpodvllm
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by runpod-workers
All 5 repos by runpod-workers- runpod-workers/worker-comfyuiStars: 749PythonBeta
- runpod-workers/worker-faster_whisperStars: 144PythonPrototype
- runpod-workers/worker-templateStars: 136PythonPrototype
- runpod-workers/worker-a1111Stars: 100PythonPrototype
Nearby in Python
All Python repos- apple-aiml-research/ml-litoStars: 474PythonAlpha
- huskydoge/Awesome-Loop-ModelsStars: 474PythonAlpha
- ByteDance-Seed/EdgeBenchStars: 474PythonAlpha
- django-commons/django-robotsStars: 474PythonAlpha
- py-moneyed/py-moneyedStars: 474PythonAlpha
- TabViewer/tabviewStars: 474PythonAlpha