BetaRare
vllm-project/guidellm
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
- Owner
- vllm-project (organization)
- Stars
- Stars: 1,738
- Forks
- Forks: 283
- Language
- Python
- License
- Apache-2.0
- Created
- 2024
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by vllm-project
All 20 repos by vllm-project- vllm-project/vllmStars: 96,102PythonLTS
- vllm-project/vllm-omniStars: 7,480PythonStable
- vllm-project/semantic-routerStars: 6,371GoStable
- vllm-project/aibrixStars: 5,175GoStable
- vllm-project/llm-compressorStars: 3,933PythonRC
- vllm-project/vllm-ascendStars: 3,039PythonRC
Nearby in Python
All Python repos- google-research/circuit_trainingStars: 1,738PythonBeta
- tenstorrent/tt-metalStars: 1,738PythonBeta
- jesselau76/ebook-GPT-translatorStars: 1,738PythonBeta
- lijiejie/ds_store_expStars: 1,738PythonBeta
- alkaline-ml/pmdarimaStars: 1,738PythonBeta