RCEpic
vllm-project/llm-compressor
State-of-the-art LLM compression, built for production inference with vLLM
- Owner
- vllm-project (organization)
- Stars
- Stars: 3,933
- Forks
- Forks: 721
- Language
- Python
- License
- Apache-2.0
- Created
- 2024
- Topics
- compressionquantization
- Tier
- RC (2,000 to 4,999 ★) What this tier means
More repos by vllm-project
All 20 repos by vllm-project- vllm-project/vllmStars: 96,102PythonLTS
- vllm-project/vllm-omniStars: 7,480PythonStable
- vllm-project/semantic-routerStars: 6,371GoStable
- vllm-project/aibrixStars: 5,175GoStable
- vllm-project/vllm-ascendStars: 3,039PythonRC
- vllm-project/production-stackStars: 2,704PythonRC
Nearby in Python
All Python repos- mesa/mesaStars: 3,937PythonRC
- BlinkDL/AI-WriterStars: 3,935PythonRC
- ansible/ansible-lintStars: 3,933PythonRC
- danijar/dreamerv3Stars: 3,932PythonRC
- cornellius-gp/gpytorchStars: 3,931PythonRC
- diego-vicente/som-tspStars: 3,931PythonRC