BetaRare
turboderp-org/exllamav3
An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
- Owner
- turboderp-org (organization)
- Stars
- Stars: 1,778
- Forks
- Forks: 281
- Language
- Python
- License
- MIT
- Created
- 2025
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by turboderp-org
All 3 repos by turboderp-org- turboderp-org/exllamav2Stars: 4,648PythonRC
- turboderp-org/exuiStars: 517JavaScriptAlpha
Nearby in Python
All Python repos- Toyhom/Chinese-medical-dialogue-dataStars: 1,778PythonBeta
- dunnousername/yanderifierStars: 1,778PythonBeta
- ExtensityAI/symbolicaiStars: 1,778PythonBeta
- etesync/serverStars: 1,778PythonBeta