RCEpic
turboderp-org/exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
- Owner
- turboderp-org (organization)
- Stars
- Stars: 4,648
- Forks
- Forks: 348
- Language
- Python
- License
- MIT
- Created
- 2023
- Tier
- RC (2,000 to 4,999 ★) What this tier means
More repos by turboderp-org
All 3 repos by turboderp-org- turboderp-org/exllamav3Stars: 1,778PythonBeta
- turboderp-org/exuiStars: 517JavaScriptAlpha
Nearby in Python
All Python repos- pythonguis/pythonguis-examplesStars: 4,653PythonRC
- sweetice/Deep-reinforcement-learning-with-pytorchStars: 4,653PythonRC
- ReversecLabs/drozerStars: 4,648PythonRC
- tlkh/asitopStars: 4,646PythonRC
- promptslab/PromptifyStars: 4,645PythonRC
- michael-lazar/rtvStars: 4,641PythonRC