PrototypeCommon
ahtx/kindi
A custom LLM inference engine for low-cost GPUs: NVIDIA cards from a 1 GB Quadro K420 to an RTX 3080, the AMD Radeon 780M and the CPU. Runs the Bonsai 2B to 27B models and Nemotron with an OpenAI-compatible server.
- Owner
- ahtx (personal account)
- Stars
- Stars: 116
- Forks
- Forks: 31
- Language
- Python
- License
- AGPL-3.0
- Created
- 2026
- Topics
- bitnetcudakeplerllm-inferencelocal-llmopenai-compatiblequadroternaryamperemaxwell
- Tier
- Prototype (100 to 249 ★) What this tier means
Nearby in Python
All Python repos- flemuh/radar-public-sectorStars: 116PythonPrototype
- yqf66/SoleviaStars: 116PythonPrototype
- fuyichen0725/blinkmimicStars: 116PythonPrototype
- jezdez/django-mobileadminStars: 116PythonPrototype
- montylounge/django-sugarStars: 116PythonPrototype
- codysoyland/django-template-replStars: 116PythonPrototype