# ahtx/kindi

<https://repo.masters-masters.com/en/repos/ahtx/kindi>

[Home](https://repo.masters-masters.com/en) › [ahtx](https://repo.masters-masters.com/en/owners/ahtx) › [kindi](https://repo.masters-masters.com/en/repos/ahtx/kindi)

ahtx/kindi has 116 stars on GitHub. Its RepoMasters card: Prototype tier. A custom LLM inference engine for low-cost GPUs: NVIDIA cards from a 1 GB Quadro…

| Field | Value |
| --- | --- |
| Owner | [ahtx](https://repo.masters-masters.com/en/owners/ahtx) |
| Stars | 116 |
| Forks | 31 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | AGPL-3.0 |
| Created | 2026 |
| Topics | bitnet, cuda, kepler, llm-inference, local-llm, openai-compatible, quadro, ternary, ampere, maxwell |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [ahtx/kindi](https://github.com/ahtx/kindi) |

## Repository

A custom LLM inference engine for low-cost GPUs: NVIDIA cards from a 1 GB Quadro K420 to an RTX 3080, the AMD Radeon 780M and the CPU. Runs the Bonsai 2B to 27B models and Nemotron with an OpenAI-compatible server.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## Nearby in Python

- [flemuh/radar-public-sector · ★ 116 · Python · Prototype](https://repo.masters-masters.com/en/repos/flemuh/radar-public-sector)
- [yqf66/Solevia · ★ 116 · Python · Prototype](https://repo.masters-masters.com/en/repos/yqf66/Solevia)
- [fuyichen0725/blinkmimic · ★ 116 · Python · Prototype](https://repo.masters-masters.com/en/repos/fuyichen0725/blinkmimic)
- [jezdez/django-mobileadmin · ★ 116 · Python · Prototype](https://repo.masters-masters.com/en/repos/jezdez/django-mobileadmin)
- [montylounge/django-sugar · ★ 116 · Python · Prototype](https://repo.masters-masters.com/en/repos/montylounge/django-sugar)
- [codysoyland/django-template-repl · ★ 116 · Python · Prototype](https://repo.masters-masters.com/en/repos/codysoyland/django-template-repl)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.