# nath1295/MLX-Textgen

<https://repo.masters-masters.com/en/repos/nath1295/MLX-Textgen>

[Home](https://repo.masters-masters.com/en) › [nath1295](https://repo.masters-masters.com/en/owners/nath1295) › [MLX-Textgen](https://repo.masters-masters.com/en/repos/nath1295/MLX-Textgen)

nath1295/MLX-Textgen has 104 stars on GitHub. Its RepoMasters card: Prototype tier. A python package for serving LLM on OpenAI-compatible API endpoints with…

| Field | Value |
| --- | --- |
| Owner | [nath1295](https://repo.masters-masters.com/en/owners/nath1295) |
| Stars | 104 |
| Forks | 8 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2024 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [nath1295/MLX-Textgen](https://github.com/nath1295/MLX-Textgen) |

## Repository

A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by nath1295

- [nath1295/LLMFlex · ★ 150 · Python · Prototype](https://repo.masters-masters.com/en/repos/nath1295/LLMFlex)

## Nearby in Python

- [clawgeek/mcd-nutrition-expert · ★ 104 · Python · Prototype](https://repo.masters-masters.com/en/repos/clawgeek/mcd-nutrition-expert)
- [sandskatherinenymph/Electrum-Fake-Balance · ★ 104 · Python · Prototype](https://repo.masters-masters.com/en/repos/sandskatherinenymph/Electrum-Fake-Balance)
- [vixhal-baraiya/qwenGPU · ★ 104 · Python · Prototype](https://repo.masters-masters.com/en/repos/vixhal-baraiya/qwenGPU)
- [jcbagneris/fms-jcb · ★ 104 · Python · Prototype](https://repo.masters-masters.com/en/repos/jcbagneris/fms-jcb)
- [zain/jogging · ★ 104 · Python · Prototype](https://repo.masters-masters.com/en/repos/zain/jogging)
- [lilspikey/django-background-task · ★ 104 · Python · Prototype](https://repo.masters-masters.com/en/repos/lilspikey/django-background-task)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.