# kvcache-ai/ktransformers

<https://repo.masters-masters.com/en/repos/kvcache-ai/ktransformers>

[Home](https://repo.masters-masters.com/en) › [kvcache-ai](https://repo.masters-masters.com/en/owners/kvcache-ai) › [ktransformers](https://repo.masters-masters.com/en/repos/kvcache-ai/ktransformers)

kvcache-ai/ktransformers has 19,654 stars on GitHub. Its RepoMasters card: Stable tier. A Flexible Framework for Experiencing Heterogeneous LLM…

| Field | Value |
| --- | --- |
| Owner | [kvcache-ai](https://repo.masters-masters.com/en/owners/kvcache-ai) |
| Stars | 19,654 |
| Forks | 1,602 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2024 |
| Tier | [Stable (5,000 to 19,999 ★)](https://repo.masters-masters.com/en/ranks/cult) |
| View on GitHub | [kvcache-ai/ktransformers](https://github.com/kvcache-ai/ktransformers) |

## Repository

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

The tier for repos with 5,000 to 19,999 ★. Published odds per card pulled: 0.9%. Rarity: Very rare.

## More repos by kvcache-ai

- [kvcache-ai/Mooncake · ★ 6,958 · C++ · Stable](https://repo.masters-masters.com/en/repos/kvcache-ai/Mooncake)
- [kvcache-ai/AgentENV · ★ 3,719 · Rust · RC](https://repo.masters-masters.com/en/repos/kvcache-ai/AgentENV)

## Nearby in Python

- [agent0ai/agent-zero · ★ 19,670 · Python · Stable](https://repo.masters-masters.com/en/repos/agent0ai/agent-zero)
- [huggingface/trl · ★ 19,660 · Python · Stable](https://repo.masters-masters.com/en/repos/huggingface/trl)
- [stas00/ml-engineering · ★ 19,657 · Python · Stable](https://repo.masters-masters.com/en/repos/stas00/ml-engineering)
- [jianchang512/pyvideotrans · ★ 19,628 · Python · Stable](https://repo.masters-masters.com/en/repos/jianchang512/pyvideotrans)
- [openai/tiktoken · ★ 19,586 · Python · Stable](https://repo.masters-masters.com/en/repos/openai/tiktoken)
- [stitionai/devika · ★ 19,555 · Python · Stable](https://repo.masters-masters.com/en/repos/stitionai/devika)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.