# zhihu/ZhiLight

<https://repo.masters-masters.com/en/repos/zhihu/ZhiLight>

[Home](https://repo.masters-masters.com/en) › [zhihu](https://repo.masters-masters.com/en/owners/zhihu) › [ZhiLight](https://repo.masters-masters.com/en/repos/zhihu/ZhiLight)

zhihu/ZhiLight has 906 stars on GitHub. Its RepoMasters card: Beta tier. A highly optimized LLM inference acceleration engine for Llama and its variants.

| Field | Value |
| --- | --- |
| Owner | [zhihu](https://repo.masters-masters.com/en/owners/zhihu) |
| Stars | 906 |
| Forks | 105 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | Apache-2.0 |
| Created | 2024 |
| Topics | inference-engine, llm, cuda, gpt, llama, llm-serving, pytorch, llm-inference, model-serving, deepseek-r1 |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [zhihu/ZhiLight](https://github.com/zhihu/ZhiLight) |

## Repository

A highly optimized LLM inference acceleration engine for Llama and its variants.

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by zhihu

- [zhihu/Matisse · ★ 12,492 · Java · Stable](https://repo.masters-masters.com/en/repos/zhihu/Matisse)
- [zhihu/griffith · ★ 2,507 · TypeScript · RC](https://repo.masters-masters.com/en/repos/zhihu/griffith)
- [zhihu/kids · ★ 1,213 · C++ · Beta](https://repo.masters-masters.com/en/repos/zhihu/kids)
- [zhihu/rucene · ★ 1,019 · Rust · Beta](https://repo.masters-masters.com/en/repos/zhihu/rucene)
- [zhihu/cuBERT · ★ 546 · C++ · Alpha](https://repo.masters-masters.com/en/repos/zhihu/cuBERT)
- [zhihu/RxLifecycle · ★ 507 · Java · Alpha](https://repo.masters-masters.com/en/repos/zhihu/RxLifecycle)

## Nearby in C++

- [eyalroz/cuda-api-wrappers · ★ 906 · C++ · Beta](https://repo.masters-masters.com/en/repos/eyalroz/cuda-api-wrappers)
- [DustinHLand/vkDOOM3 · ★ 906 · C++ · Beta](https://repo.masters-masters.com/en/repos/DustinHLand/vkDOOM3)
- [google/quiche · ★ 906 · C++ · Beta](https://repo.masters-masters.com/en/repos/google/quiche)
- [CLD2Owners/cld2 · ★ 905 · C++ · Beta](https://repo.masters-masters.com/en/repos/CLD2Owners/cld2)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.