# mit-han-lab/TinyChatEngine

<https://repo.masters-masters.com/en/repos/mit-han-lab/TinyChatEngine>

[Home](https://repo.masters-masters.com/en) › [mit-han-lab](https://repo.masters-masters.com/en/owners/mit-han-lab) › [TinyChatEngine](https://repo.masters-masters.com/en/repos/mit-han-lab/TinyChatEngine)

mit-han-lab/TinyChatEngine has 970 stars on GitHub. Its RepoMasters card: Beta tier. TinyChatEngine: On-Device LLM Inference Library Language: C++.

| Field | Value |
| --- | --- |
| Owner | [mit-han-lab](https://repo.masters-masters.com/en/owners/mit-han-lab) |
| Stars | 970 |
| Forks | 102 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | MIT |
| Created | 2023 |
| Topics | arm, c, cpp, cuda-programming, deep-learning, edge-computing, large-language-models, on-device-ai, quantization, x86-64 |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [mit-han-lab/TinyChatEngine](https://github.com/mit-han-lab/TinyChatEngine) |

## Repository

TinyChatEngine: On-Device LLM Inference Library

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by mit-han-lab

- [mit-han-lab/streaming-llm · ★ 7,276 · Python · Stable](https://repo.masters-masters.com/en/repos/mit-han-lab/streaming-llm)
- [mit-han-lab/llm-awq · ★ 3,661 · Python · RC](https://repo.masters-masters.com/en/repos/mit-han-lab/llm-awq)
- [mit-han-lab/efficientvit · ★ 3,374 · Python · RC](https://repo.masters-masters.com/en/repos/mit-han-lab/efficientvit)
- [mit-han-lab/bevfusion · ★ 3,235 · Python · RC](https://repo.masters-masters.com/en/repos/mit-han-lab/bevfusion)
- [mit-han-lab/temporal-shift-module · ★ 2,229 · Python · RC](https://repo.masters-masters.com/en/repos/mit-han-lab/temporal-shift-module)
- [mit-han-lab/once-for-all · ★ 1,957 · Python · Beta](https://repo.masters-masters.com/en/repos/mit-han-lab/once-for-all)

## Nearby in C++

- [BBuf/Image-processing-algorithm · ★ 970 · C++ · Beta](https://repo.masters-masters.com/en/repos/BBuf/Image-processing-algorithm)
- [horsicq/XMachOViewer · ★ 970 · C++ · Beta](https://repo.masters-masters.com/en/repos/horsicq/XMachOViewer)
- [kp7742/UE4Dumper · ★ 970 · C++ · Beta](https://repo.masters-masters.com/en/repos/kp7742/UE4Dumper)
- [vlc-qt/vlc-qt · ★ 970 · C++ · Beta](https://repo.masters-masters.com/en/repos/vlc-qt/vlc-qt)
- [microsoft/rDSN · ★ 970 · C++ · Beta](https://repo.masters-masters.com/en/repos/microsoft/rDSN)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.