BetaRare
mit-han-lab/TinyChatEngine
TinyChatEngine: On-Device LLM Inference Library
- Owner
- mit-han-lab (organization)
- Stars
- Stars: 970
- Forks
- Forks: 102
- Language
- C++
- License
- MIT
- Created
- 2023
- Topics
- armccppcuda-programmingdeep-learningedge-computinglarge-language-modelson-device-aiquantizationx86-64
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by mit-han-lab
All 53 repos by mit-han-lab- mit-han-lab/streaming-llmStars: 7,275PythonStable
- mit-han-lab/llm-awqStars: 3,661PythonRC
- mit-han-lab/efficientvitStars: 3,374PythonRC
- mit-han-lab/bevfusionStars: 3,235PythonRC
- mit-han-lab/temporal-shift-moduleStars: 2,229PythonRC
- mit-han-lab/once-for-allStars: 1,957PythonBeta
Nearby in C++
All C++ repos- ablab/spadesStars: 970C++Beta
- BBuf/Image-processing-algorithmStars: 970C++Beta
- horsicq/XMachOViewerStars: 970C++Beta
- vlc-qt/vlc-qtStars: 970C++Beta