StableVery rare
Tiiny-AI/PowerInfer
High-speed Large Language Model Serving for Local Deployment
- Owner
- Tiiny-AI (organization)
- Stars
- Stars: 9,862
- Forks
- Forks: 612
- Language
- C++
- License
- MIT
- Created
- 2023
- Topics
- large-language-modelsllamallmllm-inferencelocal-inference
- Tier
- Stable (5,000 to 19,999 ★) What this tier means
Nearby in C++
All C++ repos- AGWA/git-cryptStars: 9,979C++Stable
- diasurgical/DevilutionXStars: 9,971C++Stable
- cocos/cocos-engineStars: 9,897C++Stable
- owasp-modsecurity/ModSecurityStars: 9,849C++Stable
- google/re2Stars: 9,842C++Stable
- o3de/o3deStars: 9,808C++Stable