# Tiiny-AI/PowerInfer

<https://repo.masters-masters.com/en/repos/Tiiny-AI/PowerInfer>

[Home](https://repo.masters-masters.com/en) › [Tiiny-AI](https://repo.masters-masters.com/en/owners/Tiiny-AI) › [PowerInfer](https://repo.masters-masters.com/en/repos/Tiiny-AI/PowerInfer)

Tiiny-AI/PowerInfer has 9,863 stars on GitHub. Its RepoMasters card: Stable tier. High-speed Large Language Model Serving for Local Deployment Language: C++.

| Field | Value |
| --- | --- |
| Owner | [Tiiny-AI](https://repo.masters-masters.com/en/owners/Tiiny-AI) |
| Stars | 9,863 |
| Forks | 612 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | MIT |
| Created | 2023 |
| Topics | large-language-models, llama, llm, llm-inference, local-inference |
| Tier | [Stable (5,000 to 19,999 ★)](https://repo.masters-masters.com/en/ranks/cult) |
| View on GitHub | [Tiiny-AI/PowerInfer](https://github.com/Tiiny-AI/PowerInfer) |

## Repository

High-speed Large Language Model Serving for Local Deployment

The tier for repos with 5,000 to 19,999 ★. Published odds per card pulled: 0.9%. Rarity: Very rare.

## Nearby in C++

- [AGWA/git-crypt · ★ 9,979 · C++ · Stable](https://repo.masters-masters.com/en/repos/AGWA/git-crypt)
- [diasurgical/DevilutionX · ★ 9,976 · C++ · Stable](https://repo.masters-masters.com/en/repos/diasurgical/DevilutionX)
- [cocos/cocos-engine · ★ 9,901 · C++ · Stable](https://repo.masters-masters.com/en/repos/cocos/cocos-engine)
- [owasp-modsecurity/ModSecurity · ★ 9,849 · C++ · Stable](https://repo.masters-masters.com/en/repos/owasp-modsecurity/ModSecurity)
- [google/re2 · ★ 9,842 · C++ · Stable](https://repo.masters-masters.com/en/repos/google/re2)
- [o3de/o3de · ★ 9,812 · C++ · Stable](https://repo.masters-masters.com/en/repos/o3de/o3de)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.