# MegEngine/InferLLM

<https://repo.masters-masters.com/en/repos/MegEngine/InferLLM>

[Home](https://repo.masters-masters.com/en) › [MegEngine](https://repo.masters-masters.com/en/owners/MegEngine) › [InferLLM](https://repo.masters-masters.com/en/repos/MegEngine/InferLLM)

MegEngine/InferLLM has 752 stars on GitHub. Its RepoMasters card: Beta tier. a lightweight LLM model inference framework Language: C++.

| Field | Value |
| --- | --- |
| Owner | [MegEngine](https://repo.masters-masters.com/en/owners/MegEngine) |
| Stars | 752 |
| Forks | 94 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | deeplearning, inference, llm, mobile |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [MegEngine/InferLLM](https://github.com/MegEngine/InferLLM) |

## Repository

a lightweight LLM model inference framework

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by MegEngine

- [MegEngine/MegEngine · ★ 4,809 · C++ · RC](https://repo.masters-masters.com/en/repos/MegEngine/MegEngine)
- [MegEngine/MegSpot · ★ 607 · Vue · Alpha](https://repo.masters-masters.com/en/repos/MegEngine/MegSpot)
- [MegEngine/MegCC · ★ 481 · C++ · Alpha](https://repo.masters-masters.com/en/repos/MegEngine/MegCC)
- [MegEngine/MegFlow · ★ 400 · Rust · Alpha](https://repo.masters-masters.com/en/repos/MegEngine/MegFlow)
- [MegEngine/Models · ★ 305 · Python · Alpha](https://repo.masters-masters.com/en/repos/MegEngine/Models)
- [MegEngine/RepLKNet · ★ 284 · Python · Alpha](https://repo.masters-masters.com/en/repos/MegEngine/RepLKNet)

## Nearby in C++

- [weigert/SimpleHydrology · ★ 752 · C++ · Beta](https://repo.masters-masters.com/en/repos/weigert/SimpleHydrology)
- [RoboSense-LiDAR/rslidar\_sdk · ★ 752 · C++ · Beta](https://repo.masters-masters.com/en/repos/RoboSense-LiDAR/rslidar_sdk)
- [ptyfyre/mandarine-neo · ★ 752 · C++ · Beta](https://repo.masters-masters.com/en/repos/ptyfyre/mandarine-neo)
- [tapir-dream/berserkJS · ★ 752 · C++ · Beta](https://repo.masters-masters.com/en/repos/tapir-dream/berserkJS)
- [Iyengar111/NanoLog · ★ 752 · C++ · Beta](https://repo.masters-masters.com/en/repos/Iyengar111/NanoLog)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.