Illustration: the project’s public image, pixelated by RepoMasters. Credits
BetaRare

MegEngine/InferLLM

a lightweight LLM model inference framework

Owner
MegEngine (organization)
Stars
Stars: 752
Forks
Forks: 94
Language
C++
License
Apache-2.0
Created
2023
Topics
deeplearninginferencellmmobile
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by MegEngine

All 12 repos by MegEngine

Nearby in C++

All C++ repos