Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits

AlphaUncommon

xaskasdf/ntransformer

High-efficiency LLM inference engine in C++/CUDA. Run Llama 70B on RTX 3090.

Owner: xaskasdf (personal account)
Stars: Stars: 469
Forks: Forks: 20
Language: C++
License: None
Created: 2026
Tier: Alpha (250 to 699 ★) What this tier means

Nearby in C++

Offensive-Panda/ProcessInjectionTechniquesStars: 469C++Alpha
can1357/seleneStars: 469C++Alpha
open-planning/roboplanStars: 469C++Alpha
alliedmodders/hl2sdkStars: 469C++Alpha
u8sand/Baka-MPlayerStars: 469C++Alpha
DISTORTEC/distortosStars: 469C++Alpha