Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

NaiveAI-Labs/NaiveRT

NaiveRT: a self-contained TP8 inference runtime for the Naive N series on eight Blackwell GPUs with UMMA support. One persistent CUDA graph per rank runs draft, eight-row verify, top-p sampling and cache commit with no host in the loop: 1,700 tokens/s at batch size 1, one-second peaks above 2,000.

Owner
NaiveAI-Labs (organization)
Stars
Stars: 114
Forks
Forks: 7
Language
Python
License
Apache-2.0
Created
2026
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by NaiveAI-Labs

All 2 repos by NaiveAI-Labs

Nearby in Python

All Python repos