PrototypeCommon
NaiveAI-Labs/NaiveRT
NaiveRT: a self-contained TP8 inference runtime for the Naive N series on eight Blackwell GPUs with UMMA support. One persistent CUDA graph per rank runs draft, eight-row verify, top-p sampling and cache commit with no host in the loop: 1,700 tokens/s at batch size 1, one-second peaks above 2,000.
- Owner
- NaiveAI-Labs (organization)
- Stars
- Stars: 114
- Forks
- Forks: 7
- Language
- Python
- License
- Apache-2.0
- Created
- 2026
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by NaiveAI-Labs
All 2 repos by NaiveAI-Labs- NaiveAI-Labs/Naive-N0.5-FlashStars: 382PythonAlpha
Nearby in Python
All Python repos- Fryankarangora/MantleFenghuangStars: 114PythonPrototype
- zensers/zensersStars: 114PythonPrototype
- Toyaspio/maibot-baidu-searchStars: 114PythonPrototype
- leah/django-elsewhereStars: 114PythonPrototype
- fschulze/mr.developerStars: 114PythonPrototype
- cloudkick/libcloudStars: 114PythonPrototype