Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

ferrumox/rabbit

Run Qwen 3.8 MAX (2.4T MoE) on a 50GB-RAM consumer machine in pure Rust, experts streamed from disk. Tiny engine, immense model.

Owner
ferrumox (organization)
Stars
Stars: 191
Forks
Forks: 21
Language
Rust
License
Apache-2.0
Created
2026
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by ferrumox

All 2 repos by ferrumox

Nearby in Rust

All Rust repos