BetaRare
Helldez/BigMoeOnEdge
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
- Owner
- Helldez (personal account)
- Stars
- Stars: 704
- Forks
- Forks: 81
- Language
- C++
- License
- Apache-2.0
- Created
- 2026
- Topics
- androidcppedge-aiggufinferencellama-cppllmmixture-of-expertsmoeon-device-ai
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by Helldez
All 2 repos by Helldez- Helldez/HearoPilot-AppStars: 108KotlinPrototype
Nearby in C++
All C++ repos- facebookresearch/rebelStars: 704C++Beta
- benapetr/TuxManagerStars: 704C++Beta
- mrT4ntr4/NtWardenStars: 704C++Beta
- Tokutek/mongoStars: 704C++Beta
- Drive-Trust-Alliance/sedutilStars: 704C++Beta
- sebbbi/perftestStars: 704C++Beta