Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
BetaRare

Helldez/BigMoeOnEdge

Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

Owner
Helldez (personal account)
Stars
Stars: 704
Forks
Forks: 81
Language
C++
License
Apache-2.0
Created
2026
Topics
androidcppedge-aiggufinferencellama-cppllmmixture-of-expertsmoeon-device-ai
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by Helldez

All 2 repos by Helldez

Nearby in C++

All C++ repos