AlphaUncommon
wici-ai/inferssd
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
- Owner
- wici-ai (organization)
- Stars
- Stars: 296
- Forks
- Forks: 44
- Language
- C++
- License
- Apache-2.0
- Created
- 2026
- Topics
- apple-siliconcudaggufinferencellama-cppllmmetalmixture-of-expertsssd
- Tier
- Alpha (250 to 699 ★) What this tier means
Nearby in C++
All C++ repos- engcang/FAST-LIO-Localization-QNStars: 296C++Alpha
- Teapot174/ESP-HACKStars: 296C++Alpha
- Game-Crafters-Guild/OpenEngineStars: 296C++Alpha
- fwbuilder/fwbuilderStars: 296C++Alpha
- kennykerr/modernStars: 296C++Alpha
- tora-tool/toraStars: 296C++Alpha