# wici-ai/inferssd

<https://repo.masters-masters.com/en/repos/wici-ai/inferssd>

[Home](https://repo.masters-masters.com/en) › [wici-ai](https://repo.masters-masters.com/en/owners/wici-ai) › [inferssd](https://repo.masters-masters.com/en/repos/wici-ai/inferssd)

wici-ai/inferssd has 296 stars on GitHub. Its RepoMasters card: Alpha tier. Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built…

| Field | Value |
| --- | --- |
| Owner | [wici-ai](https://repo.masters-masters.com/en/owners/wici-ai) |
| Stars | 296 |
| Forks | 44 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | Apache-2.0 |
| Created | 2026 |
| Topics | apple-silicon, cuda, gguf, inference, llama-cpp, llm, metal, mixture-of-experts, ssd |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [wici-ai/inferssd](https://github.com/wici-ai/inferssd) |

## Repository

Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## Nearby in C++

- [engcang/FAST-LIO-Localization-QN · ★ 296 · C++ · Alpha](https://repo.masters-masters.com/en/repos/engcang/FAST-LIO-Localization-QN)
- [Teapot174/ESP-HACK · ★ 296 · C++ · Alpha](https://repo.masters-masters.com/en/repos/Teapot174/ESP-HACK)
- [Game-Crafters-Guild/OpenEngine · ★ 296 · C++ · Alpha](https://repo.masters-masters.com/en/repos/Game-Crafters-Guild/OpenEngine)
- [fwbuilder/fwbuilder · ★ 296 · C++ · Alpha](https://repo.masters-masters.com/en/repos/fwbuilder/fwbuilder)
- [kennykerr/modern · ★ 296 · C++ · Alpha](https://repo.masters-masters.com/en/repos/kennykerr/modern)
- [tora-tool/tora · ★ 296 · C++ · Alpha](https://repo.masters-masters.com/en/repos/tora-tool/tora)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.