PrototypeCommon
swellweb/reame
CPU-first LLM inference server on llama.cpp. Runs useful models on free-tier ARM boxes; rewriting the input made it ~6x faster and more accurate than tuning the engine. MIT, benchmarks and failures included.
- Owner
- swellweb (personal account)
- Stars
- Stars: 114
- Forks
- Forks: 10
- Language
- C++
- License
- MIT
- Created
- 2026
- Topics
- cpuggufinferencekv-cachellama-cppllmopenai-apispeculative-decodinglocal-llmself-hosted
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by swellweb
All 2 repos by swellweb- swellweb/targetBridgeStars: 333SwiftAlpha
Nearby in C++
All C++ repos- demonixis/oxrsysStars: 114C++Prototype
- 2dom/keypadStars: 114C++Prototype
- SirSamael/ppsspp-switch-community-buildStars: 114C++Prototype
- vicaya/hypertableStars: 114C++Prototype
- apache/activemq-cppStars: 114C++Prototype
- vavrusa/libusbnetStars: 114C++Prototype