Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

Scottcjn/ram-coffers

LLM infrastructure cost reduction via NUMA-aware weight banking: 147 t/s (8.8x stock llama.cpp) on refurbished enterprise POWER8. Self-hosted inference, no cloud APIs. Part of the Proof of Physical AI stack.

Owner
Scottcjn (personal account)
Stars
Stars: 173
Forks
Forks: 59
Language
Python
License
AGPL-3.0
Created
2026
Topics
llama-cppllmnumapower8ai-inferencedepinhebbianpowerpcproof-of-physical-aivec-perm
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by Scottcjn

All 12 repos by Scottcjn

Nearby in Python

All Python repos