Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

raketenkater/ggrun

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

Owner
raketenkater (personal account)
Stars
Stars: 283
Forks
Forks: 18
Language
Go
License
MIT
Created
2026
Topics
cudaggufllama-cppllmmetalmoemulti-gpugolanginference-serverllamacpp
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

Nearby in Go

All Go repos