RCEpic
b4rtaz/distributed-llama
Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
- Owner
- b4rtaz (personal account)
- Stars
- Stars: 3,125
- Forks
- Forks: 260
- Language
- C++
- License
- MIT
- Created
- 2023
- Topics
- distributed-computingllama2llmllm-inferenceneural-networkllmsopen-llmdistributed-llmllama3
- Tier
- RC (2,000 to 4,999 ★) What this tier means
More repos by b4rtaz
All 3 repos by b4rtaz- b4rtaz/voice-assistantStars: 295TypeScriptAlpha
- b4rtaz/t3mpl-editorStars: 171TypeScriptPrototype
Nearby in C++
All C++ repos- ChaiScript/ChaiScriptStars: 3,133C++RC
- lynckia/licodeStars: 3,132C++RC
- xiaoyifang/goldendict-ngStars: 3,132C++RC
- ZDoom/gzdoomStars: 3,123C++RC
- xbpeng/DeepMimicStars: 3,120C++RC
- lammps/lammpsStars: 3,119C++RC