# b4rtaz/distributed-llama

<https://repo.masters-masters.com/en/repos/b4rtaz/distributed-llama>

[Home](https://repo.masters-masters.com/en) › [b4rtaz](https://repo.masters-masters.com/en/owners/b4rtaz) › [distributed-llama](https://repo.masters-masters.com/en/repos/b4rtaz/distributed-llama)

b4rtaz/distributed-llama has 3,125 stars on GitHub. Its RepoMasters card: RC tier. Distributed LLM inference. Connect home devices into a powerful cluster to…

| Field | Value |
| --- | --- |
| Owner | [b4rtaz](https://repo.masters-masters.com/en/owners/b4rtaz) |
| Stars | 3,125 |
| Forks | 260 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | MIT |
| Created | 2023 |
| Topics | distributed-computing, llama2, llm, llm-inference, neural-network, llms, open-llm, distributed-llm, llama3 |
| Tier | [RC (2,000 to 4,999 ★)](https://repo.masters-masters.com/en/ranks/blockbuster) |
| View on GitHub | [b4rtaz/distributed-llama](https://github.com/b4rtaz/distributed-llama) |

## Repository

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

The tier for repos with 2,000 to 4,999 ★. Published odds per card pulled: 3%. Rarity: Epic.

## More repos by b4rtaz

- [b4rtaz/voice-assistant · ★ 295 · TypeScript · Alpha](https://repo.masters-masters.com/en/repos/b4rtaz/voice-assistant)
- [b4rtaz/t3mpl-editor · ★ 171 · TypeScript · Prototype](https://repo.masters-masters.com/en/repos/b4rtaz/t3mpl-editor)

## Nearby in C++

- [allenk/GeminiWatermarkTool · ★ 3,134 · C++ · RC](https://repo.masters-masters.com/en/repos/allenk/GeminiWatermarkTool)
- [ChaiScript/ChaiScript · ★ 3,133 · C++ · RC](https://repo.masters-masters.com/en/repos/ChaiScript/ChaiScript)
- [lynckia/licode · ★ 3,132 · C++ · RC](https://repo.masters-masters.com/en/repos/lynckia/licode)
- [ZDoom/gzdoom · ★ 3,124 · C++ · RC](https://repo.masters-masters.com/en/repos/ZDoom/gzdoom)
- [lammps/lammps · ★ 3,122 · C++ · RC](https://repo.masters-masters.com/en/repos/lammps/lammps)
- [heavyai/heavydb · ★ 3,120 · C++ · RC](https://repo.masters-masters.com/en/repos/heavyai/heavydb)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.