# Infini-AI-Lab/UMbreLLa

<https://repo.masters-masters.com/en/repos/Infini-AI-Lab/UMbreLLa>

[Home](https://repo.masters-masters.com/en) › [Infini-AI-Lab](https://repo.masters-masters.com/en/owners/Infini-AI-Lab) › [UMbreLLa](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/UMbreLLa)

Infini-AI-Lab/UMbreLLa has 131 stars on GitHub. Its RepoMasters card: Prototype tier. LLM Inference on consumer devices Language: Python.

| Field | Value |
| --- | --- |
| Owner | [Infini-AI-Lab](https://repo.masters-masters.com/en/owners/Infini-AI-Lab) |
| Stars | 131 |
| Forks | 15 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2024 |
| Topics | llm-inference, offloading, speculative-decoding |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [Infini-AI-Lab/UMbreLLa](https://github.com/Infini-AI-Lab/UMbreLLa) |

## Repository

LLM Inference on consumer devices

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by Infini-AI-Lab

- [Infini-AI-Lab/hermit · ★ 441 · Python · Alpha](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/hermit)
- [Infini-AI-Lab/Sequoia · ★ 376 · Python · Alpha](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/Sequoia)
- [Infini-AI-Lab/TriForce · ★ 280 · Python · Alpha](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/TriForce)
- [Infini-AI-Lab/MagicPIG · ★ 256 · Python · Alpha](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/MagicPIG)
- [Infini-AI-Lab/MagicDec · ★ 162 · Python · Prototype](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/MagicDec)
- [Infini-AI-Lab/MonarchRT · ★ 146 · Python · Prototype](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/MonarchRT)

## Nearby in Python

- [yurenpai/mc-points-steward · ★ 131 · Python · Prototype](https://repo.masters-masters.com/en/repos/yurenpai/mc-points-steward)
- [yesterdayfuture/confess · ★ 131 · Python · Prototype](https://repo.masters-masters.com/en/repos/yesterdayfuture/confess)
- [lexifina/romania-law · ★ 131 · Python · Prototype](https://repo.masters-masters.com/en/repos/lexifina/romania-law)
- [jerem/psdparse · ★ 131 · Python · Prototype](https://repo.masters-masters.com/en/repos/jerem/psdparse)
- [davepeck/game-of-go · ★ 131 · Python · Prototype](https://repo.masters-masters.com/en/repos/davepeck/game-of-go)
- [brendano/tsvutils · ★ 131 · Python · Prototype](https://repo.masters-masters.com/en/repos/brendano/tsvutils)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.