PrototypeCommon
Infini-AI-Lab/UMbreLLa
LLM Inference on consumer devices
- Owner
- Infini-AI-Lab (organization)
- Stars
- Stars: 131
- Forks
- Forks: 15
- Language
- Python
- License
- Apache-2.0
- Created
- 2024
- Topics
- llm-inferenceoffloadingspeculative-decoding
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by Infini-AI-Lab
All 9 repos by Infini-AI-Lab- Infini-AI-Lab/hermitStars: 441PythonAlpha
- Infini-AI-Lab/SequoiaStars: 376PythonAlpha
- Infini-AI-Lab/TriForceStars: 280PythonAlpha
- Infini-AI-Lab/MagicPIGStars: 256PythonAlpha
- Infini-AI-Lab/MagicDecStars: 162PythonPrototype
- Infini-AI-Lab/MonarchRTStars: 146PythonPrototype
Nearby in Python
All Python repos- yurenpai/mc-points-stewardStars: 131PythonPrototype
- yesterdayfuture/confessStars: 131PythonPrototype
- lexifina/romania-lawStars: 131PythonPrototype
- jerem/psdparseStars: 131PythonPrototype
- davepeck/game-of-goStars: 131PythonPrototype
- brendano/tsvutilsStars: 131PythonPrototype