Illustration: the project’s public image, pixelated by RepoMasters. Credits
StableVery rare

google-ai-edge/LiteRT-LM

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

Owner
google-ai-edge (organization)
Stars
Stars: 6,805
Forks
Forks: 780
Language
C++
License
Apache-2.0
Created
2025
Topics
edge-aion-device-aion-device-llm
Tier
Stable (5,000 to 19,999 ★) What this tier means
View on GitHub

More repos by google-ai-edge

All 11 repos by google-ai-edge

Nearby in C++

All C++ repos