Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

Picovoice/picollm

On-device LLM Inference Powered by X-Bit Quantization

Owner
Picovoice (organization)
Stars
Stars: 318
Forks
Forks: 27
Language
Python
License
Apache-2.0
Created
2024
Topics
llmcompressionefficient-inferencegemmagenerative-ailanguage-modellanguage-modelslarge-language-modelllamallama2
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by Picovoice

All 13 repos by Picovoice

Nearby in Python

All Python repos