# Picovoice/picollm

<https://repo.masters-masters.com/en/repos/Picovoice/picollm>

[Home](https://repo.masters-masters.com/en) › [Picovoice](https://repo.masters-masters.com/en/owners/Picovoice) › [picollm](https://repo.masters-masters.com/en/repos/Picovoice/picollm)

Picovoice/picollm has 318 stars on GitHub. Its RepoMasters card: Alpha tier. On-device LLM Inference Powered by X-Bit Quantization Language: Python.

| Field | Value |
| --- | --- |
| Owner | [Picovoice](https://repo.masters-masters.com/en/owners/Picovoice) |
| Stars | 318 |
| Forks | 27 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2024 |
| Topics | llm, compression, efficient-inference, gemma, generative-ai, language-model, language-models, large-language-model, llama, llama2 |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [Picovoice/picollm](https://github.com/Picovoice/picollm) |

## Repository

On-device LLM Inference Powered by X-Bit Quantization

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by Picovoice

- [Picovoice/porcupine · ★ 5,017 · Python · Stable](https://repo.masters-masters.com/en/repos/Picovoice/porcupine)
- [Picovoice/rhino · ★ 717 · Python · Beta](https://repo.masters-masters.com/en/repos/Picovoice/rhino)
- [Picovoice/picovoice · ★ 706 · Python · Beta](https://repo.masters-masters.com/en/repos/Picovoice/picovoice)
- [Picovoice/speech-to-text-benchmark · ★ 699 · Python · Alpha](https://repo.masters-masters.com/en/repos/Picovoice/speech-to-text-benchmark)
- [Picovoice/cheetah · ★ 672 · Python · Alpha](https://repo.masters-masters.com/en/repos/Picovoice/cheetah)
- [Picovoice/leopard · ★ 485 · Python · Alpha](https://repo.masters-masters.com/en/repos/Picovoice/leopard)

## Nearby in Python

- [xai-org/plugin-marketplace · ★ 318 · Python · Alpha](https://repo.masters-masters.com/en/repos/xai-org/plugin-marketplace)
- [melonelish/context-engine · ★ 318 · Python · Alpha](https://repo.masters-masters.com/en/repos/melonelish/context-engine)
- [ktwu01/benchmark-radar · ★ 318 · Python · Alpha](https://repo.masters-masters.com/en/repos/ktwu01/benchmark-radar)
- [johnpaulett/python-hl7 · ★ 318 · Python · Alpha](https://repo.masters-masters.com/en/repos/johnpaulett/python-hl7)
- [alex/pretend · ★ 318 · Python · Alpha](https://repo.masters-masters.com/en/repos/alex/pretend)
- [trustedsec/ridenum · ★ 318 · Python · Alpha](https://repo.masters-masters.com/en/repos/trustedsec/ridenum)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.