Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

Infini-AI-Lab/MagicPIG

[ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation

Owner
Infini-AI-Lab (organization)
Stars
Stars: 256
Forks
Forks: 21
Language
Python
License
Apache-2.0
Created
2024
Topics
decodingllm-inferencelsh-algorithmgpu-cpu
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by Infini-AI-Lab

All 9 repos by Infini-AI-Lab

Nearby in Python

All Python repos