Illustration: the project’s public image, pixelated by RepoMasters. Credits
BetaRare

SqueezeAILab/SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

Owner
SqueezeAILab (organization)
Stars
Stars: 724
Forks
Forks: 54
Language
Python
License
MIT
Created
2023
Topics
efficient-inferencelarge-language-modelsllmmodel-compressionnatural-language-processingpost-training-quantizationquantizationtext-generationtransformerllama
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by SqueezeAILab

All 5 repos by SqueezeAILab

Nearby in Python

All Python repos