StableVery rare
microsoft/LLMLingua
[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
- Owner
- microsoft (organization)
- Stars
- Stars: 6,795
- Forks
- Forks: 448
- Language
- Python
- License
- MIT
- Created
- 2023
- Tier
- Stable (5,000 to 19,999 ★) What this tier means
More repos by microsoft
All 1,923 repos by microsoft- microsoft/vscodeStars: 194,462TypeScriptLTS
- microsoft/markitdownStars: 193,456PythonLTS
- microsoft/PowerToysStars: 140,398CLTS
- microsoft/generative-ai-for-beginnersStars: 122,788Jupyter NotebookLTS
- microsoft/TypeScriptStars: 111,714GoLTS
- microsoft/terminalStars: 105,311C++LTS
Nearby in Python
All Python repos- django-extensions/django-extensionsStars: 6,805PythonStable
- internetarchive/openlibraryStars: 6,802PythonStable
- kijai/ComfyUI-WanVideoWrapperStars: 6,801PythonStable
- Mai-with-u/MaiBotStars: 6,791PythonStable
- worldveil/dejavuStars: 6,790PythonStable
- FoundationVision/ByteTrackStars: 6,789PythonStable