# microsoft/LLMLingua

<https://repo.masters-masters.com/en/repos/microsoft/LLMLingua>

[Home](https://repo.masters-masters.com/en) › [microsoft](https://repo.masters-masters.com/en/owners/microsoft) › [LLMLingua](https://repo.masters-masters.com/en/repos/microsoft/LLMLingua)

microsoft/LLMLingua has 6,798 stars on GitHub. Its RepoMasters card: Stable tier. \[EMNLP'23, ACL'24\] To speed up LLMs' inference and enhance LLM's perceive of…

| Field | Value |
| --- | --- |
| Owner | [microsoft](https://repo.masters-masters.com/en/owners/microsoft) |
| Stars | 6,798 |
| Forks | 448 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2023 |
| Tier | [Stable (5,000 to 19,999 ★)](https://repo.masters-masters.com/en/ranks/cult) |
| View on GitHub | [microsoft/LLMLingua](https://github.com/microsoft/LLMLingua) |

## Repository

\[EMNLP'23, ACL'24\] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

The tier for repos with 5,000 to 19,999 ★. Published odds per card pulled: 0.9%. Rarity: Very rare.

## More repos by microsoft

- [microsoft/vscode · ★ 194,514 · TypeScript · LTS](https://repo.masters-masters.com/en/repos/microsoft/vscode)
- [microsoft/markitdown · ★ 193,634 · Python · LTS](https://repo.masters-masters.com/en/repos/microsoft/markitdown)
- [microsoft/PowerToys · ★ 140,457 · C · LTS](https://repo.masters-masters.com/en/repos/microsoft/PowerToys)
- [microsoft/generative-ai-for-beginners · ★ 122,874 · Jupyter Notebook · LTS](https://repo.masters-masters.com/en/repos/microsoft/generative-ai-for-beginners)
- [microsoft/TypeScript · ★ 111,723 · Go · LTS](https://repo.masters-masters.com/en/repos/microsoft/TypeScript)
- [microsoft/terminal · ★ 105,315 · C++ · LTS](https://repo.masters-masters.com/en/repos/microsoft/terminal)

## Nearby in Python

- [django-extensions/django-extensions · ★ 6,804 · Python · Stable](https://repo.masters-masters.com/en/repos/django-extensions/django-extensions)
- [kijai/ComfyUI-WanVideoWrapper · ★ 6,804 · Python · Stable](https://repo.masters-masters.com/en/repos/kijai/ComfyUI-WanVideoWrapper)
- [beenuar/AiSOC · ★ 6,799 · Python · Stable](https://repo.masters-masters.com/en/repos/beenuar/AiSOC)
- [FoundationVision/ByteTrack · ★ 6,790 · Python · Stable](https://repo.masters-masters.com/en/repos/FoundationVision/ByteTrack)
- [worldveil/dejavu · ★ 6,789 · Python · Stable](https://repo.masters-masters.com/en/repos/worldveil/dejavu)
- [wzdnzd/aggregator · ★ 6,783 · Python · Stable](https://repo.masters-masters.com/en/repos/wzdnzd/aggregator)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.