# mit-han-lab/omniserve

<https://repo.masters-masters.com/en/repos/mit-han-lab/omniserve>

[Home](https://repo.masters-masters.com/en) › [mit-han-lab](https://repo.masters-masters.com/en/owners/mit-han-lab) › [omniserve](https://repo.masters-masters.com/en/repos/mit-han-lab/omniserve)

mit-han-lab/omniserve has 867 stars on GitHub. Its RepoMasters card: Beta tier. \[MLSys'25\] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM…

| Field | Value |
| --- | --- |
| Owner | [mit-han-lab](https://repo.masters-masters.com/en/owners/mit-han-lab) |
| Stars | 867 |
| Forks | 74 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | Apache-2.0 |
| Created | 2024 |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [mit-han-lab/omniserve](https://github.com/mit-han-lab/omniserve) |

## Repository

\[MLSys'25\] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; \[MLSys'25\] LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by mit-han-lab

- [mit-han-lab/streaming-llm · ★ 7,277 · Python · Stable](https://repo.masters-masters.com/en/repos/mit-han-lab/streaming-llm)
- [mit-han-lab/llm-awq · ★ 3,662 · Python · RC](https://repo.masters-masters.com/en/repos/mit-han-lab/llm-awq)
- [mit-han-lab/efficientvit · ★ 3,376 · Python · RC](https://repo.masters-masters.com/en/repos/mit-han-lab/efficientvit)
- [mit-han-lab/bevfusion · ★ 3,236 · Python · RC](https://repo.masters-masters.com/en/repos/mit-han-lab/bevfusion)
- [mit-han-lab/temporal-shift-module · ★ 2,229 · Python · RC](https://repo.masters-masters.com/en/repos/mit-han-lab/temporal-shift-module)
- [mit-han-lab/once-for-all · ★ 1,957 · Python · Beta](https://repo.masters-masters.com/en/repos/mit-han-lab/once-for-all)

## Nearby in C++

- [JokerJohn/LIO\_SAM\_6AXIS · ★ 868 · C++ · Beta](https://repo.masters-masters.com/en/repos/JokerJohn/LIO_SAM_6AXIS)
- [Slicer/SlicerGitSVNArchive · ★ 867 · C++ · Beta](https://repo.masters-masters.com/en/repos/Slicer/SlicerGitSVNArchive)
- [Mapaler/FastCopy-M · ★ 867 · C++ · Beta](https://repo.masters-masters.com/en/repos/Mapaler/FastCopy-M)
- [clMathLibraries/clBLAS · ★ 866 · C++ · Beta](https://repo.masters-masters.com/en/repos/clMathLibraries/clBLAS)
- [ashea-code/BLUI · ★ 866 · C++ · Beta](https://repo.masters-masters.com/en/repos/ashea-code/BLUI)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.