BetaRare
mit-han-lab/omniserve
[MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention
- Owner
- mit-han-lab (organization)
- Stars
- Stars: 867
- Forks
- Forks: 74
- Language
- C++
- License
- Apache-2.0
- Created
- 2024
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by mit-han-lab
All 53 repos by mit-han-lab- mit-han-lab/streaming-llmStars: 7,277PythonStable
- mit-han-lab/llm-awqStars: 3,662PythonRC
- mit-han-lab/efficientvitStars: 3,376PythonRC
- mit-han-lab/bevfusionStars: 3,236PythonRC
- mit-han-lab/temporal-shift-moduleStars: 2,229PythonRC
- mit-han-lab/once-for-allStars: 1,957PythonBeta
Nearby in C++
All C++ repos- JokerJohn/LIO_SAM_6AXISStars: 868C++Beta
- Slicer/SlicerGitSVNArchiveStars: 867C++Beta
- Mapaler/FastCopy-MStars: 867C++Beta
- clMathLibraries/clBLASStars: 866C++Beta
- ashea-code/BLUIStars: 866C++Beta