AlphaUncommon
mit-han-lab/Quest
[ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
- Owner
- mit-han-lab (organization)
- Stars
- Stars: 414
- Forks
- Forks: 50
- Language
- Cuda
- License
- MIT
- Created
- 2024
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by mit-han-lab
All 53 repos by mit-han-lab- mit-han-lab/streaming-llmStars: 7,276PythonStable
- mit-han-lab/llm-awqStars: 3,661PythonRC
- mit-han-lab/efficientvitStars: 3,374PythonRC
- mit-han-lab/bevfusionStars: 3,235PythonRC
- mit-han-lab/temporal-shift-moduleStars: 2,229PythonRC
- mit-han-lab/once-for-allStars: 1,957PythonBeta
Nearby in Cuda
All Cuda repos- QINZHAOYU/CudaStepsStars: 428CudaAlpha
- MooreThreads/LiteGSStars: 427CudaAlpha
- kwea123/pytorch-cppcuda-tutorialStars: 422CudaAlpha
- ifromeast/cuda_learningStars: 410CudaAlpha
- 1zb/deformable-convolution-pytorchStars: 409CudaAlpha
- nosferalatu/SimpleGPUHashTableStars: 408CudaAlpha