StableVery rare
xlite-dev/Awesome-LLM-Inference
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
- Owner
- xlite-dev (organization)
- Stars
- Stars: 5,542
- Forks
- Forks: 443
- Language
- Python
- License
- GPL-3.0
- Created
- 2023
- Topics
- flash-attentionpaged-attentiontensorrt-llmvllmawesome-llmllm-inferencedeepseekflash-attention-3deepseek-v3minimax-01
- Tier
- Stable (5,000 to 19,999 ★) What this tier means
More repos by xlite-dev
All 8 repos by xlite-dev- xlite-dev/LeetCUDAStars: 12,140CudaStable
- xlite-dev/lite.ai.toolkitStars: 4,446C++RC
- xlite-dev/Awesome-DiT-InferenceStars: 594PythonAlpha
- xlite-dev/lihang-notesStars: 512TeXAlpha
- xlite-dev/torchlmStars: 272PythonAlpha
- xlite-dev/HGEMMStars: 158CudaPrototype
Nearby in Python
All Python repos- anishathalye/neural-styleStars: 5,547PythonStable
- HKUDS/ClawTeamStars: 5,547PythonStable
- volcengine/MineContextStars: 5,542PythonStable
- airbnb/knowledge-repoStars: 5,541PythonStable
- encode/apistarStars: 5,536PythonStable
- sapientinc/PRAXISTStars: 5,535PythonStable