StableVery rare
flashinfer-ai/flashinfer
FlashInfer: Kernel Library for LLM Serving
- Owner
- flashinfer-ai (organization)
- Stars
- Stars: 6,841
- Forks
- Forks: 1,688
- Language
- Cuda
- License
- Apache-2.0
- Created
- 2023
- Topics
- gpularge-large-modelscudapytorchllm-inferencejitattentionnvidiadistributed-inferencemoe
- Tier
- Stable (5,000 to 19,999 ★) What this tier means
More repos by flashinfer-ai
All 3 repos by flashinfer-ai- flashinfer-ai/flashinfer-benchStars: 301PythonAlpha
- flashinfer-ai/flashinfer-bench-starter-kitStars: 186PythonPrototype
Nearby in Cuda
All Cuda repos- HigherOrderCO/HVM1Stars: 11,353CudaStable
- deepseek-ai/DeepEPStars: 10,404CudaStable
- deepseek-ai/DeepGEMMStars: 9,143CudaStable
- luanfujun/deep-painterly-harmonizationStars: 6,034CudaStable
- leoxiaobin/deep-high-resolution-net.pytorchStars: 4,477CudaRC
- Infatoshi/cuda-courseStars: 4,166CudaRC