# flashinfer-ai/flashinfer

<https://repo.masters-masters.com/en/repos/flashinfer-ai/flashinfer>

[Home](https://repo.masters-masters.com/en) › [flashinfer-ai](https://repo.masters-masters.com/en/owners/flashinfer-ai) › [flashinfer](https://repo.masters-masters.com/en/repos/flashinfer-ai/flashinfer)

flashinfer-ai/flashinfer has 6,850 stars on GitHub. Its RepoMasters card: Stable tier. FlashInfer: Kernel Library for LLM Serving Language: Cuda.

| Field | Value |
| --- | --- |
| Owner | [flashinfer-ai](https://repo.masters-masters.com/en/owners/flashinfer-ai) |
| Stars | 6,850 |
| Forks | 1,693 |
| Language | [Cuda](https://repo.masters-masters.com/en/languages/cuda) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | gpu, large-large-models, cuda, pytorch, llm-inference, jit, attention, nvidia, distributed-inference, moe |
| Tier | [Stable (5,000 to 19,999 ★)](https://repo.masters-masters.com/en/ranks/cult) |
| View on GitHub | [flashinfer-ai/flashinfer](https://github.com/flashinfer-ai/flashinfer) |

## Repository

FlashInfer: Kernel Library for LLM Serving

The tier for repos with 5,000 to 19,999 ★. Published odds per card pulled: 0.9%. Rarity: Very rare.

## More repos by flashinfer-ai

- [flashinfer-ai/flashinfer-bench · ★ 301 · Python · Alpha](https://repo.masters-masters.com/en/repos/flashinfer-ai/flashinfer-bench)
- [flashinfer-ai/flashinfer-bench-starter-kit · ★ 186 · Python · Prototype](https://repo.masters-masters.com/en/repos/flashinfer-ai/flashinfer-bench-starter-kit)

## Nearby in Cuda

- [HigherOrderCO/HVM1 · ★ 11,352 · Cuda · Stable](https://repo.masters-masters.com/en/repos/HigherOrderCO/HVM1)
- [deepseek-ai/DeepEP · ★ 10,409 · Cuda · Stable](https://repo.masters-masters.com/en/repos/deepseek-ai/DeepEP)
- [deepseek-ai/DeepGEMM · ★ 9,155 · Cuda · Stable](https://repo.masters-masters.com/en/repos/deepseek-ai/DeepGEMM)
- [luanfujun/deep-painterly-harmonization · ★ 6,034 · Cuda · Stable](https://repo.masters-masters.com/en/repos/luanfujun/deep-painterly-harmonization)
- [leoxiaobin/deep-high-resolution-net.pytorch · ★ 4,476 · Cuda · RC](https://repo.masters-masters.com/en/repos/leoxiaobin/deep-high-resolution-net.pytorch)
- [Infatoshi/cuda-course · ★ 4,168 · Cuda · RC](https://repo.masters-masters.com/en/repos/Infatoshi/cuda-course)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.