# efeslab/Nanoflow

<https://repo.masters-masters.com/en/repos/efeslab/Nanoflow>

[Home](https://repo.masters-masters.com/en) › [efeslab](https://repo.masters-masters.com/en/owners/efeslab) › [Nanoflow](https://repo.masters-masters.com/en/repos/efeslab/Nanoflow)

efeslab/Nanoflow has 976 stars on GitHub. Its RepoMasters card: Beta tier. A throughput-oriented high-performance serving framework for LLMs

| Field | Value |
| --- | --- |
| Owner | [efeslab](https://repo.masters-masters.com/en/owners/efeslab) |
| Stars | 976 |
| Forks | 55 |
| Language | [Jupyter Notebook](https://repo.masters-masters.com/en/languages/jupyter-notebook) |
| License | None |
| Created | 2024 |
| Topics | cuda, inference, llama2, llm, llm-serving, model-serving |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [efeslab/Nanoflow](https://github.com/efeslab/Nanoflow) |

## Repository

A throughput-oriented high-performance serving framework for LLMs

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by efeslab

- [efeslab/Atom · ★ 350 · Cuda · Alpha](https://repo.masters-masters.com/en/repos/efeslab/Atom)
- [efeslab/fiddler · ★ 268 · Python · Alpha](https://repo.masters-masters.com/en/repos/efeslab/fiddler)
- [efeslab/LiteASR · ★ 160 · Python · Prototype](https://repo.masters-masters.com/en/repos/efeslab/LiteASR)

## Nearby in Jupyter Notebook

- [tuanavu/airflow-tutorial · ★ 978 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/tuanavu/airflow-tutorial)
- [mxrch/penglab · ★ 978 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/mxrch/penglab)
- [tamlhp/awesome-machine-unlearning · ★ 976 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/tamlhp/awesome-machine-unlearning)
- [salesforce/OmniXAI · ★ 975 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/salesforce/OmniXAI)
- [vega/falcon · ★ 974 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/vega/falcon)
- [aialgorithm/Blog · ★ 974 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/aialgorithm/Blog)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.