BetaRare
efeslab/Nanoflow
A throughput-oriented high-performance serving framework for LLMs
- Owner
- efeslab (organization)
- Stars
- Stars: 976
- Forks
- Forks: 55
- Language
- Jupyter Notebook
- License
- None
- Created
- 2024
- Topics
- cudainferencellama2llmllm-servingmodel-serving
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by efeslab
All 4 repos by efeslab- efeslab/AtomStars: 350CudaAlpha
- efeslab/fiddlerStars: 267PythonAlpha
- efeslab/LiteASRStars: 160PythonPrototype
Nearby in Jupyter Notebook
All Jupyter Notebook repos- tuanavu/airflow-tutorialStars: 978Jupyter NotebookBeta
- mxrch/penglabStars: 978Jupyter NotebookBeta
- tamlhp/awesome-machine-unlearningStars: 976Jupyter NotebookBeta
- salesforce/OmniXAIStars: 975Jupyter NotebookBeta
- ECNU-ICALK/EduChatStars: 975Jupyter NotebookBeta
- vega/falconStars: 974Jupyter NotebookBeta