Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

86MaxCao/nano-vllm-prefillonly

A specialized optimization of nano-vllm for prefill-only inference tasks, designed for industrial-scale discriminative applications with multimodal large language models

Owner
86MaxCao (personal account)
Stars
Stars: 120
Forks
Forks: 0
Language
Python
License
MIT
Created
2026
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos