Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

52Hz-kiko/mini-vllm-qwen3-serving

A Mini-vLLM optimization project for Qwen3-32B TP=2 serving, Prefix Cache, and Triton PagedAttention.

Owner
52Hz-kiko (personal account)
Stars
Stars: 101
Forks
Forks: 8
Language
Python
License
Apache-2.0
Created
2026
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos