Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

changjonathanc/flex-nano-vllm

FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.

Owner
changjonathanc (personal account)
Stars
Stars: 363
Forks
Forks: 21
Language
Python
License
MIT
Created
2025
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by changjonathanc

All 4 repos by changjonathanc

Nearby in Python

All Python repos