Illustration: the project’s public image, pixelated by RepoMasters. Credits
RCEpic

syv-ai/HyperQwen

Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.

Owner
syv-ai (organization)
Stars
Stars: 2,532
Forks
Forks: 322
Language
Python
License
Apache-2.0
Created
2026
Topics
kv-cachellm-inferencelocal-llmquantizationqwenqwen3rtx-3090speculative-decodingvllmconsumer-gpu
Tier
RC (2,000 to 4,999 ★) What this tier means
View on GitHub

More repos by syv-ai

All 2 repos by syv-ai

Nearby in Python

All Python repos