RCEpic
syv-ai/HyperQwen
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
- Owner
- syv-ai (organization)
- Stars
- Stars: 2,532
- Forks
- Forks: 322
- Language
- Python
- License
- Apache-2.0
- Created
- 2026
- Topics
- kv-cachellm-inferencelocal-llmquantizationqwenqwen3rtx-3090speculative-decodingvllmconsumer-gpu
- Tier
- RC (2,000 to 4,999 ★) What this tier means
More repos by syv-ai
All 2 repos by syv-ai- syv-ai/dashStars: 286TypeScriptAlpha
Nearby in Python
All Python repos- jcjohnson/cnn-benchmarksStars: 2,533PythonRC
- allegro/ralphStars: 2,532PythonRC
- nateshmbhat/pyttsx3Stars: 2,532PythonRC
- lamini-ai/laminiStars: 2,531PythonRC
- chatdoc-com/OCRFluxStars: 2,530PythonRC