BetaRare
weicj/vLLM-2080Ti-Definitive
The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-request decode with support of FP8 weight ( Join Discord :https://discord.gg/VFqVVySdMS )
- Owner
- weicj (personal account)
- Stars
- Stars: 1,200
- Forks
- Forks: 167
- Language
- Python
- License
- Apache-2.0
- Created
- 2026
- Tier
- Beta (700 to 1,999 ★) What this tier means
Nearby in Python
All Python repos- aws/deep-learning-containersStars: 1,200PythonBeta
- DeepWisdom/AutoDLStars: 1,200PythonBeta
- awesome-spectral-indices/awesome-spectral-indicesStars: 1,200PythonBeta
- mintapi/mintapiStars: 1,200PythonBeta
- paul-nameless/tgStars: 1,200PythonBeta
- developmentseed/titilerStars: 1,200PythonBeta