Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

shtjww/llm-inference-capacity-handbook

大模型推理案头手册(开源版):给定 GPU 算力,一个模型能扛多少 QPS?三层模型 × 三面墙 × 排队论 × 开环压测

Owner
shtjww (personal account)
Stars
Stars: 185
Forks
Forks: 0
Language
No language
License
None
Created
2026
Topics
capacity-planninggpullm-inferencellmopsqueueing-theoryvllm
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub