PrototypeCommon
llm-d/llm-d-inference-sim
A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.
- Owner
- llm-d (organization)
- Stars
- Stars: 230
- Forks
- Forks: 180
- Language
- Go
- License
- Apache-2.0
- Created
- 2025
- Topics
- incubating
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by llm-d
All 4 repos by llm-d- llm-d/llm-dStars: 5,129PythonStable
- llm-d/llm-d-routerStars: 444GoAlpha
- llm-d/llm-d-kv-cacheStars: 189GoPrototype
Nearby in Go
All Go repos- Lampon/PanCheckStars: 230GoPrototype
- onewinner/MPETStars: 230GoPrototype
- Lichas/maxclawStars: 230GoPrototype
- abh/geoipStars: 230GoPrototype
- pearkes/gethubStars: 230GoPrototype
- UlricQin/beego-blogStars: 230GoPrototype