Illustration: the project’s public image, pixelated by RepoMasters. Credits
BetaRare

microsoft/vidur

Accurate, large-scale, and extensible simulator for LLM inference Systems

Owner
microsoft (organization)
Stars
Stars: 719
Forks
Forks: 142
Language
Python
License
MIT
Created
2023
Topics
inferencellmsimulationtransformervllm
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by microsoft

All 1,923 repos by microsoft

Nearby in Python

All Python repos