Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

modular/llm-inference-handbook

Everything you need to know about LLM inference

Owner
modular (organization)
Stars
Stars: 474
Forks
Forks: 55
Language
TypeScript
License
Apache-2.0
Created
2025
Topics
llmllm-inferenceinference-handbookinference-optimizationinference-infrastructure
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by modular

All 7 repos by modular

Nearby in TypeScript

All TypeScript repos