Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

amitshekhariitbhu/llm-inference-engineering

Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.

Owner
amitshekhariitbhu (personal account)
Stars
Stars: 396
Forks
Forks: 50
Language
Markdown
License
Apache-2.0
Created
2026
Topics
inference-optimizationllmllm-engineeringllm-inferencellmsinference-engineeringlarge-language-models
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by amitshekhariitbhu

All 39 repos by amitshekhariitbhu

Nearby in Markdown

All Markdown repos