Illustration: the project’s public image, pixelated by RepoMasters. Credits
BetaRare

pegainfer-project/pegainfer

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

Owner
pegainfer-project (organization)
Stars
Stars: 730
Forks
Forks: 121
Language
Rust
License
Apache-2.0
Created
2026
Topics
inferencekimillm-servingmodel-servingcudacuda-kernelsdeepseekgpuinference-enginekimi-k2
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by pegainfer-project

All 2 repos by pegainfer-project

Nearby in Rust

All Rust repos