Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

guoqingbao/xinfer

Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.

Owner
guoqingbao (personal account)
Stars
Stars: 345
Forks
Forks: 52
Language
Rust
License
MIT
Created
2025
Topics
agentllmqwenrustvllm
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

Nearby in Rust

All Rust repos