Illustration: the project’s public image, pixelated by RepoMasters. Credits
StableVery rare

magnitudedev/magnitude

Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.

Owner
magnitudedev (organization)
Stars
Stars: 7,693
Forks
Forks: 555
Language
Rust
License
Apache-2.0
Created
2026
Tier
Stable (5,000 to 19,999 ★) What this tier means
View on GitHub

More repos by magnitudedev

All 2 repos by magnitudedev

Nearby in Rust

All Rust repos