Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits

StableVery rare

Michael-A-Kuykendall/shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Owner: Michael-A-Kuykendall (personal account)
Stars: Stars: 6,007
Forks: Forks: 587
Language: Rust
License: Apache-2.0
Created: 2025
Topics: llamallamacppllm-inferenceollama-apicommand-line-toolggufinference-serverlocal-aimachine-learningapi-server
Tier: Stable (5,000 to 19,999 ★) What this tier means

More repos by Michael-A-Kuykendall