Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
BetaRare

SharpAI/SwiftLM

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

Owner
SharpAI (organization)
Stars
Stars: 792
Forks
Forks: 56
Language
Swift
License
MIT
Created
2026
Topics
inferenceiosllmmetalmlxmoeon-device-aiopenai-apiswiftapple-sili
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by SharpAI

All 2 repos by SharpAI

Nearby in Swift

All Swift repos