PrototypeCommon
NeelM0906/Mference
Swift + Metal MoE inference for Apple Silicon: Qwen 3.6 35B at 23.5–29.3 tok/s decode with 2.20× faster long-prompt prefill on a 24 GB M5; Gemma 4 26B in ~2 GB, DeepSeek-V4-Flash 284B, Inkling-Small 276B, native Mac app, CLI, and OpenAI-compatible server.
- Owner
- NeelM0906 (personal account)
- Stars
- Stars: 122
- Forks
- Forks: 17
- Language
- Swift
- License
- None
- Created
- 2026
- Topics
- apple-silicondeepseekgemmallm-inferencemacosmetalmixture-of-expertsqwenswift
- Tier
- Prototype (100 to 249 ★) What this tier means
Nearby in Swift
All Swift repos- easychen/markmarkStars: 122SwiftPrototype
- icloudza/termoStars: 122SwiftPrototype
- zzjcool/krdStars: 122SwiftPrototype
- exercism/swiftStars: 122SwiftPrototype
- nschum/SwiftCGRectExtensionsStars: 122SwiftPrototype
- honghaoz/AutoKeyboardScrollViewStars: 122SwiftPrototype