BetaRare
waybarrios/vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
- Owner
- waybarrios (personal account)
- Stars
- Stars: 1,646
- Forks
- Forks: 236
- Language
- Python
- License
- Apache-2.0
- Created
- 2025
- Topics
- apple-siliconllmmacosmlxmultimodal-aispeech-to-texttext-to-speechvision-language-modelvllmanthropic
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by waybarrios
All 2 repos by waybarrios- waybarrios/opencode-power-packStars: 550PythonAlpha
Nearby in Python
All Python repos- graykode/distribution-is-all-you-needStars: 1,646PythonBeta
- snwfdhmp/awesome-gpt-prompt-engineeringStars: 1,646PythonBeta
- langchain-ai/streamlit-agentStars: 1,646PythonBeta
- mailgun/flankerStars: 1,646PythonBeta