BetaRare
madroidmaq/mlx-omni-server
MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.
- Owner
- madroidmaq (personal account)
- Stars
- Stars: 746
- Forks
- Forks: 88
- Language
- Python
- License
- MIT
- Created
- 2024
- Topics
- mlxopenaiopenai-apisttttsfunction-callingstructured-outputtoolsgenai
- Tier
- Beta (700 to 1,999 ★) What this tier means
Nearby in Python
All Python repos- KovenYu/WonderWorldStars: 746PythonBeta
- agentic-box/memoraStars: 746PythonBeta
- chenjin-cmd/xhs-virtual-productStars: 746PythonBeta
- jfoote/exploitableStars: 746PythonBeta
- dropbox/changesStars: 746PythonBeta
- duo-labs/webauthn.ioStars: 746PythonBeta