Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

cubist38/mlx-openai-server

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible inte…

Owner
cubist38 (personal account)
Stars
Stars: 365
Forks
Forks: 70
Language
Python
License
MIT
Created
2025
Topics
mlxmlx-vlmfastapimlx-lmqueueapple-siliconvision-apiopenai-compatiblespeech-recognitionflux
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos