LTSLegendary
jundot/omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
- Owner
- jundot (personal account)
- Stars
- Stars: 23,304
- Forks
- Forks: 2,088
- Language
- Python
- License
- Apache-2.0
- Created
- 2026
- Topics
- apple-siliconinference-serverllmmacosmlxopenai-api
- Tier
- LTS (20,000 ★ and up) What this tier means
Nearby in Python
All Python repos- matplotlib/matplotlibStars: 23,420PythonLTS
- marimo-team/marimoStars: 23,413PythonLTS
- Skyvern-AI/skyvernStars: 23,336PythonLTS
- Sanster/IOPaintStars: 23,299PythonLTS
- mlc-ai/mlc-llmStars: 23,296PythonLTS
- akfamily/akshareStars: 23,182PythonLTS