
omlx
by jundot (personal account)
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar (description from the project’s GitHub page)
Repository facts
- Stars
- 22,905
- Forks
- 2,136
- Open issues and pull requests
- 651
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- jundot · Personal account
- Created
- Feb 13, 2026
- Last push
- Oct 17, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 4,327: waybarrios/vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code supp…
1,626 starsPythonApache-2.0Last push Oct 16, 2026
Rank 1,979: raullenchai/Rapid-MLX
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents.…
3,996 starsPythonOther licenseLast push Oct 18, 2026
Rank 3,695: ddalcu/mlx-serve
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
1,977 starsZigOther licenseLast push Oct 18, 2026
Rank 3,829: vllm-project/vllm-metal
Community maintained hardware plugin for vLLM on Apple Silicon
1,886 starsPythonApache-2.0Last push Oct 18, 2026
Rank 4,701: ARahim3/mlx-tune
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.
1,444 starsPythonApache-2.0Last push Jun 23, 2026
Rank 6,168: jjang-ai/mlxstudio
MLX Studio - Easiest way to run LLM's on your Mac. All in one engine.
986 starsNo license file detectedLast push Oct 14, 2026