vllm-mlx

Repository facts

Stars

1,626

Forks

241

Open issues and pull requests

104

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

waybarrios · Personal account

Created

Dec 6, 2025

Last push

Oct 16, 2026

Topics

• anthropic
• anthropic-api
• apple-silicon
• claude-code
• continuous-batching
• inference-server
• llm
• local-llm
• macos
• mcp
• mlx
• multimodal-ai
• openai
• openai-api
• openai-compatible
• speech-to-text
• text-to-speech
• tool-calling
• vision-language-model
• vllm

Rank #4,327 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 1,979

  Rank 1,979: raullenchai/Rapid-MLX

  Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents.…

  3,996 starsPythonOther licenseLast push Oct 18, 2026

• 3,695

  Rank 3,695: ddalcu/mlx-serve

  Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

  1,977 starsZigOther licenseLast push Oct 18, 2026

• 4,701

  Rank 4,701: ARahim3/mlx-tune

  Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

  1,444 starsPythonApache-2.0Last push Jun 23, 2026

• 2,959

  Rank 2,959: youssofal/MTPLX

  The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculati…

  2,598 starsPythonApache-2.0Last push Oct 10, 2026

• 2,336

  Rank 2,336: nicedreamzapp/claude-code-local

  Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gem…

  3,369 starsPythonMITLast push Oct 15, 2026

• 359

  Rank 359: jundot/omlx

  LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

  22,905 starsPythonApache-2.0Last push Oct 17, 2026