mlx-serve

Repository facts

Stars

1,977

Forks

205

Open issues and pull requests

59

Primary language

Zig

License

Other license

Owner

ddalcu · Personal account

Created

Feb 17, 2026

Last push

Oct 18, 2026

Topics

• agent
• anthropic-api
• apple-silicon
• claude-code
• deepseek-v4
• diffusion
• gguf
• image-generation
• inference
• llm
• local-llm
• macos
• macos-app
• mlx
• openai-api
• tool-calling
• video-generation
• voice-agent
• voice-cloning
• zig

Rank #3,695 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 4,327

  Rank 4,327: waybarrios/vllm-mlx

  High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code supp…

  1,626 starsPythonApache-2.0Last push Oct 16, 2026

• 1,979

  Rank 1,979: raullenchai/Rapid-MLX

  Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents.…

  3,996 starsPythonOther licenseLast push Oct 18, 2026

• 6,168

  Rank 6,168: jjang-ai/mlxstudio

  MLX Studio - Easiest way to run LLM's on your Mac. All in one engine.

  986 starsNo license file detectedLast push Oct 14, 2026

• 2,336

  Rank 2,336: nicedreamzapp/claude-code-local

  Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gem…

  3,369 starsPythonMITLast push Oct 15, 2026

• 2,959

  Rank 2,959: youssofal/MTPLX

  The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculati…

  2,598 starsPythonApache-2.0Last push Oct 10, 2026

• 7,596

  Rank 7,596: ARahim3/mlx-dspark

  Up to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM…

  719 starsPythonMITLast push Oct 5, 2026