vllm-metal

Repository facts

Stars

1,886

Forks

330

Open issues and pull requests

41

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

vllm-project · Organization

Created

Dec 12, 2025

Last push

Oct 18, 2026

Topics

• apple-silicon
• llm
• macos
• metal
• mlx
• vllm

Rank #3,829 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 4,327

  Rank 4,327: waybarrios/vllm-mlx

  High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code supp…

  1,626 starsPythonApache-2.0Last push Oct 16, 2026

• 2,959

  Rank 2,959: youssofal/MTPLX

  The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculati…

  2,598 starsPythonApache-2.0Last push Oct 10, 2026

• 7,596

  Rank 7,596: ARahim3/mlx-dspark

  Up to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM…

  719 starsPythonMITLast push Oct 5, 2026

• 359

  Rank 359: jundot/omlx

  LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

  22,905 starsPythonApache-2.0Last push Oct 17, 2026

• 4,701

  Rank 4,701: ARahim3/mlx-tune

  Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

  1,444 starsPythonApache-2.0Last push Jun 23, 2026

• 1,169

  Rank 1,169: drumih/turbo-fieldfare

  Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

  6,943 starsSwiftApache-2.0Last push Oct 15, 2026