mlx-omni-server
by madroidmaq (personal account)
MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference. (description from the project’s GitHub page)
Repository facts
- Stars
- 745
- Forks
- 88
- Open issues and pull requests
- 25
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- madroidmaq · Personal account
- Created
- Nov 5, 2024
- Last push
- May 9, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 7,914: teilomillet/gollm
Unified Go interface for Language Model (LLM) providers. Simplifies LLM integration with flexible prompt management and common task functions.
676 starsGoApache-2.0Last push Mar 21, 2026
Rank 7,009: KoljaB/Linguflex
Command Your World with Voice
813 starsPythonNo license file detectedLast push Jun 17, 2025
Rank 4,327: waybarrios/vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code supp…
1,626 starsPythonApache-2.0Last push Oct 16, 2026
Rank 7,070: Blaizzy/mlx-audio-swift
A modular Swift SDK for audio processing with MLX on Apple Silicon
802 starsSwiftMITLast push Oct 10, 2026
Rank 1,851: algorithmicsuperintelligence/optillm
Optimizing inference proxy for LLMs
4,319 starsPythonApache-2.0Last push Oct 11, 2026
Rank 7,815: travisvn/chatterbox-tts-api
Local, OpenAI-compatible text-to-speech (TTS) API using Chatterbox, enabling users to generate voice cloned speech anywhere the OpenAI API is used (e.g. Open WebUI, AnythingLLM, e…
690 starsPythonAGPL-3.0Last push Dec 23, 2025