
SwiftLM
by SharpAI (organization)
⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app. (description from the project’s GitHub page)
Repository facts
- Stars
- 784
- Forks
- 54
- Open issues and pull requests
- 3
- Primary language
- Swift
- License
- MIT License (MIT)
- Owner
- SharpAI · Organization
- Created
- Mar 21, 2026
- Last push
- Oct 17, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 787: RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
10,330 starsC++Other licenseLast push Oct 18, 2026
Rank 1,169: drumih/turbo-fieldfare
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
6,943 starsSwiftApache-2.0Last push Oct 15, 2026
Rank 8,495: Fabric-Project/Fabric
Node Creative Coding / 3D / Image Processing tool inspired by Quartz Composer
603 starsSwiftBSD-3-ClauseLast push Oct 17, 2026
Rank 5,461: rudrankriyam/Foundation-Models-Framework-Lab
A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.
1,189 starsSwiftMITLast push Sep 18, 2026
Rank 8,244: Helldez/BigMoeOnEdge
Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp
631 starsC++Apache-2.0Last push Oct 18, 2026
Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026