OlliteRT
by NightMean (personal account)
Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source (description from the project’s GitHub page)
Repository facts
- Stars
- 569
- Forks
- 81
- Open issues and pull requests
- 15
- Primary language
- Kotlin
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- NightMean · Personal account
- Created
- Apr 6, 2026
- Last push
- Oct 8, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 6,424: jegly/Box
The most advanced, fully offline client-side AI suite on Android today.
921 starsKotlinOther licenseLast push Oct 18, 2026
Rank 3,551: fikrikarim/parlor
On-device, real-time multimodal AI with features similar to GPT-Live
2,076 starsPythonApache-2.0Last push Aug 3, 2026
Rank 8,162: DenisovAV/flutter_edge_ai
On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.
641 starsDartMITLast push Oct 18, 2026
Rank 5,734: agents-io/PokeClaw
PokeClaw (PocketClaw) — first on-device AI that controls your Android phone. Gemma 4, no cloud, no API key. Poke is short for Pocket.
1,100 starsKotlinApache-2.0Last push Jun 2, 2026
Rank 3,695: ddalcu/mlx-serve
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
1,977 starsZigOther licenseLast push Oct 18, 2026
Rank 4,327: waybarrios/vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code supp…
1,626 starsPythonApache-2.0Last push Oct 16, 2026