
willow-inference-server
by toverainc (organization)
Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS (description from the project’s GitHub page)
Repository facts
- Stars
- 511
- Forks
- 60
- Open issues and pull requests
- 41
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- toverainc · Organization
- Created
- Feb 3, 2023
- Last push
- Feb 12, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 4,701: ARahim3/mlx-tune
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.
1,444 starsPythonApache-2.0Last push Jun 23, 2026
Rank 7,162: mezbaul-h/june
Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkit
788 starsPythonMITLast push Aug 12, 2024
Rank 2,519: HeyWillow/willow
Open source, local, and self-hosted Amazon Echo/Google Home competitive Voice Assistant alternative
3,127 starsCApache-2.0Last push Oct 1, 2026
Rank 610: abus-aikorea/voice-pro
Gradio WebUI for creators and developers, featuring key TTS (Edge-TTS, kokoro) and zero-shot Voice Cloning (E2 & F5-TTS, CosyVoice), with Whisper audio processing, YouTube downloa…
13,159 starsPythonGPL-3.0Last push Jul 13, 2026
Rank 467: leon-ai/leon
🧠 Leon is your open-source personal assistant.
17,587 starsTypeScriptMITLast push Oct 12, 2026
Rank 1,259: argmaxinc/argmax-oss-swift
On-device Speech AI for Apple Silicon
6,406 starsSwiftMITLast push Oct 11, 2026