paddler
by intentee (organization)
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU. (description from the project’s GitHub page)
Repository facts
- Stars
- 1,679
- Forks
- 110
- Open issues and pull requests
- 30
- Primary language
- Rust
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- intentee · Organization
- Created
- Apr 27, 2024
- Last push
- Oct 15, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 2,442: Josh-XT/AGiXT
AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memo…
3,216 starsPythonMITLast push Jul 28, 2026
Rank 8,229: Fast-Editor/Lynkr
Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.
633 starsJavaScriptApache-2.0Last push Oct 13, 2026
Rank 1,139: tbphp/gpt-load
Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关：多渠道多凭据统一接入，含密钥与订阅账号…
7,147 starsGoMITLast push Oct 18, 2026
Rank 2,450: SilasMarvin/lsp-ai
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
3,210 starsRustMITLast push Jan 7, 2025
Rank 3,363: floneum/kalosm
Instant, controllable, local pre-trained AI models in Rust
2,226 starsRustApache-2.0Last push Oct 18, 2026
Rank 6,626: huggingface/llm-ls
LSP server leveraging LLMs for code completion (and more?)
881 starsRustApache-2.0Last push Sep 23, 2026