litellm
by BerriAI (organization)
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM] (description from the project’s GitHub page)
Repository facts
- Stars
- 61,490
- Forks
- 12,456
- Open issues and pull requests
- 5,567
- Primary language
- Python
- License
- Other license
- Owner
- BerriAI · Organization
- Created
- Jul 27, 2023
- Last push
- Oct 18, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 609: Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
13,214 starsTypeScriptMITLast push May 25, 2026
Rank 8,126: mozilla-ai/otari
Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
646 starsPythonApache-2.0Last push Oct 18, 2026
Rank 249: decolua/9router
Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit li…
31,012 starsJavaScriptMITLast push Oct 15, 2026
Rank 59: diegosouzapw/OmniRoute
Never stop coding. Free MIT AI gateway: one endpoint, 359 providers (150+ free), 1200+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cur…
78,008 starsTypeScriptMITLast push Oct 18, 2026
Rank 1,148: katanemo/plano
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core l…
7,091 starsRustApache-2.0Last push Oct 7, 2026