
LitServe
by Lightning-AI (organization)
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling. (description from the project’s GitHub page)
Repository facts
- Stars
- 3,955
- Forks
- 318
- Open issues and pull requests
- 65
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- Lightning-AI · Organization
- Created
- Dec 12, 2023
- Last push
- Oct 14, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 6,348: msoedov/langcorn
⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops
941 starsPythonMITLast push Jul 15, 2024
Rank 3,518: Anil-matcha/open-agent-email
Open-source email infrastructure for AI agents: secure inboxes, REST and MCP APIs, SMTP, human approval workflows, signed webhooks, and Python and TypeScript SDKs. Self-host with…
2,100 starsPythonApache-2.0Last push Oct 16, 2026
Rank 5,298: bricks-cloud/BricksLLM
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environ…
1,230 starsGoMITLast push Jan 5, 2025
Rank 6,331: Pipelex/pipelex
Build AI methods with your coding agent, then run them anywhere: as an MCP for chatbots, as a webapp for people, or via API for your software.
946 starsPythonOther licenseLast push Oct 18, 2026
Rank 1,396: Klavis-AI/klavis
Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale
5,814 starsPythonApache-2.0Last push Jun 1, 2026