BentoML

Repository facts

Stars

8,906

Forks

1,045

Open issues and pull requests

235

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

bentoml · Organization

Created

Apr 2, 2019

Last push

Oct 5, 2026

Topics

• ai-inference
• deep-learning
• generative-ai
• inference-platform
• llm
• llm-inference
• llm-serving
• llmops
• machine-learning
• ml-engineering
• mlops
• model-inference-service
• model-serving
• multimodal
• python

Rank #922 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 376

  Rank 376: jina-ai/serve

  ☁️ Build multimodal AI applications with cloud-native stack

  21,854 starsPythonApache-2.0Last push Mar 24, 2025

• 2,619

  Rank 2,619: vllm-project/vllm-ascend

  Community maintained hardware plugin for vLLM on Huawei Ascend

  2,996 starsPythonApache-2.0Last push Oct 18, 2026

• 645

  Rank 645: bentoml/OpenLLM

  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

  12,559 starsPythonApache-2.0Last push Oct 12, 2026

• 1,506

  Rank 1,506: superduper-io/superduper

  Superduper: End-to-end framework for building custom AI applications and agents.

  5,325 starsPythonApache-2.0Last push Sep 1, 2025

• 3,552

  Rank 3,552: microsoft/aici

  AICI: Prompts as (Wasm) Programs

  2,076 starsRustMITLast push Jan 22, 2025

• 6,523

  Rank 6,523: mosecorg/mosec

  A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

  902 starsPythonApache-2.0Last push Oct 12, 2026