model_server

Repository facts

Stars

950

Forks

283

Open issues and pull requests

157

Primary language

C++

License

Apache License 2.0 (Apache-2.0)

Owner

openvinotoolkit · Organization

Created

Sep 26, 2018

Last push

Oct 16, 2026

Topics

• ai
• cloud
• dag
• deep-learning
• edge
• genai
• inference
• kubernetes
• machine-learning
• model-serving
• openvino
• serving

Rank #6,312 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 9,107

  Rank 9,107: underneathall/pinferencia

  Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

  541 starsPythonApache-2.0Last push Feb 14, 2023

• 729

  Rank 729: triton-inference-server/server

  The Triton Inference Server provides an optimized cloud and edge inferencing solution.

  11,095 starsPythonBSD-3-ClauseLast push Oct 16, 2026

• 1,327

  Rank 1,327: kserve/kserve

  Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

  6,128 starsGoApache-2.0Last push Oct 17, 2026

• 3,293

  Rank 3,293: dstackai/dstack

  A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clus…

  2,284 starsPythonMPL-2.0Last push Oct 17, 2026

• 3,828

  Rank 3,828: nndeploy/nndeploy

  一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

  1,886 starsC++Apache-2.0Last push Aug 15, 2026

• 736

  Rank 736: openvinotoolkit/openvino

  OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

  11,018 starsC++Apache-2.0Last push Oct 17, 2026