
mosec
by mosecorg (organization)
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine (description from the project’s GitHub page)
Repository facts
- Stars
- 902
- Forks
- 82
- Open issues and pull requests
- 14
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- mosecorg · Organization
- Created
- Mar 13, 2021
- Last push
- Oct 12, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 3,339: kubeflow/trainer
Distributed AI Model Training and LLM Fine-Tuning on Kubernetes
2,249 starsGoApache-2.0Last push Oct 16, 2026
Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026
Rank 6,137: keras-team/keras-hub
Pretrained model hub for Keras 3.
994 starsPythonApache-2.0Last push Oct 16, 2026
Rank 922: bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
8,906 starsPythonApache-2.0Last push Oct 5, 2026
Rank 2,728: explosion/thinc
🔮 A refreshing functional take on deep learning, compatible with your favorite libraries
2,891 starsPythonMITLast push Mar 27, 2026
Rank 4,184: tensorly/tensorly
TensorLy: Tensor Learning in Python.
1,694 starsPythonOther licenseLast push Oct 17, 2026