truss

Repository facts

Stars

1,220

Forks

134

Open issues and pull requests

93

Primary language

Python

License

MIT License (MIT)

Owner

basetenlabs · Organization

Created

Jul 6, 2022

Last push

Oct 16, 2026

Topics

• artificial-intelligence
• easy-to-use
• falcon
• inference-api
• inference-server
• machine-learning
• model-serving
• open-source
• packaging
• stable-diffusion
• whisper
• wizardlm

Rank #5,341 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 3,072

  Rank 3,072: roboflow/inference

  Turn any computer or edge device into a command center for your computer vision projects.

  2,478 starsPythonOther licenseLast push Oct 18, 2026

• 9,107

  Rank 9,107: underneathall/pinferencia

  Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

  541 starsPythonApache-2.0Last push Feb 14, 2023

• 8,405

  Rank 8,405: jina-ai/agentchain

  Chain together LLMs for reasoning & orchestrate multiple large models for accomplishing complex tasks

  612 starsPythonMITLast push Apr 11, 2023

• 3,540

  Rank 3,540: vitoplantamura/OnnxStream

  Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers.…

  2,088 starsC++Other licenseLast push Jun 18, 2026

• 5,560

  Rank 5,560: Woolverine94/biniou

  a self-hosted webui for 30+ generative ai

  1,154 starsPythonGPL-3.0Last push Oct 18, 2026

• 4,571

  Rank 4,571: microsoft/ai-dev-gallery

  An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

  1,509 starsC#MITLast push Oct 17, 2026