sonar

Repository facts

Stars

1,877

Forks

211

Open issues and pull requests

55

Primary language

Python

License

GNU Affero General Public License v3.0 (AGPL-3.0)

Owner

dphnAI · Organization

Created

Jun 23, 2023

Last push

Oct 18, 2026

Topics

• api-rest
• cuda
• inference-engine
• inferentia
• intel
• lora
• machine-learning
• rocm
• speculative-decoding
• tpu

Rank #3,844 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 6,051

  Rank 6,051: peonist-ai/halogen-flash-server

  The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)

  1,018 starsShellOther licenseLast push Oct 18, 2026

• 2,698

  Rank 2,698: Luce-Org/lucebox

  LLM speculative inference server for heterogeneous hardware & consumer GPUs

  2,928 starsC++Apache-2.0Last push Oct 18, 2026

• 3,720

  Rank 3,720: siliconflow/onediff

  OneDiff: An out-of-the-box acceleration library for diffusion models.

  1,962 starsJupyter NotebookApache-2.0Last push Dec 4, 2025

• 6,725

  Rank 6,725: insight-platform/Savant

  Python Computer Vision & Video Analytics Framework With Batteries Included

  863 starsPythonApache-2.0Last push Sep 23, 2026

• 7,888

  Rank 7,888: ARahim3/kaggle-tpu-lab

  Frontier-class open models on a free Kaggle TPU v5e-8: GLM-5.3-Flash 320B MoE (~165 tok/s, our own JAX engine) and Qwen3.8-27B bf16 (~130 tok/s), 262k context, prefix caching. Wor…

  679 starsPythonMITLast push Oct 6, 2026

• 500

  Rank 500: tracel-ai/burn

  Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

  16,127 starsRustApache-2.0Last push Oct 16, 2026