Bonsai-demo

Repository facts

Stars

3,399

Forks

382

Open issues and pull requests

21

Primary language

Shell

License

Apache License 2.0 (Apache-2.0)

Owner

PrismML-Eng · Organization

Created

Mar 25, 2026

Last push

Oct 15, 2026

Topics

• bonsai
• llamacpp
• llm
• mlx
• prism-ml
• small-models

Rank #2,320 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 851

  Rank 851: xorbitsai/inference

  Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…

  9,616 starsPythonApache-2.0Last push Oct 18, 2026

• 3,960

  Rank 3,960: AtomicBot-ai/Atomic-Chat

  Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

  1,810 starsTypeScriptOther licenseLast push Oct 17, 2026

• 7,018

  Rank 7,018: XHToken/Spark-X2.5

  Spark-x2.5 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models

  812 starsApache-2.0Last push Sep 20, 2026

• 7,567

  Rank 7,567: SqueezeAILab/SqueezeLLM

  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

  724 starsPythonMITLast push Aug 13, 2024

• 4,188

  Rank 4,188: microsoft/EdgeML

  This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India.

  1,691 starsC++Other licenseLast push May 20, 2024

• 133

  Rank 133: janhq/jan

  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

  44,996 starsRustOther licenseLast push Oct 16, 2026