cactus

Repository facts

Stars

6,128

Forks

518

Open issues and pull requests

115

Primary language

C++

License

Other license

Owner

cactus-compute · Organization

Created

Apr 23, 2025

Last push

Sep 26, 2026

Topics

• ai
• android
• arm
• edge
• edge-ai
• framework
• ios
• llamacpp
• llm
• llm-inference
• llms
• mobile
• mobile-inference
• on-device-ai
• quantiz
• rag
• smartphone
• speech
• transformer
• whisper

Rank #1,326 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 787

  Rank 787: RunanywhereAI/runanywhere-sdks

  Production ready toolkit to run AI locally

  10,330 starsC++Other licenseLast push Oct 18, 2026

• 6,292

  Rank 6,292: huawei-noah/bolt

  Bolt is a deep learning library with high performance and heterogeneous flexibility.

  955 starsC++MITLast push Apr 11, 2025

• 4,946

  Rank 4,946: feder-cr/jev

  jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

  1,354 starsC++MITLast push Oct 16, 2026

• 4,044

  Rank 4,044: software-mansion/react-native-executorch

  High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's ExecuTorch runtime

  1,766 starsTypeScriptOther licenseLast push Oct 16, 2026

• 5,461

  Rank 5,461: rudrankriyam/Foundation-Models-Framework-Lab

  A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.

  1,189 starsSwiftMITLast push Sep 18, 2026

• 8,244

  Rank 8,244: Helldez/BigMoeOnEdge

  Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp

  631 starsC++Apache-2.0Last push Oct 18, 2026