LiteRT-LM

Repository facts

Stars

6,691

Forks

758

Open issues and pull requests

712

Primary language

C++

License

Apache License 2.0 (Apache-2.0)

Owner

google-ai-edge · Organization

Created

Apr 14, 2025

Last push

Oct 18, 2026

Topics

• edge-ai
• on-device-ai
• on-device-llm

Rank #1,208 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 1,169

  Rank 1,169: drumih/turbo-fieldfare

  Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

  6,943 starsSwiftApache-2.0Last push Oct 15, 2026

• 1,326

  Rank 1,326: cactus-compute/cactus

  Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

  6,128 starsC++Other licenseLast push Sep 26, 2026

• 4,946

  Rank 4,946: feder-cr/jev

  jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

  1,354 starsC++MITLast push Oct 16, 2026

• 8,244

  Rank 8,244: Helldez/BigMoeOnEdge

  Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp

  631 starsC++Apache-2.0Last push Oct 18, 2026

• 583

  Rank 583: cactus-compute/needle

  Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontro…

  14,078 starsPythonApache-2.0Last push Oct 17, 2026

• 3,976

  Rank 3,976: cosmo-wander-ai/cosmo-edge

  Production-grade C++ edge AI engine for video analytics and on-device VLM across Sophon, Rockchip RKNN, and x86, with visual orchestration, real-time OSD, events, and reproducible…

  1,802 starsCApache-2.0Last push Oct 16, 2026