llamafile

Repository facts

Stars

26,418

Forks

1,771

Open issues and pull requests

215

Primary language

C++

License

Other license

Owner

mozilla-ai · Organization

Created

Sep 10, 2023

Last push

Oct 12, 2026

Topics

• cross-platform
• gguf
• llama-cpp
• local-ai
• local-inference
• local-llm
• open-source-ai
• single-file-executable
• speech-to-text

Rank #310 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 4,946

  Rank 4,946: feder-cr/jev

  jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

  1,354 starsC++MITLast push Oct 16, 2026

• 7,760

  Rank 7,760: tetherto/qvac

  Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-plat…

  697 starsTypeScriptApache-2.0Last push Oct 18, 2026

• 2,417

  Rank 2,417: off-grid-ai/OGAM

  The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and loc…

  3,250 starsTypeScriptMITLast push Oct 17, 2026

• 2,323

  Rank 2,323: AtomicBot-ai/atomic-agent

  Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

  3,392 starsTypeScriptMITLast push Oct 17, 2026

• 890

  Rank 890: MakazhanAlpamys/Soup

  Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

  9,314 starsPythonApache-2.0Last push Oct 18, 2026

• 3,960

  Rank 3,960: AtomicBot-ai/Atomic-Chat

  Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

  1,810 starsTypeScriptOther licenseLast push Oct 17, 2026