shimmy

Repository facts

Stars

5,982

Forks

586

Open issues and pull requests

13

Primary language

Rust

License

Apache License 2.0 (Apache-2.0)

Owner

Michael-A-Kuykendall · Personal account

Created

Aug 28, 2025

Last push

Aug 30, 2026

Topics

• api-server
• command-line-tool
• developer-tools
• gguf
• huggingface
• huggingface-models
• huggingface-transformers
• inference-server
• llama
• llamacpp
• llm-inference
• local-ai
• machine-learning
• ollama-api
• openai-compatible
• rust
• rust-crate
• transformers
• webgpu
• webgpu-shaders

Rank #1,362 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 6,966

  Rank 6,966: mukel/llama3.java

  Llama 3+ inference in pure Java

  820 starsJavaMITLast push Apr 24, 2026

• 890

  Rank 890: MakazhanAlpamys/Soup

  Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

  9,314 starsPythonApache-2.0Last push Oct 18, 2026

• 1,979

  Rank 1,979: raullenchai/Rapid-MLX

  Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents.…

  3,996 starsPythonOther licenseLast push Oct 18, 2026

• 3,960

  Rank 3,960: AtomicBot-ai/Atomic-Chat

  Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

  1,810 starsTypeScriptOther licenseLast push Oct 17, 2026

• 7,760

  Rank 7,760: tetherto/qvac

  Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-plat…

  697 starsTypeScriptApache-2.0Last push Oct 18, 2026

• 9,193

  Rank 9,193: automataIA/graphrag-rs

  GraphRAG-rs is a high-performance, state-of-the-art Rust implementation of GraphRAG (Graph-based Retrieval Augmented Generation) that builds knowledge graphs from documents and en…

  532 starsRustMITLast push Jun 2, 2026