yalm

Repository facts

Stars

604

Forks

71

Open issues and pull requests

4

Primary language

C++

License

No license file detected

Owner

andrewkchan · Personal account

Created

Oct 2, 2024

Last push

Sep 13, 2025

Topics

• cpp
• cuda
• inference-engine
• llama
• llamacpp
• llm
• llm-inference
• machine-learning
• mistral

Rank #8,484 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 6,501

  Rank 6,501: zhihu/ZhiLight

  A highly optimized LLM inference acceleration engine for Llama and its variants.

  907 starsC++Apache-2.0Last push Mar 18, 2026

• 1,372

  Rank 1,372: lemonade-sdk/lemonade

  Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

  5,927 starsC++Apache-2.0Last push Oct 18, 2026

• 7,564

  Rank 7,564: pegainfer-project/pegainfer

  Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

  724 starsRustApache-2.0Last push Oct 17, 2026

• 2,450

  Rank 2,450: SilasMarvin/lsp-ai

  LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

  3,210 starsRustMITLast push Jan 7, 2025

• 3,363

  Rank 3,363: floneum/kalosm

  Instant, controllable, local pre-trained AI models in Rust

  2,226 starsRustApache-2.0Last push Oct 18, 2026

• 1,362

  Rank 1,362: Michael-A-Kuykendall/shimmy

  ⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

  5,982 starsRustApache-2.0Last push Aug 30, 2026