krasis

Repository facts

Stars

522

Forks

33

Open issues and pull requests

19

Primary language

C++

License

Other license

Owner

brontoguana · Personal account

Created

Feb 9, 2026

Last push

Sep 15, 2026

Topics

• cpu-inference
• gguf-model-support
• gpu-inference
• high-performance-inference
• hybrid-inference
• inference-engine
• inference-optimization
• large-language-models
• llama-cpp-alternative
• llm-inference
• mixture-of-experts
• transformer

Rank #9,294 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 908

  Rank 908: FareedKhan-dev/kimi-k3-in-c

  A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

  9,094 starsCApache-2.0Last push Oct 2, 2026

• 6,051

  Rank 6,051: peonist-ai/halogen-flash-server

  The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)

  1,018 starsShellOther licenseLast push Oct 18, 2026

• 4,383

  Rank 4,383: xLLM-AI/xllm

  A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

  1,601 starsC++Apache-2.0Last push Oct 18, 2026

• 1,851

  Rank 1,851: algorithmicsuperintelligence/optillm

  Optimizing inference proxy for LLMs

  4,319 starsPythonApache-2.0Last push Oct 11, 2026

• 1,389

  Rank 1,389: gpustack/gpustack

  A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

  5,844 starsPythonApache-2.0Last push Oct 16, 2026

• 4,946

  Rank 4,946: feder-cr/jev

  jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

  1,354 starsC++MITLast push Oct 16, 2026