uzu

Repository facts

Stars

2,390

Forks

148

Open issues and pull requests

18

Primary language

Rust

License

MIT License (MIT)

Owner

trymirai · Organization

Created

Jun 23, 2025

Last push

Oct 18, 2026

Topics

• ai
• high-performance
• inference
• llm
• metal
• rust
• tts

Rank #3,167 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 5,043

  Rank 5,043: StarlightSearch/EmbedAnything

  Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

  1,315 starsRustApache-2.0Last push Sep 25, 2026

• 8,611

  Rank 8,611: zhongkaifu/TensorSharp

  A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-comp…

  592 starsC#BSD-3-ClauseLast push Oct 18, 2026

• 3,552

  Rank 3,552: microsoft/aici

  AICI: Prompts as (Wasm) Programs

  2,076 starsRustMITLast push Jan 22, 2025

• 2,928

  Rank 2,928: openlake-project/openlake

  OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

  2,641 starsRustApache-2.0Last push Oct 9, 2026

• 7,185

  Rank 7,185: SharpAI/SwiftLM

  ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

  784 starsSwiftMITLast push Oct 17, 2026

• 2,989

  Rank 2,989: pykeio/ort

  Fast ML inference & training for ONNX models in Rust

  2,572 starsRustApache-2.0Last push Oct 17, 2026