pooled

Repository facts

Stars

596

Forks

94

Open issues and pull requests

67

Primary language

JavaScript

License

MIT License (MIT)

Owner

Nehanth · Personal account

Created

Sep 1, 2026

Last push

Oct 16, 2026

Topics

• browser
• distributed-inference
• inference
• llm
• local-llm
• peer-to-peer
• speculative-decoding
• webgpu
• webrtc
• wgsl

Rank #8,576 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 1,389

  Rank 1,389: gpustack/gpustack

  A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

  5,844 starsPythonApache-2.0Last push Oct 16, 2026

• 1,655

  Rank 1,655: llm-d/llm-d

  Achieve state of the art inference performance with modern accelerators on Kubernetes

  4,856 starsPythonApache-2.0Last push Oct 18, 2026

• 6,051

  Rank 6,051: peonist-ai/halogen-flash-server

  The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)

  1,018 starsShellOther licenseLast push Oct 18, 2026

• 4,512

  Rank 4,512: sgl-project/sglang-omni

  SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.

  1,543 starsPythonApache-2.0Last push Oct 18, 2026

• 3,695

  Rank 3,695: ddalcu/mlx-serve

  Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

  1,977 starsZigOther licenseLast push Oct 18, 2026

• 1,979

  Rank 1,979: raullenchai/Rapid-MLX

  Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents.…

  3,996 starsPythonOther licenseLast push Oct 18, 2026