
smg
by smg-project (organization)
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant… (description from the project’s GitHub page)
Repository facts
- Stars
- 618
- Forks
- 195
- Open issues and pull requests
- 191
- Primary language
- Rust
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- smg-project · Organization
- Created
- Nov 22, 2025
- Last push
- Oct 18, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 132: LibreChat-AI/LibreChat
Enhanced ChatGPT Clone: Features Agents, MCP, Skills, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, A…
45,924 starsTypeScriptMITLast push Oct 18, 2026
Rank 4,327: waybarrios/vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code supp…
1,626 starsPythonApache-2.0Last push Oct 16, 2026
Rank 3,874: shiwenwen/hope-agent
🦭 A cross-device desktop AI agent with memory, autonomous goals, dynamic workflows, and headless deployment | 会记忆、能持续推进目标、会动态编排多 Agent 的跨端桌面 AI 助手,也可服务化常驻 NAS / 云端
1,864 starsRustMITLast push Oct 18, 2026
Rank 5,415: FranciscoMoretti/chat-js
Production-ready AI chat. Start here and make it your own. Formerly Sparka AI
1,201 starsTypeScriptApache-2.0Last push Oct 18, 2026
Rank 276: yamadashy/repomix
📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or…
28,893 starsTypeScriptMITLast push Oct 18, 2026
Rank 533: CoplayDev/unity-mcp
Unity MCP acts as a bridge between AI assistants and your Unity Editor. Give your LLM tools to manage assets, control scenes, edit scripts, and automate tasks within Unity.
15,085 starsC#MITLast push Oct 17, 2026