Categories / LLM Infrastructure
smg-project/smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
Created
Nov 2025
Total stars
732
Last 7 days
+18
Last 30 days
+86
Last 12 months
+731
README badge
[](https://rustystars.dev/smg-project/smg)