Categories / LLM Infrastructure
majiayu000/litellm-rs
Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.
ai-gatewayanthropicapi-clientasync-rustaws-bedrockembeddingsgeminillmload-balancingmulti-providerollamaopenaiopenai-compatibleruststreaming
Created
Jul 2025
Total stars
124
Last 7 days
+2
Last 30 days
+3
Last 12 months
+123
README badge
[](https://rustystars.dev/majiayu000/litellm-rs)