Categories / LLM Infrastructure

Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.

Last push 1 day ago

Created

Jul 2025

Total stars

124

Last 7 days

+2

Last 30 days

+3

Last 12 months

+123

README badge

Rusty Stars badge for majiayu000/litellm-rs
[![Rusty Stars](https://rustystars.dev/badge/majiayu000/litellm-rs.svg)](https://rustystars.dev/majiayu000/litellm-rs)