Categories / LLM Infrastructure

azrtydxb

azrtydxb/Fastllm-proxy

The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.

Last push 3 days ago

ai-gatewayinferencelitellmllmllm-gatewayload-balancingobservabilityopenai-apirbacreverse-proxyrustvllm

Created

Aug 2026

Total stars

109

Last 7 days

0

Last 30 days

0

Last 12 months

0

README badge

Rusty Stars badge for azrtydxb/Fastllm-proxy
[![Rusty Stars](https://rustystars.dev/badge/azrtydxb/Fastllm-proxy.svg)](https://rustystars.dev/azrtydxb/Fastllm-proxy)