Categories / LLM Infrastructure

azrtydxb

azrtydxb/Fastllm-proxy

The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.

Last push 4 days ago

Created

Aug 2026

Total stars

109

Last 7 days

0

Last 30 days

+3

Last 12 months

+109

README badge

Rusty Stars badge for azrtydxb/Fastllm-proxy
[![Rusty Stars](https://rustystars.dev/badge/azrtydxb/Fastllm-proxy.svg)](https://rustystars.dev/azrtydxb/Fastllm-proxy)