Categories / LLM Infrastructure
underclass: an OpenAI-compatible pooling proxy that pins sessions to one account (prompt cache stays warm), cools quota-exhausted subscriptions until their window resets, and fails fast with the earliest Retry-After when the whole pool is dry.
openaiopenai-proxy-load-balancer
Created
Sep 2026
Total stars
303
Last 7 days
0
Last 30 days
0
Last 12 months
0
README badge
[](https://rustystars.dev/ghuntley/underclass)