Categories / LLM Infrastructure

underclass: an OpenAI-compatible pooling proxy that pins sessions to one account (prompt cache stays warm), cools quota-exhausted subscriptions until their window resets, and fails fast with the earliest Retry-After when the whole pool is dry.

Last push 14 hours ago

openaiopenai-proxy-load-balancer

Created

Sep 2026

Total stars

303

Last 7 days

+5

Last 30 days

+42

Last 12 months

+303

README badge

Rusty Stars badge for ghuntley/underclass
[![Rusty Stars](https://rustystars.dev/badge/ghuntley/underclass.svg)](https://rustystars.dev/ghuntley/underclass)