GitHub topics

rate-limiting

31% of these repos are in LLM Infrastructure, 12% in Web programming.

Repositories

16

Total stars

4,511

Trending

eliasbiondo

🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.

Created Oct 2026

a2a ai-gateway anthropic api-gateway bifrost-alternative
Total428
30 days +365
LibreQoE

Self-hosted traffic management and network operations platform for ISPs. Use CAKE and fq_codel to reduce bufferbloat, enforce bandwidth plans, and troubleshoot congestion with topology-aware subscriber visibility.

Created Oct 2020

active-queue-management aqm bandwidth-limiting bufferbloat cake
Total729
30 days +5
ThinkWatchProject

Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs.

Created Apr 2026

ai-gateway ai-governance ai-proxy audit-log audit-logging
Total817
30 days +4

Top

ThinkWatchProject

Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs.

Created Apr 2026

ai-gateway ai-governance ai-proxy audit-log audit-logging
Total817
LibreQoE

Self-hosted traffic management and network operations platform for ISPs. Use CAKE and fq_codel to reduce bufferbloat, enforce bandwidth plans, and troubleshoot congestion with topology-aware subscriber visibility.

Created Oct 2020

active-queue-management aqm bandwidth-limiting bufferbloat cake
Total729
eliasbiondo

🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.

Created Oct 2026

a2a ai-gateway anthropic api-gateway bifrost-alternative
Total428
AlephantAI

Alephant is an open-source AI Agent Gateway for routing, tracking, and controlling LLM usage across AI agents, members, and workflows, and for publishing agent capabilities as paid endpoints with x402 and MPP payment rails.

Created May 2026

agent ai ai-agent ai-gateways claude
Total119
ayarotsky

Redis and Valkey module that implements the token-bucket algorithm as a native command for high-performance rate limiting

Created Jan 2020

rate-limiting redis redis-module rust rust-library
Total101
FrancescoCoding

📡 A free, open-source NetLimiter-style bandwidth monitor and limiter for Windows, written in Rust.

Created Jul 2026

bandwidth-limiter bandwidth-monitor desktop-app egui gui
Total90
biandratti

High-performance reverse proxy forwarding TLS (JA4), HTTP/2 (Akamai), and TCP-SYN (eBPF-powered) fingerprints as HTTP headers

Created Dec 2025

akamai akamai-fingerprint bot-detection ebpf ebpf-programs
Total63
soapbucket

Open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. One Apache-2.0 binary: 72 native providers behind an OpenAI-compatible API, or serve vLLM and llama.cpp on your own GPUs. Keys, budgets, guardrails, semantic cache, WAF.

Created Apr 2026

Total54
shuaiZend

Distributed, centrally-controlled Web Application Firewall built on pingap & Cloudflare Pingora. Semantic attack detection, Cloudflare-style rules, CC & Bot defense, automatic TLS, embedded i18n dashboard.

Created Sep 2026

acme bot-protection elasticsearch grpc letsencrypt
Total53

Related

All topics →