GitHub topics

llm-proxy

54% of these repos are in LLM Infrastructure, 27% in MLOps.

Repositories

11

Total stars

10,711

Trending

eliasbiondo

🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.

Created Oct 2026

a2a ai-gateway anthropic api-gateway bifrost-alternative
Total431
30 days +389
TsinHzl

Kiro 代理到 Claude Code 与 Codex,支持 Claude Opus 5.5/5/4.8/4.7/4.6、Sonnet 5.5/5/4.6、Haiku 5.5、GPT-5.6、Kimi K3、Grok-4.7,支持前缀缓存,并支持 SSE 流式输出。Kiro proxy for Claude Code and Codex. Supports Claude Opus 5.5/5/4.8/4.7/4.6, Sonnet 5.5/5/4.6, Haiku5.5,GPT-5.6, Kimi K3,Grok-4.7, Supports Prefix Cache, and SSE streaming.

Created May 2026

anthropic api-proxy claude-api claude-code codex
Total357
30 days +145
LeenHawk

gproxy is a Rust-based multi-channel LLM proxy that exposes OpenAI / Claude / Gemini-style APIs through a unified gateway, with a built-in admin console, user/key management, and request/usage auditing.

Created Feb 2026

Total297
30 days +35
GetBusbar

The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.

Created May 2026

ai-gateway anthropic bedrock circuit-breaker claude
Total226
30 days +33
katanemo

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

Created Jul 2024

ai-gateway ai-gateway-support envoy envoyproxy gateway
Total7,119
30 days +31
api7

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

Created Apr 2026

ai-agents ai-gateway ai-gateway-rust aisix anthropic
Total227
30 days +26
ThinkWatchProject

Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs.

Created Apr 2026

ai-gateway ai-governance ai-proxy audit-log audit-logging
Total817
30 days +4

Top

katanemo

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

Created Jul 2024

ai-gateway ai-gateway-support envoy envoyproxy gateway
Total7,119
ThinkWatchProject

Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs.

Created Apr 2026

ai-gateway ai-governance ai-proxy audit-log audit-logging
Total817
eliasbiondo

🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.

Created Oct 2026

a2a ai-gateway anthropic api-gateway bifrost-alternative
Total431
TsinHzl

Kiro 代理到 Claude Code 与 Codex,支持 Claude Opus 5.5/5/4.8/4.7/4.6、Sonnet 5.5/5/4.6、Haiku 5.5、GPT-5.6、Kimi K3、Grok-4.7,支持前缀缓存,并支持 SSE 流式输出。Kiro proxy for Claude Code and Codex. Supports Claude Opus 5.5/5/4.8/4.7/4.6, Sonnet 5.5/5/4.6, Haiku5.5,GPT-5.6, Kimi K3,Grok-4.7, Supports Prefix Cache, and SSE streaming.

Created May 2026

anthropic api-proxy claude-api claude-code codex
Total357
LeenHawk

gproxy is a Rust-based multi-channel LLM proxy that exposes OpenAI / Claude / Gemini-style APIs through a unified gateway, with a built-in admin console, user/key management, and request/usage auditing.

Created Feb 2026

Total297
api7

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

Created Apr 2026

ai-agents ai-gateway ai-gateway-rust aisix anthropic
Total227
GetBusbar

The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.

Created May 2026

ai-gateway anthropic bedrock circuit-breaker claude
Total226
soapbucket

Open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. One Apache-2.0 binary: 72 native providers behind an OpenAI-compatible API, or serve vLLM and llama.cpp on your own GPUs. Keys, budgets, guardrails, semantic cache, WAF.

Created Apr 2026

Total54

Related

All topics →