GitHub topics

ai-gateway

54% of these repos are in LLM Infrastructure, 12% in MLOps.

Repositories

24

Total stars

21,211

Trending

eliasbiondo

🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.

Created Oct 2026

a2a ai-gateway anthropic api-gateway bifrost-alternative
Total428
30 days +365
higress-group

Make Codex and Claude Code subscriptions go further: a local model router that gives routine agent work to economical models and keeps your strongest model for the hard parts.

Created Sep 2026

Total480
30 days +193
gotempsh

AI-native open-source alternative to Vercel + Sentry + PostHog + Pingdom + Resend + E2B. 440+ CLI operations with drop-in skills for Claude Code, Codex & OpenCode — deployments, analytics, session replay, error tracking, OpenTelemetry, email, sandboxes & AI gateway in one self-hosted Rust binary.

Created Oct 2025

Total936
30 days +83
GetBusbar

The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.

Created May 2026

ai-gateway anthropic bedrock circuit-breaker claude
Total226
30 days +30
katanemo

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

Created Jul 2024

ai-gateway ai-gateway-support envoy envoyproxy gateway
Total7,118
30 days +29
api7

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

Created Apr 2026

ai-agents ai-gateway ai-gateway-rust aisix anthropic
Total227
30 days +26
LiteLLM-Labs

1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents.

Created May 2026

agent-builder agent-builder-tools agent-platform agent-vault ai-gateway
Total1,334
30 days +23
taichuy

Build for agents — from the AI Gateway to the entire application stack.

Created Mar 2026

agent-native agent-observability ai-app-builder ai-gateway claude-api
Total296
30 days +15

Top

katanemo

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

Created Jul 2024

ai-gateway ai-gateway-support envoy envoyproxy gateway
Total7,118
LiteLLM-Labs

1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents.

Created May 2026

agent-builder agent-builder-tools agent-platform agent-vault ai-gateway
Total1,334
gotempsh

AI-native open-source alternative to Vercel + Sentry + PostHog + Pingdom + Resend + E2B. 440+ CLI operations with drop-in skills for Claude Code, Codex & OpenCode — deployments, analytics, session replay, error tracking, OpenTelemetry, email, sandboxes & AI gateway in one self-hosted Rust binary.

Created Oct 2025

Total936
ThinkWatchProject

Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs.

Created Apr 2026

ai-gateway ai-governance ai-proxy audit-log audit-logging
Total817
eliasbiondo

🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.

Created Oct 2026

a2a ai-gateway anthropic api-gateway bifrost-alternative
Total428
taichuy

Build for agents — from the AI Gateway to the entire application stack.

Created Mar 2026

agent-native agent-observability ai-app-builder ai-gateway claude-api
Total296
api7

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

Created Apr 2026

ai-agents ai-gateway ai-gateway-rust aisix anthropic
Total227
GetBusbar

The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.

Created May 2026

ai-gateway anthropic bedrock circuit-breaker claude
Total226
AprilNEA

Turn AI subscriptions into standard API endpoints. OpenAI & Anthropic compatible gateway — for Amp Code, Cursor, Factory CLI, and more.

Created Feb 2026

ai-gateway amp anthropic-api claude copilot
Total141
lsuen

SUGT - local AI gateway & skills console. Centralize LLM API keys, one OpenAI/Anthropic-compatible proxy for Claude Code, Codex & OpenCode. Homebrew & winget. Fully open source (Apache-2.0).

Created Jul 2026

Total134
LiteLLM-Labs

Onboard AI tools in one step, and catch the rest. Relay sets up Claude Desktop, Claude Code, and Codex to run through your LiteLLM AI Gateway with zero dev setup and routes shadow AI (Notion AI, Perplexity, …) there too.

Created Jul 2026

ai-gateway ai-governance ai-monitoring ai-proxy shadow-ai
Total112
azrtydxb

The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.

Created Aug 2026

Total109
gridaco

A workflow engine for generative asset pipelines. Plan, price, cache, and run workflows with Rust, Python, and TypeScript.

Created Oct 2020

3d-generation ai-gateway ai-pipeline asset-pipeline generative-ai
Total104
Noveum

Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly and quickly.

Created Nov 2024

Total100
soapbucket

Open source Enterprise AI Gateway for API, MCP and agent, and AI model traffic. One Apache-2.0 binary: 72 native providers behind an OpenAI-compatible API, or serve vLLM and llama.cpp on your own GPUs. Keys, budgets, guardrails, semantic cache, WAF.

Created Apr 2026

Total54

Related

All topics →