CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
Created Jan 2026
30% of these repos are in AI Agents and Coding Assistants, 11% in LLM Infrastructure.
Repositories
76
Total stars
123,838
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
Created Jan 2026
Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
Created Sep 2026
🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.
Created Oct 2026
自托管 AI Coding Agent(Rust):常驻 Runtime 撑起终端 / 浏览器 / 手机三端;每行改动可追溯到具体 Agent 与工具调用,子 Agent 的活由退出码裁决,检查点回退、目标 token 预算与验收清单跨轮次跨重启累计,用量与反馈账本留在本地。接任意 OpenAI 兼容或 Anthropic 端点。Self-hosted auditable AI coding agent: per-line attribution, exit-code-verified sub-agents, restart-safe goal budgets, local usage and feedback ledgers.
Created Aug 2026
Rust-native, library-first coding-agent runtime and terminal CLI inspired by Pi, with composable LLM providers, tools, sessions, and plugin ABI
Created Aug 2026
Kiro 代理到 Claude Code 与 Codex,支持 Claude Opus 5.5/5/4.8/4.7/4.6、Sonnet 5.5/5/4.6、Haiku 5.5、GPT-5.6、Kimi K3、Grok-4.7,支持前缀缓存,并支持 SSE 流式输出。Kiro proxy for Claude Code and Codex. Supports Claude Opus 5.5/5/4.8/4.7/4.6, Sonnet 5.5/5/4.6, Haiku5.5,GPT-5.6, Kimi K3,Grok-4.7, Supports Prefix Cache, and SSE streaming.
Created May 2026
Claude Code multi-account manager, usage monitor (CLI, TUI & cross-account delegation via MCP)
Created Apr 2026
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
Created Nov 2025
🦭 A cross-device desktop AI agent with memory, autonomous goals, dynamic workflows, and headless deployment | 会记忆、能持续推进目标、会动态编排多 Agent 的跨端桌面 AI 助手,也可服务化常驻 NAS / 云端
Created Mar 2026
Menu bar app for macOS, Windows and Linux that cuts Claude Code and ChatGPT Codex token costs by ~50%
Created Mar 2026
Top 50 of 76
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
Created Jan 2026
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
Created Jul 2024
A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.
Created Jan 2025
🦭 A cross-device desktop AI agent with memory, autonomous goals, dynamic workflows, and headless deployment | 会记忆、能持续推进目标、会动态编排多 Agent 的跨端桌面 AI 助手,也可服务化常驻 NAS / 云端
Created Mar 2026
Open-source AI agent harness in native Rust — GUI, CLI, headless, and webapp from one binary. Multi-provider, MCP, skills, plugins, agent teams.
Created Apr 2026
Open Source ClaudeCode Leaked. Same functionalities as Claude Code by Anthropic. Written in Rust, Ready to use immediately for free.
Created Apr 2026
Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
Created Sep 2026
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
Created Nov 2025
Desktop app to control your computer with AI using your terminal, browser, mouse & keyboard
Created Oct 2024
Menu bar app for macOS, Windows and Linux that cuts Claude Code and ChatGPT Codex token costs by ~50%
Created Mar 2026
High-performance AI routing proxy built in Rust with automatic failover, priority-based routing, and support for 15+ providers (Anthropic, OpenAI, Cerebras, Minimax, Kimi, etc.)
Created Nov 2025
帮你的 Claude Science 一键接入你自己的 API:DeepSeek / 通义千问 / 智谱 GLM / Kimi / MiniMax / 小米 MiMo / 硅基流动 / OpenRouter / 任意 OpenAI·Anthropic 兼容端点
Created Jul 2026
🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.
Created Oct 2026
Claude Code session log viewer for JSONL files in ~/.claude/projects. Browse conversations, tool calls, tokens, and live tail sessions on desktop, web, and TUI.
Created Mar 2026
Kiro 代理到 Claude Code 与 Codex,支持 Claude Opus 5.5/5/4.8/4.7/4.6、Sonnet 5.5/5/4.6、Haiku 5.5、GPT-5.6、Kimi K3、Grok-4.7,支持前缀缓存,并支持 SSE 流式输出。Kiro proxy for Claude Code and Codex. Supports Claude Opus 5.5/5/4.8/4.7/4.6, Sonnet 5.5/5/4.6, Haiku5.5,GPT-5.6, Kimi K3,Grok-4.7, Supports Prefix Cache, and SSE streaming.
Created May 2026
Claude Code multi-account manager, usage monitor (CLI, TUI & cross-account delegation via MCP)
Created Apr 2026
本地运行的大模型聚合网关,GUI桌面端app,零代码部署,把Coding Plan、大模型 API 额度聚合成一个虚拟 Plan,一键接入 Claude Code、Claude Desktop App、OpenClaw、OpenCode 等工具。Bundle your scattered Token Plan, Coding Plan, and LLM API quotas into a single virtual Plan, and plug it into Claude Code, Claude Desktop App, OpenClaw, OpenCode, and more.
Created Apr 2026
Rust-native, library-first coding-agent runtime and terminal CLI inspired by Pi, with composable LLM providers, tools, sessions, and plugin ABI
Created Aug 2026
A native Rust terminal frontend for Claude Code 🦀
Created Feb 2026
Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted tokens from prompts, history, tool output, and code before they're sent: -31% input / -74% output, measured live. Any provider, no extra model calls. Also an MCP server and embeddable library (Rust, Python, Ruby, Kotlin, Swift, JS/TS).
Created Jun 2026
Smart Tree: not just a tree, a philosophy. A context-aware, AI-crafted replacement for 20+ tools with MEM8 quantum compression, semantic search, AST-smart editing, and partnership memory. Crafted with care by human + AI—accept no knock-offs.
Created Jun 2025
自托管 AI Coding Agent(Rust):常驻 Runtime 撑起终端 / 浏览器 / 手机三端;每行改动可追溯到具体 Agent 与工具调用,子 Agent 的活由退出码裁决,检查点回退、目标 token 预算与验收清单跨轮次跨重启累计,用量与反馈账本留在本地。接任意 OpenAI 兼容或 Anthropic 端点。Self-hosted auditable AI coding agent: per-line attribution, exit-code-verified sub-agents, restart-safe goal budgets, local usage and feedback ledgers.
Created Aug 2026
One API for every LLM: 170+ providers through one client, with a Rust core and native bindings for every major language.
Created Mar 2026
Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.
Created Apr 2026
The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.
Created May 2026
Cognitive memory database for AI agents — consolidates duplicates, detects contradictions, and fades stale memories via temporal decay, written in Rust (Apache-2.0) as a library, MCP server, or HTTP cluster.
Created Apr 2026
RAM efficient terminal agent harness for coding, cybersecurity, and automation.
Created Sep 2026
cc-switch 中转站的专用增强版(cc-switch for API relay providers),免去配置各种 密钥 endpoint 的烦恼。
Created Aug 2026
SUGT - local AI gateway & skills console. Centralize LLM API keys, one OpenAI/Anthropic-compatible proxy for Claude Code, Codex & OpenCode. Homebrew & winget. Fully open source (Apache-2.0).
Created Jul 2026
10 Claude sessions running. What are they doing? Live dashboard — monitor, cost tracking, search, sub-agent visibility.
Created Jan 2026
Tandem is the authority layer between AI agents and company tools: runtime policy for tools, memory, approvals, and audit trails.
Created Jan 2026
Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.
Created Jul 2025
Switch AI coding tools between your accounts. App and command line for macOS, Windows and Linux.
Created Sep 2026
🦀 A Pure Rust Framework For Building AGI.
Created Mar 2024
Windows app that turns any subject into a full, scheduled, graded course, built and marked by your own Claude Code
Created Nov 2026
Self-evolving AI agent in Rust. Single binary, 10 LLM providers, 30+ tools, 17 platform adapters. Zero dependencies.
Created Apr 2026
Monitor Claude Code sessions, costs, config, hooks, agents & MCP servers from a single Rust binary — TUI (9 tabs) + Web interface with live process tracking, budget alerts, and 30-day forecasting
Created Feb 2026