CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
Created Jan 2026
Topics / llm
Rust repositories on GitHub with the topic llm, ranked by their stars. Updated daily.
Repositories
32
Total stars
489,897
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
Created Jan 2026
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
Created Aug 2023
The fastest, cheapest, most efficient open-source agent harness. Run more than 500 agents on a $10 VPS.
Created Feb 2026
An open-source coding agent for your terminal, written in Rust. It works with any model, can split one task across several agents, and every line of it is yours to read.
Created Jan 2026
Hundreds of models & providers. One command to find what runs on your hardware.
Created Feb 2026
YC (S26) | Screenpipe finds the work worth automating | Continuously record computer work locally, discover recurring workflows, and hand the result to any agent you already use.
Created Jun 2024
Open-source Agent Operating System
Created Feb 2026
Incremental engine for long horizon agents 🌟 Star if you like it!
Created Mar 2025
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
Created Jul 2024
Astrid is a portable, capability-secure operating system for composable software.
Created Feb 2026
The programming language for agents
Created Oct 2023
⚙️🦀 Build modular and scalable LLM Applications in Rust
Created Jun 2024
AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models
Created Dec 2024
An embeddable, portable, branchable virtual machine to safely run Agents locally.
Created Dec 2025
Postgres with GPUs for ML/AI apps.
Created Apr 2022
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
Created Mar 2023
A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.
Created Jan 2025
A blazing fast inference solution for text embeddings models
Created Oct 2023
Manage multiple Claude Code, OpenCode agents from either TUI or Web for easy access on mobile. Also supports Mistral Vibe, Codex CLI, Gemini CLI, Pi.dev, Copilot CLI, Factory Droid Coding.
Created Jan 2026
Language model tokenization at GB/s
Created Nov 2025
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
Created Nov 2023
A tiny, fast Rust CLI that drives a real browser over the Chrome DevTools Protocol — built for coding agents.
Created Dec 2016