Topics / llm

Rust llm projects

Rust repositories on GitHub with the topic llm, ranked by their stars. Updated daily.

Repositories

32

Total stars

489,897

Most stars

rtk-ai

CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies

Created Jan 2026

agentic-coding ai-coding anthropic claude-code cli
Total87,151
janhq

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

Created Aug 2023

llamacpp localai self-hosted gpt tauri
Total45,839
codewhale-hq

An open-source coding agent for your terminal, written in Rust. It works with any model, can split one task across several agents, and every line of it is yours to read.

Created Jan 2026

cli rust tui ai-agent coding-agent
Total41,181
AlexsJones

Hundreds of models & providers. One command to find what runs on your hardware.

Created Feb 2026

llm skill localai gguf mlx
Total39,102
screenpipe

YC (S26) | Screenpipe finds the work worth automating | Continuously record computer work locally, discover recurring workflows, and hand the result to any agent you already use.

Created Jun 2024

ai computer-vision llm machine-learning multimodal
Total22,472
1jehuang

High performance coding agent harness written in Rust, built for heavy multi-agent dev workflows

Created Jan 2026

ai claude cli coding-agent llm
Total21,902
memvid

Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.

Created May 2025

ai context embedded faiss knowledge-base
Total17,432
cocoindex-io

Incremental engine for long horizon agents 🌟 Star if you like it!

Created Mar 2025

ai change-data-capture data-indexing etl indexing
Total11,915
tensorzero

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Created Jul 2024

ai artificial-intelligence deep-learning gpt llm
Total11,700
sigoden

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

Created Mar 2023

claude gemini ollama openai function-calling
Total10,587
astrid-runtime

Astrid is a portable, capability-secure operating system for composable software.

Created Feb 2026

agent-runtime ai-agents capability-security llm mcp
Total10,291
0xPlaygrounds

⚙️🦀 Build modular and scalable LLM Applications in Rust

Created Jun 2024

ai llm agent artificial-intelligence automation
Total9,182
deeplethe

World's first open-source enterprise world model.

Created Aug 2026

agent-memory knowledge-base knowledge-graph llm pgvector
Total8,738
tailcallhq

AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models

Created Dec 2024

ai-workflows artifical-intelligense claude-3-7-sonnet command-line multi-agent-reinforcement-learning
Total7,635
smol-machines

An embeddable, portable, branchable virtual machine to safely run Agents locally.

Created Dec 2025

containers crun libkrun microvm rust
Total7,141
rustformers

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

Created Mar 2023

ai ggml llm ml rust
Total6,143
winfunc

A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.

Created Jan 2025

ai anthropic anthropic-claude api chain-of-thought
Total5,353
agent-of-empires

Manage multiple Claude Code, OpenCode agents from either TUI or Web for easy access on mobile. Also supports Mistral Vibe, Codex CLI, Gemini CLI, Pi.dev, Copilot CLI, Factory Droid Coding.

Created Jan 2026

ai-coding claude-code cli opencode terminal
Total4,693
Mesh-LLM

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

Created Feb 2026

agents ai decentralized distributed llm
Total4,170
marcelroed

Language model tokenization at GB/s

Created Nov 2025

llm nlp tokenization tokenizer
Total4,157
Open-Less

Hold a key, speak, release — AI-polished text appears at your cursor in any app. Open-source voice input for macOS & Windows. (按住快捷键说话,松开即得润色后的文字)

Created Apr 2026

ai-prompt asr dictation macos open-source
Total4,137
yvgude

LeanCTX is the Context Gateway for AI Systems. Select task-relevant context, apply supported controls, connect local knowledge and inspect recorded evidence. Open-source Engine: CLI, MCP, hooks and supported proxy paths.

Created Mar 2026

ai cursor llm mcp rust
Total3,955
trymirai

A high-performance inference engine for AI models

Created Jun 2025

high-performance inference llm metal rust
Total3,371
SilasMarvin

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

Created Nov 2023

ai auto-completion developer-tools ide language-client
Total3,216
keon

A tiny, fast Rust CLI that drives a real browser over the Chrome DevTools Protocol — built for coding agents.

Created Dec 2016

rust agent browser-automation llm
Total3,161

Related topics

All topics →