⚙️🦀 Build modular and scalable LLM Applications in Rust
Created Jun 2024
23% of these repos are in LLM Infrastructure, 15% in Artificial Intelligence.
Repositories
13
Total stars
32,343
⚙️🦀 Build modular and scalable LLM Applications in Rust
Created Jun 2024
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
Created Jul 2024
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
Created Jul 2024
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
Created Mar 2024
The AI-powered 3D CAD IDE — edit code, visualize in 3D, and reshape your designs with natural language.
Created Feb 2026
High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
Created Oct 2024
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
Created Jul 2024
⚙️🦀 Build modular and scalable LLM Applications in Rust
Created Jun 2024
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
Created Jul 2024
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
Created Mar 2024
The AI-powered 3D CAD IDE — edit code, visualize in 3D, and reshape your designs with natural language.
Created Feb 2026
High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
Created Oct 2024
Windows app that turns any subject into a full, scheduled, graded course, built and marked by your own Claude Code
Created Nov 2026
A workflow engine for generative asset pipelines. Plan, price, cache, and run workflows with Rust, Python, and TypeScript.
Created Oct 2020
Invoking models on Amazon Bedrock using Rust
Created Feb 2024
An unofficial rust-based client library to interact with the Google Gemini generative AI API
Created Dec 2023
An open source, Native AI Gateway and LLM proxy built in Rust
Created Mar 2026