A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, ElevenLabs...) with a single, extensible API. Build, chain, evaluate, and serve complex multi-step AI workflows — including speech-to-text, text-to-speech, completions, vision, and reasoning.

Last push 5 months ago

Created

Jan 2025

Total stars

368

Last 7 days

+1

Last 30 days

+1

Last 12 months

+121

Used by crates

35

Downloads, 90 days

20,963

README badge

Rusty Stars badge for graniet/llm
[![Rusty Stars](https://rustystars.dev/badge/graniet/llm.svg)](https://rustystars.dev/graniet/llm)