Categories / Artificial Intelligence

Mattbusel

Mattbusel/tokio-prompt-orchestrator

The proxy in front of your LLM should not be the slow part. Rust LLM API proxy: +0.5 ms, 55 MB, same prompt twice costs one call.

Last push 8 hours ago

Created

Oct 2025

Total stars

62

Last 7 days

+1

Last 30 days

+2

Last 12 months

+58

Used by crates

0

Downloads, 90 days

389

README badge

Rusty Stars badge for Mattbusel/tokio-prompt-orchestrator
[![Rusty Stars](https://rustystars.dev/badge/Mattbusel/tokio-prompt-orchestrator.svg)](https://rustystars.dev/Mattbusel/tokio-prompt-orchestrator)