Categories / LLM Infrastructure

This is a project that unifies the management of LLM APIs. It can call multiple backend services through a unified API interface, convert them to the OpenAI format uniformly, and support load balancing. Currently supported backend services include: OpenAI, Anthropic, DeepBricks, OpenRouter, Gemini, Vertex, etc.

Last push 1 day ago

Created

Jul 2024

Total stars

1,273

Last 7 days

+2

Last 30 days

+10

Last 12 months

+210

README badge

Rusty Stars badge for yym68686/uni-api
[![Rusty Stars](https://rustystars.dev/badge/yym68686/uni-api.svg)](https://rustystars.dev/yym68686/uni-api)