A high-performance and light-weight router for vLLM large scale deployment
Created Jul 2025
Total527
Repositories
3
Total stars
937
A high-performance and light-weight router for vLLM large scale deployment
Created Jul 2025
High-performance Rust benchmark client for vLLM serving endpoints.
Created Jun 2026