Categories / LLM Infrastructure
guidance-ai/llgtrt
TensorRT-LLM server with Structured Outputs (JSON) built with Rust
Created
Oct 2024
Total stars
73
Last 7 days
0
Last 30 days
0
Last 12 months
0
README badge
[](https://rustystars.dev/guidance-ai/llgtrt)