Categories / LLM Infrastructure

TensorRT-LLM server with Structured Outputs (JSON) built with Rust

Last push 2 years ago

cfgguidancejsonopenai-apiregexstructured-generationtensorrt-llm

Created

Oct 2024

Total stars

73

Last 7 days

0

Last 30 days

0

Last 12 months

0

README badge

Rusty Stars badge for guidance-ai/llgtrt
[![Rusty Stars](https://rustystars.dev/badge/guidance-ai/llgtrt.svg)](https://rustystars.dev/guidance-ai/llgtrt)