Categories / LLM Infrastructure

npuichigo

npuichigo/openai_trtllm

OpenAI compatible API for TensorRT LLM triton backend

Last push 2 years ago

langchainllmopenai-apitensorrt-llmtriton-inference-server

Created

Nov 2023

Total stars

221

Last 7 days

0

Last 30 days

0

Last 12 months

+4

README badge

Rusty Stars badge for npuichigo/openai_trtllm
[![Rusty Stars](https://rustystars.dev/badge/npuichigo/openai_trtllm.svg)](https://rustystars.dev/npuichigo/openai_trtllm)