npuichigo

npuichigo

GitHub

Repositories

1

Total stars

221

Top repositories

OpenAI compatible API for TensorRT LLM triton backend

Created Nov 2023

langchain llm openai-api tensorrt-llm triton-inference-server
Total221