TensorRT-LLM backend support?
Author: npuichigoCreated Oct 21, 2023Updated Sep 1, 2026
Labelsenhancementgood first issue
Any plan to NVIDIA's new tensorrt llm backend? https://github.com/NVIDIA/TensorRT-LLM/tree/release/0.5.0
Source: lm-sys/FastChat
Any plan to NVIDIA's new tensorrt llm backend? https://github.com/NVIDIA/TensorRT-LLM/tree/release/0.5.0
Source: lm-sys/FastChat