NVIDIA/TensorRT-LLM

[New Model]: Qwen2.5-VL

Closed this issue · 3 comments

The model to consider.

Can tensorrt-llm support the Qwen2.5-VL model on the OrinNX platform? Are there any relevant guidelines?

The closest model TensorRT-LLM already supports.

No response

What's your difficulty of supporting the model you want?

No response

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.

We do not aim to support models on edge devices/platforms.

Issue has not received an update in over 14 days. Adding stale label.

This issue was closed because it has been 14 days without activity since it has been marked as stale.