HolyWu/vs-rife

Use dynamic shapes for TRT backend?

banjaminicc opened this issue · 0 comments

Would it be possible to include a toggle to build a dynamic shapes engine instead of static as people like me who vary their input resolutions a lot will benefit much more from not having to build engine over the ~5% speed decrease in inference (referring to vs-mlrt wiki benchmarks)

Many thanks!