hidet-org/hidet

Does hidet have inputs with dynamic shapes support now?

changcui opened this issue · 2 comments

changcui commented
Does hidet have inputs with dynamic shapes support now?
yaoyaoding commented

Hi @changcui, sorry, we do not support dynamic shape for now. The support for dynamic shape is on the plan with high priority.

The Hidet Script has the ability to write kernel with dynamic shape, see the example. However, to support the model with dynamic input (i.e., sequence length in text-generation models), we still need to enhance our graph IR and scheduling system.

  • 👍1
changcui commented

Thanks for your reply. I will keep an eye on your work.