About TorchDynamo

[hexisyztem]

Have you considered using torchDynamo instead of tracing for exporting the ONNX model? You can refer to the document below.
https://pytorch.org/tutorials/beginner/onnx/export_simple_model_to_onnx_tutorial.html
https://pytorch.org/docs/stable/torch.compiler_deepdive.html

[Masao-Someki]

Thank you, @hexisyztem. We haven't discussed TorchDynamo before, but if it can speed up inference, we should consider supporting it. Unfortunately, I don't have enough time right now, but I can look into it in October.