Add data performance improvements for native precision

Question

Add data performance improvements for native precision

SeanNaren opened this issue 4 years ago · 2 comments

There are some data processing in the collate function that can be done if mixed precision/native precision is used:

https://github.com/huggingface/transformers/pull/9796/files

These will probably give us some nice optimizations when using native precision

Answer 1 · 2021-03-28T13:21:38.000Z

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

Answer 2 · 2021-06-06T11:27:22.000Z

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.