Data preprocessing should happend on TPU?
Closed this issue · 2 comments
edwardyehuang commented
From my "knowledge" of TensorFlow 2.0, data preprocessing should happen on TPU. For example, I can process a batch of large images on a micro-size VM (1GB ram) with TPUv3-8. This behavior may be different on GPU.
deeplab2/model/kmax_deeplab.py
Line 177 in 7884ed6
Forgive me if my "knowledge" is incorrect
aquariusjay commented
Hi @edwardyehuang,
In our implementation, the data preprocessing happens on the host CPUs.
We do normalization in that line, which will happen on TPUs.
Cheers,
edwardyehuang commented
Thanks for the quick reply. Now I understand.