getao/icae

Does pretrain.py in code v2 support batch_size>1? Why do I get an error when I use Batch_size larger than 1

Closed this issue · 1 comments

WUHU-G commented
Does pretrain.py in code v2 support batch_size>1? Why do I get an error when I use Batch_size larger than 1
getao commented

yes, v2 implementation now only supports batch=1 because we didn't observe throughput improvement after increasing batch size.

v1 doesn't have this constraint.