One issue about pretrain-tv-init.bin file

I'm training the HERO model based on the provided TV dataset. The model needs to pre-load "pretrain-tv-init.bin" to initialize the network. However, I do not know how to obtain this file by ourselves, and I modified the code to ignore this file. But after the pre-training process is finished, the performance is really poor. Is "pretrain-tv-init.bin" essential? If so, how can we obtain this file from scratch?

HERO/scripts/download_tv_pretrain.sh

Line 37 in faaf15d

wget $BLOB/pretrained/pretrain-tv-init.bin -P $DOWNLOAD/pretrained/

@linjieli222

HERO/scripts/download_tv_pretrain.sh

Line 37 in faaf15d

wget $BLOB/pretrained/pretrain-tv-init.bin -P $DOWNLOAD/pretrained/

I know you provide this file. But I want to know what should we do to obtain this file totally by ourselves?

We obtained the RoBERTa pre-trained weights on TVR dataset from the original authors.

Closed due to inactivity.