namespace-Pt/GateFormers

Instruction

1. Download MIND dataset here
2. Save MIND dataset in a directory, e.g. ~/Data

3. pip install torch==1.9.1+cu111 -f https://download.pytorch.org/whl/torch_stable.html
   

4. python -m main.gateformer --world-size 2 --data-root ~/Data