rstrivedi/Melting-Pot-Contest-2023

Evaluation doesn't show results for al_harvest and clean_up substrates, and unable to get evaluation working when use_attention is True

juandavidvargas19 opened this issue · 0 comments

We are starting to test attention mechanisms and we get no evaluation result both with the evaluation.py file as well as with the local_evaluation.py file. We use a working without attention configs.py file and set the attention parameters. We deactivate use_lstm and set use_attention. The evaluation.py results can be seen here: https://drive.google.com/drive/folders/1s2OIwmb_bFjUoJ9O_OnI2BG-GL_fk_gU?usp=sharing. Also, there is a sample here of the result when submitting as well as when doing local evaluation.
error_submission_oct_18.txt
output (1).txt