chandar-lab/Recall2Imagine

Getting raw data for plots

Opened this issue · 1 comments

Hello, I wonder how can we get/generate the scores from the experiments of r2i. In the code, I saw the JSON logger writing to two files: 'metrics.jsonl' and 'scores.jsonl'. Neither of them has the same content format as the .json files under ./score in original DreamerV3 code, where each uncompressed .json file has the format:

task": "atari_battle_zone",
        "method": "dreamerv3",
        "seed": "3",
        "xs": [ ...],
        "ys": [ ...],

I'm trying to reproduce the results of r2i and am currently trying to plotting the performance curve. Thanks for your help!

Hi @LYK-love . We did all the logging for our work in wandb so I can export them and upload to our repo within the same format as DreamerV3 did. I will do that in a day or two.