Logging for graphing

[slerman12]

The logging method used here is the Baselines logger, and it looks like the output of this logger (in the A2C Sonic code) is in training.txt. Is there a way to modify the logger code in model.py to output to a specific file (such as training.txt) and moreover, to do so in a format more accessible for graphing, such as CSV?

[slerman12]

Secondly, could this code possibly be modified such that reward is logged as well? I need to be able to graph the progress of the agent.