Training an agent with WSL and sample-factory is not learning

[visuallization]

Training an agent with WSL and sample-factory is not learning.

When running on Linux: drl --trainer=sf --env=gdrl --env_path=examples/godot_rl_JumperHard/bin/JumperHard.x86_64 --num_workers=10 --experiment=JumperHard01 --viz --batched_sampling=True --speedup=8

The training looks something like this:

When running on WSL with the same command the training looks like this:

As you can see on Linux the agent actually learns, whereas on WSL the agent does not learn.

This might be related to this issue:
alex-petrenko/sample-factory#128

As stated in the issue you might be able to work around this by running the training on the CPU but it won't allow for large scale training.

[edbeeching]

Closing for now, but keeping pinned.