oxwhirl/smac

Does rollout.py work with qmix?

nsa26 opened this issue · 0 comments

nsa26 commented

I am trying to evaluate qmix trained model using rollout.py but I am getting the following:

checkpoint: /home/ray_results/QMIX2/checkpoint_2/checkpoint-2
2021-03-22 17:27:39,867 INFO trainable.py:489 -- Current state after restoring: {'_iteration': 2, '_timesteps_total': None, '_time_total': 4.807272911071777, '_episodes_total': 200}
Traceback (most recent call last):
File "rollout.py", line 562, in
run(args, parser)
File "rollout.py", line 376, in run
True, None)
File "rollout.py", line 509, in rollout
policy_id=policy_id)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/agents/trainer.py", line 831, in compute_action
explore=explore)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/policy/policy.py", line 207, in compute_single_action
timestep=timestep)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/agents/qmix/qmix_policy.py", line 287, in compute_actions
explore=explore)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/exploration/epsilon_greedy.py", line 80, in get_exploration_action
timestep)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/exploration/epsilon_greedy.py", line 146, in _get_torch_exploration_action
epsilon = self.epsilon_schedule(self.last_timestep)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/schedules/schedule.py", line 45, in call
return self.value(t)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/schedules/schedule.py", line 40, in value
return self._value(t)
File "/home/.local/lib/python3.6/site-packages/ray/rllib/utils/schedules/piecewise_schedule.py", line 53, in _value
if l_t <= t < r_t:
TypeError: '<=' not supported between instances of 'int' and 'NoneType'