Comparison operator not supported for 'collections.OrderedDict'

[riathehl]

I'm trying to implement the TabularQAgent and I am running into the following error (in Python 3.8):

{TypeError}'<' not supported between instances of 'collections.OrderedDict' and 'collections.OrderedDict'

The error is thrown when max_q_state_action is defined on line 208 of tabular_q_agent.py (due to the max function).