juliusfrost/dreamer-pytorch

main.py does not run on pytorch==1.5.0

juliusfrost opened this issue · 0 comments

main.py does not run in mac os. Because I don't use a mac to develop, I won't fix this, but someone else can take a crack at it!

It turns out, it was because PyTorch updated to 1.5.0 and the pip install for mac didn't specify a version number. It seems this error affects all os versions in 1.5.0.

Error log from the build:

2020-04-22T20:42:36.5876540Z Collecting pytest
2020-04-22T20:42:36.6195830Z   Downloading pytest-5.4.1-py3-none-any.whl (246 kB)
2020-04-22T20:42:36.8314650Z Collecting pytest-cov
2020-04-22T20:42:36.8405240Z   Downloading pytest_cov-2.8.1-py2.py3-none-any.whl (18 kB)
2020-04-22T20:42:37.1253830Z Collecting packaging
2020-04-22T20:42:37.1347300Z   Downloading packaging-20.3-py2.py3-none-any.whl (37 kB)
2020-04-22T20:42:37.2577280Z Collecting py>=1.5.0
2020-04-22T20:42:37.2647560Z   Downloading py-1.8.1-py2.py3-none-any.whl (83 kB)
2020-04-22T20:42:37.4000280Z Collecting pluggy<1.0,>=0.12
2020-04-22T20:42:37.4081120Z   Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
2020-04-22T20:42:37.5453000Z Collecting more-itertools>=4.0.0
2020-04-22T20:42:37.5524190Z   Downloading more_itertools-8.2.0-py3-none-any.whl (43 kB)
2020-04-22T20:42:37.6967750Z Collecting attrs>=17.4.0
2020-04-22T20:42:37.7051850Z   Downloading attrs-19.3.0-py2.py3-none-any.whl (39 kB)
2020-04-22T20:42:37.9789450Z Collecting importlib-metadata>=0.12; python_version < "3.8"
2020-04-22T20:42:37.9865520Z   Downloading importlib_metadata-1.6.0-py2.py3-none-any.whl (30 kB)
2020-04-22T20:42:38.1663180Z Collecting wcwidth
2020-04-22T20:42:38.1730610Z   Downloading wcwidth-0.1.9-py2.py3-none-any.whl (19 kB)
2020-04-22T20:42:39.4831290Z Collecting coverage>=4.4
2020-04-22T20:42:39.4918760Z   Downloading coverage-5.1-cp36-cp36m-macosx_10_13_x86_64.whl (203 kB)
2020-04-22T20:42:39.7908350Z Requirement already satisfied: six in /Users/runner/hostedtoolcache/Python/3.6.10/x64/lib/python3.6/site-packages (from packaging->pytest) (1.14.0)
2020-04-22T20:42:40.1113990Z Collecting pyparsing>=2.0.2
2020-04-22T20:42:40.1195300Z   Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
2020-04-22T20:42:40.2541140Z Collecting zipp>=0.5
2020-04-22T20:42:40.2603170Z   Downloading zipp-3.1.0-py3-none-any.whl (4.9 kB)
2020-04-22T20:42:40.7142020Z Installing collected packages: pyparsing, packaging, py, zipp, importlib-metadata, pluggy, more-itertools, attrs, wcwidth, pytest, coverage, pytest-cov
2020-04-22T20:42:42.0165720Z Successfully installed attrs-19.3.0 coverage-5.1 importlib-metadata-1.6.0 more-itertools-8.2.0 packaging-20.3 pluggy-0.13.1 py-1.8.1 pyparsing-2.4.7 pytest-5.4.1 pytest-cov-2.8.1 wcwidth-0.1.9 zipp-3.1.0
2020-04-22T20:42:43.0003890Z ============================= test session starts ==============================
2020-04-22T20:42:43.0007750Z platform darwin -- Python 3.6.10, pytest-5.4.1, py-1.8.1, pluggy-0.13.1
2020-04-22T20:42:43.0061510Z rootdir: /Users/runner/runners/2.169.0/work/dreamer-pytorch/dreamer-pytorch
2020-04-22T20:42:43.0062060Z plugins: cov-2.8.1
2020-04-22T20:42:51.8153180Z collected 18 items
2020-04-22T20:42:51.8160320Z 
2020-04-22T20:42:54.6529430Z tests/dreamer/test_main.py F                                             [  5%]
2020-04-22T20:42:54.6733660Z tests/dreamer/models/test_action.py ....                                 [ 27%]
2020-04-22T20:42:54.8353140Z tests/dreamer/models/test_agent.py ...                                   [ 44%]
2020-04-22T20:42:54.8440990Z tests/dreamer/models/test_dense.py ..                                    [ 55%]
2020-04-22T20:42:54.8464560Z tests/dreamer/models/test_distribution.py .                              [ 61%]
2020-04-22T20:42:55.3288250Z tests/dreamer/models/test_observation.py .....                           [ 88%]
2020-04-22T20:42:55.6524340Z tests/dreamer/models/test_rnns.py ..                                     [100%]
2020-04-22T20:42:55.6524610Z 
2020-04-22T20:42:55.6527570Z =================================== FAILURES ===================================
2020-04-22T20:42:55.6527860Z __________________________________ test_main ___________________________________
2020-04-22T20:42:55.6527920Z 
2020-04-22T20:42:55.6529400Z     def test_main():
2020-04-22T20:42:55.6530410Z         logdir = 'data/tests/'
2020-04-22T20:42:55.6530610Z >       build_and_train(logdir)
2020-04-22T20:42:55.6530660Z 
2020-04-22T20:42:55.6530780Z tests/dreamer/test_main.py:63: 
2020-04-22T20:42:55.6531140Z _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
2020-04-22T20:42:55.6532490Z tests/dreamer/test_main.py:58: in build_and_train
2020-04-22T20:42:55.6532630Z     runner.train()
2020-04-22T20:42:55.6534550Z /Users/runner/hostedtoolcache/Python/3.6.10/x64/lib/python3.6/site-packages/rlpyt/runners/minibatch_rl.py:259: in train
2020-04-22T20:42:55.6534760Z     opt_info = self.algo.optimize_agent(itr, samples)
2020-04-22T20:42:55.6535470Z dreamer/algos/dreamer_algo.py:152: in optimize_agent
2020-04-22T20:42:55.6535770Z     actor_loss.backward()
2020-04-22T20:42:55.6537470Z /Users/runner/hostedtoolcache/Python/3.6.10/x64/lib/python3.6/site-packages/torch/tensor.py:198: in backward
2020-04-22T20:42:55.6537860Z     torch.autograd.backward(self, gradient, retain_graph, create_graph)
2020-04-22T20:42:55.6539330Z _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
2020-04-22T20:42:55.6539440Z 
2020-04-22T20:42:55.6540780Z tensors = (tensor(0.0182, grad_fn=<NegBackward>),), grad_tensors = (tensor(1.),)
2020-04-22T20:42:55.6541740Z retain_graph = False, create_graph = False, grad_variables = None
2020-04-22T20:42:55.6541830Z 
2020-04-22T20:42:55.6543880Z     def backward(tensors, grad_tensors=None, retain_graph=None, create_graph=False, grad_variables=None):
2020-04-22T20:42:55.6545170Z         r"""Computes the sum of gradients of given tensors w.r.t. graph leaves.
2020-04-22T20:42:55.6545330Z     
2020-04-22T20:42:55.6546700Z         The graph is differentiated using the chain rule. If any of ``tensors``
2020-04-22T20:42:55.6547560Z         are non-scalar (i.e. their data has more than one element) and require
2020-04-22T20:42:55.6548400Z         gradient, then the Jacobian-vector product would be computed, in this
2020-04-22T20:42:55.6549220Z         case the function additionally requires specifying ``grad_tensors``.
2020-04-22T20:42:55.6549570Z         It should be a sequence of matching length, that contains the "vector"
2020-04-22T20:42:55.6551040Z         in the Jacobian-vector product, usually the gradient of the differentiated
2020-04-22T20:42:55.6551510Z         function w.r.t. corresponding tensors (``None`` is an acceptable value for
2020-04-22T20:42:55.6553210Z         all tensors that don't need gradient tensors).
2020-04-22T20:42:55.6553350Z     
2020-04-22T20:42:55.6553850Z         This function accumulates gradients in the leaves - you might need to zero
2020-04-22T20:42:55.6554030Z         them before calling it.
2020-04-22T20:42:55.6554210Z     
2020-04-22T20:42:55.6555190Z         Arguments:
2020-04-22T20:42:55.6556250Z             tensors (sequence of Tensor): Tensors of which the derivative will be
2020-04-22T20:42:55.6556430Z                 computed.
2020-04-22T20:42:55.6558330Z             grad_tensors (sequence of (Tensor or None)): The "vector" in the Jacobian-vector
2020-04-22T20:42:55.6558920Z                 product, usually gradients w.r.t. each element of corresponding tensors.
2020-04-22T20:42:55.6559670Z                 None values can be specified for scalar Tensors or ones that don't require
2020-04-22T20:42:55.6560480Z                 grad. If a None value would be acceptable for all grad_tensors, then this
2020-04-22T20:42:55.6560680Z                 argument is optional.
2020-04-22T20:42:55.6562090Z             retain_graph (bool, optional): If ``False``, the graph used to compute the grad
2020-04-22T20:42:55.6562230Z                 will be freed. Note that in nearly all cases setting this option to ``True``
2020-04-22T20:42:55.6563730Z                 is not needed and often can be worked around in a much more efficient
2020-04-22T20:42:55.6563960Z                 way. Defaults to the value of ``create_graph``.
2020-04-22T20:42:55.6565200Z             create_graph (bool, optional): If ``True``, graph of the derivative will
2020-04-22T20:42:55.6565750Z                 be constructed, allowing to compute higher order derivative products.
2020-04-22T20:42:55.6566350Z                 Defaults to ``False``.
2020-04-22T20:42:55.6566470Z         """
2020-04-22T20:42:55.6567060Z         if grad_variables is not None:
2020-04-22T20:42:55.6568310Z             warnings.warn("'grad_variables' is deprecated. Use 'grad_tensors' instead.")
2020-04-22T20:42:55.6568530Z             if grad_tensors is None:
2020-04-22T20:42:55.6569320Z                 grad_tensors = grad_variables
2020-04-22T20:42:55.6569490Z             else:
2020-04-22T20:42:55.6571150Z                 raise RuntimeError("'grad_tensors' and 'grad_variables' (deprecated) "
2020-04-22T20:42:55.6571360Z                                    "arguments both passed to backward(). Please only "
2020-04-22T20:42:55.6572000Z                                    "use 'grad_tensors'.")
2020-04-22T20:42:55.6572180Z     
2020-04-22T20:42:55.6577090Z         tensors = (tensors,) if isinstance(tensors, torch.Tensor) else tuple(tensors)
2020-04-22T20:42:55.6577350Z     
2020-04-22T20:42:55.6577520Z         if grad_tensors is None:
2020-04-22T20:42:55.6577790Z             grad_tensors = [None] * len(tensors)
2020-04-22T20:42:55.6578960Z         elif isinstance(grad_tensors, torch.Tensor):
2020-04-22T20:42:55.6579360Z             grad_tensors = [grad_tensors]
2020-04-22T20:42:55.6579740Z         else:
2020-04-22T20:42:55.6580230Z             grad_tensors = list(grad_tensors)
2020-04-22T20:42:55.6580560Z     
2020-04-22T20:42:55.6581290Z         grad_tensors = _make_grads(tensors, grad_tensors)
2020-04-22T20:42:55.6582120Z         if retain_graph is None:
2020-04-22T20:42:55.6582300Z             retain_graph = create_graph
2020-04-22T20:42:55.6582870Z     
2020-04-22T20:42:55.6583350Z         Variable._execution_engine.run_backward(
2020-04-22T20:42:55.6583970Z             tensors, grad_tensors, retain_graph, create_graph,
2020-04-22T20:42:55.6584480Z >           allow_unreachable=True)  # allow_unreachable flag
2020-04-22T20:42:55.6587140Z E       RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation: [torch.FloatTensor [300, 1]], which is output 0 of TBackward, is at version 2; expected version 1 instead. Hint: enable anomaly detection to find the operation that failed to compute its gradient, with torch.autograd.set_detect_anomaly(True).
2020-04-22T20:42:55.6587270Z 
2020-04-22T20:42:55.6589120Z /Users/runner/hostedtoolcache/Python/3.6.10/x64/lib/python3.6/site-packages/torch/autograd/__init__.py:100: RuntimeError
2020-04-22T20:42:55.6590200Z ----------------------------- Captured stdout call -----------------------------
2020-04-22T20:42:55.6590800Z 2020-04-22 20:42:51.890607  | dreamer_pong_0 Runner  master CPU affinity: UNAVAILABLE MacOS.
2020-04-22T20:42:55.6591310Z 2020-04-22 20:42:51.890813  | dreamer_pong_0 Runner  master Torch threads: 1.
2020-04-22T20:42:55.6591770Z �[32musing seed 5737�[0m
2020-04-22T20:42:55.6592310Z 2020-04-22 20:42:54.065460  | dreamer_pong_0 Sampler decorrelating envs, max steps: 0
2020-04-22T20:42:55.6593190Z 2020-04-22 20:42:54.066371  | dreamer_pong_0 Serial Sampler initialized.
2020-04-22T20:42:55.6593700Z 2020-04-22 20:42:54.066464  | dreamer_pong_0 Running 20 iterations of minibatch RL.
2020-04-22T20:42:55.6594160Z 2020-04-22 20:42:54.067698  | dreamer_pong_0 Optimizing over 10 iterations.
2020-04-22T20:42:55.6594300Z Warning: No valid output stream.
2020-04-22T20:42:55.6594810Z 2020-04-22 20:42:54.139205  | dreamer_pong_0 itr #9 saving snapshot...
2020-04-22T20:42:55.6595280Z 2020-04-22 20:42:54.204652  | dreamer_pong_0 itr #9 saved
2020-04-22T20:42:55.6595770Z 2020-04-22 20:42:54.226654  | -----------------------------  ----------
2020-04-22T20:42:55.6596490Z 2020-04-22 20:42:54.226800  | Diagnostics/NewCompletedTrajs    0
2020-04-22T20:42:55.6597090Z 2020-04-22 20:42:54.227001  | Diagnostics/StepsInTrajWindow    0
2020-04-22T20:42:55.6597590Z 2020-04-22 20:42:54.227099  | Diagnostics/Iteration            9
2020-04-22T20:42:55.6598070Z 2020-04-22 20:42:54.227242  | Diagnostics/CumTime (s)          0.137128
2020-04-22T20:42:55.6598560Z 2020-04-22 20:42:54.227420  | Diagnostics/CumSteps            10
2020-04-22T20:42:55.6598990Z 2020-04-22 20:42:54.227517  | Diagnostics/CumCompletedTrajs    0
2020-04-22T20:42:55.6599470Z 2020-04-22 20:42:54.227582  | Diagnostics/CumUpdates           0
2020-04-22T20:42:55.6599950Z 2020-04-22 20:42:54.227731  | Diagnostics/StepsPerSecond      72.9245
2020-04-22T20:42:55.6600420Z 2020-04-22 20:42:54.227937  | Diagnostics/UpdatesPerSecond     0
2020-04-22T20:42:55.6600900Z 2020-04-22 20:42:54.228049  | Diagnostics/ReplayRatio          0
2020-04-22T20:42:55.6601340Z 2020-04-22 20:42:54.228121  | Diagnostics/CumReplayRatio       0
2020-04-22T20:42:55.6601820Z 2020-04-22 20:42:54.228331  | loss/Average                   nan
2020-04-22T20:42:55.6602380Z 2020-04-22 20:42:54.228460  | loss/Std                       nan
2020-04-22T20:42:55.6602870Z 2020-04-22 20:42:54.228529  | loss/Median                    nan
2020-04-22T20:42:55.6603320Z 2020-04-22 20:42:54.228627  | loss/Min                       nan
2020-04-22T20:42:55.6603790Z 2020-04-22 20:42:54.228784  | loss/Max                       nan
2020-04-22T20:42:55.6604270Z 2020-04-22 20:42:54.228888  | model_loss/Average             nan
2020-04-22T20:42:55.6604730Z 2020-04-22 20:42:54.228953  | model_loss/Std                 nan
2020-04-22T20:42:55.6605210Z 2020-04-22 20:42:54.229017  | model_loss/Median              nan
2020-04-22T20:42:55.6605640Z 2020-04-22 20:42:54.229254  | model_loss/Min                 nan
2020-04-22T20:42:55.6606520Z 2020-04-22 20:42:54.229476  | model_loss/Max                 nan
2020-04-22T20:42:55.6607260Z 2020-04-22 20:42:54.229558  | actor_loss/Average             nan
2020-04-22T20:42:55.6607780Z 2020-04-22 20:42:54.229625  | actor_loss/Std                 nan
2020-04-22T20:42:55.6608230Z 2020-04-22 20:42:54.229818  | actor_loss/Median              nan
2020-04-22T20:42:55.6608710Z 2020-04-22 20:42:54.229951  | actor_loss/Min                 nan
2020-04-22T20:42:55.6609210Z 2020-04-22 20:42:54.230024  | actor_loss/Max                 nan
2020-04-22T20:42:55.6609680Z 2020-04-22 20:42:54.230090  | value_loss/Average             nan
2020-04-22T20:42:55.6610160Z 2020-04-22 20:42:54.230197  | value_loss/Std                 nan
2020-04-22T20:42:55.6610590Z 2020-04-22 20:42:54.230384  | value_loss/Median              nan
2020-04-22T20:42:55.6611080Z 2020-04-22 20:42:54.230493  | value_loss/Min                 nan
2020-04-22T20:42:55.6611560Z 2020-04-22 20:42:54.230618  | value_loss/Max                 nan
2020-04-22T20:42:55.6612020Z 2020-04-22 20:42:54.230844  | prior_entropy/Average          nan
2020-04-22T20:42:55.6612510Z 2020-04-22 20:42:54.230915  | prior_entropy/Std              nan
2020-04-22T20:42:55.6613100Z 2020-04-22 20:42:54.231061  | prior_entropy/Median           nan
2020-04-22T20:42:55.6613590Z 2020-04-22 20:42:54.231234  | prior_entropy/Min              nan
2020-04-22T20:42:55.6614030Z 2020-04-22 20:42:54.231336  | prior_entropy/Max              nan
2020-04-22T20:42:55.6614920Z 2020-04-22 20:42:54.231451  | post_entropy/Average           nan
2020-04-22T20:42:55.6615410Z 2020-04-22 20:42:54.231570  | post_entropy/Std               nan
2020-04-22T20:42:55.6615880Z 2020-04-22 20:42:54.231637  | post_entropy/Median            nan
2020-04-22T20:42:55.6616320Z 2020-04-22 20:42:54.231701  | post_entropy/Min               nan
2020-04-22T20:42:55.6616800Z 2020-04-22 20:42:54.231813  | post_entropy/Max               nan
2020-04-22T20:42:55.6617340Z 2020-04-22 20:42:54.231878  | divergence/Average             nan
2020-04-22T20:42:55.6617820Z 2020-04-22 20:42:54.231942  | divergence/Std                 nan
2020-04-22T20:42:55.6618300Z 2020-04-22 20:42:54.232005  | divergence/Median              nan
2020-04-22T20:42:55.6618990Z 2020-04-22 20:42:54.232069  | divergence/Min                 nan
2020-04-22T20:42:55.6619560Z 2020-04-22 20:42:54.232132  | divergence/Max                 nan
2020-04-22T20:42:55.6620040Z 2020-04-22 20:42:54.232195  | reward_loss/Average            nan
2020-04-22T20:42:55.6620530Z 2020-04-22 20:42:54.232259  | reward_loss/Std                nan
2020-04-22T20:42:55.6621010Z 2020-04-22 20:42:54.232322  | reward_loss/Median             nan
2020-04-22T20:42:55.6621440Z 2020-04-22 20:42:54.232386  | reward_loss/Min                nan
2020-04-22T20:42:55.6621930Z 2020-04-22 20:42:54.232449  | reward_loss/Max                nan
2020-04-22T20:42:55.6622420Z 2020-04-22 20:42:54.232512  | image_loss/Average             nan
2020-04-22T20:42:55.6622890Z 2020-04-22 20:42:54.232611  | image_loss/Std                 nan
2020-04-22T20:42:55.6623330Z 2020-04-22 20:42:54.232688  | image_loss/Median              nan
2020-04-22T20:42:55.6623810Z 2020-04-22 20:42:54.232743  | image_loss/Min                 nan
2020-04-22T20:42:55.6624300Z 2020-04-22 20:42:54.232796  | image_loss/Max                 nan
2020-04-22T20:42:55.6624850Z 2020-04-22 20:42:54.232850  | -----------------------------  ----------
2020-04-22T20:42:55.6625360Z 2020-04-22 20:42:54.233423  | dreamer_pong_0 itr #9 Optimizing over 10 iterations.
2020-04-22T20:42:55.6625470Z Warning: No valid output stream.
2020-04-22T20:42:55.6625930Z ----------------------------- Captured stderr call -----------------------------
2020-04-22T20:42:55.6626040Z 
2020-04-22T20:42:55.6626120Z Imagination:   0%|          | 0/1 [00:00<?, ?it/s]
2020-04-22T20:42:55.6626230Z Imagination:   0%|          | 0/1 [00:00<?, ?it/s]
2020-04-22T20:42:55.6626320Z 
2020-04-22T20:42:55.6626750Z ---------- coverage: platform darwin, python 3.6.10-final-0 ----------
2020-04-22T20:42:55.6626860Z Coverage XML written to file coverage.xml
2020-04-22T20:42:55.6626910Z 
2020-04-22T20:42:55.6627070Z =========================== short test summary info ============================
2020-04-22T20:42:55.6628160Z FAILED tests/dreamer/test_main.py::test_main - RuntimeError: one of the varia...
2020-04-22T20:42:55.6628320Z ======================== 1 failed, 17 passed in 12.66s =========================
2020-04-22T20:42:55.7923550Z ##[error]Process completed with exit code 1.

Error with anomaly detection:

2020-04-22T21:21:18.5506060Z ##[group]Run pip install pytest pytest-cov
2020-04-22T21:21:18.5506380Z �[36;1mpip install pytest pytest-cov�[0m
2020-04-22T21:21:18.5506460Z �[36;1mpytest tests --cov=dreamer --cov-report=xml�[0m
2020-04-22T21:21:18.5668270Z shell: /bin/bash -e {0}
2020-04-22T21:21:18.5668470Z env:
2020-04-22T21:21:18.5668610Z   pythonLocation: /Users/runner/hostedtoolcache/Python/3.7.6/x64
2020-04-22T21:21:18.5668740Z ##[endgroup]
2020-04-22T21:21:19.6524770Z Collecting pytest
2020-04-22T21:21:19.6826470Z   Downloading pytest-5.4.1-py3-none-any.whl (246 kB)
2020-04-22T21:21:19.9416970Z Collecting pytest-cov
2020-04-22T21:21:19.9484140Z   Downloading pytest_cov-2.8.1-py2.py3-none-any.whl (18 kB)
2020-04-22T21:21:20.0467580Z Collecting wcwidth
2020-04-22T21:21:20.0575740Z   Downloading wcwidth-0.1.9-py2.py3-none-any.whl (19 kB)
2020-04-22T21:21:20.1687880Z Collecting py>=1.5.0
2020-04-22T21:21:20.1749250Z   Downloading py-1.8.1-py2.py3-none-any.whl (83 kB)
2020-04-22T21:21:20.4829230Z Collecting importlib-metadata>=0.12; python_version < "3.8"
2020-04-22T21:21:20.4914430Z   Downloading importlib_metadata-1.6.0-py2.py3-none-any.whl (30 kB)
2020-04-22T21:21:20.5889610Z Collecting pluggy<1.0,>=0.12
2020-04-22T21:21:20.5957990Z   Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
2020-04-22T21:21:20.7772780Z Collecting packaging
2020-04-22T21:21:20.7841680Z   Downloading packaging-20.3-py2.py3-none-any.whl (37 kB)
2020-04-22T21:21:20.9053280Z Collecting more-itertools>=4.0.0
2020-04-22T21:21:20.9122460Z   Downloading more_itertools-8.2.0-py3-none-any.whl (43 kB)
2020-04-22T21:21:21.0086450Z Collecting attrs>=17.4.0
2020-04-22T21:21:21.0162000Z   Downloading attrs-19.3.0-py2.py3-none-any.whl (39 kB)
2020-04-22T21:21:21.8292050Z Collecting coverage>=4.4
2020-04-22T21:21:21.8397260Z   Downloading coverage-5.1-cp37-cp37m-macosx_10_13_x86_64.whl (203 kB)
2020-04-22T21:21:21.9922260Z Collecting zipp>=0.5
2020-04-22T21:21:22.0005150Z   Downloading zipp-3.1.0-py3-none-any.whl (4.9 kB)
2020-04-22T21:21:22.0293940Z Requirement already satisfied: six in /Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages (from packaging->pytest) (1.14.0)
2020-04-22T21:21:22.2198340Z Collecting pyparsing>=2.0.2
2020-04-22T21:21:22.2269270Z   Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
2020-04-22T21:21:22.5346110Z Installing collected packages: wcwidth, py, zipp, importlib-metadata, pluggy, pyparsing, packaging, more-itertools, attrs, pytest, coverage, pytest-cov
2020-04-22T21:21:23.6225720Z Successfully installed attrs-19.3.0 coverage-5.1 importlib-metadata-1.6.0 more-itertools-8.2.0 packaging-20.3 pluggy-0.13.1 py-1.8.1 pyparsing-2.4.7 pytest-5.4.1 pytest-cov-2.8.1 wcwidth-0.1.9 zipp-3.1.0
2020-04-22T21:21:24.3545700Z ============================= test session starts ==============================
2020-04-22T21:21:24.3553280Z platform darwin -- Python 3.7.6, pytest-5.4.1, py-1.8.1, pluggy-0.13.1
2020-04-22T21:21:24.3614370Z rootdir: /Users/runner/runners/2.169.0/work/dreamer-pytorch/dreamer-pytorch
2020-04-22T21:21:24.3615030Z plugins: cov-2.8.1
2020-04-22T21:21:33.8253480Z collected 18 items
2020-04-22T21:21:33.8262020Z 
2020-04-22T21:21:37.2885550Z tests/dreamer/test_main.py F                                             [  5%]
2020-04-22T21:21:37.4517150Z tests/dreamer/models/test_action.py ....                                 [ 27%]
2020-04-22T21:21:38.0522990Z tests/dreamer/models/test_agent.py ...                                   [ 44%]
2020-04-22T21:21:38.1096380Z tests/dreamer/models/test_dense.py ..                                    [ 55%]
2020-04-22T21:21:38.1124260Z tests/dreamer/models/test_distribution.py .                              [ 61%]
2020-04-22T21:21:38.7461140Z tests/dreamer/models/test_observation.py .....                           [ 88%]
2020-04-22T21:21:40.0865880Z tests/dreamer/models/test_rnns.py ..                                     [100%]
2020-04-22T21:21:40.0866590Z 
2020-04-22T21:21:40.0867820Z =================================== FAILURES ===================================
2020-04-22T21:21:40.0868040Z __________________________________ test_main ___________________________________
2020-04-22T21:21:40.0868100Z 
2020-04-22T21:21:40.0868240Z     def test_main():
2020-04-22T21:21:40.0869190Z         logdir = 'data/tests/'
2020-04-22T21:21:40.0869290Z >       build_and_train(logdir)
2020-04-22T21:21:40.0869380Z 
2020-04-22T21:21:40.0869500Z tests/dreamer/test_main.py:63: 
2020-04-22T21:21:40.0869590Z _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
2020-04-22T21:21:40.0869740Z tests/dreamer/test_main.py:58: in build_and_train
2020-04-22T21:21:40.0869860Z     runner.train()
2020-04-22T21:21:40.0870740Z /Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/rlpyt/runners/minibatch_rl.py:259: in train
2020-04-22T21:21:40.0871270Z     opt_info = self.algo.optimize_agent(itr, samples)
2020-04-22T21:21:40.0871420Z dreamer/algos/dreamer_algo.py:154: in optimize_agent
2020-04-22T21:21:40.0871570Z     actor_loss.backward()
2020-04-22T21:21:40.0872340Z /Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/torch/tensor.py:198: in backward
2020-04-22T21:21:40.0873600Z     torch.autograd.backward(self, gradient, retain_graph, create_graph)
2020-04-22T21:21:40.0874080Z _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
2020-04-22T21:21:40.0874810Z 
2020-04-22T21:21:40.0875570Z tensors = (tensor(-0.2482, grad_fn=<NegBackward>),)
2020-04-22T21:21:40.0876050Z grad_tensors = (tensor(1.),), retain_graph = False, create_graph = False
2020-04-22T21:21:40.0876240Z grad_variables = None
2020-04-22T21:21:40.0876370Z 
2020-04-22T21:21:40.0876530Z     def backward(tensors, grad_tensors=None, retain_graph=None, create_graph=False, grad_variables=None):
2020-04-22T21:21:40.0877720Z         r"""Computes the sum of gradients of given tensors w.r.t. graph leaves.
2020-04-22T21:21:40.0877910Z     
2020-04-22T21:21:40.0878060Z         The graph is differentiated using the chain rule. If any of ``tensors``
2020-04-22T21:21:40.0878700Z         are non-scalar (i.e. their data has more than one element) and require
2020-04-22T21:21:40.0879210Z         gradient, then the Jacobian-vector product would be computed, in this
2020-04-22T21:21:40.0879390Z         case the function additionally requires specifying ``grad_tensors``.
2020-04-22T21:21:40.0879540Z         It should be a sequence of matching length, that contains the "vector"
2020-04-22T21:21:40.0880070Z         in the Jacobian-vector product, usually the gradient of the differentiated
2020-04-22T21:21:40.0880250Z         function w.r.t. corresponding tensors (``None`` is an acceptable value for
2020-04-22T21:21:40.0880740Z         all tensors that don't need gradient tensors).
2020-04-22T21:21:40.0880940Z     
2020-04-22T21:21:40.0881430Z         This function accumulates gradients in the leaves - you might need to zero
2020-04-22T21:21:40.0881620Z         them before calling it.
2020-04-22T21:21:40.0881740Z     
2020-04-22T21:21:40.0882160Z         Arguments:
2020-04-22T21:21:40.0882850Z             tensors (sequence of Tensor): Tensors of which the derivative will be
2020-04-22T21:21:40.0883360Z                 computed.
2020-04-22T21:21:40.0884550Z             grad_tensors (sequence of (Tensor or None)): The "vector" in the Jacobian-vector
2020-04-22T21:21:40.0884750Z                 product, usually gradients w.r.t. each element of corresponding tensors.
2020-04-22T21:21:40.0885540Z                 None values can be specified for scalar Tensors or ones that don't require
2020-04-22T21:21:40.0886160Z                 grad. If a None value would be acceptable for all grad_tensors, then this
2020-04-22T21:21:40.0886270Z                 argument is optional.
2020-04-22T21:21:40.0886630Z             retain_graph (bool, optional): If ``False``, the graph used to compute the grad
2020-04-22T21:21:40.0887210Z                 will be freed. Note that in nearly all cases setting this option to ``True``
2020-04-22T21:21:40.0888060Z                 is not needed and often can be worked around in a much more efficient
2020-04-22T21:21:40.0888320Z                 way. Defaults to the value of ``create_graph``.
2020-04-22T21:21:40.0888820Z             create_graph (bool, optional): If ``True``, graph of the derivative will
2020-04-22T21:21:40.0889420Z                 be constructed, allowing to compute higher order derivative products.
2020-04-22T21:21:40.0889750Z                 Defaults to ``False``.
2020-04-22T21:21:40.0889950Z         """
2020-04-22T21:21:40.0890400Z         if grad_variables is not None:
2020-04-22T21:21:40.0891350Z             warnings.warn("'grad_variables' is deprecated. Use 'grad_tensors' instead.")
2020-04-22T21:21:40.0891550Z             if grad_tensors is None:
2020-04-22T21:21:40.0891840Z                 grad_tensors = grad_variables
2020-04-22T21:21:40.0892230Z             else:
2020-04-22T21:21:40.0892880Z                 raise RuntimeError("'grad_tensors' and 'grad_variables' (deprecated) "
2020-04-22T21:21:40.0893100Z                                    "arguments both passed to backward(). Please only "
2020-04-22T21:21:40.0894040Z                                    "use 'grad_tensors'.")
2020-04-22T21:21:40.0894220Z     
2020-04-22T21:21:40.0894310Z         tensors = (tensors,) if isinstance(tensors, torch.Tensor) else tuple(tensors)
2020-04-22T21:21:40.0894460Z     
2020-04-22T21:21:40.0894780Z         if grad_tensors is None:
2020-04-22T21:21:40.0895260Z             grad_tensors = [None] * len(tensors)
2020-04-22T21:21:40.0895680Z         elif isinstance(grad_tensors, torch.Tensor):
2020-04-22T21:21:40.0896060Z             grad_tensors = [grad_tensors]
2020-04-22T21:21:40.0896200Z         else:
2020-04-22T21:21:40.0896610Z             grad_tensors = list(grad_tensors)
2020-04-22T21:21:40.0896790Z     
2020-04-22T21:21:40.0897320Z         grad_tensors = _make_grads(tensors, grad_tensors)
2020-04-22T21:21:40.0897600Z         if retain_graph is None:
2020-04-22T21:21:40.0898000Z             retain_graph = create_graph
2020-04-22T21:21:40.0898270Z     
2020-04-22T21:21:40.0898630Z         Variable._execution_engine.run_backward(
2020-04-22T21:21:40.0899000Z             tensors, grad_tensors, retain_graph, create_graph,
2020-04-22T21:21:40.0899540Z >           allow_unreachable=True)  # allow_unreachable flag
2020-04-22T21:21:40.0901920Z E       RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation: [torch.FloatTensor [300, 1]], which is output 0 of TBackward, is at version 2; expected version 1 instead. Hint: the backtrace further above shows the operation that failed to compute its gradient. The variable in question was changed in there or anywhere later. Good luck!
2020-04-22T21:21:40.0902060Z 
2020-04-22T21:21:40.0903330Z /Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/torch/autograd/__init__.py:100: RuntimeError
2020-04-22T21:21:40.0904240Z ----------------------------- Captured stdout call -----------------------------
2020-04-22T21:21:40.0904840Z 2020-04-22 21:21:33.965571  | dreamer_pong_0 Runner  master CPU affinity: UNAVAILABLE MacOS.
2020-04-22T21:21:40.0905360Z 2020-04-22 21:21:33.965814  | dreamer_pong_0 Runner  master Torch threads: 1.
2020-04-22T21:21:40.0905860Z �[32musing seed 3925�[0m
2020-04-22T21:21:40.0906330Z 2020-04-22 21:21:36.152252  | dreamer_pong_0 Sampler decorrelating envs, max steps: 0
2020-04-22T21:21:40.0906850Z 2020-04-22 21:21:36.153202  | dreamer_pong_0 Serial Sampler initialized.
2020-04-22T21:21:40.0907380Z 2020-04-22 21:21:36.153295  | dreamer_pong_0 Running 20 iterations of minibatch RL.
2020-04-22T21:21:40.0908340Z 2020-04-22 21:21:36.154483  | dreamer_pong_0 Optimizing over 10 iterations.
2020-04-22T21:21:40.0908500Z Warning: No valid output stream.
2020-04-22T21:21:40.0909000Z 2020-04-22 21:21:36.221418  | dreamer_pong_0 itr #9 saving snapshot...
2020-04-22T21:21:40.0909490Z 2020-04-22 21:21:36.296967  | dreamer_pong_0 itr #9 saved
2020-04-22T21:21:40.0909940Z 2020-04-22 21:21:36.321011  | -----------------------------  ----------
2020-04-22T21:21:40.0910730Z 2020-04-22 21:21:36.321133  | Diagnostics/NewCompletedTrajs    0
2020-04-22T21:21:40.0911310Z 2020-04-22 21:21:36.321347  | Diagnostics/StepsInTrajWindow    0
2020-04-22T21:21:40.0911810Z 2020-04-22 21:21:36.321423  | Diagnostics/Iteration            9
2020-04-22T21:21:40.0912320Z 2020-04-22 21:21:36.321491  | Diagnostics/CumTime (s)          0.142672
2020-04-22T21:21:40.0912780Z 2020-04-22 21:21:36.321568  | Diagnostics/CumSteps            10
2020-04-22T21:21:40.0913290Z 2020-04-22 21:21:36.321764  | Diagnostics/CumCompletedTrajs    0
2020-04-22T21:21:40.0913810Z 2020-04-22 21:21:36.321852  | Diagnostics/CumUpdates           0
2020-04-22T21:21:40.0914300Z 2020-04-22 21:21:36.321923  | Diagnostics/StepsPerSecond      70.0909
2020-04-22T21:21:40.0914760Z 2020-04-22 21:21:36.321999  | Diagnostics/UpdatesPerSecond     0
2020-04-22T21:21:40.0915250Z 2020-04-22 21:21:36.322199  | Diagnostics/ReplayRatio          0
2020-04-22T21:21:40.0915750Z 2020-04-22 21:21:36.322296  | Diagnostics/CumReplayRatio       0
2020-04-22T21:21:40.0916230Z 2020-04-22 21:21:36.322368  | loss/Average                   nan
2020-04-22T21:21:40.0916730Z 2020-04-22 21:21:36.322471  | loss/Std                       nan
2020-04-22T21:21:40.0917260Z 2020-04-22 21:21:36.322661  | loss/Median                    nan
2020-04-22T21:21:40.0917760Z 2020-04-22 21:21:36.322733  | loss/Min                       nan
2020-04-22T21:21:40.0918270Z 2020-04-22 21:21:36.322801  | loss/Max                       nan
2020-04-22T21:21:40.0918750Z 2020-04-22 21:21:36.322870  | model_loss/Average             nan
2020-04-22T21:21:40.0919210Z 2020-04-22 21:21:36.322946  | model_loss/Std                 nan
2020-04-22T21:21:40.0919710Z 2020-04-22 21:21:36.323139  | model_loss/Median              nan
2020-04-22T21:21:40.0920200Z 2020-04-22 21:21:36.323212  | model_loss/Min                 nan
2020-04-22T21:21:40.0920680Z 2020-04-22 21:21:36.323280  | model_loss/Max                 nan
2020-04-22T21:21:40.0921180Z 2020-04-22 21:21:36.323378  | actor_loss/Average             nan
2020-04-22T21:21:40.0921640Z 2020-04-22 21:21:36.323574  | actor_loss/Std                 nan
2020-04-22T21:21:40.0922130Z 2020-04-22 21:21:36.323646  | actor_loss/Median              nan
2020-04-22T21:21:40.0922630Z 2020-04-22 21:21:36.323725  | actor_loss/Min                 nan
2020-04-22T21:21:40.0923120Z 2020-04-22 21:21:36.323793  | actor_loss/Max                 nan
2020-04-22T21:21:40.0923570Z 2020-04-22 21:21:36.323862  | value_loss/Average             nan
2020-04-22T21:21:40.0924080Z 2020-04-22 21:21:36.323930  | value_loss/Std                 nan
2020-04-22T21:21:40.0924580Z 2020-04-22 21:21:36.323997  | value_loss/Median              nan
2020-04-22T21:21:40.0925060Z 2020-04-22 21:21:36.324065  | value_loss/Min                 nan
2020-04-22T21:21:40.0925560Z 2020-04-22 21:21:36.324133  | value_loss/Max                 nan
2020-04-22T21:21:40.0926010Z 2020-04-22 21:21:36.324200  | prior_entropy/Average          nan
2020-04-22T21:21:40.0926510Z 2020-04-22 21:21:36.324268  | prior_entropy/Std              nan
2020-04-22T21:21:40.0927100Z 2020-04-22 21:21:36.324336  | prior_entropy/Median           nan
2020-04-22T21:21:40.0927610Z 2020-04-22 21:21:36.324405  | prior_entropy/Min              nan
2020-04-22T21:21:40.0928120Z 2020-04-22 21:21:36.324598  | prior_entropy/Max              nan
2020-04-22T21:21:40.0928600Z 2020-04-22 21:21:36.324691  | post_entropy/Average           nan
2020-04-22T21:21:40.0929100Z 2020-04-22 21:21:36.324784  | post_entropy/Std               nan
2020-04-22T21:21:40.0929870Z 2020-04-22 21:21:36.324953  | post_entropy/Median            nan
2020-04-22T21:21:40.0930380Z 2020-04-22 21:21:36.325047  | post_entropy/Min               nan
2020-04-22T21:21:40.0930870Z 2020-04-22 21:21:36.325138  | post_entropy/Max               nan
2020-04-22T21:21:40.0931360Z 2020-04-22 21:21:36.325308  | divergence/Average             nan
2020-04-22T21:21:40.0931810Z 2020-04-22 21:21:36.325401  | divergence/Std                 nan
2020-04-22T21:21:40.0932560Z 2020-04-22 21:21:36.325471  | divergence/Median              nan
2020-04-22T21:21:40.0933860Z 2020-04-22 21:21:36.325574  | divergence/Min                 nan
2020-04-22T21:21:40.0934380Z 2020-04-22 21:21:36.325738  | divergence/Max                 nan
2020-04-22T21:21:40.0934880Z 2020-04-22 21:21:36.325838  | reward_loss/Average            nan
2020-04-22T21:21:40.0935330Z 2020-04-22 21:21:36.325916  | reward_loss/Std                nan
2020-04-22T21:21:40.0935830Z 2020-04-22 21:21:36.326030  | reward_loss/Median             nan
2020-04-22T21:21:40.0936340Z 2020-04-22 21:21:36.326099  | reward_loss/Min                nan
2020-04-22T21:21:40.0936820Z 2020-04-22 21:21:36.326167  | reward_loss/Max                nan
2020-04-22T21:21:40.0937360Z 2020-04-22 21:21:36.326234  | image_loss/Average             nan
2020-04-22T21:21:40.0937860Z 2020-04-22 21:21:36.326332  | image_loss/Std                 nan
2020-04-22T21:21:40.0938370Z 2020-04-22 21:21:36.326405  | image_loss/Median              nan
2020-04-22T21:21:40.0938860Z 2020-04-22 21:21:36.326462  | image_loss/Min                 nan
2020-04-22T21:21:40.0939370Z 2020-04-22 21:21:36.326517  | image_loss/Max                 nan
2020-04-22T21:21:40.0939820Z 2020-04-22 21:21:36.326572  | -----------------------------  ----------
2020-04-22T21:21:40.0940350Z 2020-04-22 21:21:36.327139  | dreamer_pong_0 itr #9 Optimizing over 10 iterations.
2020-04-22T21:21:40.0940510Z Warning: No valid output stream.
2020-04-22T21:21:40.0941000Z ----------------------------- Captured stderr call -----------------------------
2020-04-22T21:21:40.0941090Z 
2020-04-22T21:21:40.0941220Z Imagination:   0%|          | 0/1 [00:00<?, ?it/s]Warning: Error detected in MmBackward. Traceback of forward call that caused the error:
2020-04-22T21:21:40.0942520Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/bin/pytest", line 8, in <module>
2020-04-22T21:21:40.0942780Z     sys.exit(main())
2020-04-22T21:21:40.0943550Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/config/__init__.py", line 125, in main
2020-04-22T21:21:40.0943720Z     config=config
2020-04-22T21:21:40.0944290Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/hooks.py", line 286, in __call__
2020-04-22T21:21:40.0944470Z     return self._hookexec(self, self.get_hookimpls(), kwargs)
2020-04-22T21:21:40.0945060Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/manager.py", line 93, in _hookexec
2020-04-22T21:21:40.0945240Z     return self._inner_hookexec(hook, methods, kwargs)
2020-04-22T21:21:40.0945850Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/manager.py", line 87, in <lambda>
2020-04-22T21:21:40.0946020Z     firstresult=hook.spec.opts.get("firstresult") if hook.spec else False,
2020-04-22T21:21:40.0946630Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/callers.py", line 187, in _multicall
2020-04-22T21:21:40.0946760Z     res = hook_impl.function(*args)
2020-04-22T21:21:40.0947370Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/main.py", line 240, in pytest_cmdline_main
2020-04-22T21:21:40.0947550Z     return wrap_session(config, _main)
2020-04-22T21:21:40.0948160Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/main.py", line 191, in wrap_session
2020-04-22T21:21:40.0948310Z     session.exitstatus = doit(config, session) or 0
2020-04-22T21:21:40.0948910Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/main.py", line 247, in _main
2020-04-22T21:21:40.0949410Z     config.hook.pytest_runtestloop(session=session)
2020-04-22T21:21:40.0950060Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/hooks.py", line 286, in __call__
2020-04-22T21:21:40.0950240Z     return self._hookexec(self, self.get_hookimpls(), kwargs)
2020-04-22T21:21:40.0951170Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/manager.py", line 93, in _hookexec
2020-04-22T21:21:40.0951340Z     return self._inner_hookexec(hook, methods, kwargs)
2020-04-22T21:21:40.0951950Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/manager.py", line 87, in <lambda>
2020-04-22T21:21:40.0952080Z     firstresult=hook.spec.opts.get("firstresult") if hook.spec else False,
2020-04-22T21:21:40.0952690Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/callers.py", line 187, in _multicall
2020-04-22T21:21:40.0952820Z     res = hook_impl.function(*args)
2020-04-22T21:21:40.0953430Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/main.py", line 272, in pytest_runtestloop
2020-04-22T21:21:40.0953620Z     item.config.hook.pytest_runtest_protocol(item=item, nextitem=nextitem)
2020-04-22T21:21:40.0954230Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/hooks.py", line 286, in __call__
2020-04-22T21:21:40.0954380Z     return self._hookexec(self, self.get_hookimpls(), kwargs)
2020-04-22T21:21:40.0954990Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/manager.py", line 93, in _hookexec
2020-04-22T21:21:40.0955110Z     return self._inner_hookexec(hook, methods, kwargs)
2020-04-22T21:21:40.0955710Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/manager.py", line 87, in <lambda>
2020-04-22T21:21:40.0955900Z     firstresult=hook.spec.opts.get("firstresult") if hook.spec else False,
2020-04-22T21:21:40.0956490Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/callers.py", line 187, in _multicall
2020-04-22T21:21:40.0956670Z     res = hook_impl.function(*args)
2020-04-22T21:21:40.0957280Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/runner.py", line 85, in pytest_runtest_protocol
2020-04-22T21:21:40.0957450Z     runtestprotocol(item, nextitem=nextitem)
2020-04-22T21:21:40.0958020Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/runner.py", line 100, in runtestprotocol
2020-04-22T21:21:40.0958160Z     reports.append(call_and_report(item, "call", log))
2020-04-22T21:21:40.0958770Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/runner.py", line 186, in call_and_report
2020-04-22T21:21:40.0958930Z     call = call_runtest_hook(item, when, **kwds)
2020-04-22T21:21:40.0959560Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/runner.py", line 217, in call_runtest_hook
2020-04-22T21:21:40.0959710Z     lambda: ihook(item=item, **kwds), when=when, reraise=reraise
2020-04-22T21:21:40.0960310Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/runner.py", line 244, in from_call
2020-04-22T21:21:40.0960430Z     result = func()
2020-04-22T21:21:40.0961030Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/runner.py", line 217, in <lambda>
2020-04-22T21:21:40.0961210Z     lambda: ihook(item=item, **kwds), when=when, reraise=reraise
2020-04-22T21:21:40.0961800Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/hooks.py", line 286, in __call__
2020-04-22T21:21:40.0961970Z     return self._hookexec(self, self.get_hookimpls(), kwargs)
2020-04-22T21:21:40.0962580Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/manager.py", line 93, in _hookexec
2020-04-22T21:21:40.0963060Z     return self._inner_hookexec(hook, methods, kwargs)
2020-04-22T21:21:40.0963650Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/manager.py", line 87, in <lambda>
2020-04-22T21:21:40.0963830Z     firstresult=hook.spec.opts.get("firstresult") if hook.spec else False,
2020-04-22T21:21:40.0964690Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/callers.py", line 187, in _multicall
2020-04-22T21:21:40.0964890Z     res = hook_impl.function(*args)
2020-04-22T21:21:40.0965560Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/runner.py", line 135, in pytest_runtest_call
2020-04-22T21:21:40.0965710Z     item.runtest()
2020-04-22T21:21:40.0966310Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/python.py", line 1479, in runtest
2020-04-22T21:21:40.0966440Z     self.ihook.pytest_pyfunc_call(pyfuncitem=self)
2020-04-22T21:21:40.0967130Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/hooks.py", line 286, in __call__
2020-04-22T21:21:40.0967320Z     return self._hookexec(self, self.get_hookimpls(), kwargs)
2020-04-22T21:21:40.0967920Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/manager.py", line 93, in _hookexec
2020-04-22T21:21:40.0968100Z     return self._inner_hookexec(hook, methods, kwargs)
2020-04-22T21:21:40.0968700Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/manager.py", line 87, in <lambda>
2020-04-22T21:21:40.0968860Z     firstresult=hook.spec.opts.get("firstresult") if hook.spec else False,
2020-04-22T21:21:40.0969420Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/pluggy/callers.py", line 187, in _multicall
2020-04-22T21:21:40.0969600Z     res = hook_impl.function(*args)
2020-04-22T21:21:40.0970210Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/_pytest/python.py", line 184, in pytest_pyfunc_call
2020-04-22T21:21:40.0970390Z     result = testfunction(**testargs)
2020-04-22T21:21:40.0970990Z   File "/Users/runner/runners/2.169.0/work/dreamer-pytorch/dreamer-pytorch/tests/dreamer/test_main.py", line 63, in test_main
2020-04-22T21:21:40.0971150Z     build_and_train(logdir)
2020-04-22T21:21:40.0971770Z   File "/Users/runner/runners/2.169.0/work/dreamer-pytorch/dreamer-pytorch/tests/dreamer/test_main.py", line 58, in build_and_train
2020-04-22T21:21:40.0971890Z     runner.train()
2020-04-22T21:21:40.0972480Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/rlpyt/runners/minibatch_rl.py", line 259, in train
2020-04-22T21:21:40.0972660Z     opt_info = self.algo.optimize_agent(itr, samples)
2020-04-22T21:21:40.0973270Z   File "/Users/runner/runners/2.169.0/work/dreamer-pytorch/dreamer-pytorch/dreamer/algos/dreamer_algo.py", line 147, in optimize_agent
2020-04-22T21:21:40.0973440Z     model_loss, actor_loss, value_loss, loss_info = self.loss(*loss_inputs, itr, i)
2020-04-22T21:21:40.0974060Z   File "/Users/runner/runners/2.169.0/work/dreamer-pytorch/dreamer-pytorch/dreamer/algos/dreamer_algo.py", line 239, in loss
2020-04-22T21:21:40.0974220Z     imag_reward = model.reward_model(imag_feat).mean
2020-04-22T21:21:40.0974790Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/torch/nn/modules/module.py", line 550, in __call__
2020-04-22T21:21:40.0974960Z     result = self.forward(*input, **kwargs)
2020-04-22T21:21:40.0975550Z   File "/Users/runner/runners/2.169.0/work/dreamer-pytorch/dreamer-pytorch/dreamer/models/dense.py", line 30, in forward
2020-04-22T21:21:40.0975720Z     x = self.model(features)
2020-04-22T21:21:40.0976330Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/torch/nn/modules/module.py", line 550, in __call__
2020-04-22T21:21:40.0976810Z     result = self.forward(*input, **kwargs)
2020-04-22T21:21:40.0977400Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/torch/nn/modules/container.py", line 100, in forward
2020-04-22T21:21:40.0977580Z     input = module(input)
2020-04-22T21:21:40.0978180Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/torch/nn/modules/module.py", line 550, in __call__
2020-04-22T21:21:40.0978600Z     result = self.forward(*input, **kwargs)
2020-04-22T21:21:40.0979720Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/torch/nn/modules/linear.py", line 87, in forward
2020-04-22T21:21:40.0979950Z     return F.linear(input, self.weight, self.bias)
2020-04-22T21:21:40.0981230Z   File "/Users/runner/hostedtoolcache/Python/3.7.6/x64/lib/python3.7/site-packages/torch/nn/functional.py", line 1612, in linear
2020-04-22T21:21:40.0981370Z     output = input.matmul(weight.t())
2020-04-22T21:21:40.0981520Z  (print_stack at ../torch/csrc/autograd/python_anomaly_mode.cpp:60)
2020-04-22T21:21:40.0981620Z 
2020-04-22T21:21:40.0981710Z Imagination:   0%|          | 0/1 [00:00<?, ?it/s]
2020-04-22T21:21:40.0981800Z 
2020-04-22T21:21:40.0982350Z ---------- coverage: platform darwin, python 3.7.6-final-0 -----------
2020-04-22T21:21:40.0982460Z Coverage XML written to file coverage.xml
2020-04-22T21:21:40.0982540Z 
2020-04-22T21:21:40.0982770Z =========================== short test summary info ============================
2020-04-22T21:21:40.0986770Z FAILED tests/dreamer/test_main.py::test_main - RuntimeError: one of the varia...
2020-04-22T21:21:40.0986950Z ======================== 1 failed, 17 passed in 15.74s =========================
2020-04-22T21:21:40.2397990Z ##[error]Process completed with exit code 1.
2

For more detail, see:

https://github.com/juliusfrost/dreamer-pytorch/actions/runs/85118145

https://github.com/juliusfrost/dreamer-pytorch/runs/610066248