train error with gym=0.19.0 ray = 2.2.0 metadrive-simulator = 0.4.1.2

[qiaoguanren]

Hello! I'm interested in your impressive project. However, when I trained these algorithms: ippo, ccppo and copo, the codes had bug.



I don't know how to fix it. Looking forward to your reply!

[white-bubbleee]

hello, I meet the same problem, and have you solved it?

[white-bubbleee]

I meet the same problem when I run "train_copo.py".

[pengzhenghao]

Hi I've updated the dependencies requirement. Our code support MetaDrive 0.2.5 instead of the latest version. Here is the result when I ran with MetaDrive-0.2.5:

https://github.com/decisionforce/CoPO/tree/main/benchmarks/MetaDrive-0.2.5

To provide more information to you, this is the environment that I succesfully run code:

Package                  Version    Editable project location
------------------------ ---------- -----------------------------
absl-py                  2.1.0
aiohttp                  3.8.6
aiohttp-cors             0.7.0
aioredis                 2.0.1
aiosignal                1.3.1
annotated-types          0.5.0
anyio                    3.7.1
astunparse               1.6.3
async-timeout            4.0.3
asynctest                0.13.0
atari-py                 0.2.6
attrs                    23.2.0
blessed                  1.20.0
cachetools               5.3.2
certifi                  2022.12.7
charset-normalizer       3.3.2
click                    8.1.7
cloudpickle              1.6.0
colorama                 0.4.6
colorful                 0.5.6
copo                     0.0.0      /home/zhenghao/CoPO/copo_code
cycler                   0.11.0
decorator                5.1.1
distlib                  0.3.8
dm-tree                  0.1.8
exceptiongroup           1.2.0
filelock                 3.12.2
Flask                    2.2.5
fonttools                4.38.0
frozenlist               1.3.3
gast                     0.3.3
google-api-core          2.15.0
google-auth              2.27.0
google-auth-oauthlib     0.4.6
google-pasta             0.2.0
googleapis-common-protos 1.62.0
gpustat                  1.1.1
grpcio                   1.60.0
gym                      0.23.1
gym-notices              0.0.8
h11                      0.14.0
h5py                     2.10.0
idna                     3.6
imageio                  2.31.2
importlib-metadata       6.7.0
importlib-resources      5.12.0
iniconfig                2.0.0
itsdangerous             2.1.2
Jinja2                   3.1.3
jsonschema               4.17.3
Keras-Preprocessing      1.1.2
kiwisolver               1.4.5
kubernetes               29.0.0
lz4                      4.3.2
Markdown                 3.4.4
markdown-it-py           2.2.0
MarkupSafe               2.1.4
matplotlib               3.5.3
mdurl                    0.1.2
metadrive-simulator      0.2.5
msgpack                  1.0.5
multidict                6.0.4
networkx                 2.6.3
numpy                    1.21.6
nvidia-cublas-cu11       11.10.3.66
nvidia-cuda-nvrtc-cu11   11.7.99
nvidia-cuda-runtime-cu11 11.7.99
nvidia-cudnn-cu11        8.5.0.96
nvidia-ml-py             12.535.133
oauthlib                 3.2.2
opencensus               0.11.4
opencensus-context       0.1.3
opt-einsum               3.3.0
packaging                23.2
Panda3D                  1.10.14
panda3d-gltf             0.14
panda3d-simplepbr        0.10
pandas                   1.3.5
Pillow                   9.5.0
pip                      22.3.1
pkgutil_resolve_name     1.3.10
platformdirs             4.0.0
pluggy                   1.2.0
prometheus-client        0.17.1
protobuf                 3.20.3
psutil                   5.9.8
py-spy                   0.3.14
pyasn1                   0.5.1
pyasn1-modules           0.3.0
pydantic                 1.9.0
pydantic_core            2.14.6
pygame                   2.5.2
Pygments                 2.17.2
pyparsing                3.1.1
pyrsistent               0.19.3
pytest                   7.4.4
python-dateutil          2.8.2
pytz                     2023.4
PyWavelets               1.3.0
PyYAML                   6.0.1
ray                      2.2.0
redis                    5.0.1
requests                 2.31.0
requests-oauthlib        1.3.1
rich                     13.7.0
rsa                      4.9
scikit-image             0.19.3
scipy                    1.7.3
seaborn                  0.12.2
setuptools               65.6.3
six                      1.16.0
sniffio                  1.3.0
starlette                0.29.0
tabulate                 0.9.0
tensorboard              2.11.2
tensorboard-data-server  0.6.1
tensorboard-plugin-wit   1.8.1
tensorboardX             2.6.2.2
tensorflow               2.3.1
tensorflow-estimator     2.3.0
tensorflow-probability   0.11.1
termcolor                2.3.0
tifffile                 2021.11.2
tomli                    2.0.1
torch                    1.13.1
tqdm                     4.66.1
typer                    0.9.0
typing_extensions        4.7.1
urllib3                  2.0.7
uvicorn                  0.22.0
virtualenv               20.25.0
wcwidth                  0.2.13
websocket-client         1.6.1
Werkzeug                 2.2.3
wheel                    0.38.4
wrapt                    1.16.0
yapf                     0.30.0
yarl                     1.9.4
zipp                     3.15.0