To install the Gym see the instructions inside dp-gym folder.
The primary dependency of this gym environment is the following -
https://github.com/dfki-ric-underactuated-lab/double_pendulum
Please make sure the mentioned double pendulum package by RIC DFKI is installed before operating this environment.