/CoppeliaSimRL-ZeroMQ

Reinforcement learning environment with CoppeliaSim simulation platform. Support ZeroMQ and gymnasium

Primary LanguagePython

Reinforcement Learning Workspace

The basic workspace for reinforcement learning with CoppeliaSim (VREP) simulation environments, including some demonstrated project for beginners. Some tutorials can be found at:

I add gymnasium and ZeroMQ support compared with the original repository. All the demos have been tested on Windows 11, with python 3.10 environment.


Environments setup

You have to install the following softwares and environments for this project, the recommend operating system is Ubuntu.


Demo 1: Cart-pole control with the A2C (modified SAC) algorithm

  • Step 1: run CoppeliaSim, import cart_pole.ttt
  • Step 2: run visdom in your terminal, open your browser, and visit link: localhost:8097
  • Step 3: run the script named 'demo_cart_pole_learning.py' in the sub-path ./examples

Then we have: