Open-Source RL Environment for Planning Interventions on Transportation Infrastructure
InfraPlanner is a Python open-source RL environment developed in accordance to the gym environment standards. This environment enables emulating the visual insepctions process, and produces probablistic estimates for the deteriroation condition and speed. The deterioration state in this environment can be obtained at the element-level, the structural category level, and bridge-level.
Paper presnetation: YouTube.
Hierarchical reinforcement learning for transportation infrastructure maintenance planning
Hamida, Z. and Goulet, J.-A.
Reliablity Engineering & System Safety
[DOI]
-
Python 3.x
-
Pytorch: load pre-traind models (Optional).
-
Access to GPU computing (Optional)
To get started, open the terminal and clone the repo,
git clone https://github.com/CivML-PolyMtl/InfrastructuresPlanner.git
Access the project folder,
cd InfrastructuresPlanner
Create a virtual environment,
python -m venv .venv
# Or,
python3 -m venv .venv
Activate the environment,
source .venv/bin/activate
# Or in windows,
&.venv/scripts/activate.ps1
Install the required packages by using the pip command in terminal,
pip install -r requirements.txt
Run environment tests using,
python test_env.py
The Infra Planner package is originally developed based on the inspection and interventions database of the Transportation Ministry of Quebec (MTQ).
To perform analyses on vectorized environment, a recommanded wrapper is (RayEnvWrapper):
pip install RayEnvWrapper
number_of_workers, envs_per_worker = 10, 2
base_env = infra_planner
env = WrapperRayVecEnv(base_env, number_of_workers, envs_per_worker)
env.step(0)
- Note: RayEnvWrapper is an external package; therefore, it is required to verify the compatiblity with the OS in use.
Please read CONTRIBUTING.md for details on the process for submitting pull requests.
- Zachary Hamida - Methodology & code development - webpage
- James-A. Goulet - Methodology review & development - webpage
- The funding for this project is provided by the Transportation Ministry of Quebec Province (MTQ), Canada.