/inverse_rl-1

Adversarial Imitation Via Variational Inverse Reinforcement Learning

Primary LanguagePythonMIT LicenseMIT

Variation Inverse Reinforcement Learning

Implementation of Adversarial Imitation Via Variational Inverse Reinforcement Learning.

The code is an adaption of inverse-rl repository that contains the implementations of state-of-the-art imitation & inverse reinforcement learning algorithms.

Requirements

  • Rllab
    • Use our base.py by replacing from rllab.sampler.base import BaseSampler to from base import BaseSampler in the file sandbox/rocky/tf/samplers/vectorized_sampler.py
    • Include our gaussian_mlp_inverse_policy.py to the folder sandbox/rocky/tf/policies/
  • TensorFlow

Examples

Running the Ant gym environment

  1. Collect expert data

    python ant_data_collect.py

  2. Run Inverse Reinforcement Learning:

    python ant_irl.py

  3. Run transfer learning on disabled-ant

    python ant_transfer_disabled.py

Bibliography

@inproceedings{
qureshi2018adversarial,
title={Adversarial Imitation via Variational Inverse Reinforcement Learning},
author={Ahmed H. Qureshi and Byron Boots and Michael C. Yip},
booktitle={International Conference on Learning Representations},
year={2019},
url={https://openreview.net/forum?id=HJlmHoR5tQ},
}