/gym_tool_use

Gym tool use environments.

Primary LanguagePythonOtherNOASSERTION

Gym Tool Use

gym tool use environments.

$ pip install gym-tool-use

Usage

import gym_tool_use  # import to register gym envs
env = gym.make("TrapTube-v0")
observation = env.reset()
action = env.action_space.sample()
observation_next, reward, done, info = env.step(action)
image = env.render(mode="rgb_array")  # also supports mode="human"

Environments

The following environments are registered:

  • "TrapTube-v0" (base task)
  • "PerceptualTrapTube-v0"
  • "StructuralTrapTube-v0"
  • "SymbolicTrapTube-v0"
  • "PerceptualSymbolicTrapTube-v0"
  • "StructuralSymbolicTrapTube-v0"
  • "PerceptualStructuralTrapTube-v0"
  • "PerceptualStructuralSymbolicTrapTube-v0"

Baselines

Baseline implementations here: https://github.com/fomorians/tool-use

Development

Development is started with pipenv.

$ pipenv install
$ pipenv shell

Citation

If you use this code in your work, please cite the following:

@ARTICLE{2019arXiv190702050W,
      author = {{Wenke}, Sam and {Saunders}, Dan and {Qiu}, Mike and {Fleming}, Jim},
       title = "{Reasoning and Generalization in RL: A Tool Use Perspective}",
     journal = {arXiv e-prints},
    keywords = {Computer Science - Neural and Evolutionary Computing, Computer Science - Artificial Intelligence, Computer Science - Machine Learning},
        year = "2019",
       month = "Jul",
         eid = {arXiv:1907.02050},
       pages = {arXiv:1907.02050},
archivePrefix = {arXiv},
      eprint = {1907.02050},
primaryClass = {cs.NE},
      adsurl = {https://ui.adsabs.harvard.edu/abs/2019arXiv190702050W},
     adsnote = {Provided by the SAO/NASA Astrophysics Data System}
}