M0gician/RavenRL

A library for Seldonian RL framework

RavenRL -- A simple library for implementing Seldonian Algorithm

This library provides convenient tools for people to create their own seldonian algorithms. A detailed example is also included in example-cartpole.ipynb.

Dependencies

• gym==0.17.3
• numpy==1.19.1
• scipy==1.5.2

Supplementary Materials

• Definition of Seldonian Framework
  • Preventing undesirable behavior of intelligent machines
  • High Confidence Policy Improvement
• Definition of different Importance Sampling estimators
  • High Confidence Off-Policy Evaluation
• Definition of the new concentration bound
  • A New Confidence Interval for the Mean of a Bounded Random Variable