/aivle-grader

Auto grading framework for Gym and aiVLE Gym tasks.

Primary LanguagePythonBSD 3-Clause "New" or "Revised" LicenseBSD-3-Clause

aiVLE Grader

Auto grader for aiVLE Gym tasks.

Disclaimer: overall structure of this project is directly migrated from aivle-runner-kit. I created a new repository and re-implement the existing APIs from groundup to (1) avoid confusing names (i.e. runner module is defined in runner-kit repo, runner repo, a separate project runs the runner module); (2) adopt modern Python features like abc and rigorous type annotation; (3) support aivle-gym.

Getting Started

Design details

A concrete example can be found under ./examples/aivle_gym_single.py (you need to have aivle-gym ready beforehand).