Comment Experiment: Method Name Prediction with default dataset

This is the repository to run the experiment of code2seq on default dataset for the task of Method Name Prediction.

Running the experiment

First clone the repository recursively:

git clone git@github.com:ciselab/code2seq-vanilla.git --recursive

Make sure you have nvidia-container-toolkit installed, this will allow your Docker containers to access your Nvidia card:

pamac install nvidia-container-toolkit

(switch pamac for a package manager that your distribution uses). If your Nvidia card still doesn't work, some troubleshooting can be found here and here.

To run the experiments, please first run (maybe as root) prepare.sh or prepare_minimal.sh. This will download and prepare the full and minimal datasets, respectively:

bash prepare.sh

bash prepare_minimal.sh

Then cd into the experiments folder. Here you will find 5 different experiments, each with a different setup. You can change the training hyperparameters in config.py. Run the experiment by running:

docker-compose up

You can run all experiments 'in the background' by doing:

nohup bash runner.sh > code2seq-vanilla.log &

Warning! If you hit the rate limits on Nvidia Docker image downloads, you might start getting an 401 Unauthorized error when trying to download the Docker image. If that happens, please follow this guide to register and login through your Nvidia account.