NL2Bash

Overview

This repository contains the data and source code release of the paper: NL2Bash: A Corpus and Semantic Parser for Natural Language Interface to the Linux Operating System.

Specifically, it contains the following components:

A set of ~10,000 bash one-liners collected from websites such as StackOverflow and their English descriptions written by Bash programmers.
Tensorflow implementations of the following translation models:
- the standard Seq2Seq and CopyNet models
- a stage-wise NL⟶Bash model using argument filling heuristics (Lin et. al. 2017).
A Bash command parser which parses a Bash command into an abstractive syntax tree, developed on top of bashlex.
A set of domain-specific natural language processing tools, including a regex-based sentence tokenizer and a domain specific named entity recognizer.

Experiment Setup

Install TensorFlow

The Tensorflow library is required to reproduce our experiments. The experiment results can be reproduced on machines with or without GPUs.

Please follow the instructions on the official website to install the library.

The following pip installation command has been tested on Mac OS 10.10.5.

sudo pip3 install --upgrade \
 https://storage.googleapis.com/tensorflow/mac/cpu/tensorflow-1.3.0-py3-none-any.whl

Environment Variables & Dependencies

First of all, run make in the root directory of the repo.

(sudo) make

This sets up the Python path and other tools on which the main experiment depends.

Then change to the experiments folder and follow the instructions there to reproduce our results.

cd experiments

Citation

If you use the data or source code in your work, please cite

@inproceedings{LinWZE2018:NL2Bash, 
  author = {Xi Victoria Lin and Chenglong Wang and Luke Zettlemoyer and Michael D. Ernst}, 
  title = {NL2Bash: A Corpus and Semantic Parser for Natural Language Interface to the Linux Operating System}, 
  booktitle = {Proceedings of the Eleventh International Conference on Language Resources
               and Evaluation {LREC} 2018, Miyazaki (Japan), 7-12 May, 2018.},
  year = {2018} 
}

stanstarks/nl2bash