/abcde

Experimental repository for preprocessing evaluation, enhanced from "Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems"

Primary LanguagePythonMIT LicenseMIT

Action-Based Conversations Dataset - Enhanced (ABCDE)

Introduction

This respository is a fork from https://github.com/asappresearch/abcd. It is enhanced by a preprocessing pipeline, including following methods:

  • expansion
  • coreference resolution
  • cleansing by removing highly emotional text snippets
  • lemmatization

Usage

To run the code, you may use the Google Colab Notebook abcde.ipynb.

Results

The python script abcde_results.py documents the results and provides different methods to plot the results accordingly.