The INV-CDIP Dataset
Introduction
This is the INV-CDIP dataset used in our paper "Field Extraction from Forms with Unlabeled Data". The dataset contains an unlabeled set and a labeled set. The unlabeled set contains around 200k invoices. The labeled set contains 350 invoices with 7 field annotated including invoice number, purchase order, invoice date, due date, amount due, total amount and total tax.
Download Dataset
- Document ids are stored in train_set.txt and test_set.txt.
- You may browse a document using https://www.industrydocuments.ucsf.edu/docs/$document_id.
- Use the following script to download data automatically.
#install packages
bash install.sh
#download labeled data
python download_data.py --download --split labeled
#download unlabeled data
python download_data.py --download --split unlabeled
Annotation Description
-
Annotations are in ./annotation folder.
-
In each json file, field label is annotated in ['Fields']['value']['label'].
-
Field value is annotated in ['Fields']['value']['tag'].
-
Field value location is annotated in ['Fields']['value']['bbox'].
-
The key of a field value is annotated in ['Fields']['key']['tag'].
-
Key location is annotated in ['Fields']['key']['bbox'].
-
-
Use the following script to visualize the annotations.
#visualize annotations
python download_data.py --vis
Citation
Please cite our paper if you use this dataset.
@article{gao2021field,
title={Field Extraction from Forms with Unlabeled Data},
author={Gao, Mingfei and Chen, Zeyuan and Naik, Nikhil and Hashimoto, Kazuma and Xiong, Caiming and Xu, Ran},
journal={ACL Spa-NLP Workshop},
year={2022}
}
License
The INV-CDIP dataset is released under CC BY-NC 4.0. The underlying documents to which the dataset refers are from the Tobacco Collections of Industry Documents Library. Please see Copyright and Fair Use for more information.
Contact
Please contact mingfei.gao@salesforce.com if you have questions.