rafaelscnunes/COS738-AutomaticPatentClassification

Machine Learning System to classify a Patent Application based on the title and resume, using INPI-Brazil RPI text data

Automatic Patent Classification

Machine Learning System to classify a Patent Application based on it's title and resume, using INPI-Brazil RPI Patent text data for training the model.

Modules

1. download - downloads the last available RPIs on http://revistas.inpi.gov.br
2. import - parses all .txt or .TXT on ./input and generates ./output/ <RPI>.csv, <RPI>_parsed.txt and full.csv; also generates ./import.log;
3. pre_processing - based on full.csv generates dataset_ipc_first.csv containing title|resume|ipc, with stemmed text using nltk.stem.RSLPStemmer() and considering only the first IPC label of multi-label patent applications.

Inputs

1. ./input/*.txt or ./input/*.TXT - RPI (Revista da Propriedade Industrial) one RPI per file;

Outputs

1. ./import.log - record execution informations;
2. ./output/<RPI>_parsed.txt - processed RPI file (debug);
3. ./output/<RPI>.csv - records/observations extracted from .txt file;
4. ./output/full.csv - all records/observations extracted from all .txt;
5. ./imported/<RPI>.txt - archives all imported .txt files, one file per RPI;
6. ./output/dataset.csv - pre-processed records/observations.

References

1. http://revistas.inpi.gov.br - download Patent section of RPI (.txt's)
2. http://dados.gov.br/dataset/revista-da-propriedade-industrial-rpi/resource/4288c07c-f9bd-45d7-8fc0-56b4fc1f5c82 - informations on how to get RPI files