Welcome to NLP backend processor for fairvision.net!

This repo is used to accomplish all the NLP post-processing tasks from the fairvision project.

Installation

You should always check the nice documentation of Sense2Vec if you run into problems.

Create and activate conda virtual environment:

conda create --name fvhelper python=3.8

conda activate fvhelper

Install dependencies:

pip install -r requirements.txt

(If you run in to problems of nltk, check this post)

Download pre-trained models:

Follow the Sense2Vec instruction. Use tar -xvf name_of_model to unzip the downloaded file. Remember to update the path to your model in main.py.