/Preprocessing-techniques-with-Reranker

Apply different preprocessing techniques with Reranker architecture for neural information retrieval

Primary LanguageJupyter Notebook

Preprocessing-techniques-with-Reranker

This repository implements several different ways of preprocessing texts longer than 512 tokens for BERT based ranking architectures. The ranking itself is done with Reranker architecture for neural information retrieval. Details can be found in the essay.