Librairies

-torchtext

1. Language modeling

1.1 Basic functionning

-Language modeling task on rap data with LSTM

1.2 Add ons

  • BERT

  • question : ligne par ligne ou mot par mot ???

  • Rhyme ? Adds this to prediction, or as regularization ?

-Preprocess better the data with verlan ???

  • French

2 Explore other tasks

-text classification : rap or rock or ... ?

-Dataviz of RAP : insults / thees / gangsta... - W2V for embedding of songs, and find similar songs ???