jeanfranc0/Bolsistas_class_Jeanfranc0

Bolsistas_class_Jeanfranco

Gente, só precisan pegar os arquivos .ipynb no google colab e pronto!

Interesting Reads:

• Transformers from scratch
• Neural networks: training with backpropagation

Interesting books:

• Mathematics for Machine Learning

Interesting codes:

• Pytorch - Dive Into Deep Learning book
• Deep Learning course: lecture slides and lab notebooks

First assignment

We use pre-trained BERT model to classify sentences. This model is relevant because we can use a new, more representative embedding. Specific, the input embeddings are the sum of the token embeddings, the segmentation embeddings and the position embeddings.