codaibk/pytorch_tutorial

Learn Pytorch

Objective of the repository is to learn and build ML/DL models from scratch using Pytorch.

List of pytorch basic

• Tensor basic: Tensor_Pytorch.ipynb
• Autograd: Autograd.ipynb
• Backpropagation: Backpropagation.ipynb
• Gradient_Descent_using_autograd: Gradient_Descent_using_autograd.ipynb
• Template pytorch: template.ipynb
• Feedforward neural network: feedforward_neural_network.ipynb
• Logistic regression: Logistic_regression.ipynb
• Linear regression: Linear_Regression.ipynb
• Writting custom dataset dataloader transform imgaug: custom_dataset_dataloader_transform_imgaug.ipynb

---

ML from scratch

• Linear Regression: LinearRegression.ipynb
• k-nearest neighbors: KNN.ipynb
• Logistic Regression: LogisticRegression.ipynb

---

CNN

CNN	Code	Reference
LeNet5	LeNet_5.ipynb	images
AlexNet	AlexNet.ipynb	paper
VGG	VGG.ipynb	paper
InceptionResnet_v2	InceptionResnet_v2.ipynb	paper
Multioutput CNN	Age_Gender_pipeline.ipynb
ArcFace + fNet	arcface.ipynb

---

Transformers

CNN	Code	Reference
Vision Transformers	ViT.ipynb	[paper] [video]

Pytorch Lightning

• LeNet: pytorch_lightning/LeNet.ipynb
• Multioutput CNN: Age_Gender_pipeline_pytorch_lightning.ipynb

---

Image retrieval

• resnext50_32x4d_ArcFace: Pipeline_Image_Retrieval.ipynb

---

NLP

Word Tokenization

• Byte_Pair_Encoding: Byte_Pair_Encoding.ipynb
• Byte_Pair_Encoding Dropout: BPE_Dropout.ipynb

Word Embedding

• Word2vec: Word_embedding_word2vec.ipynb

Text Classification

• LSTM: LSTM.ipynb

---

Reference

• 1. https://github.com/lucidrains/vit-pytorch
• 2. https://github.com/rwightman/pytorch-image-models
• 3. Transformer tutorial
• 4. labml.ai
• 5. GNN tutorial
• 6. Yolo tutorial