PeiranLi0930/TorchProject

Paper Replication Repo

• This repo includes detailed replications of popular computer vision papers with exhaustive annotations.

• All the codes in this project is written by Pytorch.

  • New to Pytorch? See Your First Pytorch Tutor
  • The second best place to learn Pytorch

• Important architectures and mechanisms in Machine Learning and Deep Learning are included and well annotated.

• Last Update Time: June 19 2023

• In Process: Swin Transformer from Scratch

---

Content

• Self-Attention & Multi-Head Self-Attention Mechanism and Implementation from Scratch

  • Implementation Notebook
  • Functionalized Version

---

Appreciations

• The Holy Land giving me best working environments
• My first Pytorch tutor: Daniel Bourke, the creator of Zero to Mastery Learn PyTorch for Deep Learning
• Significant Guiders on my path to Machine Learning and Deep Learning: Robert Nowak , Andrew Ng, Feifei Li , Sharon Zhou, Sebastian Raschka
• I wish to express my boundless gratitude to Professor Vikas Singh. I appreciate him enduring my incessant ignorance, offering me ample patience and tolerance. He is a vital guide on my academic journey.

© 2023 - Peiran in USA - All rights reserved

---