soyul5458/study

Deep learning study

• 딥러닝 논문과 코드 실습 정리

Audio Classification (음성 분류)

image Recognition (이미지 인식)

Natural Language Processing (자연어 처리)

• Single Headed Attention RNN: Stop Thinking With Your Head (2020)
  • Original Paper Link / Paper Review Video / Summary PDF / Code Practice
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (NAACL 2019)
  • Original Paper Link / Paper Review Video / Summary PDF / Code Practice
• Attention is All You Need (NIPS 2017)
  • Original Paper Link / Paper Review Video / Summary PDF / Code Practice

Modeling & Optimization (모델링 & 최적화)

Bag of Tricks for Image Classification (CVPR 2019) Original Paper Link / Paper Review Video / Summary PDF CIFAR-10 / CIFAR-10 with Label Smoothing / CIFAR-10 with Input Mixup / CIFAR-10 with Label Smoothing and Input Mixup Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding (ICLR 2016 Oral) Original Paper Link / Paper Review Video / Summary PDF / Code Practice Batch normalization: Accelerating deep network training by reducing internal covariate shift (PMLR 2015) Original Paper Link / Paper Review Video / Summary PDF / Code Practice