This page is an archive of the Deep Learning Paper Reading Meeting. If you would like to attend the meeting or have any questions, Write in the GitHub issue table or email us at 'tfkeras@kakao.com'
| Tasks | Paper | Link | Performance Index |
|---|---|---|---|
| NLP | Attention is all you need | Youtube Paper |
NLP |
| NLP | BERT | Youtube paper |
NLP, Laguage representation |
| NLP | ERNIE | Youtube paper |
NLP, Laguage representation |
| NLP | RoBERTa | Youtube paper |
NLP, Laguage representation |
| NLP | XLNET | Youtube paper |
NLP, Laguage representation |
| NLP | SentenceBert | Youtube | |
| NLP | Defending Against neural fake news | Youtube | |
| NLP | TransformerXL | Youtube blog |
|
| NLP | Understanding back translation at scale | Youtube blog |
|
| NLP | Deep Contextualized Word Representations | Youtube | |
| NLP | Univiersal LM Fine-tuning for text classification | Youtube | |
| NLP | Subword-level Word Vector Representations for Korean | Youtube | |
| NLP | A Decomposable Attention Model for Natural Language Inference | Youtube | |
| NLP | Reformer | Youtube | |
| NLP | Neural Machine Translation by Jointly Learning to Align and Translate | Youtube | |
| NLP | ELECTRA | Youtube | |
| NLP | SBERT_WK | Youtube | |
| NLP | Revealing the Dark Secrets of BERT | Youtube | |
| NLP | PEGASUS | Youtube | |
| NLP | Document-level Neural Machine Translation with Inter-Sentence Attention | Youtube | |
| NLP | Phrase-Based & Neural Unsupervised Machine | Youtube | |
| NLP | BART | Youtube | |
| NLP | BAE | Youtube | |
| NLP | A Generative Model for Joint Natural Language Understanding and Generation | Youtube | |
| NLP | Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training | Youtube | |
| NLP | Graph Attention Networks | Youtube | |
| NLP | Switch Transformers | Youtube | |
| NLP | DeText: A Deep Text Ranking Framework with BERT | Youtube | |
| NLP | Face book Chat bot , Blender bot | Youtube | |
| NLP | Extracting Training Data from Large Language Models | Youtube | |
| NLP | Longformer: The Long-Document Transformer | Youtube | |
| NLP | Visualizing and Measuring the Geometry of BERT | Youtube | |
| NLP | Encode, Tag, Realize HighPrecision Text Editing | Youtube | |
| NLP | multimodal transformer for unaligned multimodal language sequences | Youtube | |
| NLP | SCGPT : Few-shot Natural Language Generation for Task-Oriented Dialog | Youtube | |
| NLP | ColBERT: Efficient and Effective Passage Search viaContextualized Late Interaction over BERT | Youtube | |
| NLP | Restoring and Mining the Records ofthe Joseon Dynasty via Neural LanguageModeling and Machine Translation | Youtube | |
| Vision | YOLO | Youtube paper |
Object detection |
| Vision | YOLO-v2 | Youtube | |
| Vision | Resnet | Youtube paper |
Image classification |
| Vision | GAN | Youtube | |
| Vision | Image Style Transfer Using CNN | Youtube | |
| Vision | SINGAN | Youtube | |
| Vision | FCN | Youtube | |
| Vision | DeepLabV3 | Youtube | |
| Vision | Unet | Youtube paper |
|
| Vision | CyCADA | Youtube | |
| Vision | D-SNE | Youtube | |
| Vision | Faster-RCNN | Youtube | |
| Vision | Weakly Supervised Object DetectionWith Segmentation Collaboration | Youtube | |
| Vision | Don't Judge an Object by Its Context: Learning to Overcome Contextual Bias | Youtube | |
| Vision | data efficient image recognition with contrastive predictive coding | Youtube | |
| Vision | Deep Feature Consistent Variational Autoencoder | Youtube | |
| Vision | Attention Branch Network: Learning of Attention Mechanism for Visual Explanation | Youtube | |
| Vision | RELATION-SHAPE CONVOLUTIONAL NEURAL NETWORK FOR POINT CLOUD ANALYSIS | Youtube | |
| Vision | EfficientNet | Youtube | |
| Vision | Deep Clustering for Unsupervised Learning of Visual Features | Youtube | |
| Vision | Boosting Few-shot visual learning with self-supervision | Youtube | |
| Vision | Rethinking Pre-training and Self-training | Youtube | |
| Vision | BYOL : Bootstrap Your Own Latent | Youtube | |
| Vision | Deep Image Prior | Youtube | |
| Vision | Object-Centric Learning with Slot Attention | Youtube | |
| Vision | Yolo V4 | Youtube | |
| Vision | Dynamic Routing Between Capsules | Youtube | |
| Vision | Semi-Supervised Classification with Graph Convolutional Network | Youtube | |
| Vision | Generative Pretraining from Pixels | Youtube | |
| Vision | MaskFlownet | Youtube | |
| Vision | Adversarial Robustness through Local Linearization | Youtube | |
| Vision | Locating Objects Without Bounding Boxes | Youtube | |
| Vision | Training data-efficient image transformers & distillation through attention | Youtube | |
| Vision | What Makes Training Multi-modalClassification Networks Hard? | Youtube | |
| Vision | 2020 CVPR Meta-Transfer Learning for Zero-Shot Super-Resolution | Youtube | |
| Vision | 2020 ACCV Patch SVDD: Patch-level SVDD for Anomaly Detection and Segmentation | Youtube | |
| Vision | Style GAN | Youtube | |
| Vision | HighPerformance Large Scale ImageRecognition Without Normalization | Youtube | |
| Vision | Focal Loss for Dense Object Detection | Youtube | |
| Vision | Editing in Style : Uncovering the Local Semantics of GANs | Youtube | |
| Vision | Efficient Net 2 | Youtube | |
| Vision | Style Clip | Youtube | |
| Vision | Swin Transformer | Youtube | |
| Vision | NBDT : Neural-backed Decision Tree | Youtube | |
| Vision | [2020 CVPR] Efficient DET | Youtube | |
| Vision | MLP - MIXER : An all-MLP Architecture for Vision | Youtube | |
| Recommend System | Matrix Factorization Technique for Recommender System | Youtube paper |
Recommendation system |
| Recommend System | Collaborative Filtering for Implicit Feedback Dataset | Youtube | |
| Speech | A comparison of S2S models for speech recognition | Youtube paper |
Speech Recognition |
| Fundamental | RAdam | Youtube blog paper |
Regularization |
| Fundamental | Stacked Auto Encoder for the P300 Component Detection | Youtube | |
| Fundamental | A survey on Image Data Augmentation for DL | Youtube paper |
Data augmentation |
| Fundamental | Training Confidence-calibrated classifiers for detecting out of distribution samples | Youtube | |
| Fundamental | AdamW | Youtube blog |
|
| Fundamental | Stargan | Youtube | |
| Fundamental | Drop-out | Youtube | |
| Fundamental | BLEU - a Method for Automatic Evaluation of Machine Translation | Youtube | |
| Fundamental | t-SNE | Youtube | |
| Fundamental | Gpipe | Youtube | |
| Fundamental | explainable ai | Youtube | |
| Fundamental | TAPAS | Youtube | |
| Fundamental | Learning both Weights and Connections for Efficient Neural Networks | Youtube | |
| Fundamental | ReVACNN | Youtube | |
| Fundamental | THE LOTTERY TICKET HYPOTHESIS: FINDING SPARSE, TRAINABLE NEURAL NETWORKS | Youtube | |
| Fundamental | ALPHAGO : Mastering the game of Go with Deep Neural Networks and Tree Search | Youtube | |
| Fundamental | A_BASELINE_FOR_FEW_SHOT_IMAGE_CLASSIFICATION | Youtube | |
| Fundamental | Sharp Minima Can Generalize For Deep Nets | Youtube | |
| Fundamental | Pediatric Sleep Stage Classification Using Multi-Domain Hybrid Neural Networks | Youtube | |
| Fundamental | Pruning from Scratch | Youtube | |
| Fundamental | Do We Need Zero Training Loss After Achieving Zero Training Error? | Youtube | |
| Fundamental | Deep Recurrent Q-Learning for Partially Observable MDPs | Youtube | |
| Fundamental | Large Margin Deep Networks for Classification | Youtube | |
| Fundamental | generating wikipedia by summarizing long sequences | Youtube | |
| Fundamental | Plug and Play Language Models: A Simple Approach to Controlled Text Generation | Youtube | |
| Fundamental | What Uncertainties Do We Need in Bayesian DeepLearning for Computer Vision? | Youtube | |
| Fundamental | KRED | Youtube | |
| Fundamental | Early Stopping as nonparametric Variational | Youtube | |
| Fundamental | Sharpness Aware Minimization for efficeintly improving generalization | Youtube | |
| Fundamental | Neural Graph Collaborative Filtering | Youtube | |
| Fundamental | Restricting the Flow: Information Bottlenecks for Attribution | Youtube | |
| Fundamental | Real world Anomaly Detection in Surveillance Videos | Youtube | |
| Fundamental | Deep learning model to 2Bit Quantization?! BRECQ Paper review (2021 ICLR) | Youtube | |
| Fundamental | Deep sets (2017 NIPS) | Youtube | |
| Fundamental | StyleGAN2 | Youtube | |
| Fundamental | SOTA - Beyond Synthetic Noise:Deep Learning on Controlled Noisy Labels | Youtube | |
| Fundamental | Deep Reinforcement Learning for Online Advertising Impression in Recommender Systems | Youtube | |
| Fundamental | Longformer: The Long-Document Transformer | Youtube | |
| Fundamental | soft actor critic | Youtube | |
| Fundamental | Loss Function Discovery for Object Detection Via Convergence- Simulation Driven Search | Youtube | |
| Fundamental | [2021 ICLR] The Deep Bootstrap Framework:Good Online Learners are good Offline Generalizers | Youtube | |
| Fundamental | Meta HIN | Youtube |