Pinned Repositories
Application-of-Word2vec-in-Phoneme-Recognition
Build an attention-based model for speech recogntion.Use the Word2vec model to help to train the attention model.
architect-awesome
后端架构师技术图谱
attention-is-all-you-need-pytorch
A PyTorch implementation of the Transformer model in "Attention is All You Need".
AttentionBasedLanguageModeling
AutomaticWeightedLoss
Multi-task learning using uncertainty to weigh losses for scene geometry and semantics, Auxiliary Tasks in Multi-task Learning
AuxiLearn
Official implementation of Auxiliary Learning by Implicit Differentiation [ICLR 2021]
minGPT
A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
PTB-pytorch-LSTM-attention
PTB Language Modelling task with LSTM + Attention layer
pytorch-attentive-lm
MGSong's Repositories
MGSong/LeetCode-Go
✅ Solutions to LeetCode by Go, 100% test coverage, runtime beats 100% / LeetCode 题解
MGSong/leetcode-1
LeetCode Problems' Solutions
MGSong/graph-glove
PyTorch code for the EMNLP 2020 paper "Embedding Words in Non-Vector Space with Unsupervised Graph Learning"
MGSong/torchMTL
A lightweight module for Multi-Task Learning in pytorch.
MGSong/electra-pytorch
A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
MGSong/vqcpc-bach
Vector Quantized Contrastive Predictive Coding for Template-based Music Generation
MGSong/label_confusion_learning
Official implementation of AAAI-21 paper "Label Confusion Learning to Enhance Text Classification Models"
MGSong/seq2seq-attn
Sequence-to-sequence model with LSTM encoder/decoders and attention
MGSong/lc-all-solutions
My own leetcode solutions by python
MGSong/PyContrast
PyTorch implementation of Contrastive Learning methods; List of awesome-contrastive-learning papers
MGSong/DeepLearningExamples
Deep Learning Examples
MGSong/FastSpeech2
An implementation of Microsoft's "FastSpeech 2: Fast and High-Quality End-to-End Text to Speech"
MGSong/electra
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
MGSong/SupContrast
PyTorch implementation of "Supervised Contrastive Learning" (and SimCLR incidentally)
MGSong/CopyMTL
AAAI20 "CopyMTL: Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learning"
MGSong/OmniNet
Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain
MGSong/LeetCode
:pencil2: LeetCode solutions in C++ 11 and Python3
MGSong/RTLM
MGSong/electra_pytorch
Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)
MGSong/MultiTask-MRC
Multitask Learning for Machine Reading Comprehension, NAACL 2019
MGSong/VectorQuantizedCPC
Vector-Quantized Contrastive Predictive Coding for Acoustic Unit Discovery and Voice Conversion
MGSong/moco
PyTorch implementation of MoCo: https://arxiv.org/abs/1911.05722
MGSong/minGPT
A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
MGSong/gensen
Learning General Purpose Distributed Sentence Representations via Large Scale Multi-task Learning
MGSong/Multi-task-deep-network
Usage of Multi-task deep learning network for semantic segmentation in medical images
MGSong/Statistical-Learning-Method_Code
手写实现李航《统计学习方法》书中全部算法
MGSong/multi-task-learning-example
A multi-task learning example for the paper https://arxiv.org/abs/1705.07115
MGSong/AutomaticWeightedLoss
Multi-task learning using uncertainty to weigh losses for scene geometry and semantics, Auxiliary Tasks in Multi-task Learning
MGSong/Dynamic_multi-task-learning
Multi-Task Learning Using Dynamic Weights of Tasks for Face Recognition withFacial Expression
MGSong/Pre-trained-Models
预训练语言模型综述