Pinned Repositories
attention-rank-collapse
We show pure attention suffers rank collapse, and how different mechanisms combat it.
bort
Repository for the paper "Optimal Subarchitecture Extraction for BERT"
ERNIE-Pytorch
ERNIE Pytorch Version
face_recognition
The world's simplest facial recognition api for Python and the command line
Flat-Lattice-Transformer
code for ACL 2020 paper: FLAT: Chinese NER Using Flat-Lattice Transformer
glm-codes
google-research
Google Research
MONeT
MONeT framework for reducing memory consumption of DNN training
neural-enhance
Super Resolution for images using deep learning.
performer-pytorch
An implementation of Performer, a linear attention-based transformer, in Pytorch
shayeboshi's Repositories
shayeboshi/attention-rank-collapse
We show pure attention suffers rank collapse, and how different mechanisms combat it.
shayeboshi/bort
Repository for the paper "Optimal Subarchitecture Extraction for BERT"
shayeboshi/DeepFaceLab
DeepFaceLab is the leading software for creating deepfakes.
shayeboshi/ERNIE-Pytorch
ERNIE Pytorch Version
shayeboshi/face_recognition
The world's simplest facial recognition api for Python and the command line
shayeboshi/Flat-Lattice-Transformer
code for ACL 2020 paper: FLAT: Chinese NER Using Flat-Lattice Transformer
shayeboshi/glm-codes
shayeboshi/google-research
Google Research
shayeboshi/MONeT
MONeT framework for reducing memory consumption of DNN training
shayeboshi/neural-enhance
Super Resolution for images using deep learning.
shayeboshi/performer-pytorch
An implementation of Performer, a linear attention-based transformer, in Pytorch
shayeboshi/QA_system
Question answering system based on text library
shayeboshi/recsys_justification
shayeboshi/REKCARC-TSC-UHT
清华大学计算机系课程攻略 Guidance for courses in Department of Computer Science and Technology, Tsinghua University
shayeboshi/WoBERT
以词为基本单位的中文BERT
shayeboshi/word-discovery
速度更快、效果更好的中文新词发现