transformer-encoder
There are 68 repositories under transformer-encoder topic.
microsoft/DeBERTa
The implementation of DeBERTa
VITA-Group/TransGAN
[NeurIPS‘2021] "TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up", Yifan Jiang, Shiyu Chang, Zhangyang Wang
brightmart/bert_language_understanding
Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN
lilianweng/transformer-tensorflow
Implementation of Transformer Model in Tensorflow
wgcban/ChangeFormer
[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection
zhongkaifu/Seq2SeqSharp
Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.
jackaduma/SecBERT
pretrained BERT model for cyber security text, learned CyberSecurity Knowledge
Vidhiwar/multimodule-ecg-classification
Multi-module Recurrent Convolutional Neural Network with Transformer Encoder for ECG Arrhythmia Classification
declare-lab/MIME
This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.
microsoft/CASPR
CASPR is a deep learning framework applying transformer architecture to learn and predict from tabular data at scale.
bh1995/AF-classification
The repo is for the Heart Disease classification project using Transformer Encoders in PyTorch.
helpmefindaname/transformer-smaller-training-vocab
Temporary remove unused tokens during training to save ram and speed.
ApurbaSengupta/Lyrics-Generation-using-BERT
Generating English Rock lyrics using BERT
gazelle93/Transformer-Various-Positional-Encoding
This project aims to implement the Transformer Encoder blocks using various Positional Encoding methods.
jiangnanboy/knowledge-automatic-tagging
题目知识点预测标注。Question knowledge point prediction.
heartcored98/transformer_anatomy
Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020
utahnlp/therapist-observer
Code for the ACL 2019 paper "Observing Dialogue in Therapy: Categorizing and Forecasting Behavioral Codes"
zhenyuanlu/PainAttnNet
Transformer Encoder with Multiscale Deep Learning for Pain Classification Using Physiological Signals
brainsqueeze/text2vec
Contextual embedding for text blobs.
jaketae/realformer
PyTorch implementation of RealFormer: Transformer Likes Residual Attention
nikhilroxtomar/Vision-Transformer-ViT-in-TensorFlow
Vision Transformer Implementation in TensorFlow
hoangtuanvu/conformer_ocr
Transformer OCR is a Optical Character Recognition tookit built for researchers working on both OCR for both Vietnamese and English. This project only focused on variants of vanilla Transformer (Conformer) and Feature Extraction (CNN-based approach).
JinLi711/UTGN
Universal Transforming Geometric Network for protein structure prediction.
bl0nder/makespeare
Repository for a transformer I coded from scratch and trained on the tiny-shakespeare dataset.
ImMohammadHosseini/MKP-RL
:sparkles: Solve multi_dimensional multiple knapsack problem using state_of_the_art Reinforcement Learning Algorithms and transformers
Shikhar-S/EvolvedTransformer
Contains pytorch implementation of Transformer and EvolvedTransformer architectures. WIP
naokishibuya/simple_transformer
A Transformer Implementation that is easy to understand and customizable.
samrat-halder/personality-detection-with-BERT-RoBERT
Detection of MBTI-type personality with NLP and Deep Learning
xiaobaicxy/text-classification-transformer-attention-pytorch
Pytorch实现transformer编码器+attention的文本分类算法
kyegomez/ShallowFF
Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers"
lucylow/En_francais_si_vous_plait-
French English Machine Translation. Natural language processing (NLP) transformer model from "Attention Is All You Need"
OumaimaHourrane/Bert_LDA_Combo
Topic modeling using BERT and LDA combination.
Platanus-hy/sememes_codriven_text_matching
Co-Driven Recognition of Semantic Consistency via the Fusion of Transformer and HowNet Sememes Knowledge
larngroup/TAG-DTA
TAG-DTA: Binding Region-Guided Strategy to Predict Drug-Target Affinity Using Transformers
lordzuko/Transformer-Stance-Detection
This is a transformer based implementation for Stance Detection with Bidirectional Conditional Encoding
yashkim77/Document-Similarity
Semantic Textual Similarity between two document