transformer-architecture

There are 314 repositories under transformer-architecture topic.

  • Plachtaa/VALL-E-X

    An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io/vallex/

    Language:Python7.9k85156790

  • cmhungsteve/Awesome-Transformer-Attention

    An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

    4.9k12931496

  • tairov/llama2.mojo

    Inference Llama 2 in one file of pure 🔥

    Language:Mojo2.1k2944138
  • spago

    nlpodyssey/spago

    Self-contained Machine Learning and Natural Language Processing library in Go

    Language:Go1.8k375789

  • genieincodebottle/generative-ai

    Comprehensive resources on Generative AI, including a detailed roadmap, projects, use cases, interview preparation, and coding preparation.

    Language:Jupyter Notebook1.5k222360

  • Ma-Lab-Berkeley/CRATE

    Code for CRATE (Coding RAte reduction TransformEr).

    Language:Python1.2k202293

  • awslabs/sockeye

    Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

    Language:Python1.2k48311323

  • berniwal/swin-transformer-pytorch

    Implementation of the Swin Transformer in PyTorch.

    Language:Python8441025131
  • joeynmt

    joeynmt/joeynmt

    Minimalist NMT for educational purposes

    Language:Python7021696222

  • cuiziteng/Illumination-Adaptive-Transformer

    🌕 [BMVC 2022] You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction. SOTA for low light enhancement, 0.004 seconds try this for pre-processing.

    Language:Python53257949

  • linwhitehat/ET-BERT

    The repository of ET-BERT, a network traffic classification model on encrypted traffic. The work has been accepted as The Web Conference (WWW) 2022 accepted paper.

    Language:Python5274109101

  • wgcban/ChangeFormer

    [IGARSS'22]: A Transformer-Based Siamese Network for Change Detection

    Language:Python514410764

  • fastnlp/CPT

    CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

    Language:Python49138773

  • google-research/maxvit

    [ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmentation, image quality, and generative modeling...

    Language:Jupyter Notebook48472033

  • kyegomez/MultiModalMamba

    A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.

    Language:Python4598324

  • abdur75648/Deep-Learning-Specialization-Coursera

    This repo contains the updated version of all the assignments/labs (done by me) of Deep Learning Specialization on Coursera by Andrew Ng. It includes building various deep learning models from scratch and implementing them for object detection, facial recognition, autonomous driving, neural machine translation, trigger word detection, etc.

    Language:Jupyter Notebook45365366

  • wjf5203/SeqFormer

    SeqFormer: Sequential Transformer for Video Instance Segmentation (ECCV 2022 Oral)

    Language:Python34672530

  • sgrvinod/a-PyTorch-Tutorial-to-Transformers

    Attention Is All You Need | a PyTorch Tutorial to Transformers

    Language:Python3396547

  • ZixuanKe/PyContinual

    PyContinual (An Easy and Extendible Framework for Continual Learning)

    Language:Python31782464

  • hkproj/transformer-from-scratch-notes

    Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)

    3083170

  • PengBoXiangShang/multigraph_transformer

    IEEE TNNLS 2021, transformer, multi-graph transformer, graph, graph classification, sketch recognition, sketch classification, free-hand sketch, official code of the paper "Multi-Graph Transformer for Free-Hand Sketch Recognition"

    Language:Python2967532

  • UIC-Liu-Lab/ContinualLM

    An Extensible Continual Learning Framework Focused on Language Models (LMs)

    Language:Python286111121

  • VSainteuf/pytorch-psetae

    PyTorch implementation of the model presented in "Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention"

    Language:Python20732445

  • zhongkaifu/Seq2SeqSharp

    Seq2SeqSharp is a tensor based fast & flexible deep neural network framework written by .NET (C#). It has many highlighted features, such as automatic differentiation, different network types (Transformer, LSTM, BiLSTM and so on), multi-GPUs supported, cross-platforms (Windows, Linux, x86, x64, ARM), multimodal model for text and images and so on.

    Language:C#205226041
  • ernie

    labteral/ernie

    Simple State-of-the-Art BERT-Based Sentence Classification with Keras / TensorFlow 2. Built with HuggingFace's Transformers.

    Language:Python20151431

  • prakhar21/TextAugmentation-GPT2

    Fine-tuned pre-trained GPT2 for custom topic specific text generation. Such system can be used for Text Augmentation.

    Language:Python19361043

  • miccaiif/TransMEF

    Official PyTorch implementation of our AAAI22 paper: TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework via Self-Supervised Multi-Task Learning.

    Language:Python16462016
  • LongRoPE

    jshuadvd/LongRoPE

    Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper

    Language:Python1495314

  • onlybooks/llm

    LLM을 활용한 실전 AI 애플리케이션 개발

    Language:Jupyter Notebook148529116

  • vilari-mickopf/mmwave-gesture-recognition

    Basic Gesture Recognition Using mmWave Sensor - TI AWR1642

    Language:Python13951324

  • huangjia2019/llm-gpt

    异步图书 GPT图解 大模型是怎样构建的

    Language:Jupyter Notebook1293439

  • jcwang123/BA-Transformer

    [MICCAI 2021] Boundary-aware Transformers for Skin Lesion Segmentation

    Language:Python12911524

  • ra1ph2/Vision-Transformer

    Implementation of Vision Transformer from scratch and performance compared to standard CNNs (ResNets) and pre-trained ViT on CIFAR10 and CIFAR100.

    Language:Jupyter Notebook1132111

  • jet-universe/particle_transformer

    Official implementation of "Particle Transformer for Jet Tagging".

    Language:Python1085282

  • quanghuy0497/Transformers4Vision

    A summarization of Transformer-based architectures for CV tasks, including image classification, object detection, segmentation, and Few-shot Learning. Keep updated frequently.

    1082018

  • kyegomez/Algorithm-Of-Thoughts

    My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"

    Language:Python982415