Pinned Repositories
academicpages.github.io
Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes
AI-Expert-Roadmap
Roadmap to becoming an Artificial Intelligence Expert in 2022
ALBERT-Pytorch
Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)
alphafold2
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
angular-5-examples
some example of angular 5 using typescript
angular-reddit-like
angular reddit like little app
annotated_deep_learning_paper_implementations
🧑🏫 50! Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
arabic-tacotron-tts
End to end Arabic TTS system based on tacotron
awesome-deep-learning
A curated list of awesome Deep Learning tutorials, projects and communities.
Star-Form-With-Live-Preview-Angular
Star Form With Live Preview Angular
merouone's Repositories
merouone/ProtTrans
ProtTrans is providing state of the art pretrained language models for proteins. ProtTrans was trained on thousands of GPUs from Summit and hundreds of Google TPUs using Transformers Models.
merouone/h-transformer-1d
Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning
merouone/scPretrain
scPretrain: Multi-task self-supervised learning for cell type classification
merouone/academicpages.github.io
Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes
merouone/x-transformers
A simple but complete full-attention transformer with a set of promising experimental features from various papers
merouone/cpg-transformer
CpG Transformer for imputation of single-cell methylomes
merouone/transformers-lightning
A collection of Models, Datasets, DataModules, Callbacks, Metrics, Losses and Loggers to better integrate pytorch-lightning with transformers.
merouone/TIS_transformer
Transformer model for TIS annotation
merouone/GenomicTransformer
merouone/protein_bert
merouone/reformer-pytorch
Reformer, the efficient Transformer, in Pytorch
merouone/bigbird
Transformers for Longer Sequences
merouone/DNA-transformer
merouone/transformers
🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.
merouone/alphafold2
To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released
merouone/linear-attention-transformer
Transformer based on a variant of attention that is linear complexity in respect to sequence length
merouone/long-range-arena
Long Range Arena for Benchmarking Efficient Transformers
merouone/bert-enhancer
A Transformer Architecture Based on BERT and 2D Convolutional Neural Network to Identify DNA Enhancers from Sequence Information
merouone/former
Simple transformer implementation from scratch in pytorch.
merouone/MaskedLanguageModelingRoberta
merouone/ERNIE
Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimodal Understanding & Generation, and beyond.
merouone/PLMpapers
Must-read Papers on pre-trained language models.
merouone/transformers-language-modeling
Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3
merouone/ALBERT-Pytorch
Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)
merouone/mlm-pytorch
An implementation of masked language modeling for Pytorch, made as concise and simple as possible
merouone/DNABERT
DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome
merouone/arabic-tacotron-tts
End to end Arabic TTS system based on tacotron
merouone/bigbird_pytorch
merouone/pytorch-original-transformer
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
merouone/DNATransformer