lessw2020
AI/PyTorch Partner Engineer - Meta AI (Facebook AI) Principal Software Engineer - Audere Software Architect - X10 Wireless Dev/PM - Microsoft
Seattle, WA USA
Pinned Repositories
Best-Deep-Learning-Optimizers
Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable
FAdam_PyTorch
an implementation of FAdam (Fisher Adam) in PyTorch
mish
Mish Deep Learning Activation Function for PyTorch / FastAI
Ranger-Deep-Learning-Optimizer
Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase
Ranger-Mish-ImageWoof-5
Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs
Ranger21
Ranger deep learning optimizer rewrite to use newest components
Ranger22
Testing various improvements to Ranger21 for 2022
res2net-plus
Res2Net architecture with improved stem and Mish activation function
training-detr
Unofficial Colab on how to train DETR, the intelligent object detector, with your own dataset. DETR = Detection Transformer
transformer_central
Various transformers for FSDP research
lessw2020's Repositories
lessw2020/Best-Deep-Learning-Optimizers
Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable
lessw2020/mish
Mish Deep Learning Activation Function for PyTorch / FastAI
lessw2020/res2net-plus
Res2Net architecture with improved stem and Mish activation function
lessw2020/Ranger-Mish-ImageWoof-5
Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs
lessw2020/training-detr
Unofficial Colab on how to train DETR, the intelligent object detector, with your own dataset. DETR = Detection Transformer
lessw2020/Thunder-Detr
(unofficial) - customized fork of DETR, optimized for intelligent obj detection on 'real world' custom datasets
lessw2020/AutoOpt-for-FastAI
Integrate Ebay's AutoOpt Deep Learning Optimizer into the FastAI framework
lessw2020/RangerQH-Testing
Repo for running RangerQH + Res2NetPLus with LIP Pooling
lessw2020/Curriculum-Learning-Dropout
Implementation of Curriculum Learning Dropout for FastAI framework
lessw2020/unet-seg
lessw2020/Practical_NLP_in_PyTorch
A repository containing tutorials for practical NLP using PyTorch
lessw2020/Thunder
AI framework for flexible training and results review (pytorch, vision and tabular)
lessw2020/advanced-nlp
Implementation of the latest developments in NLP ranging from ensemble learning to BERT. Pipelines are in Tensorflow and Pytorch
lessw2020/CSWin-Transformer
CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped
lessw2020/DeepLabV3Plus-Pytorch
DeepLabv3, DeepLabv3+ and pretrained models on VOC & Cityscapes
lessw2020/detr
End-to-End Object Detection with Transformers
lessw2020/diffGrad
diffGrad: An Optimization Method for Convolutional Neural Networks
lessw2020/fastai-v3
Starter app for fastai v3 model deployment on Render
lessw2020/fastai_docs
dev notebooks (for docs see http://docs.fast.ai and https://github.com/fastai/fastai)
lessw2020/files
lessw2020/golang-wiki-server
wikipedia type webserver built in golang (based on the golang tutorial)
lessw2020/Gradient-Centralization
A New Optimization Technique for Deep Neural Networks
lessw2020/Holocron
PyTorch implementations of recent Computer Vision tricks
lessw2020/imagenette
A smaller subset of 10 easily classified classes from Imagenet, and a little more French
lessw2020/ImageSubNet
Subsets of ImageNet, with corrected labelling and train/val balancing for accurate benchmarking
lessw2020/learnopencv
Learn OpenCV : C++ and Python Examples
lessw2020/lightweight-gan
Implementation of 'lightweight' GAN, proposed in ICLR 2021, in Pytorch. High resolution image generations that can be trained within a day or two
lessw2020/madgrad
MADGRAD Optimization Method
lessw2020/ManifoldMixup
Manifold-Mixup implementation for fastai
lessw2020/swin-transformer-pytorch
Implementation of the Swin Transformer in PyTorch.