sgd

vballoli/nfnets-pytorch

NFNets and Adaptive Gradient Clipping for SGD implemented in PyTorch. Find explanation at tourdeml.github.io/blog/

yechengxi/LightNet

Efficient, transparent deep learning in hundreds of lines of code.

tsycnh/mlbasic

深度学习常用优化方法详解

hiroyuki-kasai/SGDLibrary

MATLAB/Octave library for stochastic optimization algorithms: Version 1.0.20

gyrdym/ml_algo

Machine learning algorithms in Dart programming language

wenwei202/terngrad

Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)

SirRob1997/Crowded-Valley---Results

This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"

OverLordGoldDragon/keras-adamw

Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers

AnicetNgrt/jiro-nn

A Deep Learning and preprocessing framework in Rust with support for CPU and GPU.

bentrevett/a-tour-of-pytorch-optimizers

A tour of different optimization algorithms in PyTorch.

ucla-vision/entropy-sgd

Lua implementation of Entropy-SGD

jack-willturner/batchnorm-pruning

Rethinking the Smaller-Norm-Less-Informative Assumption in Channel Pruning of Convolution Layers https://arxiv.org/abs/1802.00124

ZebraDevs/LinkOS-Android-Samples

Java based sample code for developing on Android. The demos in this repository are stored on separate branches. To navigate to a demo, please click branches.

c-gabri/Federated-Learning-PyTorch

PyTorch implementation of Federated Learning algorithms FedSGD, FedAvg, FedAvgM, FedIR, FedVC, FedProx and standard SGD, applied to visual classification. Client distributions are synthesized with arbitrary non-identicalness and imbalance (Dirichlet priors). Client systems can be arbitrarily heterogeneous. Several mobile-friendly models are provided

Mrpatekful/swats

Unofficial implementation of Switching from Adam to SGD optimization in PyTorch.

hiroyuki-kasai/RSOpt

Riemannian stochastic optimization algorithms: Version 1.0.3

loudinthecloud/dpwa

Distributed Learning by Pair-Wise Averaging

decile-team/jensen

A C++ toolkit for Convex Optimization (Logistic Loss, SVM, SVR, Least Squares etc.), Convex Optimization algorithms (LBFGS, TRON, SGD, AdsGrad, CG, Nesterov etc.) and Classifiers/Regressors (Logistic Regression, SVMs, Least Squares Regression etc.)

dselivanov/FTRL

R/Rcpp implementation of the 'Follow-the-Regularized-Leader' algorithm

hwalsuklee/numpy-neuralnet-exercise

Implementation of key concepts of neuralnetwork via numpy

eBay/AutoOpt

Automatic and Simultaneous Adjustment of Learning Rate and Momentum for Stochastic Gradient Descent

haidfs/TransE

TransE方法的Python实现，解释SGD中TransE的向量更新

thecml/dpsgd-optimizer

Amortized version of the differentially private SGD algorithm published in "Deep Learning with Differential Privacy" by Abadi et al. Enforces privacy by clipping and sanitising the gradients with Gaussian noise during training.

chentingpc/NNCF

Code for paper "On Sampling Strategies for Neural Network-based Collaborative Filtering"

ucla-vision/parle

arseniyturin/SGD-From-Scratch

Stochastic gradient descent from scratch for linear regression

Akramz/grokking-deep-learning-notebooks

Notes & Code to go over "Grokking Deep Learning" Book by Andrew Trask

xinyandai/gradient-quantization

vector quantization for stochastic gradient descent.

tml-epfl/sgd-sparse-features

SGD with large step sizes learns sparse features [ICML 2023]

statmlben/ensLoss

EnsLoss: Stochastic Calibrated Loss Ensembles for Preventing Overfitting in Classification

dpressel/sgdtk

A Java library for Stochastic Gradient Descent (SGD)

LPD-EPFL/ByzantineMomentum

Distributed Momentum for Byzantine-resilient Stochastic Gradient Descent (ICLR 2021)

dimgold/Artificial_Curiosity

Adaptive Reinforcement Learning of curious AI basketball agents

yym-ustc/FactorizationMachine

implementation of factorization machine, support classification.

oligoglot/theedhum-nandrum

A sentiment classifier on mixed language (and mixed script) reviews in Tamil, Malayalam and English