optimizers
There are 69 repositories under optimizers topic.
labmlai/annotated_deep_learning_paper_implementations
🧑🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
lucidrains/lion-pytorch
🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
elixir-nx/axon
Nx-powered Neural Networks
gugarosa/opytimizer
🐦 Opytimizer is a Python library consisting of meta-heuristic optimization algorithms.
Yonghongwei/Gradient-Centralization
A New Optimization Technique for Deep Neural Networks
CyberZHG/keras-radam
RAdam implemented in Keras & TensorFlow
OverLordGoldDragon/keras-adamw
Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
clovaai/frostnet
FrostNet: Towards Quantization-Aware Network Architecture Search
Rishit-dagli/Gradient-Centralization-TensorFlow
Instantly improve your training performance of TensorFlow models with just 2 lines of code!
palle-k/DL4S
Accelerated tensor operations and dynamic neural networks based on reverse mode automatic differentiation for every device that can run Swift - from watchOS to Linux
usef-kh/fer
Code for the paper "Facial Emotion Recognition: State of the Art Performance on FER2013"
decile-team/submodlib
Summarize Massive Datasets using Submodular Optimization
hfxunlp/transformer
Neutron: A pytorch based implementation of Transformer and its variants.
CyberZHG/keras-lookahead
Lookahead mechanism for optimizers in Keras.
ivallesp/awesome-optimizers
Neural Network optimizers implemented from scratch in numpy (Adam, Adadelta, RMSProp, SGD, etc.)
ProudElm/solaredgeoptimizers
Intergration to get optimizers information from the SolarEdge portal
shreyansh26/ML-Optimizers-JAX
Toy implementations of some popular ML optimizers using Python/JAX
ShivamShrirao/dnn_from_scratch
A high level deep learning library for Convolutional Neural Networks,GANs and more, made from scratch(numpy/cupy implementation).
nestordemeure/flaxOptimizers
A collection of optimizers, some arcane others well known, for Flax.
warner-benjamin/optimi
Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
sail-sg/optim4rl
Optim4RL is a Jax framework of learning to optimize for reinforcement learning.
devzhk/cgds-package
Package for CGD and ACGD optimizers
harshalmittal4/Hypergradient_variants
Improved Hypergradient optimizers, providing better generalization and faster convergence.
chanzer0/NBA-DFS-Tools
A set of NBA optimizers and GPP tools to help you win daily fantasy sports
OrigamiDream/lion-tf
Lion - EvoLved Sign Momentum w/ New Optimizer API in TensorFlow 2.11+
seungjaeryanlee/awesome-optimizers
A curated list of optimizers for machine learning.
dmeoli/optiml
Optimizers for/and sklearn compatible Machine Learning models
plusminuschirag/Optimizers-Visualizations
A Repository to Visualize the training of Linear Model by optimizers such as SGD, Adam, RMSProp, AdamW, ASMGrad etc
timvvvht/Neural-Networks-and-Optimizers-from-scratch
Neural Networks and optimizers from scratch in NumPy, featuring newer optimizers such as DemonAdam or QHAdam.
AqwamCreates/DataPredict
Lua-Based Machine, Deep And Reinforcement Learning Library (For Roblox And Pure Lua). Contains 34 Models!
EliaFantini/ZO-AdaMM-vs-FO-AdaMM-convergence-and-minima-shape-comparison
Implementation and comparison of zero order vs first order method on the AdaMM (aka AMSGrad) optimizer: analysis of convergence rates and minima shape
Kockiee/Kockie-Optimizer-Python
Aplicação Windows desenvolvida por mim para otimização tanto do sistema como de certos jogos
Raffaelbdl/hyperbolic-nn-haiku
dm-haiku implementation of hyperbolic neural networks
dzonimn/Zoolia.jl
Julia implementations of various animal-inspired optimizers
xin-pu/ML-Sharp
ML with C#
lessw2020/QuantFour_AdamW_Cuda
Fused 4bit AdamW in Cuda