jettify/pytorch-optimizer

Issues

• AttributeError: module 'torch_optimizer' has no attribute 'Lion'

  #542 opened 3 months ago by SamMohel
  0

• How to stop memory leak while using adahessian?

  #540 opened 7 months ago by Shubh-Goyal-07
  1

• `AttributeError: module 'torch_optimizer' has no attribute 'MAGRAD'`

  #537 opened a year ago by SamMohel
  1

• Is library alive?

  #496 opened 2 years ago by dkajtoch
  2

• [Feature Request] Aida optimizer

  #538 opened a year ago by okbalefthanded
  0

• VeLO: Training Versatile Learned Optimizers by Scaling Up

  #479 opened 2 years ago by hoangmit
  2

• Configurable step size instead of hard-coded default values for adafactor

  #535 opened a year ago by lamthuy
  0

• Lookahead init does not call super init although it inherits from torch.Optimizer

  #349 opened 4 years ago by chenkins
  1

• Adafactor fails to run on a custom (rfs) resnet12 (with MAML)

  #405 opened 3 years ago by brando90
  3

• problem with Adafactor

  #469 opened 2 years ago by pavelbatyr
  2

• Implementation of Shampoo inconsistent with the paper

  #502 opened 2 years ago by siddharth9820
  0

• Include the Sophia Optimizer

  #501 opened 2 years ago by bratao
  0

• adahessian bug: it does not support the 3D conv

  #500 opened 2 years ago by ziming-liu
  0

• Include Lion Optimizer

  #498 opened 2 years ago by Haoxiang-Wang
  2

• Include AdaNorm optimizer (WACV 2023)

  #499 opened 2 years ago by shivram1987
  0

• Adai Optimizer ICML2022 Oral: adaptive momentum hyperparameters instead of adaptive learning rate

  #476 opened 2 years ago by zeke-xie
  0

• Which version of Shampoo is implemented?

  #452 opened 3 years ago by RylanSchaeffer
  1

• fix readme kappa

  #468 opened 2 years ago by pavelbatyr
  0

• Adan optimiser: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

  #459 opened 3 years ago by iiSeymour
  1

• Complex numbers

  #458 opened 3 years ago by Ni-Chen
  0

• spot bug in SGDW implementation (weight decay part)

  #454 opened 3 years ago by Leiay
  0

• lamb optimizer mistake

  #443 opened 3 years ago by trofimovaolga
  0

• Using GPU to train the model

  #257 opened 4 years ago by penny9287
  7

• how to deal with DataParallel model?

  #436 opened 3 years ago by xk-wang
  1

• the implementation of SGDW is not consistent with paper?

  #433 opened 3 years ago by twmht
  0

• [Feature Request] SAM optimizer

  #346 opened 4 years ago by bojesomo
  2

• Example of how to use scheduler

  #404 opened 3 years ago by brando90
  2

• AdamD implementation (or option to skip bias-correction to adam-derived optimizers)?

  #385 opened 3 years ago by jstjohn
  1

• Don’t include `tests` in your distribution

  #384 opened 3 years ago by flying-sheep
  1

• GPU memory leak in adahessian optimizer?

  #358 opened 4 years ago by sjscotti
  3

• If I used torch_optimizer in my research, how should i cite it?

  #356 opened 3 years ago by codewithzichao
  1

• LAMB: Differences from the paper author's official implementation

  #226 opened 4 years ago by binmakeswell
  3

• Apollo optimizer eats all the GPU memory

  #306 opened 4 years ago by EmilPi
  2

• SGDP default settings are "incorrect" (and the visualization is uncharacteristic for SGDP)

  #354 opened 4 years ago by torridgristle
  0

• [FEATURE REQUEST] LARS

  #345 opened 4 years ago by isvogor-foi
  0

• README.rst Typo

  #331 opened 4 years ago by torridgristle
  1

• [Feature Request] SAM/ASAM Sharpness-Aware Minimization for Efficiently Improving Generalization

  #326 opened 4 years ago by LukeAI
  0

• Any chance of adding this package to an anaconda channel?

  #280 opened 4 years ago by AlexMetsai
  0

• [Feature Request] Adaptive Gradient Clipping

  #272 opened 4 years ago by kayuksel
  2

• Best Optimizer for Training GANs?

  #267 opened 4 years ago by kayuksel
  1

• Visualization & Benchmarking

  #268 opened 4 years ago by kayuksel
  1

• Removing python3.5 support

  #229 opened 4 years ago by jettify
  2

• Wrong paper references for Ranger optimizer variants

  #244 opened 4 years ago by jwuphysics
  1

• eps value in Adabelief optimizer

  #236 opened 4 years ago by sidml
  2

• Unfair comparison in Visualizations

  #219 opened 4 years ago by XuezheMax
  5

• What is decay factor in Yogi

  #212 opened 4 years ago by bhardwaj1230
  1

• Add AdaBelief

  #208 opened 4 years ago by Erotemic
  1

• Dependabot couldn't authenticate with https://pypi.python.org/simple/

  #196 opened 4 years ago by dependabot-preview
  0

• Ralamb

  #188 opened 5 years ago by TezRomacH
  0

• Update ranger to use gradient centralization

  #183 opened 5 years ago by bratao
  0