iShohei220/adopt

Issues

• Ademamix mixing

  #11 opened a month ago by edmondja
  10

• Is this optimizer scheduler-free?

  #18 opened 20 days ago by calliope-pro
  0

• Cannot reproduce toy problem results

  #16 opened a month ago by Tony-Y
  0

• Unexpected error: 'decouple'

  #15 opened a month ago by adeerkhan
  0

• Lower perfoemance

  #8 opened a month ago by bolbolamir
  2

• What LR should be chosen when replacing AdamW with ADOPT

  #9 opened a month ago by omrastogi
  1

• All loses in first epoch give Nan errors

  #10 opened a month ago by adeerkhan
  1

• Jax implementation

  #14 opened a month ago by MaAl13
  0

• Actually requires torch 2.5+?

  #4 opened a month ago by dx2-66
  1

• missing _fused_adopt

  #7 opened a month ago by winglian
  1

• Formatting error in paper - Algorithm 4 is missing

  #5 opened a month ago by enolan
  1

• would love a pip package to make it super easy to install. You can use pyproject.toml

  #2 opened 2 months ago by kyegomez
  0

• Hi, might be a stupid question

  #1 opened 2 months ago by Hyle33ies
  2