astramind-ai/Mixture-of-depths

Issues

• Training error

  #9 opened 2 months ago by Mi5sssss
  2

• Gradient propagation

  #10 opened 2 months ago by NickNickGo
  1

• Question about the impl

  #11 opened 2 months ago by GeneZC
  1

• Deepspeed is Not Supported

  #12 opened 2 months ago by PhoebusSi
  0

• qwen1.5出现越界

  #8 opened 3 months ago by FB-wh
  3

• Training scripts for the MoD models

  #6 opened 3 months ago by Aafiya-H
  4

• Unable to run model.generate() using converted model

  #7 opened 3 months ago by Zkli-hub
  6

• recalculate capacity question

  #4 opened 3 months ago by starsholic
  2

• training question on LLama_factory

  #2 opened 5 months ago by putizi-super
  1

• Can we combine this method with moe?

  #3 opened 3 months ago by kostum123
  1

• Misaligned implementation with paper

  #5 opened 4 months ago by starsholic
  1

• training question

  #1 opened 5 months ago by bobzhang208
  2