QingruZhang/AdaLoRA

Issues

• TypeError: unsupported operand type(s) for *: 'Parameter' and 'NoneType'

  #21 opened 9 months ago by tf2bb
  5

• Works well

  #26 opened 4 months ago
  0

• How to use other importance metrics as in Table 4 (section 4.4)?

  #25 opened 5 months ago by geoffvdr
  0

• AssertionError

  #20 opened 10 months ago by luoxindi
  2

• where is the "training cost as C(P, E, Q)" in your total loss L(P, E, Q) = C(P, E, Q) + γ Pn k=1 R(Pk, Qk),

  #24 opened 7 months ago by LiZhangMing
  0

• Does 'apply_rankselector appear in the code?

  #15 opened 7 months ago by dddfaker
  1

• Lora Dreambooth?

  #8 opened 7 months ago by Dentoty
  1

• How to implement prune LoRA?

  #6 opened 7 months ago by A11en0
  1

• The question about convergence speed

  #19 opened a year ago by Lanbai-eleven
  1

• Question about orthogonal regularization methods

  #22 opened 9 months ago by fei407
  1

• Random seeds used in your experiments

  #23 opened 8 months ago by Car-pe
  2

• Questions about ranknum

  #12 opened 9 months ago by luchaoqi
  1

• A mismatch between best hyperparameters and hyperparameters ranges

  #11 opened a year ago by kefirski
  2

• When I use multi-GPU training on a single machine, the following error is reported：ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 470401) of binary: /home/sqh/miniconda3/envs/NLU/bin/python

  #17 opened a year ago by Sun-9923
  1

• AssertionError: DistributedDataParallel is not needed when a module doesn't have any parameter that requires a gradient.

  #18 opened a year ago by DigitalLifeYZQiu
  0

• Question about the random seeds

  #16 opened a year ago by SEONHOK
  0

• TypeError: 'NoneType' object is not iterable

  #13 opened a year ago by lcqlalala
  10

• Fusion lora weights to original weights

  #14 opened a year ago by vvhj
  0

• How do you find the optimal parameters?

  #9 opened a year ago by A11en0
  2

• How about the variance in GLUE bencharmark?

  #10 opened a year ago by A11en0
  0

• question about early stopping

  #3 opened a year ago by DopamineLcy
  2

• Tried to run ./scripts/run_debertav3_mnli.sh but received error ""

  #7 opened a year ago by ndvbd
  3

• What is the exactly count of parameters in DeBERTaV3-base

  #5 opened a year ago by Lucius-lsr
  1

• TypeError: __init__() got an unexpected keyword argument 'rankallocator'

  #4 opened a year ago by fxb392
  6

• from_pretrained parameters

  #2 opened a year ago by fxb392
  2

• Request for Hyperparameters to Reproduce Full Fine-Tuning Results in GLUE

  #1 opened a year ago by HarryWu99
  1