GraphPKU/PiSSA

Issues

• Where is the evaluation code?

  #22 opened 3 months ago by Ther-nullptr
  1

• 在加载时遇到cpu使用率过高的问题

  #23 opened 3 months ago by qinghaojun
  0

• 您好，PiSSA是否可以与LoRAMoE等方法进行结合，作为LoRA的初始化？LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugin

  #21 opened 4 months ago by Shubao-Zhao
  0

• 使用llama-factory lora微调qwen1.5-32B-Chat，报错ValueError: Cannot initialize PiSSA adapter on quantized models.

  #20 opened 4 months ago by TC10127
  0

• 您好，是否可以支持CogVLM等多模态模型？

  #15 opened 4 months ago by Shubao-Zhao
  2

• Why does my PiSSA init process so slow?

  #19 opened 5 months ago by ANYMS-A
  2

• 如何使用CodeFeedBack数据集进行微调的？

  #17 opened 4 months ago by Peroplex
  1

• Training scripts of Pissa with LLaMA-2-7b for 3 epoches

  #18 opened 4 months ago by lucasliunju
  1

• 关于kernel_size大于1的卷积的权重的分解

  #16 opened 5 months ago by lastapple
  2

• It seems to be an error when getting_peft_model：ValueError: not enough values to unpack (expected 2, got 1)

  #14 opened 5 months ago by Pashisfisuta
  1

• linalg.svd: The input tensor A must have at least 2 dimensions.

  #11 opened 6 months ago by q497629642
  3

• Output singular value

  #13 opened 5 months ago by GYDTTDYX
  0

• Ask for help: I encountered the following error while running `gsm8k_inference.py`:

  #12 opened 6 months ago by cyp-jlu-ai
  2

• Mismatches in tensor sizes

  #10 opened 6 months ago by poaboagye
  4

• [NLU] Testing PiSSA on the GLUE Benchmark with RoBERTa-Base Model?

  #8 opened 6 months ago by SKDDJ
  1

• memory issue

  #7 opened 7 months ago by Leosgp
  3

• reproduce the results

  #4 opened 7 months ago by lucasliunju
  2

• A check on my Results

  #6 opened 7 months ago by poaboagye
  2

• Unable to unzip the MetaMathQA-395K.json.zip

  #5 opened 7 months ago by poaboagye
  2

• what is difference between trrain.py and pissa_finetuning.py

  #3 opened 7 months ago by azuryl
  1

• High Training Loss

  #2 opened 7 months ago by andyzoujm
  2

• training数据集是否有问题？

  #1 opened 7 months ago by xinlanz
  1