X-jun-0130/LLM-Pretrain-FineTune

Issues

• 数据去重逻辑

  #16 opened 4 months ago by wandouguo
  3

• 构建数据集

  #12 opened 7 months ago by HarryFunn
  1

• 进行增量预训练一些问题

  #15 opened 7 months ago by codewen77
  3

• 关于数据集构建

  #13 opened 10 months ago by Stark-zheng
  1

• 请问使用到的数据会开源吗

  #14 opened 8 months ago by paizhongxing
  1

• 求预训练和sft的数据格式形式

  #11 opened a year ago by cristianohello
  1

• 请问lora多卡有代码吗

  #7 opened a year ago by belle9217
  1

• 请问处理好的数据可以提供一下吗

  #8 opened a year ago by YSLLYW
  3

• 预训练数据里的表格是怎么处理转换的？

  #10 opened a year ago by chenryn
  1

• 请问该项目支持ChatGLM-6B吗

  #9 opened a year ago by gloryyoung
  0

• 替换成LLama : Error: Incorrect padding

  #5 opened a year ago by SeekPoint
  3

• 请问预训练文本格式？

  #6 opened 2 years ago by AceCHQ
  1

• Repo id must be in the form 'repo_name' or 'namespace/repo_name': './Model_TH/Bloom_6B4_zh/'. Use `repo_type` argument if needed.

  #4 opened 2 years ago by SeekPoint
  1

• os.chdir('./Nlp_2023/Dialogue_Bloom/')

  #3 opened 2 years ago by flomok
  1

• 请问微调模型的效果如何？

  #2 opened 2 years ago by aiporter-1
  1

• 我是一个新手，可以用到 llama 上不

  #1 opened 2 years ago by ze00ro
  1