RLHF-V/RLAIF-V

Issues

• When I use the cal_logp of all dataset,I met the question.This

  #20 opened a month ago by XiaoLei2123
  4

• 我想问下 数据中logps怎么来的

  #16 opened a month ago by Spring24ch
  3

• Performance of POPE?

  #17 opened a month ago by shufangxun
  1

• Would the data generation code be released?

  #21 opened a month ago by Gaffey
  0

• Questions Regarding the Training Data and Settings for LLaVA as Used in the Paper

  #15 opened a month ago by Timsty1
  3

• About optimizer setting in Iterative Alignment

  #19 opened a month ago by davidluciolu
  2

• divide and conquer

  #18 opened 2 months ago by dreaming12580
  1

• 您好，我在跑训练的时候遇见了一个维度错误，不知道如何解决，我使用的是下载的数据集，clip是指定连接下载的clip

  #9 opened 2 months ago by XiaoLei2123
  3

• UnboundLocalError: local variable 'df' referenced before assignment

  #14 opened 2 months ago by Xuchen-Li
  2

• 请问下divide的模型是额外finetune过的么？

  #12 opened 2 months ago by menglin0320
  1

• Error when loading datasets split

  #13 opened 2 months ago by Xuchen-Li
  1

• control the output threshold of a large model

  #10 opened 3 months ago by zfr00
  1

• Self feedback data generation pipeline & reference model

  #6 opened 3 months ago by charismaticchiu
  7

• The LoRA training codes and scripts

  #11 opened 3 months ago by darkpromise98
  1

• Hello,when I run the train-scripts,I met the dimension error.But

  #8 opened 3 months ago by XiaoLei2123
  0

• keyerror:idx,I have changed the data_dir,but when I run the train script,I occured the error.How to fix

  #7 opened 3 months ago by XiaoLei2123
  2

• Error loading the parquet dataset

  #5 opened 3 months ago by charismaticchiu
  3

• Is there a paper or tech report to show the details of training and dataset

  #2 opened 4 months ago by CrossLee1
  3

• Data file not normal when opening "obj_halbench_300_with_image.jsonl"

  #4 opened 4 months ago by hxhcreate
  2

• dpo_preference_processor not defined

  #3 opened 4 months ago by RifleZhang
  1

• ref_win_logp

  #1 opened 4 months ago by buptlihang
  2