bigcode-project/bigcode-analysis

Issues

• [Decontamination] Add readme and instructions to run substring decontamination

  #19 opened 2 years ago by RaymondLi0
  1

• [Near Deduplication] Tokenization

  #10 opened 2 years ago by ChenghaoMou
  2

• cannot import AttentionType from gpt2

  #20 opened 2 years ago by ocramz
  0

• Decontamination

  #13 opened 2 years ago by ChenghaoMou
  9

• Evaluate CodeGen on safe and all-license dataset

  #23 opened 2 years ago by harm-devries
  3

• Upload github dataset with license column

  #1 opened 2 years ago by harm-devries
  0

• github scraping speed limit

  #15 opened 2 years ago by bigximik
  0

• Broken link

  #12 opened 2 years ago by Sleepyhead01
  1

• [Near Deduplication] Benchmark

  #7 opened 2 years ago by ChenghaoMou
  2

• [Exact Substring Deduplication] Analysis

  #8 opened 2 years ago by ChenghaoMou
  1

• [Near Deduplication] Post processing

  #9 opened 2 years ago by ChenghaoMou
  0

• Rename model names on HF hub

  #2 opened 3 years ago by harm-devries
  1

• Add filtering to the near deduplicated safe dataset

  #5 opened 3 years ago by loubnabnl
  1

• Reorganize bigcode-data-analysis repository

  #3 opened 3 years ago by loubnabnl
  1