bigscience-workshop/data-preparation

Issues

• Welcome to try SailCraft - A data cleaning tool built upon this repository

  #44 opened 2 months ago by longxudou
  0

• Why stopwords_min_cutoff rather than stopwords_max_cutoff?

  #43 opened 2 months ago by longxudou
  0

• Changing parmater values to extreme in parameters_filtering.py doesn't change the no. f documents being removed

  #42 opened 4 months ago by dk-github-acc
  0

• author = "bigscience-catalogue-lm-data", there is no this data in Huggingface.

  #41 opened 4 months ago by belle9217
  0

• Can't find the Deduplication Report

  #40 opened 7 months ago by longxudou
  0

• Extending this codebase

  #39 opened a year ago by chris-ha458
  0

• the version of simhash

  #38 opened a year ago by wang9702
  0

• Mismatch of the Available Data Quantity on Huggingface

  #37 opened a year ago by cll-mtk
  0

• Add citation

  #14 opened 2 years ago by HugoLaurencon
  1

• Check links

  #9 opened 2 years ago by HugoLaurencon
  0

• rename cc_pseudo_crawl seed_batch_1 slurm scripts

  #3 opened 2 years ago by SaulLu
  0

• Write READMEs

  #6 opened 2 years ago by thomasw21
  0