ChenghaoMou/text-dedup

Issues

• Doubts about the multiprocessing start method and behavior

  #26 opened a year ago
  9

• Issue with NON_ALPHA Regular Expression for Multilingual Support

  #24 opened a year ago
  1

• NameError: name 'uf' is not defined

  #23 opened a year ago
  5

• Suffix Array consumed time

  #22 opened 8 months ago
  10

• How to get jaccard score for minhash spark?

  #21 opened a year ago
  4

• Out of memory on Spark

  #20 opened a year ago
  1

• duplicated substring removal in suffix_array.py

  #19 opened a year ago
  1

• How to get duplicates cluster ids?

  #18 opened a year ago
  4

• the ngram setting of minhash

  #17 opened a year ago
  6

• any document or example?

  #16 opened 2 years ago
  4

• how to deduplicate already save_to_disk dataset ?

  #15 opened 2 years ago
  2

• Suffix array clean up

  #14 opened 2 years ago
  3

• New release

  #13 opened 2 years ago
  2

• Question about code of spark.py

  #12 opened 2 years ago
  3

• Spark configurations

  #11 opened 2 years ago
  3

• How possible to control Deduplication Threshold ?

  #10 opened 2 years ago
  2

• Suffix Array Substring Exact Deduplication

  #9 opened 2 years ago
  2

• MinHash dedup parameters

  #8 opened 2 years ago
  17

• Raising errors on subprocess calls rather than logging

  #6 opened 2 years ago
  2

• Question about GoogleSuffixArrayDeduplicator

  #5 opened 2 years ago
  3

• ModuleNotFoundError: No module named 'text_dedup.embedders'

  #4 opened 2 years ago
  6