grahamwaters/lorebook_generator_for_novelai

Improve quality of lorebook text with Spacy

grahamwaters opened this issue · 0 comments

grahamwaters commented

Using SpaCy or nltk (potentially even sklearn), we would like to reduce the size of the entry texts by eliminating text that is either:

  1. Redundant
  2. Insight Sparse
  3. Poorly formatted
  4. or noninformative (as it pertains to the overall topic.