Memory issue when processing large strings
mlhaigh opened this issue · 1 comments
mlhaigh commented
StringSifter uses extreme amounts of memory when run on a sample containing a very long string. The immediate problem is the rectangular array used to store the input strings before processing even begins, but there may be further memory consumption issues during processing.
Ideally, StringSifter memory use should be bounded to some multiple of the input size in bytes.