chanced/caps

an input with numbers followed by a lowercase string that are delimited results in the numbers being dropped by the tokenizer

chanced opened this issue · 0 comments

test case: "123_123_number"
result: "number"
expected: ["123", "123", "number"]