Improve Stanza Integration
tomassosorio opened this issue · 0 comments
tomassosorio commented
🚀 Feature
Allow stanza to automatically extract other meta-data from the process, for example, lemmatization and NER.
LEVEL: tokenizers.StanzaTokenizer
Motivation
Stanza pipelines allow to run not only tokenizer but also extract lemmatization from words or NE but for this needs the document context, so since it is already tokenizing if the user wants also the lemmatization or NER it should allow it to.