HuaizhengZhang/Active-Learning-as-a-Service

Missing model confidence values for NER model prediction result in error

Opened this issue · 0 comments

For random sampling, I have skipped the model loading in the [latest commit]
For NER tasks, the server can be started after the latest update. However, due to the task itself, sometimes the transformer model will return an empty list if there is no entity detected. In such cases, the AL strategy has no values to rank up. It is an interesting issue since currently our system only scores the score given by the hugging face models.

If you have any ideas about that, feel free to discuss them here.

Originally posted by @huangyz0918 in #39 (comment)