amazon-science/semimtr-text-recognition

Evaluation results?

yangxcccscsa opened this issue · 1 comments

yangxcccscsa commented

Hello, thank you for your contribution. When I use the downloaded model to evaluate, how do I look at the accuracy of each dataset? What does ccr, cwr, ted, ned, ted /w mean?
22222
111111

aaberdam commented

Hi,

You can see the exact calculation here

These are the full names of the mentioned metrics:

  • ccr - Character accuracy ratio
  • cwr - Word accuracy ratio
  • ted - Total edit distance
  • ned - Normalized edit distance (sum of edit distance / word length)
  • ted/w - Averaged edit distance (ted / #words)

Let me know if there is anything else.

Aviad