Mismatch of the category of AmazonPolarityClassification

Question

Mismatch of the category of AmazonPolarityClassification

twadada opened this issue 4 months ago · 2 comments

In the current ver., AmazonPolarityClassification is registered as 's2s' but it was 'p2p' in the previous ver., and the paper also says it's p2p. I looked at the actual input text, and I guess p2p is the correct one?

Answer 1 · 2024-09-13T12:05:38.000Z

Added a fix in #1220 - @Muennighoff just adding you here in case there is something I missed, but I do agree with @twadada that it should probably be s2s

Answer 2 · 2024-09-13T12:06:02.000Z

Regardless: "avg_character_length" available in descriptive_stats is probably a better metric for many use-cases.