/open-sentiment-corpus

OpenSentimentCorpus

This repository contains OpenSentimentCorpus, a sentence-level sentiment dataset for Russian.

OpenSentimentCorpus is a derivative of OpenCorpora, an open corpus of Russian texts.

Markup

  1. All the sentences shorter than 7 words were excluded.
  2. Each sentence was marked as positive, negative, neutral, mixed, or doubtful by at least three evaluators according to the sentence author's attitude to the topic of the sentence. The mixed mark indicates that the author expresses both positive and negative attitude in the sentence, and the doubtful mark indicates that the sentence has questionable sentiment, unclear author's position, or any other reason of the evaluator's uncertainty.
  3. All the sentences that had at least one doubtful, or both positive and negative marks were excluded.
  4. Two approaches to the calculation of the final sentiments were utilized.
    • According to the first approach, the final sentiment of each sentence was calculated according to the majority of marks. If there was no such a majority, the sentence was excluded.
    • According to the second approach, the final sentiment was assigned according to the result of agreement between all the evaluators. If there was no such an agreement, the sentence was excluded.

Content

There are four files in the repository:

  • opensentimentcorpus-final-by-majority.csv contains only final sentiments calculated according to the majorities of the marks;
  • opensentimentcorpus-final-by-total-agreement.csv contains only final sentiments calculated according to the total agreement of the annotators;
  • opensentimentcorpus-final-by-total-agreement-with-expert-validation.csv contains sentiments calculated according to the annotators and validated by the linguistic experts;
  • opensentimentcorpus-all-marks.csv contains all the evaluators' marks.

Evaluators

  • Alexander Skvortsov (Скворцов Александр Константинович)
  • Alla Manakhova (Манахова Алла Михайловна)
  • Anastasia Baskakova (Баскакова Анастасия Сергеевна)
  • Anastasia Chernyshova (Чернышова Анастасия Александровна)
  • Anna Moscwina (Москвина Анна Владимировна)
  • Anton Kurbatov (Курбатов Антон Игоревич)
  • Daniil Vereschagin (Верещагин Даниил Дмитриевич)
  • Dmitry Chernyshov (Чернышов Дмитрий Васильевич)
  • Dmitry Kononets (Кононец Дмитрий Анатольевич)
  • Evgenya Shikova (Шикова Евгения Борисовна)
  • Igor Krasavin (Красавин Игорь Сергеевич)
  • Ilona Arefyeva (Арефьева Илона Юрьевна)
  • Ivan Beliyakov (Беляков Иван Николаевич)
  • Maria Leonova (Леонова Мария Алексеевна)
  • Sergey Yazynin (Язынин Сергей Германович)
  • Veronika Sliskova (Слискова Вероника Валерьевна)
  • Vladislav Nepryahin (Непряхин Владислав Вадимович)
  • Vladislav Petryakov (Петряков Владислав Леонидович)

Terms of use

Please cite

@article{poletaev2023semanticrules,
    title   = {Semantic rule-based sentiment detection algorithm for {Russian} publicism sentences},
    author  = {Poletaev, Anatoliy Y. and Paramonov, Ilya V. and Boychuk, Elena I.},
    journal = {Modeling and Analysis of Information Systems},
    volume  = {30},
    number  = {4},
    pages   = {394--147},
    year    = {2023},
    doi     = {10.18255/1818-1015-2023-4-394-417}
}

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License