RuSentiment: An Enriched Sentiment Analysis Dataset for Social Media in Russian

Anna Rogers; Alexey Romanov; Anna Rumshisky; Svitlana Volkova; Mikhail Gronas; Alex Gribov

RuSentiment: An Enriched Sentiment Analysis Dataset for Social Media in Russian

Anna Rogers, Alexey Romanov, Anna Rumshisky, Svitlana Volkova, Mikhail Gronas, Alex Gribov

Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review

Abstract

This paper presents RuSentiment, a new dataset for sentiment analysis of social media posts in Russian, and a new set of comprehensive annotation guidelines that are extensible to other languages. RuSentiment is currently the largest in its class for Russian, with 31,185 posts annotated with Fleiss’ kappa of 0.58 (3 annotations per post). To diversify the dataset, 6,950 posts were pre-selected with an active learning-style strategy. We report baseline classification results, and we also release the best-performing embeddings trained on 3.2B tokens of Russian VKontakte posts.

Original language	English
Title of host publication	Proceedings of the 27th International Conference on Computational Linguistics
Number of pages	9
Place of Publication	Santa Fe, New Mexico, USA
Publisher	Association for Computational Linguistics
Publication date	2018
Pages	755-763
Publication status	Published - 2018

Keywords

RuSentiment dataset
sentiment analysis
social media
Russian language
annotation guidelines

Access to Document

http://aclweb.org/anthology/C18-1064

Cite this

@inproceedings{d758e94441f5488a94cfdc9830faed49,

title = "RuSentiment: An Enriched Sentiment Analysis Dataset for Social Media in Russian",

abstract = "This paper presents RuSentiment, a new dataset for sentiment analysis of social media posts in Russian, and a new set of comprehensive annotation guidelines that are extensible to other languages. RuSentiment is currently the largest in its class for Russian, with 31,185 posts annotated with Fleiss{\textquoteright} kappa of 0.58 (3 annotations per post). To diversify the dataset, 6,950 posts were pre-selected with an active learning-style strategy. We report baseline classification results, and we also release the best-performing embeddings trained on 3.2B tokens of Russian VKontakte posts.",

keywords = "RuSentiment dataset, sentiment analysis, social media, Russian language, annotation guidelines, RuSentiment dataset, sentiment analysis, social media, Russian language, annotation guidelines",

author = "Anna Rogers and Alexey Romanov and Anna Rumshisky and Svitlana Volkova and Mikhail Gronas and Alex Gribov",

year = "2018",

language = "English",

pages = "755--763",

booktitle = "Proceedings of the 27th International Conference on Computational Linguistics",

publisher = "Association for Computational Linguistics",

address = "United States",

}

RuSentiment: An Enriched Sentiment Analysis Dataset for Social Media in Russian. / Rogers, Anna; Romanov, Alexey; Rumshisky, Anna et al.
Proceedings of the 27th International Conference on Computational Linguistics. Santa Fe, New Mexico, USA: Association for Computational Linguistics, 2018. p. 755-763.

Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review

TY - GEN

T1 - RuSentiment: An Enriched Sentiment Analysis Dataset for Social Media in Russian

AU - Rogers, Anna

AU - Romanov, Alexey

AU - Rumshisky, Anna

AU - Volkova, Svitlana

AU - Gronas, Mikhail

AU - Gribov, Alex

PY - 2018

Y1 - 2018

N2 - This paper presents RuSentiment, a new dataset for sentiment analysis of social media posts in Russian, and a new set of comprehensive annotation guidelines that are extensible to other languages. RuSentiment is currently the largest in its class for Russian, with 31,185 posts annotated with Fleiss’ kappa of 0.58 (3 annotations per post). To diversify the dataset, 6,950 posts were pre-selected with an active learning-style strategy. We report baseline classification results, and we also release the best-performing embeddings trained on 3.2B tokens of Russian VKontakte posts.

AB - This paper presents RuSentiment, a new dataset for sentiment analysis of social media posts in Russian, and a new set of comprehensive annotation guidelines that are extensible to other languages. RuSentiment is currently the largest in its class for Russian, with 31,185 posts annotated with Fleiss’ kappa of 0.58 (3 annotations per post). To diversify the dataset, 6,950 posts were pre-selected with an active learning-style strategy. We report baseline classification results, and we also release the best-performing embeddings trained on 3.2B tokens of Russian VKontakte posts.

KW - RuSentiment dataset

KW - sentiment analysis

KW - social media

KW - Russian language

KW - annotation guidelines

KW - RuSentiment dataset

KW - sentiment analysis

KW - social media

KW - Russian language

KW - annotation guidelines

M3 - Article in proceedings

SP - 755

EP - 763

BT - Proceedings of the 27th International Conference on Computational Linguistics

PB - Association for Computational Linguistics

CY - Santa Fe, New Mexico, USA

ER -

RuSentiment: An Enriched Sentiment Analysis Dataset for Social Media in Russian

Abstract

Keywords

Access to Document

Fingerprint

Cite this