Increasing Robustness for Cross-domain Dialogue Act Classification on Social Media Data

Marcus Vielsted, Nikolaj Wallenius, Rob van der Goot

Research output: Conference Article in Proceeding or Book/Report chapterArticle in proceedingsResearchpeer-review

Abstract

Automatically detecting the intent of an utterance is important for various downstream natural language processing tasks. This task is also called Dialogue Act Classification (DAC) and was primarily researched on spoken one-to-one conversations. The rise of social media has made this an interesting data source to explore within DAC, although it comes with some difficulties: non-standard form, variety of language types (across and within platforms), and quickly evolving norms. We therefore investigate the robustness of DAC on social media data in this paper. More concretely, we provide a benchmark that includes cross-domain data splits, as well as a variety of improvements on our transformer-based baseline. Our experiments show that lexical normalization is not beneficial in this setup, balancing the labels through resampling is beneficial in some cases, and incorporating context is crucial for this task and leads to the highest performance improvements 7 F1 percentage points in-domain and 20 cross-domain).
Original languageEnglish
Title of host publicationProceedings of the Eighth Workshop on Noisy User-generated Text (W-NUT 2022)
PublisherAssociation for Computational Linguistics
Publication dateOct 2022
Pages180-193
Publication statusPublished - Oct 2022
Event29th International Conference on Computational Linguistics -
Duration: 12 Oct 202217 Nov 2022

Conference

Conference29th International Conference on Computational Linguistics
Period12/10/202217/11/2022

Fingerprint

Dive into the research topics of 'Increasing Robustness for Cross-domain Dialogue Act Classification on Social Media Data'. Together they form a unique fingerprint.

Cite this