"I’ll be there for you": The One with Understanding Indirect Answers

Cathrine Damgaard, Paulina Toborek, Trine Eriksen, Barbara Plank

Publikation: Konference artikel i Proceeding eller bog/rapport kapitelKonferencebidrag i proceedingsForskningpeer review

Abstract

Indirect answers are replies to polar questions without the direct use of word cues such as ‘yes’ and ‘no’. Humans are very good at understanding indirect answers, such as ‘I gotta go home sometime’, when asked ‘You wanna crash on the couch?’. Understanding indirect answers is a challenging problem for dialogue systems. In this paper, we introduce a new English corpus to study the problem of under- standing indirect answers. Instead of crowd- sourcing both polar questions and answers, we collect questions and indirect answers from transcripts of a prominent TV series and manually annotate them for answer type. The resulting dataset contains 5,930 question-answer pairs. We release both aggregated and raw human annotations. We present a set of experiments in which we evaluate Convolutional Neural Networks (CNNs) for this task, including a cross-dataset evaluation and experiments with learning from disagreements in annotation. Our results show that the task of interpret- ing indirect answers remains challenging, yet we obtain encouraging improvements when ex-
plicitly modeling human disagreement.
OriginalsprogEngelsk
TitelThe Second Workshop on Computational Approaches to Discourse
ForlagAssociation for Computational Linguistics
Publikationsdato2021
StatusUdgivet - 2021

Fingeraftryk

Dyk ned i forskningsemnerne om '"I’ll be there for you": The One with Understanding Indirect Answers'. Sammen danner de et unikt fingeraftryk.

Citationsformater