Sensitive Pictures: Emotional Interpretation in the Museum

Steve Benford; Anders Sundnes Løvlie; Karin Ryding; Paulina Rajkowska; Edgar Bodiaj; Dimitrios   Paris Darzentas; Harriet Cameron; Jocelyn Spence; Joy Egede; Bogdan Spanjevic

Sensitive Pictures: Emotional Interpretation in the Museum

Steve Benford
, Anders Sundnes Løvlie
, Karin Ryding
, Paulina Rajkowska
, Edgar Bodiaj
, Dimitrios Paris Darzentas
, Harriet Cameron
, Jocelyn Spence
, Joy Egede
, Bogdan Spanjevic

University of Nottingham
Uppsala University
NextGame

Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review

Abstract

Museums are interested in designing emotional visitor experiences to complement traditional interpretations. HCI is interested in the relationship between Affective Computing and Affective Interaction. We describe Sensitive Pictures, an emotional visitor experience co-created with the Munch art museum. Visitors choose emotions, locate associated paintings in the museum, experience an emotional story while viewing them, and self-report their response. A subsequent interview with a portrayal of the artist employs computer vision to estimate emotional responses from facial expressions. Visitors are given a souvenir postcard visualizing their emotional data. A study of 132 members of the public (39 interviewed) illuminates key themes: designing emotional provocations; capturing emotional responses; engaging visitors with their data; a tendency for them to align their views with the system's interpretation; and integrating these elements into emotional trajectories. We consider how Affective Computing can hold up a mirror to our emotions during Affective Interaction.

Original language	English
Title of host publication	CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems
Number of pages	16
Publisher	Association for Computing Machinery
Publication date	2022
Publication status	Published - 2022
Event	CHI Conference on Human Factors in Computing Systems - PACIFICO Yokohama, Yokohama, Japan Duration: 8 May 2021 → 13 May 2021 Conference number: 43 https://chi2025.acm.org/

Conference

Conference	CHI Conference on Human Factors in Computing Systems
Number	43
Location	PACIFICO Yokohama
Country/Territory	Japan
City	Yokohama
Period	08/05/2021 → 13/05/2021
Internet address	https://chi2025.acm.org/

Keywords

Affective Computing, Affective Interaction, Emotion, Affect, Museum, Data Souvenir, Interpretation, Ambiguity, Computer Vision

Access to Document

sensitive pictures postprintAccepted author manuscript, 7.59 MB

https://dl.acm.org/doi/10.1145/3491102.3502080

Cite this

Benford, S., Løvlie, A. S., Ryding, K., Rajkowska, P., Bodiaj, E., Paris Darzentas, D., Cameron, H., Spence, J., Egede, J., & Spanjevic, B. (2022). Sensitive Pictures: Emotional Interpretation in the Museum. In CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems Association for Computing Machinery. https://dl.acm.org/doi/10.1145/3491102.3502080

@inproceedings{eff3362f375b40f188140de4343507f7,

title = "Sensitive Pictures: Emotional Interpretation in the Museum",

abstract = "Museums are interested in designing emotional visitor experiences to complement traditional interpretations. HCI is interested in the relationship between Affective Computing and Affective Interaction. We describe Sensitive Pictures, an emotional visitor experience co-created with the Munch art museum. Visitors choose emotions, locate associated paintings in the museum, experience an emotional story while viewing them, and self-report their response. A subsequent interview with a portrayal of the artist employs computer vision to estimate emotional responses from facial expressions. Visitors are given a souvenir postcard visualizing their emotional data. A study of 132 members of the public (39 interviewed) illuminates key themes: designing emotional provocations; capturing emotional responses; engaging visitors with their data; a tendency for them to align their views with the system's interpretation; and integrating these elements into emotional trajectories. We consider how Affective Computing can hold up a mirror to our emotions during Affective Interaction.",

keywords = "Affective Computing, Affective Interaction, Emotion, Affect, Museum, Data Souvenir, Interpretation, Ambiguity, Computer Vision, Affective Computing, Affective Interaction, Emotion, Affect, Museum, Data Souvenir, Interpretation, Ambiguity, Computer Vision",

author = "Steve Benford and L{\o}vlie, \{Anders Sundnes\} and Karin Ryding and Paulina Rajkowska and Edgar Bodiaj and \{Paris Darzentas\}, Dimitrios and Harriet Cameron and Jocelyn Spence and Joy Egede and Bogdan Spanjevic",

year = "2022",

language = "English",

booktitle = "CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems",

publisher = "Association for Computing Machinery",

address = "United States",

note = "CHI Conference on Human Factors in Computing Systems, CHI'21 ; Conference date: 08-05-2021 Through 13-05-2021",

url = "https://chi2025.acm.org/",

}

Benford, S, Løvlie, AS, Ryding, K, Rajkowska, P, Bodiaj, E, Paris Darzentas, D, Cameron, H, Spence, J, Egede, J & Spanjevic, B 2022, Sensitive Pictures: Emotional Interpretation in the Museum. in CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, 08/05/2021. <https://dl.acm.org/doi/10.1145/3491102.3502080>

Sensitive Pictures: Emotional Interpretation in the Museum. / Benford, Steve; Løvlie, Anders Sundnes; Ryding, Karin et al.
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, 2022.

Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review

TY - GEN

T1 - Sensitive Pictures

T2 - CHI Conference on Human Factors in Computing Systems

AU - Benford, Steve

AU - Løvlie, Anders Sundnes

AU - Ryding, Karin

AU - Rajkowska, Paulina

AU - Bodiaj, Edgar

AU - Paris Darzentas, Dimitrios

AU - Cameron, Harriet

AU - Spence, Jocelyn

AU - Egede, Joy

AU - Spanjevic, Bogdan

N1 - Conference code: 43

PY - 2022

Y1 - 2022

N2 - Museums are interested in designing emotional visitor experiences to complement traditional interpretations. HCI is interested in the relationship between Affective Computing and Affective Interaction. We describe Sensitive Pictures, an emotional visitor experience co-created with the Munch art museum. Visitors choose emotions, locate associated paintings in the museum, experience an emotional story while viewing them, and self-report their response. A subsequent interview with a portrayal of the artist employs computer vision to estimate emotional responses from facial expressions. Visitors are given a souvenir postcard visualizing their emotional data. A study of 132 members of the public (39 interviewed) illuminates key themes: designing emotional provocations; capturing emotional responses; engaging visitors with their data; a tendency for them to align their views with the system's interpretation; and integrating these elements into emotional trajectories. We consider how Affective Computing can hold up a mirror to our emotions during Affective Interaction.

AB - Museums are interested in designing emotional visitor experiences to complement traditional interpretations. HCI is interested in the relationship between Affective Computing and Affective Interaction. We describe Sensitive Pictures, an emotional visitor experience co-created with the Munch art museum. Visitors choose emotions, locate associated paintings in the museum, experience an emotional story while viewing them, and self-report their response. A subsequent interview with a portrayal of the artist employs computer vision to estimate emotional responses from facial expressions. Visitors are given a souvenir postcard visualizing their emotional data. A study of 132 members of the public (39 interviewed) illuminates key themes: designing emotional provocations; capturing emotional responses; engaging visitors with their data; a tendency for them to align their views with the system's interpretation; and integrating these elements into emotional trajectories. We consider how Affective Computing can hold up a mirror to our emotions during Affective Interaction.

KW - Affective Computing, Affective Interaction, Emotion, Affect, Museum, Data Souvenir, Interpretation, Ambiguity, Computer Vision

M3 - Article in proceedings

BT - CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

Y2 - 8 May 2021 through 13 May 2021

ER -

Sensitive Pictures: Emotional Interpretation in the Museum

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this