Investigating the Uncanny Valley Phenomenon Through the Temporal Dynamics of Neural Responses to Virtual Characters

Chiara Gorlini; Laurits Dixen; Paolo Burelli

doi:10.1109/CoG57401.2023.10333130

Investigating the Uncanny Valley Phenomenon Through the Temporal Dynamics of Neural Responses to Virtual Characters

Chiara Gorlini
, Laurits Dixen
, Paolo Burelli

Creative AI Lab

Polytechnic University of Milan

Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review

Abstract

The Uncanny Valley phenomenon refers to the feeling of unease that arises when interacting with characters that appear almost, but not quite, human-like. First theorised by Masahiro Mori in 1970, it has since been widely observed in different contexts from humanoid robots to video games, in which it can result in players feeling uncomfortable or disconnected from the game, leading to a lack of immersion and potentially reducing the overall enjoyment. The phenomenon has been observed and described mostly through behavioural studies based on self-reported scales of uncanny feeling: however, there is still no consensus on its cognitive and perceptual origins, which limits our understanding of its impact on player experience. In this paper, we present a study aimed at identifying the mechanisms that trigger the uncanny response by collecting and analysing both self-reported feedback and EEG data.
Index Terms—Uncanny Valley, Virtual Characters, Video Games, EEG, ERP, Survey, Perception, Cognition

Original language	English
Title of host publication	Proceedings of the IEEE Conference on Game
Publisher	IEEE
Publication date	2023
ISBN (Print)	979-8-3503-2278-1
ISBN (Electronic)	979-8-3503-2277-4
DOIs	https://doi.org/10.1109/CoG57401.2023.10333130
Publication status	Published - 2023
Event	Conference on Games - Boston, United States Duration: 21 Aug 2023 → 24 Aug 2023 https://2023.ieee-cog.org/

Conference

Conference	Conference on Games
Country/Territory	United States
City	Boston
Period	21/08/2023 → 24/08/2023
Internet address	https://2023.ieee-cog.org/

Series	Proceedings of the 2023 IEEE conference on Games

Keywords

Uncanny Valley
Human-like Characters
Masahiro Mori
Humanoid Robots
Player Immersion
Behavioural Studies
Self-reported Scales
Cognitive Origins
Perceptual Mechanisms
EEG Data
ERP
Video Game Experience
Player Feedback
Cognitive and Perceptual Origins
Human-Computer Interaction

Access to Document

10.1109/CoG57401.2023.10333130

IEEE_COG_2023___Uncanny_Valley_EEGProof, 3.03 MB

EEG Recordings of Exposure to Unrealistic, Semi-realistic and Realistic Character Faces - A Pilot Study
Gorlini, C. (Creator), Dixen, L. (Creator) & Burelli, P. (Creator), ZENODO, 18 May 2023
DOI: 10.5281/zenodo.7948158, https://zenodo.org/records/7948158
Dataset

Cite this

@inproceedings{1c828948693c48e1aaff83894a1b75f7,

title = "Investigating the Uncanny Valley Phenomenon Through the Temporal Dynamics of Neural Responses to Virtual Characters",

abstract = "The Uncanny Valley phenomenon refers to the feeling of unease that arises when interacting with characters that appear almost, but not quite, human-like. First theorised by Masahiro Mori in 1970, it has since been widely observed in different contexts from humanoid robots to video games, in which it can result in players feeling uncomfortable or disconnected from the game, leading to a lack of immersion and potentially reducing the overall enjoyment. The phenomenon has been observed and described mostly through behavioural studies based on self-reported scales of uncanny feeling: however, there is still no consensus on its cognitive and perceptual origins, which limits our understanding of its impact on player experience. In this paper, we present a study aimed at identifying the mechanisms that trigger the uncanny response by collecting and analysing both self-reported feedback and EEG data. Index Terms—Uncanny Valley, Virtual Characters, Video Games, EEG, ERP, Survey, Perception, Cognition",

keywords = "Uncanny Valley, Human-like Characters, Masahiro Mori, Humanoid Robots, Player Immersion, Behavioural Studies, Self-reported Scales, Cognitive Origins, Perceptual Mechanisms, EEG Data, ERP, Video Game Experience, Player Feedback, Cognitive and Perceptual Origins, Human-Computer Interaction, Uncanny Valley, Human-like Characters, Masahiro Mori, Humanoid Robots, Player Immersion, Behavioural Studies, Self-reported Scales, Cognitive Origins, Perceptual Mechanisms, EEG Data, ERP, Video Game Experience, Player Feedback, Cognitive and Perceptual Origins, Human-Computer Interaction",

author = "Chiara Gorlini and Laurits Dixen and Paolo Burelli",

year = "2023",

doi = "10.1109/CoG57401.2023.10333130",

language = "English",

isbn = "979-8-3503-2278-1",

series = "Proceedings of the 2023 IEEE conference on Games",

publisher = "IEEE",

booktitle = "Proceedings of the IEEE Conference on Game",

address = "United States",

note = "Conference on Games, IEEE CoG ; Conference date: 21-08-2023 Through 24-08-2023",

url = "https://2023.ieee-cog.org/",

}

Gorlini, C, Dixen, L & Burelli, P 2023, Investigating the Uncanny Valley Phenomenon Through the Temporal Dynamics of Neural Responses to Virtual Characters. in Proceedings of the IEEE Conference on Game. IEEE, Proceedings of the 2023 IEEE conference on Games, Conference on Games, Boston, Massachusetts, United States, 21/08/2023. https://doi.org/10.1109/CoG57401.2023.10333130

Investigating the Uncanny Valley Phenomenon Through the Temporal Dynamics of Neural Responses to Virtual Characters. / Gorlini, Chiara; Dixen, Laurits ; Burelli, Paolo.
Proceedings of the IEEE Conference on Game. IEEE, 2023. (Proceedings of the 2023 IEEE conference on Games).

Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review

TY - GEN

T1 - Investigating the Uncanny Valley Phenomenon Through the Temporal Dynamics of Neural Responses to Virtual Characters

AU - Gorlini, Chiara

AU - Dixen, Laurits

AU - Burelli, Paolo

PY - 2023

Y1 - 2023

N2 - The Uncanny Valley phenomenon refers to the feeling of unease that arises when interacting with characters that appear almost, but not quite, human-like. First theorised by Masahiro Mori in 1970, it has since been widely observed in different contexts from humanoid robots to video games, in which it can result in players feeling uncomfortable or disconnected from the game, leading to a lack of immersion and potentially reducing the overall enjoyment. The phenomenon has been observed and described mostly through behavioural studies based on self-reported scales of uncanny feeling: however, there is still no consensus on its cognitive and perceptual origins, which limits our understanding of its impact on player experience. In this paper, we present a study aimed at identifying the mechanisms that trigger the uncanny response by collecting and analysing both self-reported feedback and EEG data. Index Terms—Uncanny Valley, Virtual Characters, Video Games, EEG, ERP, Survey, Perception, Cognition

AB - The Uncanny Valley phenomenon refers to the feeling of unease that arises when interacting with characters that appear almost, but not quite, human-like. First theorised by Masahiro Mori in 1970, it has since been widely observed in different contexts from humanoid robots to video games, in which it can result in players feeling uncomfortable or disconnected from the game, leading to a lack of immersion and potentially reducing the overall enjoyment. The phenomenon has been observed and described mostly through behavioural studies based on self-reported scales of uncanny feeling: however, there is still no consensus on its cognitive and perceptual origins, which limits our understanding of its impact on player experience. In this paper, we present a study aimed at identifying the mechanisms that trigger the uncanny response by collecting and analysing both self-reported feedback and EEG data. Index Terms—Uncanny Valley, Virtual Characters, Video Games, EEG, ERP, Survey, Perception, Cognition

KW - Uncanny Valley

KW - Human-like Characters

KW - Masahiro Mori

KW - Humanoid Robots

KW - Player Immersion

KW - Behavioural Studies

KW - Self-reported Scales

KW - Cognitive Origins

KW - Perceptual Mechanisms

KW - EEG Data

KW - ERP

KW - Video Game Experience

KW - Player Feedback

KW - Cognitive and Perceptual Origins

KW - Human-Computer Interaction

KW - Uncanny Valley

KW - Human-like Characters

KW - Masahiro Mori

KW - Humanoid Robots

KW - Player Immersion

KW - Behavioural Studies

KW - Self-reported Scales

KW - Cognitive Origins

KW - Perceptual Mechanisms

KW - EEG Data

KW - ERP

KW - Video Game Experience

KW - Player Feedback

KW - Cognitive and Perceptual Origins

KW - Human-Computer Interaction

U2 - 10.1109/CoG57401.2023.10333130

DO - 10.1109/CoG57401.2023.10333130

M3 - Article in proceedings

SN - 979-8-3503-2278-1

T3 - Proceedings of the 2023 IEEE conference on Games

BT - Proceedings of the IEEE Conference on Game

PB - IEEE

T2 - Conference on Games

Y2 - 21 August 2023 through 24 August 2023

ER -

Investigating the Uncanny Valley Phenomenon Through the Temporal Dynamics of Neural Responses to Virtual Characters

Abstract

Conference

Keywords

Access to Document

Fingerprint

Datasets

EEG Recordings of Exposure to Unrealistic, Semi-realistic and Realistic Character Faces - A Pilot Study

Cite this