Evaluating Quality of Gaming Narratives Co-created with AI

Arturo Valdivia Martinez; Paolo Burelli

doi:10.48550/arXiv.2509.04239

Evaluating Quality of Gaming Narratives Co-created with AI

Research output: Conference Article in Proceeding or Book/Report chapter › Article in proceedings › Research › peer-review

Abstract

This paper proposes a structured methodology to evaluate AI-generated game narratives, leveraging the Delphi study structure with a panel of narrative design experts. Our approach synthesizes story quality dimensions from literature and expert insights, mapping them into the Kano model framework to understand their impact on player satisfaction. The results can inform game developers on prioritizing quality aspects when co-creating game narratives with generative AI.

Original language	English
Title of host publication	Proceedings of the 2025 IEEE Conference on Games
Publisher	IEEE
Publication date	2025
DOIs	https://doi.org/10.48550/arXiv.2509.04239 https://doi.org/10.1109/CoG64752.2025.11114354
Publication status	Published - 2025
Event	IEEE 7th Conference on Games 2025 - Instituto Superior Tecnico, Lisbon, Portugal Duration: 26 Aug 2025 → 29 Aug 2025 Conference number: 7 https://cog2025.inesc-id.pt/

Conference

Conference	IEEE 7th Conference on Games 2025
Number	7
Location	Instituto Superior Tecnico
Country/Territory	Portugal
City	Lisbon
Period	26/08/2025 → 29/08/2025
Internet address	https://cog2025.inesc-id.pt/

Keywords

AI-generated narratives
Delphi method
Kano model
game narrative quality
player satisfaction

Access to Document

Cite this

@inproceedings{81e56ec37811444caab57826d766c041,

title = "Evaluating Quality of Gaming Narratives Co-created with AI",

abstract = "This paper proposes a structured methodology to evaluate AI-generated game narratives, leveraging the Delphi study structure with a panel of narrative design experts. Our approach synthesizes story quality dimensions from literature and expert insights, mapping them into the Kano model framework to understand their impact on player satisfaction. The results can inform game developers on prioritizing quality aspects when co-creating game narratives with generative AI.",

keywords = "AI-generated narratives, Delphi method, Kano model, game narrative quality, player satisfaction",

author = "\{Valdivia Martinez\}, Arturo and Paolo Burelli",

year = "2025",

doi = "10.48550/arXiv.2509.04239",

language = "English",

booktitle = "Proceedings of the 2025 IEEE Conference on Games",

publisher = "IEEE",

address = "United States",

note = "IEEE 7th Conference on Games 2025, IEEE CoG 2025 ; Conference date: 26-08-2025 Through 29-08-2025",

url = "https://cog2025.inesc-id.pt/",

}

TY - GEN

T1 - Evaluating Quality of Gaming Narratives Co-created with AI

AU - Valdivia Martinez, Arturo

AU - Burelli, Paolo

N1 - Conference code: 7

PY - 2025

Y1 - 2025

N2 - This paper proposes a structured methodology to evaluate AI-generated game narratives, leveraging the Delphi study structure with a panel of narrative design experts. Our approach synthesizes story quality dimensions from literature and expert insights, mapping them into the Kano model framework to understand their impact on player satisfaction. The results can inform game developers on prioritizing quality aspects when co-creating game narratives with generative AI.

AB - This paper proposes a structured methodology to evaluate AI-generated game narratives, leveraging the Delphi study structure with a panel of narrative design experts. Our approach synthesizes story quality dimensions from literature and expert insights, mapping them into the Kano model framework to understand their impact on player satisfaction. The results can inform game developers on prioritizing quality aspects when co-creating game narratives with generative AI.

KW - AI-generated narratives

KW - Delphi method

KW - Kano model

KW - game narrative quality

KW - player satisfaction

U2 - 10.48550/arXiv.2509.04239

DO - 10.48550/arXiv.2509.04239

M3 - Article in proceedings

BT - Proceedings of the 2025 IEEE Conference on Games

PB - IEEE

T2 - IEEE 7th Conference on Games 2025

Y2 - 26 August 2025 through 29 August 2025

ER -

Evaluating Quality of Gaming Narratives Co-created with AI

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this