When Are We Done with Games?

Niels Orsleff Justesen, Michael S. Debus, Sebastian Risi

Research output: Conference Article in Proceeding or Book/Report chapterArticle in proceedingsResearchpeer-review


From an early point, games have been promoted as important challenges within the research field of Artificial Intelligence (AI). Recent developments in machine learning have allowed a few AI systems to win against top professionals in even the most challenging video games, including Dota 2 and StarCraft. It thus may seem that AI has now achieved all of the long-standing goals that were set forth by the research community. In this paper, we introduce a black box approach that provides a pragmatic way of evaluating the fairness of AI vs. human competitions, by only considering motoric and perceptual fairness on the competitors' side. Additionally, we introduce the notion of extrinsic and intrinsic factors of a game competition and apply these to discuss and compare the competitions in relation to human vs. human competitions. We conclude that Dota 2 and StarCraft II are not yet mastered by AI as they so far only have been able to win against top professionals in limited competition structures in restricted variants of the games.
Original languageEnglish
Title of host publicationIEEE Conference on Games
Publication date2019
ISBN (Electronic)978-1-7281-1884-0
Publication statusPublished - 2019
EventIEEE Conference on Games (2019) - Queen Mary University of London, London, United Kingdom
Duration: 20 Aug 201923 Aug 2019


ConferenceIEEE Conference on Games (2019)
LocationQueen Mary University of London
Country/TerritoryUnited Kingdom
Internet address


Dive into the research topics of 'When Are We Done with Games?'. Together they form a unique fingerprint.

Cite this