When Are We Done with Games?

Niels Orsleff Justesen, Michael S. Debus, Sebastian Risi

    Research output: Conference Article in Proceeding or Book/Report chapterArticle in proceedingsResearchpeer-review

    Abstract

    From an early point, games have been promoted as important challenges within the research field of Artificial Intelligence (AI). Recent developments in machine learning have allowed a few AI systems to win against top professionals in even the most challenging video games, including Dota 2 and StarCraft. It thus may seem that AI has now achieved all of the long-standing goals that were set forth by the research community. In this paper, we introduce a black box approach that provides a pragmatic way of evaluating the fairness of AI vs. human competitions, by only considering motoric and perceptual fairness on the competitors' side. Additionally, we introduce the notion of extrinsic and intrinsic factors of a game competition and apply these to discuss and compare the competitions in relation to human vs. human competitions. We conclude that Dota 2 and StarCraft II are not yet mastered by AI as they so far only have been able to win against top professionals in limited competition structures in restricted variants of the games.
    Original languageEnglish
    Title of host publicationIEEE Conference on Games
    PublisherIEEE
    Publication date2019
    ISBN (Electronic)978-1-7281-1884-0
    DOIs
    Publication statusPublished - 2019
    EventIEEE Conference on Games (2019) - Queen Mary University of London, London, United Kingdom
    Duration: 20 Aug 201923 Aug 2019
    http://www.ieee-cog.org

    Conference

    ConferenceIEEE Conference on Games (2019)
    LocationQueen Mary University of London
    Country/TerritoryUnited Kingdom
    CityLondon
    Period20/08/201923/08/2019
    Internet address

    Keywords

    • Artificial Intelligence
    • Machine Learning
    • Game Competition
    • Fairness Evaluation
    • Motoric and Perceptual Fairness

    Fingerprint

    Dive into the research topics of 'When Are We Done with Games?'. Together they form a unique fingerprint.

    Cite this