Investigating MCTS Modifications in General Video Game Playing

Frederik Frydenberg, Kasper Andersen, Sebastian Risi, Julian Togelius

Publikation: Konference artikel i Proceeding eller bog/rapport kapitelKonferencebidrag i proceedingsForskningpeer review


While Monte Carlo tree search (MCTS) methods have shown promise in a variety of different board games, more complex video games still present significant challenges. Recently, several modifications to the core MCTS algorithm have been proposed with the hope to increase its effectiveness on arcade-style video games. This paper investigates of how well these modifications perform in general video game playing using the general video game AI (GVG-AI) framework and introduces a new MCTS modification called UCT reverse penalty that penalizes the MCTS controller for exploring recently visited children. The results of our experiments show that a combination of two MCTS modifications can improve the performance of the vanilla MCTS controller, but the effectiveness of the modifications highly depends on the particular game being played.
TitelProceedings of the 2015 IEEE Conference on Computational Intelligence and Games
ForlagIEEE Computer Society Press
ISBN (Trykt)978-1-4799-8621-7
StatusUdgivet - 2015


Dyk ned i forskningsemnerne om 'Investigating MCTS Modifications in General Video Game Playing'. Sammen danner de et unikt fingeraftryk.