Abstract
While Monte Carlo tree search (MCTS) methods have shown promise in a variety of different board games, more complex video games still present significant challenges. Recently, several modifications to the core MCTS algorithm have been proposed with the hope to increase its effectiveness on arcade-style video games. This paper investigates of how well these modifications perform in general video game playing using the general video game AI (GVG-AI) framework and introduces a new MCTS modification called UCT reverse penalty that penalizes the MCTS controller for exploring recently visited children. The results of our experiments show that a combination of two MCTS modifications can improve the performance of the vanilla MCTS controller, but the effectiveness of the modifications highly depends on the particular game being played.
Original language | English |
---|---|
Title of host publication | Proceedings of the 2015 IEEE Conference on Computational Intelligence and Games |
Publisher | IEEE Computer Society Press |
Publication date | 2015 |
Pages | 107-113 |
ISBN (Print) | 978-1-4799-8621-7 |
DOIs | |
Publication status | Published - 2015 |
Keywords
- Monte Carlo tree search
- video games
- algorithm modification
- general video game AI (GVG-AI)
- UCT reverse penalty