3-Dimensional convolutional neural networks for predicting StarCraft Ⅱ results and extracting key game situations

PLoS One. 2022 Mar 3;17(3):e0264550. doi: 10.1371/journal.pone.0264550. eCollection 2022.

Abstract

In real-time strategy games, players collect resources, control various units, and create strategies to win. The creation of winning strategies requires accurately analyzing previous games; therefore, it is important to be able to identify the key situations that determined the outcomes of those games. However, previous studies have mainly focused on predicting game results. In this study, we propose a methodology to predict outcomes and to identify information about the turning points that determine outcomes in StarCraft Ⅱ, one of the most popular real-time strategy games. We used replay data from StarCraft Ⅱ that is similar to video data providing continuous multiple images. First, we trained a result prediction model using 3D-residual networks (3D-ResNet) and replay data to improve prediction performance by utilizing in-game spatiotemporal information. Second, we used gradient-weighted class activation mapping to extract information defining the key situations that significantly influenced the outcomes of the game. We then proved that the proposed method outperforms by comparing 2D-residual networks (2D-ResNet) using only one time-point information and 3D-ResNet with multiple time-point information. We verified the usefulness of our methodology on a 3D-ResNet with a gradient class activation map linked to a StarCraft Ⅱ replay dataset.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Neural Networks, Computer*

Grants and funding

SBK was supported by a National Research Foundation of Korea grant funded by the MSIT (NRF-2019R1A4A1024732). IB was supported by the Brain Korea 21 FOUR, Ministry of Science and ICT in Korea under the ITRC support program (IITP-2020-0-01749), and the Ministry of Culture, Sports and Tourism and Korea Creative Content Agency (R2019020067). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.