Gaming behavior and brain activation using functional near-infrared spectroscopy, Iowa gambling task, and machine learning techniques

Abstract

Introduction: The current study investigates the utilization and performance of machine learning (ML) algorithms in the cognitive task of finding the correlation between numerical parameters of the human brain activation during gaming. We hypothesize that our integrated feature extraction platform is able to distinguish between different psychosomatic conditions in the gaming process as measured by the functional near-infrared brain imaging technique.

Methods: For demonstration, the decision-making process was constructed in the experiment environment that combined gaming simulator, such as the Iowa Gaming Task (IGT), with functional near-infrared spectroscopy (fNIRS) as the neuroimaging technique. Features of fNIRS levels were extracted, averaged, and synchronized by time with the IGT dataset to predict the task score inside ML algorithms, such as multiple regression, classification and regression trees, support vector machine, artificial neural network, and random forest. For findings validation, the experiment data were resampled by training and testing sets. Further, a training dataset was used to train the ML algorithms, and prediction accuracy was estimated by repeated cross-validation methods and compared by R squared and root mean square error (RMSE). The model with the best accuracy was used with the testing dataset and finalized the experiment.

Results: During the experiment, the highest correlation was identified in the fourth block between the oxy-hemoglobin signal and IGT score in average value (0.24) and signal feature (0.57). Such relationship is due to block 4 characterization as "conceptual" period when participants task experience reaches the maximum, and rewards raise accordingly. Simultaneously, ML algorithms, constructed based on training data set, demonstrate acceptable performance, and RMSE as the primary performance metric dynamically increases from block 1 to block 5, from the state of uncertainty and unknown to the certainty and risky. In contrast, R squared decreases during the same transition. In most IGT blocks, the best fitted model was determined as support vector machine with radial bases function kernel, and predictions were made with the highest accuracy (lowest RMSE) than in training models.

Conclusion: Obtained findings showed the applicability and capability of ML models as a powerful technique to evaluate the cognitive neuroimaging task result. Moreover, in terms of features it was identified that the hemodynamic response reacts to the acceleration decision-making process and raises more significance than it was observed before.

Keywords: Iowa gambling task; cognitive neuroimaging; functional near-infrared spectroscopy; machine learning.