Assessing Continuous Operator Workload With a Hybrid Scaffolded Neuroergonomic Modeling Approach

Hum Factors. 2017 Feb;59(1):134-146. doi: 10.1177/0018720816672308.

Abstract

Objective: We aimed to predict operator workload from neurological data using statistical learning methods to fit neurological-to-state-assessment models.

Background: Adaptive systems require real-time mental workload assessment to perform dynamic task allocations or operator augmentation as workload issues arise. Neuroergonomic measures have great potential for informing adaptive systems, and we combine these measures with models of task demand as well as information about critical events and performance to clarify the inherent ambiguity of interpretation.

Method: We use machine learning algorithms on electroencephalogram (EEG) input to infer operator workload based upon Improved Performance Research Integration Tool workload model estimates.

Results: Cross-participant models predict workload of other participants, statistically distinguishing between 62% of the workload changes. Machine learning models trained from Monte Carlo resampled workload profiles can be used in place of deterministic workload profiles for cross-participant modeling without incurring a significant decrease in machine learning model performance, suggesting that stochastic models can be used when limited training data are available.

Conclusion: We employed a novel temporary scaffold of simulation-generated workload profile truth data during the model-fitting process. A continuous workload profile serves as the target to train our statistical machine learning models. Once trained, the workload profile scaffolding is removed and the trained model is used directly on neurophysiological data in future operator state assessments.

Application: These modeling techniques demonstrate how to use neuroergonomic methods to develop operator state assessments, which can be employed in adaptive systems.

Keywords: discrete-event simulation; human performance modeling; mental workload; neuroergonomics; operator state assessment; physiological measurement.

MeSH terms

  • Electroencephalography*
  • Ergonomics*
  • Humans
  • Machine Learning*
  • Memory, Short-Term / physiology*
  • Models, Theoretical*
  • Psychomotor Performance / physiology*