Classification of Drivers' Workload Using Physiological Signals in Conditional Automation

Quentin Meteier; Marine Capallera; Simon Ruffieux; Leonardo Angelini; Omar Abou Khaled; Elena Mugellini; Marino Widmer; Andreas Sonderegger

doi:10.3389/fpsyg.2021.596038

Classification of Drivers' Workload Using Physiological Signals in Conditional Automation

Front Psychol. 2021 Feb 18:12:596038. doi: 10.3389/fpsyg.2021.596038. eCollection 2021.

Authors

Quentin Meteier¹, Marine Capallera¹, Simon Ruffieux¹, Leonardo Angelini¹, Omar Abou Khaled¹, Elena Mugellini¹, Marino Widmer², Andreas Sonderegger³

Affiliations

¹ HumanTech Institute, University of Applied Sciences of Western Switzerland, Haute École Spécialisée de Suisse Occidentale, Fribourg, Switzerland.
² Department of Informatics, University of Fribourg, Fribourg, Switzerland.
³ Bern University of Applied Sciences, Business School, Institute for New Work, Bern, Switzerland.

Abstract

The use of automation in cars is increasing. In future vehicles, drivers will no longer be in charge of the main driving task and may be allowed to perform a secondary task. However, they might be requested to regain control of the car if a hazardous situation occurs (i.e., conditionally automated driving). Performing a secondary task might increase drivers' mental workload and consequently decrease the takeover performance if the workload level exceeds a certain threshold. Knowledge about the driver's mental state might hence be useful for increasing safety in conditionally automated vehicles. Measuring drivers' workload continuously is essential to support the driver and hence limit the number of accidents in takeover situations. This goal can be achieved using machine learning techniques to evaluate and classify the drivers' workload in real-time. To evaluate the usefulness of physiological data as an indicator for workload in conditionally automated driving, three physiological signals from 90 subjects were collected during 25 min of automated driving in a fixed-base simulator. Half of the participants performed a verbal cognitive task to induce mental workload while the other half only had to monitor the environment of the car. Three classifiers, sensor fusion and levels of data segmentation were compared. Results show that the best model was able to successfully classify the condition of the driver with an accuracy of 95%. In some cases, the model benefited from sensors' fusion. Increasing the segmentation level (e.g., size of the time window to compute physiological indicators) increased the performance of the model for windows smaller than 4 min, but decreased for windows larger than 4 min. In conclusion, the study showed that a high level of drivers' mental workload can be accurately detected while driving in conditional automation based on 4-min recordings of respiration and skin conductance.

Keywords: automated driving; classification; driver; machine learning; physiology; secondary task; workload.