Validation of Deep Learning-based Sleep State Classification

MicroPubl Biol. 2022 Oct 4:2022:10.17912/micropub.biology.000643. doi: 10.17912/micropub.biology.000643. eCollection 2022.

Abstract

Deep learning methods have been developed to classify sleep states of mouse electroencephalogram (EEG) and electromyogram (EMG) recordings with accuracy reported as high as 97%. However, when applied to independent datasets, with a variety of experimental and recording conditions, sleep state classification accuracy often drops due to distributional shift. Mixture z-scoring, a pre-processing standardization of EEG/EMG signals, has been suggested to account for these variations. This study sought to validate mixture z-scoring in combination with a deep learning method on an independent dataset. The open-source software Accusleep, which implements mixture z-scoring in combination with deep learning via a convolutional neural network, was used to classify sleep states in 12, three-hour EEG/EMG recordings from mice sleeping in a head-fixed position. Mixture z-scoring with deep learning classified sleep states on two independent recordings with 85-92% accuracy and a Cohen's κ of 0.66-0.71. These results validate mixture z-scoring in combination with deep learning to classify sleep states with the potential for widespread use.