Systematic analysis and comparison of commercial seizure-detection software

Epilepsia. 2021 Feb;62(2):426-438. doi: 10.1111/epi.16812. Epub 2021 Jan 19.

Abstract

Objective: To determine if three different commercially available seizure-detection software packages (Besa 2.0, Encevis 1.7, and Persyst 13) accurately detect seizures with high sensitivity, high specificity, and short detection delay in epilepsy patients undergoing long-term video-electroencephalography (EEG) monitoring (VEM).

Methods: Comparison of sensitivity (detection rate), specificity (false alarm rate), and detection delay of three commercially available seizure-detection software packages in 81 randomly selected patients with epilepsy undergoing long-term VEM.

Results: Detection rates on a per-patient basis were not significantly different between Besa (mean 67.6%, range 0-100%), Encevis (77.8%, 0-100%) and Persyst (81%, 0-100%; P = .059). False alarm rate (per hour) was significantly different between Besa (mean 0.7/h, range 0.01-6.2/h), Encevis (0.2/h, 0.01-0.5/h), and Persyst (0.9/h, 0.04-6.5/h; P < .001). Detection delay was significantly different between Besa (mean 30 s, range 0-431 s), Encevis (25 s, 2-163 s), and Persyst (20 s, 0-167 s; P = .007). Kappa statistics showed moderate to substantial agreement between the reference standard and each seizure-detection software (Besa: 0.47, 95% confidence interval [CI] 0.36-0.59; Encevis: 0.59, 95% CI 0.47-0.7; Persyst: 0.63, 95% CI 0.51-0.74).

Significance: Three commercially available seizure-detection software packages showed similar, reasonable sensitivities on the same data set, but differed in false alarm rates and detection delay. Persyst 13 showed the highest detection rate and false alarm rate with the shortest detection delay, whereas Encevis 1.7 had a slightly lower sensitivity, the lowest false alarm rate, and longer detection delay.

Keywords: epilepsy; seizure detection; video-EEG.

Publication types

  • Comparative Study

MeSH terms

  • Adolescent
  • Adult
  • Aged
  • Cluster Analysis
  • Electroencephalography*
  • Female
  • Fourier Analysis
  • Humans
  • Male
  • Middle Aged
  • Neural Networks, Computer
  • Retrospective Studies
  • Seizures / diagnosis*
  • Seizures / physiopathology
  • Sensitivity and Specificity
  • Signal Processing, Computer-Assisted*
  • Software*
  • Video Recording
  • Young Adult