Incorporating advanced language models into the P300 speller using particle filtering

J Neural Eng. 2015 Aug;12(4):046018. doi: 10.1088/1741-2560/12/4/046018. Epub 2015 Jun 10.

Abstract

Objective: The P300 speller is a common brain-computer interface (BCI) application designed to communicate language by detecting event related potentials in a subject's electroencephalogram signal. Information about the structure of natural language can be valuable for BCI communication, but attempts to use this information have thus far been limited to rudimentary n-gram models. While more sophisticated language models are prevalent in natural language processing literature, current BCI analysis methods based on dynamic programming cannot handle their complexity.

Approach: Sampling methods can overcome this complexity by estimating the posterior distribution without searching the entire state space of the model. In this study, we implement sequential importance resampling, a commonly used particle filtering (PF) algorithm, to integrate a probabilistic automaton language model.

Main result: This method was first evaluated offline on a dataset of 15 healthy subjects, which showed significant increases in speed and accuracy when compared to standard classification methods as well as a recently published approach using a hidden Markov model (HMM). An online pilot study verified these results as the average speed and accuracy achieved using the PF method was significantly higher than that using the HMM method.

Significance: These findings strongly support the integration of domain-specific knowledge into BCI classification to improve system performance.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms
  • Brain Mapping / methods
  • Brain-Computer Interfaces*
  • Communication Aids for Disabled*
  • Computer Simulation
  • Electroencephalography / methods*
  • Event-Related Potentials, P300 / physiology*
  • Humans
  • Machine Learning*
  • Models, Statistical
  • Natural Language Processing*
  • Pattern Recognition, Automated / methods
  • Reproducibility of Results
  • Sensitivity and Specificity
  • Signal Processing, Computer-Assisted
  • Task Performance and Analysis
  • Word Processing / methods