Language-Model Assisted And Icon-based Communication Through a Brain Computer Interface With Different Presentation Paradigms

IEEE Trans Neural Syst Rehabil Eng. 2018 Jul 25. doi: 10.1109/TNSRE.2018.2859432. Online ahead of print.

Abstract

Augmentative and alternative communication (AAC) is typically used by people with severe speech and physical disabilities (SSPI) and is one of the main application areas for brain computer interface (BCI) technology. The target population includes people with cerebral palsy (CP), amyotrophic lateral sclerosis (ALS) and locked-in-syndrome (LIS). Word-based AAC systems are mainly faster than letter-based counterparts and are usually supplemented by icons to aid the users. Those iconbased AAC systems that use binary signaling methods such as single click can convert into a single input BCI systems such as ERP detection. Matrix speller paradigm are typically used to help users identify their target icon on the screen, however it ties screen space to vocabulary size and navigation complexity, which may require users to make repetitive head, neck, or eye movements to visually locate their intended targets on the screen. Rapid serial visual presentation (RSVP) is an alternative interface that minimizes required movement by displaying all icons at a fix location, one at a time. IconMessenger is an icon-based BCI-AAC system that combines ERP signal detection with a unified framework for different presentation paradigms including RSVP, matrix speller row&column presentation (RCP) and matrix speller single character presentation (SCP). Icon- Messenger also take advantage of a unique sem-gram language model, incorporated tightly in the inference engine. In this study, we assess the ERP shape, classification accuracy and typing performance of different presentation paradigms on 10 healthy participants.