Enhancing gesture decoding performance using signals from posterior parietal cortex: a stereo-electroencephalograhy (SEEG) study

J Neural Eng. 2020 Sep 11;17(4):046043. doi: 10.1088/1741-2552/ab9987.

Abstract

Objective: Hand movement is a crucial function for humans' daily life. Developing brain-machine interface (BMI) to control a robotic hand by brain signals would help the severely paralyzed people partially regain the functional independence. Previous intracranial electroencephalography (iEEG)-based BMIs towards gesture decoding mostly used neural signals from the primary sensorimotor cortex while ignoring the hand movement related signals from posterior parietal cortex (PPC). Here, we propose combining iEEG recordings from PPC with that from primary sensorimotor cortex to enhance the gesture decoding performance of iEEG-based BMI.

Approach: Stereoelectroencephalography (SEEG) signals from 25 epilepsy subjects were recorded when they performed a three-class hand gesture task. Across all 25 subjects, we identified 524, 114 and 221 electrodes from three regions of interest (ROIs), including PPC, postcentral cortex (POC) and precentral cortex (PRC), respectively. Based on the time-varying high gamma power (55-150 Hz) of SEEG signal, both the general activation in the task and the fine selectivity to gestures of each electrode in these ROIs along time was evaluated by the coefficient of determination r 2. According to the activation along time, we further assessed the first activation time of each ROI. Finally, the decoding accuracy for gestures was obtained by linear support vector machine classifier to comparatively explore if the PPC will assist PRC and POC for gesture decoding.

Main results: We find that a majority(L: [Formula: see text] 60%, R: [Formula: see text] 40%) of electrodes in all the three ROIs present significant activation during the task. A large scale temporal activation sequence exists among the ROIs, where PPC activates first, PRC second and POC last. Among the activated electrodes, 15% (PRC), 26% (POC) and 4% (left PPC) of electrodes are significantly selective to gestures. Moreover, decoding accuracy obtained by combining the selective electrodes from three ROIs together is 5%, 3.6%, and 8% higher than that from only PRC and POC when decoding features across, before, and after the movement onset, were used.

Significance: This is the first human iEEG study demonstrating that PPC contains neural information about fine hand movement, supporting the role of PPC in hand shape encoding. Combining PPC with primary sensorimotor cortex can provide more information to improve the gesture decoding performance. Our results suggest that PPC could be a rich neural source for iEEG-based BMI. Our findings also demonstrate the early involvement of human PPC in visuomotor task and thus may provide additional implications for further scientific research and BMI applications.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Brain-Computer Interfaces*
  • Electrocorticography
  • Gestures*
  • Humans
  • Movement
  • Parietal Lobe