A comparison and classification of oscillatory characteristics in speech perception and covert speech

Abstract

Covert speech, the mental imagery of speaking, has been studied increasingly to understand and decode thoughts in the context of brain-computer interfaces. In studies of speech comprehension, neural oscillations are thought to play a key role in the temporal encoding of speech. However, little is known about the role of oscillations in covert speech. In this study, we investigated the oscillatory involvements in covert speech and speech perception. Data were collected from 10 participants with 64 channel EEG. Participants heard the words, 'blue' and 'orange', and subsequently mentally rehearsed them. First, continuous wavelet transform was performed on epoched signals and subsequently two-tailed t-tests between two classes (tasks) were conducted to determine statistical differences in frequency and time (t-CWT). In the current experiment, a task comprised speech perception or covert rehearsal of a word while a condition was the discrimination between tasks. Features were extracted using t-CWT and subsequently classified using a support vector machine. θ and γ phase amplitude coupling (PAC) was also assessed within tasks and across conditions between perception and covert activities (i.e. cross-task). All binary classifications accuracies (80-90%) significantly exceeded chance level, supporting the use of t-CWT in determining relative oscillatory involvements. While the perception condition dynamically invoked all frequencies with more prominent θ and α activity, the covert condition favoured higher frequencies with significantly higher γ activity than perception. Moreover, the perception condition produced significant θ-γ PAC, possibly corroborating a reported linkage between syllabic and phonemic sampling. Although this coupling was found to be suppressed in the covert condition, we found significant cross-task coupling between perception θ and covert speech γ. Covert speech processing appears to be largely associated with higher frequencies of EEG. Importantly, the significant cross-task coupling between speech perception and covert speech, in the absence of within-task covert speech PAC, seems to support the notion that the γ- and θ-bands reflect, respectively, shared and unique encoding processes across tasks.

Keywords: Brain-computer interface; Covert speech; EEG; Neural oscillation; Phase-amplitude coupling; Speech perception.