Key considerations in designing a speech brain-computer interface

Florent Bocquelet (1) , Thomas Hueber (2) , Laurent Girin (2) , Stephan Chabardès (3) , Blaise Yvert (1)

1 Brain Tech Lab - BrainTech Laboratory [CHU Grenoble Alpes - Inserm U1205]
2 GIPSA-CRISSP - GIPSA - Cognitive Robotics, Interactive Systems, & Speech Processing
3 CHUGA - Centre Hospitalier Universitaire [CHU Grenoble]

Restoring communication in case of aphasia is a key challenge for neurotechnologies. To this end, brain-computer strategies can be envisioned to allow artificial speech synthesis from the continuous decoding of neural signals underlying speech imagination. Such speech brain-computer interfaces do not exist yet and their design should consider three key choices that need to be made: the choice of appropriate brain regions to record neural activity from, the choice of an appropriate recording technique, and the choice of a neural decoding scheme in association with an appropriate speech synthesis method. These key considerations are discussed here in light of (1) the current understanding of the functional neuroanatomy of cortical areas underlying overt and covert speech production, (2) the available literature making use of a variety of brain recording techniques to better characterize and address the challenge of decoding cor-tical speech signals, and (3) the different speech synthesis approaches that can be considered depending on the level of speech representation (phonetic, acoustic or articulatory) envisioned to be decoded at the core of a speech BCI paradigm.

Mots clés: Rehabilitation; Neural decoding; Neural prosthesis; Speech synthesis; Silent speech; Aphasia

Domaines: Neurosciences; Interface homme-machine [cs.HC]

Florent Bocquelet, Thomas Hueber, Laurent Girin, Stephan Chabardès, Blaise Yvert. Key considerations in designing a speech brain-computer interface. Journal of Physiology - Paris, 2016, 110 (4, Part A), pp.392-401. ⟨10.1016/j.jphysparis.2017.07.002⟩. ⟨hal-01978301⟩