Abstract
Silent speech interfaces could enable people who lost the ability to use their voice or gestures to communicate with the external world, e.g., through decoding the person's brain signals when imagining speech. Only a few and small databases exist that allow for the development and training of brain computer interfaces (BCIs) that can decode imagined speech from recorded brain signals. Here, we present an open database consisting of electroencephalography (EEG) and speech data from 20 participants recorded during the covert (imagined) and actual articulation of 15 Dutch prompts. A validation speaker-independent classification experiment using a ResNet-50 model with spatial-spectral-temporal features extracted from the EEG signals obtained an average accuracy of 70.6% for the classification of rest vs. covert vs. articulated speech trials. This and observed structural differences in the EEG signals between covert and articulated speech demonstrate that the EEG signals in the three classes contain discriminative information.
Original language | English |
---|---|
Title of host publication | ICASSP 2023 |
Subtitle of host publication | IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) : Proceedings |
Place of Publication | Piscataway, NJ |
Publisher | IEEE |
Number of pages | 5 |
ISBN (Electronic) | 978-1-7281-6327-7 |
ISBN (Print) | 978-1-7281-6328-4 |
DOIs | |
Publication status | Published - 2023 |
Externally published | Yes |
Event | 48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023 - Rhodes Island, Greece Duration: 4 Jun 2023 → 10 Jun 2023 Conference number: 48 |
Publication series
Name | IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) - Proceedings |
---|---|
Publisher | IEEE |
Volume | 2023 |
ISSN (Print) | 1520-6149 |
ISSN (Electronic) | 2379-190X |
Conference
Conference | 48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023 |
---|---|
Abbreviated title | ICASSP |
Country/Territory | Greece |
City | Rhodes Island |
Period | 4/06/23 → 10/06/23 |
Keywords
- Brain computer interfaces
- Covert (imagined) speech
- Electroencephalography (EEG)
- ResNet
- n/a OA procedure