DAIS: The Delft Database of EEG Recordings of Dutch Articulated and Imagined Speech

Bo Dekker*, Alfred C. Schouten, Odette Scharenborg

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

Silent speech interfaces could enable people who lost the ability to use their voice or gestures to communicate with the external world, e.g., through decoding the person's brain signals when imagining speech. Only a few and small databases exist that allow for the development and training of brain computer interfaces (BCIs) that can decode imagined speech from recorded brain signals. Here, we present an open database consisting of electroencephalography (EEG) and speech data from 20 participants recorded during the covert (imagined) and actual articulation of 15 Dutch prompts. A validation speaker-independent classification experiment using a ResNet-50 model with spatial-spectral-temporal features extracted from the EEG signals obtained an average accuracy of 70.6% for the classification of rest vs. covert vs. articulated speech trials. This and observed structural differences in the EEG signals between covert and articulated speech demonstrate that the EEG signals in the three classes contain discriminative information.

Original languageEnglish
Title of host publicationICASSP 2023
Subtitle of host publicationIEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) : Proceedings
Place of PublicationPiscataway, NJ
PublisherIEEE
Number of pages5
ISBN (Electronic)978-1-7281-6327-7
ISBN (Print)978-1-7281-6328-4
DOIs
Publication statusPublished - 2023
Externally publishedYes
Event48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023 - Rhodes Island, Greece
Duration: 4 Jun 202310 Jun 2023
Conference number: 48

Publication series

NameIEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) - Proceedings
PublisherIEEE
Volume2023
ISSN (Print)1520-6149
ISSN (Electronic)2379-190X

Conference

Conference48th IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2023
Abbreviated titleICASSP
Country/TerritoryGreece
CityRhodes Island
Period4/06/2310/06/23

Keywords

  • Brain computer interfaces
  • Covert (imagined) speech
  • Electroencephalography (EEG)
  • ResNet
  • n/a OA procedure

Fingerprint

Dive into the research topics of 'DAIS: The Delft Database of EEG Recordings of Dutch Articulated and Imagined Speech'. Together they form a unique fingerprint.

Cite this