Subject-Independent Emotion Recognition During Music Listening Based on EEG Using Deep Convolutional Neural Networks

Panayu Keelawat*, Nattapong Thammasan, Boonserm Kijsirikul, Masayuki Numao

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

22 Citations (Scopus)
10 Downloads (Pure)

Abstract

Emotion recognition during music listening using electroencephalogram (EEG) has gained more attention from researchers, recently. Many studies focused on accuracy on one subject while subject-independent performance evaluation was still unclear. In this paper, the objective is to create an emotion recognition model that can be applied to multiple subjects. By adopting convolutional neural networks (CNNs), advantage could be gained from utilizing information from electrodes and time steps. Using CNNs also does not need feature extraction which might leave out other related but unobserved features. CNNs with three to seven convolutional layers were deployed in this research. We measured their performance with a binary classification task for compositions of emotions including arousal and valence. The results showed that our method captured EEG signal patterns from numerous subjects by 10-fold cross validation with 81.54% and 86.87% accuracy from arousal and valence respectively. The method also showed a higher capability of generalization to unseen subjects than the previous method as can be observed from the results of leave-one-subject-out validation.
Original languageEnglish
Title of host publication2019 IEEE 15th International Colloquium on Signal Processing & Its Applications (CSPA)
PublisherIEEE
Pages21-26
Number of pages6
ISBN (Electronic)978-1-5386-7563-2
ISBN (Print)978-1-5386-7564-9
DOIs
Publication statusPublished - 8 Mar 2019
Event15th IEEE Colloquium on Signal Processing and its Applications, CSPA 2019 - Penang Island, Malaysia
Duration: 8 Mar 20199 Mar 2019
Conference number: 15

Conference

Conference15th IEEE Colloquium on Signal Processing and its Applications, CSPA 2019
Abbreviated titleCSPA 2019
Country/TerritoryMalaysia
CityPenang Island
Period8/03/199/03/19

Keywords

  • Electroencephalography
  • Emotion recognition
  • Convolutional Neural Network (CNN)

Fingerprint

Dive into the research topics of 'Subject-Independent Emotion Recognition During Music Listening Based on EEG Using Deep Convolutional Neural Networks'. Together they form a unique fingerprint.

Cite this