EEG analysis for implicit tagging of video data

Sander Koelstra, Christian Mühl, Ioannis Patras

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    32 Citations (Scopus)
    36 Downloads (Pure)

    Abstract

    In this work, we aim to find neuro-physiological indicators to validate tags attached to video content. Subjects are shown a video and a tag and we aim to determine whether the shown tag was congruent with the presented video by detecting the occurrence of an N400 event-related potential. Tag validation could be used in conjunction with a vision-based recognition system as a feedback mechanism to improve the classification accuracy for multimedia indexing and retrieval. An advantage of using the EEG modality for tag validation is that it is a way of performing implicit tagging. This means it can be performed while the user is passively watching the video. Independent Component Analysis and repeated measures ANOVA are used for analysis. Our experimental results show a clear occurrence of the N400 and a significant difference in N400 activation between matching and non-matching tags.
    Original languageEnglish
    Title of host publicationProceedings 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009
    Place of PublicationLos Alamitos, NJ
    PublisherIEEE Computer Society Press
    Pages27-32
    Number of pages6
    Volume2
    ISBN (Print)978-1-4244-4799-2
    DOIs
    Publication statusPublished - 2009
    Event3rd International Conference on Affective Computing and Intelligent Interaction, ACII 2009 - Amsterdam, Netherlands
    Duration: 10 Sep 200912 Sep 2009
    Conference number: 3

    Conference

    Conference3rd International Conference on Affective Computing and Intelligent Interaction, ACII 2009
    Abbreviated titleACII
    CountryNetherlands
    CityAmsterdam
    Period10/09/0912/09/09

    Keywords

    • METIS-264313
    • IR-69486
    • Multimedia tagging
    • EEG
    • HMI-MI: MULTIMODAL INTERACTIONS
    • Multimedia Retrieval
    • EWI-17167
    • Category retrieval
    • HMI-MR: MULTIMEDIA RETRIEVAL
    • N400

    Fingerprint Dive into the research topics of 'EEG analysis for implicit tagging of video data'. Together they form a unique fingerprint.

  • Cite this

    Koelstra, S., Mühl, C., & Patras, I. (2009). EEG analysis for implicit tagging of video data. In Proceedings 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009 (Vol. 2, pp. 27-32). Los Alamitos, NJ: IEEE Computer Society Press. https://doi.org/10.1109/ACII.2009.5349482