Stress and Cognitive Load in Multimodal Conversational Interactions

A.I. Niculescu, Y. Cao, Antinus Nijholt

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review


    The quality assessment of multimodal conversational interactions is determined by many influence parameters. Stress and cognitive load are two of them. In order to assess the impact of stress and cognitive load on the perceived conversational quality it is essential to control their levels during the interaction. Therefore we present in this paper preliminary experiments carried out to determine the circumstances in which low/high levels of stress respectively cognitive load are achieved while interacting with the system. Different levels are manipulated by varying task difficulty (information complexity, task load, and simulated speech recognition errors), information presentation (modality usage, spatial organization and temporal order of information items) and time pressure. Heart rate variability (HRV) and galvanic skin response (GSR) as well as subjective judgments in the form of questionnaires are deployed to validate the induced stress and cognitive levels. Methods and preliminary results are presented.
    Original languageUndefined
    Title of host publicationHCI International. 13th International Conference on Human-Computer Interaction
    EditorsC. Stephanides
    Place of PublicationHeidelberg
    Number of pages5
    ISBN (Print)978-3-642-02884-7
    Publication statusPublished - 19 Jul 2009
    Event13th International Conference on Human-Computer Interaction, HCI International 2009 - San Diego, United States
    Duration: 19 Jul 200923 Jul 2009
    Conference number: 13

    Publication series

    NameProceedings and Poster DVD
    PublisherSpringer Verlag


    Conference13th International Conference on Human-Computer Interaction, HCI International 2009
    Abbreviated titleHCI International
    CountryUnited States
    CitySan Diego
    Internet address


    • IR-67819
    • METIS-263934
    • Cognitive load
    • EWI-15741
    • multimodal conversation
    • HMI-HF: Human Factors
    • Stress

    Cite this