How the agent’s gender influence users’ evaluation of a QA system

A.I. Niculescu, D.H.W. Hofs, Elisabeth M.A.G. van Dijk, Antinus Nijholt

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    11 Citations (Scopus)
    76 Downloads (Pure)

    Abstract

    In this paper we present the results of a pilot study investigating the effects of agents’ gender-ambiguous vs. gender-marked look on the perceived interaction quality of a multimodal question answering system. Eight test subjects interacted with three system agents, each having a feminine, masculine or gender-ambiguous look. The subjects were told each agent was representing a differently configured system. In fact, they were interacting with the same system. In the end, the subjects filled in an evaluation questionnaire and participated in an in-depth qualitative interview. The results showed that the user evaluation seemed to be influenced by the agent’s gender look: the system represented by the feminine agent achieved on average the highest evaluation scores. On the other hand, the system represented by the gender-ambiguous agent was systematically lower rated. This outcome might be relevant for an appropriate agent look, especially since many designers tend to develop gender-ambiguous characters for interactive interfaces to match various users’ preferences. However, additional empirical evidence is needed in the future to confirm our findings.
    Original languageUndefined
    Title of host publicationProceedings of the International Conference on User Science and Engineering 2010
    EditorsF. Mohd Saman, N.L. Md Noor, H. Haron, A. Yeo, A. Edwards
    Place of PublicationUSA
    PublisherIEEE
    Pages16-20
    Number of pages5
    ISBN (Print)978-1-4244-9049-3
    DOIs
    Publication statusPublished - Dec 2010

    Publication series

    Name
    PublisherIEEE
    Volumeonline pre
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Keywords

    • METIS-271077
    • IR-73715
    • User studies
    • HMI-HF: Human Factors
    • Anthropomorphic agents
    • EWI-18616
    • HMI-MI: MULTIMODAL INTERACTIONS
    • Gender-ambiguous vs. gender-marked look

    Cite this

    Niculescu, A. I., Hofs, D. H. W., van Dijk, E. M. A. G., & Nijholt, A. (2010). How the agent’s gender influence users’ evaluation of a QA system. In F. Mohd Saman, N. L. Md Noor, H. Haron, A. Yeo, & A. Edwards (Eds.), Proceedings of the International Conference on User Science and Engineering 2010 (pp. 16-20). USA: IEEE. https://doi.org/10.1109/IUSER.2010.5716715