Methodologies for the User Evaluation of the Motion of Virtual Humans

S.E.M. Jansen, H. van Welbergen

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    3 Citations (Scopus)

    Abstract

    Virtual humans are employed in many interactive applications, including (serious) games. Their motion should be natural and allow interaction with its surroundings and other (virtual) humans in real time. Physical controllers offer physical realism and (physical) interaction with the environment. Because they typically act on a selected set of joints, it is hard to evaluate their naturalness in isolation. We propose to augment the motion steered by such a controller with motion capture, using a mixed paradigm animation that creates coherent full body motion. A user evaluation of this resulting motion assesses the naturalness of the controller. Methods from Signal Detection Theory provide us with evaluation metrics that can be compared among different test setups, observers and motions. We demonstrate our approach by evaluating the naturalness of a balance controller. We compare different test paradigms, assessing their efficiency and sensitivity.
    Original languageEnglish
    Title of host publicationIntelligent Virtual Agents
    Subtitle of host publication9th International Conference, IVA 2009 Amsterdam, The Netherlands, September 14-16, 2009 Proceedings
    Place of PublicationBerlin
    PublisherSpringer
    Pages125-131
    Number of pages7
    ISBN (Electronic)978-3-642-04380-2
    ISBN (Print)978-3-642-04379-6
    DOIs
    Publication statusPublished - 19 Sep 2009
    Event9th International Conference on Intelligent Virtual Agents, IVA 2009 - Amsterdam, Netherlands
    Duration: 14 Sep 200916 Sep 2009
    Conference number: 9

    Publication series

    NameLecture Notes in Computer Science
    PublisherSpringer
    Volume5773
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference9th International Conference on Intelligent Virtual Agents, IVA 2009
    Abbreviated titleIVA
    CountryNetherlands
    CityAmsterdam
    Period14/09/0916/09/09

    Fingerprint

    Controllers
    Signal detection
    Animation
    Serious games

    Keywords

    • METIS-264016
    • IR-67878
    • EWI-16045
    • Evaluation of Virtual Agents
    • CR-I.3.7
    • Naturalness of Animation

    Cite this

    Jansen, S. E. M., & van Welbergen, H. (2009). Methodologies for the User Evaluation of the Motion of Virtual Humans. In Intelligent Virtual Agents: 9th International Conference, IVA 2009 Amsterdam, The Netherlands, September 14-16, 2009 Proceedings (pp. 125-131). (Lecture Notes in Computer Science; Vol. 5773). Berlin: Springer. https://doi.org/10.1007/978-3-642-04380-2_16
    Jansen, S.E.M. ; van Welbergen, H. / Methodologies for the User Evaluation of the Motion of Virtual Humans. Intelligent Virtual Agents: 9th International Conference, IVA 2009 Amsterdam, The Netherlands, September 14-16, 2009 Proceedings. Berlin : Springer, 2009. pp. 125-131 (Lecture Notes in Computer Science).
    @inproceedings{c67e8150a6de4ab29c5b806c830ff6b6,
    title = "Methodologies for the User Evaluation of the Motion of Virtual Humans",
    abstract = "Virtual humans are employed in many interactive applications, including (serious) games. Their motion should be natural and allow interaction with its surroundings and other (virtual) humans in real time. Physical controllers offer physical realism and (physical) interaction with the environment. Because they typically act on a selected set of joints, it is hard to evaluate their naturalness in isolation. We propose to augment the motion steered by such a controller with motion capture, using a mixed paradigm animation that creates coherent full body motion. A user evaluation of this resulting motion assesses the naturalness of the controller. Methods from Signal Detection Theory provide us with evaluation metrics that can be compared among different test setups, observers and motions. We demonstrate our approach by evaluating the naturalness of a balance controller. We compare different test paradigms, assessing their efficiency and sensitivity.",
    keywords = "METIS-264016, IR-67878, EWI-16045, Evaluation of Virtual Agents, CR-I.3.7, Naturalness of Animation",
    author = "S.E.M. Jansen and {van Welbergen}, H.",
    year = "2009",
    month = "9",
    day = "19",
    doi = "10.1007/978-3-642-04380-2_16",
    language = "English",
    isbn = "978-3-642-04379-6",
    series = "Lecture Notes in Computer Science",
    publisher = "Springer",
    pages = "125--131",
    booktitle = "Intelligent Virtual Agents",

    }

    Jansen, SEM & van Welbergen, H 2009, Methodologies for the User Evaluation of the Motion of Virtual Humans. in Intelligent Virtual Agents: 9th International Conference, IVA 2009 Amsterdam, The Netherlands, September 14-16, 2009 Proceedings. Lecture Notes in Computer Science, vol. 5773, Springer, Berlin, pp. 125-131, 9th International Conference on Intelligent Virtual Agents, IVA 2009, Amsterdam, Netherlands, 14/09/09. https://doi.org/10.1007/978-3-642-04380-2_16

    Methodologies for the User Evaluation of the Motion of Virtual Humans. / Jansen, S.E.M.; van Welbergen, H.

    Intelligent Virtual Agents: 9th International Conference, IVA 2009 Amsterdam, The Netherlands, September 14-16, 2009 Proceedings. Berlin : Springer, 2009. p. 125-131 (Lecture Notes in Computer Science; Vol. 5773).

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    TY - GEN

    T1 - Methodologies for the User Evaluation of the Motion of Virtual Humans

    AU - Jansen, S.E.M.

    AU - van Welbergen, H.

    PY - 2009/9/19

    Y1 - 2009/9/19

    N2 - Virtual humans are employed in many interactive applications, including (serious) games. Their motion should be natural and allow interaction with its surroundings and other (virtual) humans in real time. Physical controllers offer physical realism and (physical) interaction with the environment. Because they typically act on a selected set of joints, it is hard to evaluate their naturalness in isolation. We propose to augment the motion steered by such a controller with motion capture, using a mixed paradigm animation that creates coherent full body motion. A user evaluation of this resulting motion assesses the naturalness of the controller. Methods from Signal Detection Theory provide us with evaluation metrics that can be compared among different test setups, observers and motions. We demonstrate our approach by evaluating the naturalness of a balance controller. We compare different test paradigms, assessing their efficiency and sensitivity.

    AB - Virtual humans are employed in many interactive applications, including (serious) games. Their motion should be natural and allow interaction with its surroundings and other (virtual) humans in real time. Physical controllers offer physical realism and (physical) interaction with the environment. Because they typically act on a selected set of joints, it is hard to evaluate their naturalness in isolation. We propose to augment the motion steered by such a controller with motion capture, using a mixed paradigm animation that creates coherent full body motion. A user evaluation of this resulting motion assesses the naturalness of the controller. Methods from Signal Detection Theory provide us with evaluation metrics that can be compared among different test setups, observers and motions. We demonstrate our approach by evaluating the naturalness of a balance controller. We compare different test paradigms, assessing their efficiency and sensitivity.

    KW - METIS-264016

    KW - IR-67878

    KW - EWI-16045

    KW - Evaluation of Virtual Agents

    KW - CR-I.3.7

    KW - Naturalness of Animation

    U2 - 10.1007/978-3-642-04380-2_16

    DO - 10.1007/978-3-642-04380-2_16

    M3 - Conference contribution

    SN - 978-3-642-04379-6

    T3 - Lecture Notes in Computer Science

    SP - 125

    EP - 131

    BT - Intelligent Virtual Agents

    PB - Springer

    CY - Berlin

    ER -

    Jansen SEM, van Welbergen H. Methodologies for the User Evaluation of the Motion of Virtual Humans. In Intelligent Virtual Agents: 9th International Conference, IVA 2009 Amsterdam, The Netherlands, September 14-16, 2009 Proceedings. Berlin: Springer. 2009. p. 125-131. (Lecture Notes in Computer Science). https://doi.org/10.1007/978-3-642-04380-2_16