Automatic detection of children's engagement using non-verbal features and ordinal learning

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    88 Downloads (Pure)

    Abstract

    In collaborative play, young children can exhibit different types of engagement. Some children are engaged with other children in the play activity while others are just looking. In this study, we investigated methods to automatically detect the children's levels of engagement in play settings using non-verbal vocal features. Rather than labelling the level of engagement in an absolute manner, as has frequently been done in previous related studies, we designed an annotation scheme that takes the order of children's engagement levels into account. Taking full advantage of the ordinal annotations, we explored the use of SVM-based ordinal learning, i.e. ordinal regression and ranking, and compared these to a rule-based ranking and a classification method. We found promising performances for the ordinal methods. Particularly, the ranking method demonstrated the most robust performance against the large variation of children and their interactions.
    Original languageUndefined
    Title of host publicationProceedings of the Workshop on Child Computer Interaction (WOCCI 2016)
    Place of PublicationBaixas, France
    PublisherISCA
    Pages29-34
    Number of pages6
    ISBN (Print)not assigned
    DOIs
    Publication statusPublished - Sep 2016
    EventWorkshop on Child Computer Interaction (WOCCI 2016), San Francisco, CA, U.S.A: Proceedings of the Workshop on Child Computer Interaction (WOCCI 2016) - Baixas, France
    Duration: 1 Sep 2016 → …

    Publication series

    Name
    PublisherISCA

    Conference

    ConferenceWorkshop on Child Computer Interaction (WOCCI 2016), San Francisco, CA, U.S.A
    CityBaixas, France
    Period1/09/16 → …

    Keywords

    • EWI-27467
    • HMI-SLT: Speech and Language Technology
    • non-verbal
    • ranking
    • METIS-320905
    • Children
    • Engagement
    • IR-102932
    • EC Grant Agreement nr.: FP7/610532

    Cite this