Touch Challenge ‘15: Recognizing Social Touch Gestures

Merel Madeleine Jung, Xi Laura Cang, Mannes Poel, Karon E. MacLean

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademic

    30 Citations (Scopus)
    309 Downloads (Pure)


    Advances in the field of touch recognition could open up applications for touch-based interaction in areas such as Human-Robot Interaction (HRI). We extended this challenge to the research community working on multimodal interaction with the goal of sparking interest in the touch modality and to promote exploration of the use of data processing techniques from other more mature modalities for touch recognition. Two data sets were made available containing labeled pressure sensor data of social touch gestures that were performed by touching a touch-sensitive surface with the hand. Each set was collected from similar sensor grids, but under conditions reflecting different application orientations: CoST: Corpus of Social Touch and HAART: The Human-Animal Affective Robot Touch gesture set. In this paper we describe the challenge protocol and summa- rize the results from the touch challenge hosted in conjunction with the 2015 ACM International Conference on Multi- modal Interaction (ICMI). The most important outcomes of the challenges were: (1) transferring techniques from other modalities, such as image processing, speech, and human action recognition provided valuable feature sets; (2) gesture classification confusions were similar despite the various data processing methods used. Categories
    Original languageUndefined
    Title of host publicationProceedings of the 2015 ACM on International Conference on Multimodal Interaction, ICMI 2015
    Place of PublicationNew York
    PublisherAssociation for Computing Machinery
    Pages387 -390
    Number of pages4
    ISBN (Print)978-1-4503-3912-4
    Publication statusPublished - Nov 2015
    Event17th ACM International Conference on Multimodal Interaction, ICMI 2015 - Seattle, United States
    Duration: 9 Nov 201513 Nov 2015
    Conference number: 17

    Publication series



    Conference17th ACM International Conference on Multimodal Interaction, ICMI 2015
    Abbreviated titleICMI
    Country/TerritoryUnited States


    • EWI-26507
    • IR-98396
    • METIS-315060

    Cite this