Volleyball Action Modelling for Behavior Analysis and Interactive Multi-modal Feedback

Fahim A. Salim, Fasih Haider, Sena Busra Yengec Tasdemir, Vahid Naghashi, Izem Tengiz, Kübra Cengiz, Dees B.W. Postma, Robby van Delden, Dennis Reidsma, Saturnino Luz, Bert-Jan van Beijnum

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

30 Downloads (Pure)

Abstract

Quick and easy access to performance data during matches and training sessions is important for both players and coaches. While there are many video tagging systems available, these systems require manual efforts. In this project, we use Inertial Measurement Units (IMU) sensors strapped on the wrists of volleyball players to capture motion data and use Machine Learning techniques to model their actions and non-actions events during matches and training sessions.

Analysis of the results suggests that all sensors in the IMU (i.e. magnetometer, accelerometer, barometer and gyroscope) contribute unique information in the classification of volleyball-specific actions. We demonstrate that while the accelerometer feature set provides the best Unweighted Average Recall (UAR) overall, decision fusion of the accelerometer with the magnetometer improves UAR slightly from 85.86\% to 86.9\%. Interestingly, it is also demonstrated that the non-dominant hand provides better UAR than the dominant hand. These results are even more marked with decision fusion.

Apart from machine learning models, the project proposes a modular architecture for a system to automatically supplement video recording by detecting events of interests in volleyball matches and training sessions and to provide tailored and interactive multi-modal feedback by utilizing an html5/JavaScript application. A proof of concept prototype is also developed based on this architecture.
Original languageEnglish
Title of host publicationeNTERFACE’19, 15th International Summer Workshop on Multimodal Interface
Place of PublicationAnkara
PublisherBilkent University
Number of pages9
Publication statusPublished - 1 Jan 2020
EventeNTERFACE'19: 15th International Summer Workshop on Multimodal Interfaces - Bilkent University, Ankara, Turkey
Duration: 8 Jul 20192 Aug 2019
Conference number: 15

Conference

ConferenceeNTERFACE'19
Abbreviated titleeNTERFACE'19
CountryTurkey
CityAnkara
Period8/07/192/08/19

    Fingerprint

Cite this

Salim, F. A., Haider, F., Yengec Tasdemir, S. B., Naghashi, V., Tengiz, I., Cengiz, K., ... van Beijnum, B-J. (2020). Volleyball Action Modelling for Behavior Analysis and Interactive Multi-modal Feedback. In eNTERFACE’19, 15th International Summer Workshop on Multimodal Interface Ankara: Bilkent University.