Synchronization between Sensors and Cameras in Movement Data Labeling Frameworks

Jacob Wilhelm Kamminga, Michael Jones, Kevin Seppi, Nirvana Meratnia, Paul J.M. Havinga

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

3 Citations (Scopus)
122 Downloads (Pure)


Obtaining labeled data for activity recognition tasks is a tremendously time consuming, tedious, and labor-intensive task. Often, ground-truth video of the activity is recorded along with sensordata recorded during the activity. The data must be synchronized with the recorded video to be useful. In this paper, we present and compare two labeling frameworks that each has a different approach to synchronization. Approach A uses time-stamped visual indicators positioned on the data loggers. The approach results in accurate synchronization between video and data but adds more overhead and is not practical when using multiple sensors, subjects, and cameras simultaneously. Also, synchronization needs to be redone for each recording session. Approach B uses Real-Time Clocks (RTCs) on the devices for synchronization, which is less accurate but has several advantages: multiple subjects can be recorded on various cameras, it becomes easier to collect more data, and synchronization only needs to be done once across multiple recording sessions. Therefore, it is easier to collect more data which increases the probability of capturing an unusual activity. The best way forward is likely a combination of both approaches.
Original languageEnglish
Title of host publicationDATA'19: Proceedings of the 2nd Workshop on Data Acquisition To Analysis
ISBN (Electronic)978-1-4503-6993-0
Publication statusPublished - 10 Nov 2019
Event2nd Workshop on Data Acquisition To Analysis, DATA 2019 - Columbus University, New York, United States
Duration: 10 Nov 201910 Nov 2019
Conference number: 2


Conference2nd Workshop on Data Acquisition To Analysis, DATA 2019
Abbreviated titleDATA
Country/TerritoryUnited States
CityNew York


Dive into the research topics of 'Synchronization between Sensors and Cameras in Movement Data Labeling Frameworks'. Together they form a unique fingerprint.

Cite this