Cost-effective solution to synchronized audio-visual capture using multiple sensors

Jeroen Lichtenauer, Michel Valstar, Jie Shen, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    18 Citations (Scopus)
    106 Downloads (Pure)


    Applications such as surveillance and human motion capture require high-bandwidth recording from multiple cameras. Furthermore, the recent increase in research on sensor fusion has raised the demand on synchronization accuracy between video, audio and other sensor modalities. Previously, capturing synchronized, high resolution video from multiple cameras required complex, inflexible and expensive solutions. Our experiments show that a single PC, built from contemporary low-cost computer hardware, could currently handle up to 470MB/s of input data. This allows capturing from 18 cameras of 780x580pixels at 60fps each, or 36 cameras at 30fps. Furthermore, we achieve accurate synchronization between audio, video and additional sensors, by recording audio together with sensor trigger- or timestamp signals, using a multi-channel audio input. In this way, each sensor modality can be captured with separate software and hardware, allowing maximal flexibility with minimal cost.
    Original languageUndefined
    Title of host publicationProceedings 6th International Conference on Advanced Video and Signal Based Surveillance (AVSS '09)
    Place of PublicationLos Alamitos
    PublisherIEEE Computer Society
    Number of pages6
    ISBN (Print)978-0-7695-3718-4
    Publication statusPublished - 2009
    EventIEEE International Conference on Advanced Video and Signal Based Surveillance, AVSS ’09 - Genova, Italy
    Duration: 2 Sep 20094 Sep 2009

    Publication series

    PublisherIEEE Computer Society Press


    ConferenceIEEE International Conference on Advanced Video and Signal Based Surveillance, AVSS ’09
    Other2-4 Sept. 2009


    • METIS-264473
    • IR-69694
    • Synchronization
    • Video recording
    • Multisensor systems
    • Audio recording
    • EWI-17188
    • EC Grant Agreement nr.: FP7/211486
    • HMI-HF: Human Factors

    Cite this