A representative-based framework for parsing and summarizing events in surveillance videos

Zhen Ju, Weiyao Lin*, Michael Ying Yang, Zhang Bo, Chuanfei Luo, Chia Wen Lin, Tao Mei

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

1 Citation (Scopus)

Abstract

This paper presents a novel representative-based framework for parsing and summarizing events in long surveillance videos. The proposed framework first extracts object blob sequences and utilizes them to represent events in a surveillance video. Then, a sequence filtering strategy is introduced which detects and eliminates noisy blob sequences based on their spatial and temporal characteristics. After clustering the blob sequences into different event types, we further introduce a representative-based model which integrates location, size, and appearance cues to select a representative blob sequence from each cluster, and creates a snapshot image for each representative blob sequence. Based on the blob-sequence clustering and representative-sequence selection results, two schemes are further proposed to summarize contents of the input surveillance video: (1) type-based scheme which shows snapshot images to users and creates a summary video for a specific event cluster according to user-selected snapshot image; (2) representative-based scheme which creates a summary video only with the extracted representative blob sequences. Experimental results show that our approach can create more effective and well-organized summarization results compared with the state-of-the-art methods.

Original languageEnglish
Title of host publication2016 IEEE International Conference on Multimedia and Expo Workshop, ICMEW 2016
Place of PublicationSeattle
PublisherIEEE
Pages1-6
Number of pages6
ISBN (Electronic)9781509015528
DOIs
Publication statusPublished - 22 Sep 2016
Event2016 IEEE International Conference on Multimedia and Expo Workshop, ICMEW - The Westin Seattle Hotel, Seattle, United States
Duration: 11 Jul 201615 Jul 2016

Publication series

Name2016 IEEE International Conference on Multimedia and Expo Workshop, ICMEW 2016

Conference

Conference2016 IEEE International Conference on Multimedia and Expo Workshop, ICMEW
Abbreviated titleICMEW 2016
CountryUnited States
CitySeattle
Period11/07/1615/07/16

Cite this

Ju, Z., Lin, W., Yang, M. Y., Bo, Z., Luo, C., Lin, C. W., & Mei, T. (2016). A representative-based framework for parsing and summarizing events in surveillance videos. In 2016 IEEE International Conference on Multimedia and Expo Workshop, ICMEW 2016 (pp. 1-6). [7574772] (2016 IEEE International Conference on Multimedia and Expo Workshop, ICMEW 2016). Seattle: IEEE. https://doi.org/10.1109/ICMEW.2016.7574772