Fall Detection and Recognition from Egocentric Visual Data: A Case Study

Xueyi Wang*, Estefanía Talavera, Dimka Karastoyanova, George Azzopardi

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review


Falling is among the most damaging events for elderly people, which sometimes may end with significant injuries. Due to fear of falling, many elderly people choose to stay more at home in order to feel safer. In this work, we propose a new fall detection and recognition approach, which analyses egocentric videos collected by wearable cameras through a computer vision/machine learning pipeline. More specifically, we conduct a case study with one volunteer who collected video data from two cameras; one attached to the chest and the other one attached to the waist. A total of 776 videos were collected describing four types of falls and nine kinds of non-falls. Our method works as follows: extracts several uniformly distributed frames from the videos, uses a pre-trained ConvNet model to describe each frame by a feature vector, followed by feature fusion and a classification model. Our proposed model demonstrates its suitability for the detection and recognition of falls from the data captured by the two cameras together. For this case study, we detect all falls with only one false positive, and reach a balanced accuracy of 93% in the recognition of the 13 types of activities. Similar results are obtained for videos of the two cameras when considered separately. Moreover, we observe better performance of videos collected in indoor scenes.

Original languageEnglish
Title of host publicationPattern Recognition. ICPR International Workshops and Challenges
Subtitle of host publicationVirtual Event, January 10–15, 2021, Proceedings
EditorsAlberto Del Bimbo, Rita Cucchiara, Stan Sclaroff, Giovanni Maria Farinella, Tao Mei, Marco Bertini, Hugo Jair Escalante, Roberto Vezzani
Place of PublicationCham
Number of pages13
ISBN (Electronic)978-3-030-68763-2
ISBN (Print)978-3-030-68762-5
Publication statusPublished - 2021
Externally publishedYes
Event25th International Conference on Pattern Recognition, ICPR 2020 - Online conference, Virtual, Milan, Italy
Duration: 10 Jan 202115 Jan 2021
Conference number: 25

Publication series

NameLecture Notes in Computer Science
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference25th International Conference on Pattern Recognition, ICPR 2020
Abbreviated titleICPR
CityVirtual, Milan
Internet address


  • Egocentric vision
  • Fall detection
  • Fall recognition
  • Health monitoring
  • Wearable camera
  • Well-being


Dive into the research topics of 'Fall Detection and Recognition from Egocentric Visual Data: A Case Study'. Together they form a unique fingerprint.

Cite this