Structural Building Damage Detection with Deep Learning: Assessment of a State-of-the-Art CNN in Operational Conditions

Francesco Nex, Diogo Duarte, Fabio Giulio Tonolo, Norman Kerle

Research output: Contribution to journalArticleAcademicpeer-review

127 Citations (Scopus)
174 Downloads (Pure)

Abstract

Remotely sensed data can provide the basis for timely and efficient building damage maps that are of fundamental importance to support the response activities following disaster events. However, the generation of these maps continues to be mainly based on the manual extraction of relevant information in operational frameworks. Considering the identification of visible structural damages caused by earthquakes and explosions, several recent works have shown that Convolutional Neural Networks (CNN) outperform traditional methods. However, the limited availability of publicly available image datasets depicting structural disaster damages, and the wide variety of sensors and spatial resolution used for these acquisitions (from space, aerial and UAV platforms), have limited the clarity of how these networks can effectively serve First Responder needs and emergency mapping service requirements. In this paper, an advanced CNN for visible structural damage detection is tested to shed some light on what deep learning networks can currently deliver, and its adoption in realistic operational conditions after earthquakes and explosions is critically discussed. The heterogeneous and large datasets collected by the authors covering different locations, spatial resolutions and platforms were used to assess the network performances in terms of transfer learning with specific regard to geographical transferability of the trained network to imagery acquired in different locations. The computational time needed to deliver these maps is also assessed. Results show that quality metrics are influenced by the composition of training samples used in the network. To promote their wider use, three pre-trained networks—optimized for satellite, airborne and UAV image spatial resolutions and viewing angles—are made freely available to the scientific community.
Original languageEnglish
Article number2765
Pages (from-to)1-17
Number of pages17
JournalRemote sensing
Volume11
Issue number23
DOIs
Publication statusPublished - 24 Nov 2019

Keywords

  • ITC-ISI-JOURNAL-ARTICLE
  • ITC-GOLD
  • Trained models
  • CNN
  • Geographical transferability
  • Transfer learning
  • Machine learning
  • Disaster
  • Building damage detection

Fingerprint

Dive into the research topics of 'Structural Building Damage Detection with Deep Learning: Assessment of a State-of-the-Art CNN in Operational Conditions'. Together they form a unique fingerprint.

Cite this