Towards improved unmanned aerial vehicle edge intelligence: a road infrastructure monitoring case study

S. Tilon*, F. Nex, G. Vosselman, Irene Sevilla de la Llave, N. Kerle

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

5 Citations (Scopus)
112 Downloads (Pure)

Abstract

Consumer-grade Unmanned Aerial Vehicles (UAVs) are poorly suited to monitor complex scenes where multiple analysis tasks need to be carried out in real-time and in parallel to fulfil time-critical requirements. Therefore, we developed an innovative UAV agnostic system that is able to carry out multiple road infrastructure monitoring tasks simultaneously and in real-time. The aim of the paper is to discuss the system design considerations and the performance of the processing pipeline in terms of computational strain and latency. The system was deployed on a unique typology of UAV and instantiated with realistic placeholder modules that are of importance for infrastructure inspection tasks, such as vehicle detection for traffic monitoring, scene segmentation for qualitative semantic reasoning, and 3D scene reconstruction for large-scale damage detection. The system was validated by carrying out a trial on a highway in Guadalajara, Spain. By utilizing edge computation and remote processing, the end-to-end pipeline, from image capture to information dissemination to drone operators on the ground, takes on average 2.9 s, which is sufficiently quick for road monitoring purposes. The system is dynamic and, therefore, can be extended with additional modules, while continuously accommodating developments in technologies, such as IoT or 5G.

Original languageEnglish
Article number4008
JournalRemote sensing
Volume14
Issue number16
DOIs
Publication statusPublished - 18 Aug 2022

Keywords

  • edge-computation
  • real-time
  • remote processing
  • PANOPTIS
  • deep learning
  • DeltaQuad
  • monitoring
  • fixed-wing VTOL
  • hybrid UAV
  • ITC-ISI-JOURNAL-ARTICLE
  • ITC-GOLD

Fingerprint

Dive into the research topics of 'Towards improved unmanned aerial vehicle edge intelligence: a road infrastructure monitoring case study'. Together they form a unique fingerprint.

Cite this