Benchmarking the Extraction of 3d Geometry From Uav Images with Deep Learning Methods

F. Nex, N. Zhang, F. Remondino, E.M. Farella, R. Qin, C. Zhang

Research output: Contribution to journalConference articleAcademicpeer-review

4 Citations (Scopus)
44 Downloads (Pure)

Abstract

3D reconstruction from single and multi-view stereo images is still an open research topic, despite the high number of solutions proposed in the last decades. The surge of deep learning methods has then stimulated the development of new methods using monocular (MDE, Monocular Depth Estimation), stereoscopic and Multi-View Stereo (MVS) 3D reconstruction, showing promising results, often comparable to or even better than traditional methods. The more recent development of NeRF (Neural Radial Fields) has further triggered the interest for this kind of solution. Most of the proposed approaches, however, focus on terrestrial applications (e.g., autonomous driving or small artefacts 3D reconstructions), while airborne and UAV acquisitions are often overlooked. The recent introduction of new datasets, such as UseGeo has, therefore, given the opportunity to assess how state-of-the-art MDE, MVS and NeRF 3D reconstruction algorithms perform using airborne UAV images, allowing their comparison with LiDAR ground truth. This paper aims to present the results achieved by two MDE, two MVS and two NeRF approaches levering deep learning approaches, trained and tested using the UseGeo dataset. This work allows the comparison with a ground truth showing the current state of the art of these solutions and providing useful indications for their future development and improvement.

Original languageEnglish
Pages (from-to)123-130
Number of pages8
JournalInternational Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
Volume48
Issue number1/W3-2023
DOIs
Publication statusPublished - 19 Oct 2023
Event2nd International Workshop on Evaluation and BENCHmarking of Sensors, Systems and GEOspatial Data in Photogrammetry and Remote Sensing, GEOBENCH 2023 - Krakow, Poland
Duration: 23 Oct 202324 Oct 2023
Conference number: 2

Keywords

  • 3D
  • benchmark
  • Deep Learning
  • monocular
  • MVS
  • NeRF
  • Photogrammetry
  • UAV

Fingerprint

Dive into the research topics of 'Benchmarking the Extraction of 3d Geometry From Uav Images with Deep Learning Methods'. Together they form a unique fingerprint.

Cite this