A Guided Registration Strategy Employing Virtual Planes To Overcome Non-Standard Geometries – Using The Example Of Mobile Mapping And Aerial Oblique Imagery

P.L.H. Jende, F.C. Nex, Markus Gerke, G. Vosselman

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

2 Citations (Scopus)
46 Downloads (Pure)

Abstract

Mobile mapping (MM) is an intriguing as well as emerging platform and technology for geo-data acquisition. In typical areas of interest for MM campaigns, such as urban areas, unwanted GNSS multipath, non-line-of-sight effects, and IMU drifts may lead to deteriorated position fixes. In this work, we are proposing a novel technique to register MM and aerial oblique imagery. As aerial platforms are not affected by GNSS occlusions and are able to collect very-high resolution images, a co-registration of the data sets enables a) an independent verification of the platform’s accuracy and b) an adjustment of the MM data’s pose. Both data sets depict the scene from an entirely different perspective, which complicates the matching problem. Our approach is based on the assumption that common visible entities in both images are available, e.g. façade surfaces. By determining planes coinciding with these visible entities in object space, variances can be overcome. As the orientation of the data sets is known – MM data has an unknown accuracy – derived planes are employed to support a visibility hypothesis while storing image information for image registration in object space. This enables constraining search space to support the actual registration. Although the inhomogeneity of the data sets poses a challenge to a successful registration, we can show that our stepwise strategy of finding common visible entities, exploiting them to increase the resemblance of the data sets, and utilising accurate registration methods renders this matching scenario possible. In this paper, the algorithm is explained in detail, experimental results of significant steps will be shown, and possible extensions are discussed.
Original languageEnglish
Title of host publication2018 ISPRS TC II Mid-term Symposium “Towards Photogrammetry 2020”, 4–7 June 2018, Riva del Garda, Italy
Place of PublicationRiva Del Garda
PublisherInternational Society for Photogrammetry and Remote Sensing (ISPRS)
Pages471-477
Number of pages7
DOIs
Publication statusPublished - 30 May 2018

Publication series

NameThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
PublisherISPRS
VolumeXLII-2

Fingerprint

Antennas
Geometry
Image registration
Image resolution
Visibility
Data acquisition

Keywords

  • ITC-GOLD

Cite this

Jende, P. L. H., Nex, F. C., Gerke, M., & Vosselman, G. (2018). A Guided Registration Strategy Employing Virtual Planes To Overcome Non-Standard Geometries – Using The Example Of Mobile Mapping And Aerial Oblique Imagery. In 2018 ISPRS TC II Mid-term Symposium “Towards Photogrammetry 2020”, 4–7 June 2018, Riva del Garda, Italy (pp. 471-477). (The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences; Vol. XLII-2). Riva Del Garda: International Society for Photogrammetry and Remote Sensing (ISPRS). https://doi.org/10.5194/isprs-archives-XLII-2-471-2018
Jende, P.L.H. ; Nex, F.C. ; Gerke, Markus ; Vosselman, G. / A Guided Registration Strategy Employing Virtual Planes To Overcome Non-Standard Geometries – Using The Example Of Mobile Mapping And Aerial Oblique Imagery. 2018 ISPRS TC II Mid-term Symposium “Towards Photogrammetry 2020”, 4–7 June 2018, Riva del Garda, Italy. Riva Del Garda : International Society for Photogrammetry and Remote Sensing (ISPRS), 2018. pp. 471-477 (The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences).
@inproceedings{32248e06cca947d4a3ca4c5f39c12be6,
title = "A Guided Registration Strategy Employing Virtual Planes To Overcome Non-Standard Geometries – Using The Example Of Mobile Mapping And Aerial Oblique Imagery",
abstract = "Mobile mapping (MM) is an intriguing as well as emerging platform and technology for geo-data acquisition. In typical areas of interest for MM campaigns, such as urban areas, unwanted GNSS multipath, non-line-of-sight effects, and IMU drifts may lead to deteriorated position fixes. In this work, we are proposing a novel technique to register MM and aerial oblique imagery. As aerial platforms are not affected by GNSS occlusions and are able to collect very-high resolution images, a co-registration of the data sets enables a) an independent verification of the platform’s accuracy and b) an adjustment of the MM data’s pose. Both data sets depict the scene from an entirely different perspective, which complicates the matching problem. Our approach is based on the assumption that common visible entities in both images are available, e.g. fa{\cc}ade surfaces. By determining planes coinciding with these visible entities in object space, variances can be overcome. As the orientation of the data sets is known – MM data has an unknown accuracy – derived planes are employed to support a visibility hypothesis while storing image information for image registration in object space. This enables constraining search space to support the actual registration. Although the inhomogeneity of the data sets poses a challenge to a successful registration, we can show that our stepwise strategy of finding common visible entities, exploiting them to increase the resemblance of the data sets, and utilising accurate registration methods renders this matching scenario possible. In this paper, the algorithm is explained in detail, experimental results of significant steps will be shown, and possible extensions are discussed.",
keywords = "ITC-GOLD",
author = "P.L.H. Jende and F.C. Nex and Markus Gerke and G. Vosselman",
year = "2018",
month = "5",
day = "30",
doi = "10.5194/isprs-archives-XLII-2-471-2018",
language = "English",
series = "The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences",
publisher = "International Society for Photogrammetry and Remote Sensing (ISPRS)",
pages = "471--477",
booktitle = "2018 ISPRS TC II Mid-term Symposium “Towards Photogrammetry 2020”, 4–7 June 2018, Riva del Garda, Italy",

}

Jende, PLH, Nex, FC, Gerke, M & Vosselman, G 2018, A Guided Registration Strategy Employing Virtual Planes To Overcome Non-Standard Geometries – Using The Example Of Mobile Mapping And Aerial Oblique Imagery. in 2018 ISPRS TC II Mid-term Symposium “Towards Photogrammetry 2020”, 4–7 June 2018, Riva del Garda, Italy. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLII-2, International Society for Photogrammetry and Remote Sensing (ISPRS), Riva Del Garda, pp. 471-477. https://doi.org/10.5194/isprs-archives-XLII-2-471-2018

A Guided Registration Strategy Employing Virtual Planes To Overcome Non-Standard Geometries – Using The Example Of Mobile Mapping And Aerial Oblique Imagery. / Jende, P.L.H.; Nex, F.C.; Gerke, Markus; Vosselman, G.

2018 ISPRS TC II Mid-term Symposium “Towards Photogrammetry 2020”, 4–7 June 2018, Riva del Garda, Italy. Riva Del Garda : International Society for Photogrammetry and Remote Sensing (ISPRS), 2018. p. 471-477 (The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences; Vol. XLII-2).

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - A Guided Registration Strategy Employing Virtual Planes To Overcome Non-Standard Geometries – Using The Example Of Mobile Mapping And Aerial Oblique Imagery

AU - Jende, P.L.H.

AU - Nex, F.C.

AU - Gerke, Markus

AU - Vosselman, G.

PY - 2018/5/30

Y1 - 2018/5/30

N2 - Mobile mapping (MM) is an intriguing as well as emerging platform and technology for geo-data acquisition. In typical areas of interest for MM campaigns, such as urban areas, unwanted GNSS multipath, non-line-of-sight effects, and IMU drifts may lead to deteriorated position fixes. In this work, we are proposing a novel technique to register MM and aerial oblique imagery. As aerial platforms are not affected by GNSS occlusions and are able to collect very-high resolution images, a co-registration of the data sets enables a) an independent verification of the platform’s accuracy and b) an adjustment of the MM data’s pose. Both data sets depict the scene from an entirely different perspective, which complicates the matching problem. Our approach is based on the assumption that common visible entities in both images are available, e.g. façade surfaces. By determining planes coinciding with these visible entities in object space, variances can be overcome. As the orientation of the data sets is known – MM data has an unknown accuracy – derived planes are employed to support a visibility hypothesis while storing image information for image registration in object space. This enables constraining search space to support the actual registration. Although the inhomogeneity of the data sets poses a challenge to a successful registration, we can show that our stepwise strategy of finding common visible entities, exploiting them to increase the resemblance of the data sets, and utilising accurate registration methods renders this matching scenario possible. In this paper, the algorithm is explained in detail, experimental results of significant steps will be shown, and possible extensions are discussed.

AB - Mobile mapping (MM) is an intriguing as well as emerging platform and technology for geo-data acquisition. In typical areas of interest for MM campaigns, such as urban areas, unwanted GNSS multipath, non-line-of-sight effects, and IMU drifts may lead to deteriorated position fixes. In this work, we are proposing a novel technique to register MM and aerial oblique imagery. As aerial platforms are not affected by GNSS occlusions and are able to collect very-high resolution images, a co-registration of the data sets enables a) an independent verification of the platform’s accuracy and b) an adjustment of the MM data’s pose. Both data sets depict the scene from an entirely different perspective, which complicates the matching problem. Our approach is based on the assumption that common visible entities in both images are available, e.g. façade surfaces. By determining planes coinciding with these visible entities in object space, variances can be overcome. As the orientation of the data sets is known – MM data has an unknown accuracy – derived planes are employed to support a visibility hypothesis while storing image information for image registration in object space. This enables constraining search space to support the actual registration. Although the inhomogeneity of the data sets poses a challenge to a successful registration, we can show that our stepwise strategy of finding common visible entities, exploiting them to increase the resemblance of the data sets, and utilising accurate registration methods renders this matching scenario possible. In this paper, the algorithm is explained in detail, experimental results of significant steps will be shown, and possible extensions are discussed.

KW - ITC-GOLD

UR - https://ezproxy2.utwente.nl/login?url=https://webapps.itc.utwente.nl/library/2018/conf/jende_gui.pdf

U2 - 10.5194/isprs-archives-XLII-2-471-2018

DO - 10.5194/isprs-archives-XLII-2-471-2018

M3 - Conference contribution

T3 - The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences

SP - 471

EP - 477

BT - 2018 ISPRS TC II Mid-term Symposium “Towards Photogrammetry 2020”, 4–7 June 2018, Riva del Garda, Italy

PB - International Society for Photogrammetry and Remote Sensing (ISPRS)

CY - Riva Del Garda

ER -

Jende PLH, Nex FC, Gerke M, Vosselman G. A Guided Registration Strategy Employing Virtual Planes To Overcome Non-Standard Geometries – Using The Example Of Mobile Mapping And Aerial Oblique Imagery. In 2018 ISPRS TC II Mid-term Symposium “Towards Photogrammetry 2020”, 4–7 June 2018, Riva del Garda, Italy. Riva Del Garda: International Society for Photogrammetry and Remote Sensing (ISPRS). 2018. p. 471-477. (The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences). https://doi.org/10.5194/isprs-archives-XLII-2-471-2018