Vectorizing Planar Roof Structure From Very High Resolution Remote Sensing Images Using Transformers

Wufan Zhao*, Claudio Persello, Xianwei Lv, Alfred Stein

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

Grasping the roof structure of a building is a key part of building reconstruction. Directly predicting the geometric structure of the roof from a raster image to a vectorized representation, however, remains challenging. This paper introduces an efficient and accurate parsing method based upon a vision Transformer we dubbed Roof-Former. Our method consists of three steps: 1) Image encoder and edge node initialization, 2) Image feature fusion with an enhanced segmentation refinement branch, and 3) Edge filtering and structural reasoning. The vertex and edge heat map F1-scores have increased by 2.0% and 1.9% on the VWB dataset when compared to HEAT. Additionally, qualitative evaluations suggest that our method is superior to the current state-of-the-art. It indicates effectiveness for extracting global image information and maintaining the consistency and topological validity of the roof structure.

Original languageEnglish
Title of host publicationIGARSS 2023 - 2023 IEEE International Geoscience and Remote Sensing Symposium, Proceedings
PublisherIEEE
Pages4899-4902
Number of pages4
ISBN (Electronic)9798350320107
DOIs
Publication statusPublished - 2023
Event43rd IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2023 - Pasadena Convention Center, Pasadena, United States
Duration: 16 Jul 202321 Jul 2023
Conference number: 43
https://2023.ieeeigarss.org/index.php

Publication series

NameInternational Geoscience and Remote Sensing Symposium (IGARSS)
Volume2023-July

Conference

Conference43rd IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2023
Abbreviated titleIGARSS 2023
Country/TerritoryUnited States
CityPasadena
Period16/07/2321/07/23
Internet address

Keywords

  • geometry reconstruction
  • remote sensing image
  • Roof structure extraction
  • Transformer
  • 2024 OA procedure

Fingerprint

Dive into the research topics of 'Vectorizing Planar Roof Structure From Very High Resolution Remote Sensing Images Using Transformers'. Together they form a unique fingerprint.

Cite this