Roof Structure Extraction from Aerial Images and nDSM using Deep Learning

Meruyert Kenzhebay*, Wufan Zhao, M.N. Koeva, C. Persello

*Corresponding author for this work

Research output: Working paperPreprintAcademic

25 Downloads (Pure)


A topic of growing interest in urban remote sensing is the automated extraction of geometrical building information for 3D city modeling. Roof geometry information is useful for applications such as urban planning, solar potential estimation and telecommunication installation planning, and wind flow simulations for pollutant diffusion analysis. Recent research has proven that the advance in remote sensing technologies and deep learning methods offer the prospects of deriving the roof structure information accurately and efficiently. In this study, we propose a Vectorized Roof Extractor-method based on Fully Convolutional Networks (FCNs) and advanced polygonization method to extract roof structure from aerial imagery and a normalized Digital Surface Models (nDSM) in a regularized vector format. The roof structure consists of building outlines, external edges of the building roof, inner rooflines, internal intersections of the main roof planes. The methodology is comprised of segmentation, vectorization and post-processing for outer rooflines, external edges of the building roof, and inner rooflines, and internal intersections of the main roof planes. For the comparison, we adapt the Frame field Learning (FFL) method originally designed to extract building polygons [1]. Our experiments are conducted on a custom data set derived for the city of Enschede, The Netherlands, using aerial imagery, nDSM and manually digitized training polygons. The results show that the proposed Vectorized Roof Extractor outperformed adapted FFL on PoLiS distance with values of 3.5 m and 1.2 m for outlines and inner rooflines, respectively. Furthermore, the model
Original languageEnglish
Publication statusPublished - 12 Sept 2023

Publication series


  • image processing; image analysis; deep learning; roof structure extraction; roof vectorization; frame field learning


Dive into the research topics of 'Roof Structure Extraction from Aerial Images and nDSM using Deep Learning'. Together they form a unique fingerprint.

Cite this