Semantic segmentation of building in airborne images

S. Huang, F. Nex, Y. Lin, M. Y. Yang

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

3 Citations (Scopus)
183 Downloads (Pure)


Building is a key component to the reconstructing of LoD3 city modelling. Compared to terrestrial view, airborne datasets have more occlusions at street level but can cover larger area in the urban areas. With the popularity of the Deep Learning, many tasks in the field of computer vision can be solved in easier and efficiency way. In this paper, we propose a method to apply deep neural networks to building façade segmentation. In particular, the FC-DenseNet and the DeepLabV3+ algorithms are used to segment the building from airborne images and get semantic information such as, wall, roof, balcony and opening area. The patch-wise segmentation is used in the training and testing process in order to get information at pixel level. Different typologies of input have been considered: beside the conventional 2D information (i.e. RGB image), we combined 2D information with 3D features extracted from dense image matching point clouds to improve the performance of the segmentation. Results show that FC-DenseNet trained with 2D and 3D features achieves the best result, IoU up to 64.41%, it increases 5.13% compared to the result of the same model trained without 3D features.
Original languageEnglish
Title of host publicationThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Subtitle of host publicationISPRS Geospatial Week 2019
Place of PublicationEnschede
PublisherInternational Society for Photogrammetry and Remote Sensing (ISPRS)
Number of pages8
Publication statusPublished - 4 Jun 2019
Event4th ISPRS Geospatial Week 2019 - University of Twente, Enschede, Netherlands
Duration: 10 Jun 201914 Jun 2019
Conference number: 4

Publication series

NameInternational Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
ISSN (Print)2194-9034


Conference4th ISPRS Geospatial Week 2019
Internet address




Dive into the research topics of 'Semantic segmentation of building in airborne images'. Together they form a unique fingerprint.

Cite this