Effect of label noise in semantic segmentation of high resolution aerial images and height data

A. Maiti*, S. J. Oude Elberink, G. Vosselman

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review

3 Citations (Scopus)
335 Downloads (Pure)

Abstract

The performance of deep learning models in semantic segmentation is dependent on the availability of a large amount of labeled data. However, the influence of label noise, in the form of incorrect annotations, on the performance is significant and mostly ignored. This is a big concern in remote sensing applications, wherein acquired datasets are spatially limited, labeling is done by domain experts with possible sources of high inter-and intra-observer variability leading to erroneous predictions. In this paper, we first simulate the label noise while conducting experiments on two different datasets with very high-resolution aerial images, height data, and inaccurate labels, responsible for the training of deep learning models. We then focus on the effect of these noises on the model performance. Different classes respond differently to the label noise. The typical size of an object belonging to a class is a crucial factor regarding the class-specific performance of the model trained with erroneous labels. Errors caused by relative shifts of labels are the most influential label errors. The model is generally more tolerant of the random label noise than other label errors. It has been observed that the accuracy gets reduced by at least 3% while 5% of label pixels are erroneous. In this regard, our study provides a new perspective of evaluating and quantifying the propagation of label noise in the model performance that is indeed important for adopting reliable semantic segmentation practices.
Original languageEnglish
Title of host publicationISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Subtitle of host publicationCongress “Imaging today, foreseeing tomorrow”, Commission II
EditorsA. Yilmaz, J.D. Wegner, R. Qin, F. Remondino, T. Fuse, I. Toschi
PublisherCopernicus
Pages275-282
Number of pages8
Volume5
Edition2
DOIs
Publication statusPublished - 17 May 2022
EventXXIV ISPRS Congress 2022: Congress “Imaging today, foreseeing tomorrow” - Nice, France
Duration: 6 Jun 202211 Jun 2022
https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B3-2022/index.html

Publication series

NameISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
PublisherCopernicus
ISSN (Print)2194-9042

Conference

ConferenceXXIV ISPRS Congress 2022
Abbreviated titleISPRS 2022
Country/TerritoryFrance
CityNice
Period6/06/2211/06/22
Internet address

Keywords

  • ITC-GOLD

Fingerprint

Dive into the research topics of 'Effect of label noise in semantic segmentation of high resolution aerial images and height data'. Together they form a unique fingerprint.

Cite this