Scale-aware neural network for semantic segmentation of multi-resolution remote sensing images

Libo Wang, Ce Zhang, Rui Li, Chenxi Duan, Xiaoliang Meng*, Peter M. Atkinson

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

14 Citations (Scopus)
94 Downloads (Pure)

Abstract

Assigning geospatial objects with specific categories at the pixel level is a fundamental task in remote sensing image analysis. Along with the rapid development of sensor technologies, remotely sensed images can be captured at multiple spatial resolutions (MSR) with information content manifested at different scales. Extracting information from these MSR images represents huge opportunities for enhanced feature representation and characterisation. However, MSR images suffer from two critical issues: (1) increased scale variation of geo-objects and (2) loss of detailed information at coarse spatial resolutions. To bridge these gaps, in this paper, we propose a novel scale-aware neural network (SaNet) for the semantic segmentation of MSR remotely sensed imagery. SaNet deploys a densely connected feature network (DCFFM) module to capture high-quality multi-scale context, such that the scale variation is handled properly and the quality of segmentation is increased for both large and small objects. A spatial feature recalibration (SFRM) module was further incorporated into the network to learn intact semantic content with enhanced spatial relationships, where the negative effects of information loss are removed. The combination of DCFFM and SFRM allows SaNet to learn scale-aware feature representation, which outperforms the existing multi-scale feature representation. Extensive experiments on three semantic segmentation datasets demonstrated the effectiveness of the proposed SaNet in cross-resolution segmentation.

Original languageEnglish
Article number5015
Pages (from-to)1-19
Number of pages19
JournalRemote sensing
Volume13
Issue number24
DOIs
Publication statusPublished - 10 Dec 2021

Keywords

  • Deep convolutional neural network
  • Multiple spatial resolutions
  • Remote sensing
  • Scale-aware feature representation
  • Semantic segmentation
  • ITC-ISI-JOURNAL-ARTICLE
  • ITC-GOLD

Fingerprint

Dive into the research topics of 'Scale-aware neural network for semantic segmentation of multi-resolution remote sensing images'. Together they form a unique fingerprint.

Cite this