Bidirectional multi-scale attention networks for semantic segmentation of oblique UAV imagery

Y. Lyu*, G. Vosselman, Gui Song Xia, M. Y. Yang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review

1 Downloads (Pure)

Abstract

Semantic segmentation for aerial platforms has been one of the fundamental scene understanding task for the earth observation. Most of the semantic segmentation research focused on scenes captured in nadir view, in which objects have relatively smaller scale variation compared with scenes captured in oblique view. The huge scale variation of objects in oblique images limits the performance of deep neural networks (DNN) that process images in a single scale fashion. In order to tackle the scale variation issue, in this paper, we propose the novel bidirectional multi-scale attention networks, which fuse features from multiple scales bidirectionally for more adaptive and effective feature extraction. The experiments are conducted on the UAVid2020 dataset and have shown the effectiveness of our method. Our model achieved the state-of-the-art (SOTA) result with a mean intersection over union (mIoU) score of 70.80%.
Original languageEnglish
Title of host publicationISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Subtitle of host publicationXXIV ISPRS Congress Imaging today, foreseeing tomorrow, Commission II
EditorsN. Paparoditis, C. Mallet, F. Lafarge, M.Y. Yang, A. Yilmaz, J.D. Wegner, F. Remondino, T. Fuse, I. Toschi
PublisherInternational Society for Photogrammetry and Remote Sensing (ISPRS)
Pages75-82
Number of pages8
VolumeV-2-2021
DOIs
Publication statusPublished - 17 Jun 2021
EventXXIV ISPRS Congress 2021 - Virtual Event, Nice, France
Duration: 5 Jul 20219 Jul 2021
https://www.isprs2020-nice.com/

Publication series

NameISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
PublisherCopernicus
ISSN (Print)2194-9042

Conference

ConferenceXXIV ISPRS Congress 2021
CountryFrance
CityNice
Period5/07/219/07/21
Internet address

Fingerprint

Dive into the research topics of 'Bidirectional multi-scale attention networks for semantic segmentation of oblique UAV imagery'. Together they form a unique fingerprint.

Cite this