XAI for small-data problems in remote sensing: monitoring Atlantic forests with UAVs

Pranav Chandramouli, Caroline M. Gevaert, Francesco Nattino, Ou Ku, Alexandra Aguiar Pedro, Patricia do Prado Oliveira, Eduardo Hortal Pereira Barreto, Felipe de Ovileira

Research output: Contribution to conferenceAbstractAcademic

36 Downloads (Pure)

Abstract

Despite the increased availability of UAV / drone imagery in Low- to upper Middle-Income countries and the demonstrated potential of deep learning to support the interpretation of these images for sustainable development purposes, practical operations in these countries are constrained by the need for sufficient labeled data-sets which are often difficult to obtain (especially for tropical forest). This makes it difficult to train suitable networks and assess whether the model is performing well. One such example is the use of drones to monitor the Atlantic Forest in Sao Paulo, Brazil. Here, members of the Sao Paulo Municipal Green and Environment Secretariat (Secretaria do Verde e do Meio Ambiente - SVMA) are starting to use drones to identify some native and invasive species in their forests. Deep learning will quickly speed up this process, but there is little training data available. This refers to the so called ‘small-data problem’ commonly found in DL for remote sensing applications [1]. A workflow was designed to support this application through a novel zero-shot learning technique and explainable AI methods. A pre-trained tree-crown detection model ‘DeepForest’ [2] is used to identify individual tree crowns in the UAV imagery. The detected tree-crowns are further classified using a Siamese network architecture using zero-shot learning – the model is trained on relevant data-sets but not exposed to species found in the test data-set. A Siamese network architecture is motivated by the need for explainability in DL models – the results will be used for making administrative decision for forest management. A more intricate DL model (such as image segmentation) could be more accurate but at the cost of transparency/explainability. In particular, we apply a variation of the ‘What I Know’ (WIK) explainability method [3] which provides examples from the training set along with the test sample increasing transparency and understanding of the model results.
Original languageEnglish
DOIs
Publication statusPublished - 8 Mar 2024
EventEGU General Assembly 2024 - Vienna, Austria
Duration: 14 Apr 202419 Apr 2024
https://www.egu24.eu/

Conference

ConferenceEGU General Assembly 2024
Country/TerritoryAustria
CityVienna
Period14/04/2419/04/24
Internet address

Fingerprint

Dive into the research topics of 'XAI for small-data problems in remote sensing: monitoring Atlantic forests with UAVs'. Together they form a unique fingerprint.

Cite this