Active and incremental learning for semantic ALS point cloud segmentation

Yaping Lin, G. Vosselman, Yanpeng Cao*, Michael Ying Yang*

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

6 Downloads (Pure)

Abstract

Supervised training of a deep neural network for semantic segmentation of point clouds requires a large amount of labelled data. Nowadays, it is easy to acquire a huge number of points with high density in large-scale areas using current LiDAR and photogrammetric techniques. However it is extremely time-consuming to manually label point clouds for model training. In this paper, we propose an active and incremental learning strategy to iteratively query informative point cloud data for manual annotation and the model is continuously trained to adapt to the newly labelled samples in each iteration. We evaluate the data informativeness step by step and effectively and incrementally enrich the model knowledge. The data informativeness is estimated by two data dependent uncertainty metrics (point entropy and segment entropy) and one model dependent metric (mutual information). The proposed methods are tested on two datasets. The results indicate the proposed uncertainty metrics can enrich current model knowledge by selecting informative samples, such as considering points with difficult class labels and choosing target objects with various geometries in the labelled training pool. Compared to random selection, our metrics provide valuable information to significantly reduce the labelled training samples. In contrast with training from scratch, the incremental fine-tuning strategy significantly save the training time.

Original languageEnglish
Pages (from-to)73-92
Number of pages20
JournalISPRS journal of photogrammetry and remote sensing
Volume169
Early online date14 Sep 2020
DOIs
Publication statusPublished - Nov 2020

Keywords

  • Active learning
  • Deep learning
  • Incremental learning
  • Point clouds
  • Semantic segmentation
  • UT-Hybrid-D
  • ITC-HYBRID
  • ITC-ISI-JOURNAL-ARTICLE

Fingerprint Dive into the research topics of 'Active and incremental learning for semantic ALS point cloud segmentation'. Together they form a unique fingerprint.

Cite this