Abstract
Training effective models for segmentation or classification of microscopy images is a hard task, complicated by the scarcity of adequately labeled data sets. In this context, self-supervised learning strategies can be deployed to learn suitable image representations from the available large quantity of unlabeled data, e.g. the 500k electron microscopy images that compose the CEM500k data sets. In this work, we investigate a self-supervised strategy for representation learning based on a colorization pre-text task on microscopy images. We integrate the colorization task into the BYOL (Bootstrap your own latent) self-supervised contrastive pre-training strategy. We train the self-supervised architecture on the CEM500k data set of electron microscopy images. As backbone of the BYOL framework, we investigate the use of Resnet50 and a Stand-alone Self-Attention network, and subsequently test them as feature extractors for downstream classification and segmentation tasks. The Self-Attention encoders pre-trained with the colorization-based BYOL method are able to learn effective features for segmentation of microscopy images, achieving higher results than those of encoders, both Resnet- and Self-Attention-based, trained with the original BYOL. This shows the effectiveness of colorization as pre-text for a downstream segmentation task on microscopy images. We release the code at https://github.com/nis-research/selfsup-byol-colorization.
Original language | English |
---|---|
Title of host publication | Image Analysis and Processing – ICIAP 2022 |
Subtitle of host publication | 21st International Conference, Lecce, Italy, May 23-27, 2022. Proceedings, Part II |
Editors | Stan Sclaroff, Cosimo Distante, Marco Leo, Giovanni M. Farinella, Federico Tombari |
Place of Publication | Cham, Switzerland |
Publisher | Springer |
Pages | 621-632 |
Number of pages | 12 |
ISBN (Electronic) | 978-3-031-06430-2 |
ISBN (Print) | 978-3-031-06429-6 |
DOIs | |
Publication status | Published - 17 May 2022 |
Event | 21st International Conference on Image Analysis and Processing, ICIAP 2022 - Lecce, Italy Duration: 23 May 2022 → 27 May 2022 Conference number: 21 |
Publication series
Name | Lecture Notes in Computer Science |
---|---|
Volume | 13232 |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Conference
Conference | 21st International Conference on Image Analysis and Processing, ICIAP 2022 |
---|---|
Abbreviated title | ICIAP 2022 |
Country/Territory | Italy |
City | Lecce |
Period | 23/05/22 → 27/05/22 |
Keywords
- BYOL
- Colorization
- Microscopy images
- Pre-training
- Self-supervised learning
- 22/3 OA procedure