Self-supervised Learning Through Colorization for Microscopy Images

Vaidehi Pandey, Christoph Brune, Nicola Strisciuglio*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

Training effective models for segmentation or classification of microscopy images is a hard task, complicated by the scarcity of adequately labeled data sets. In this context, self-supervised learning strategies can be deployed to learn suitable image representations from the available large quantity of unlabeled data, e.g. the 500k electron microscopy images that compose the CEM500k data sets. In this work, we investigate a self-supervised strategy for representation learning based on a colorization pre-text task on microscopy images. We integrate the colorization task into the BYOL (Bootstrap your own latent) self-supervised contrastive pre-training strategy. We train the self-supervised architecture on the CEM500k data set of electron microscopy images. As backbone of the BYOL framework, we investigate the use of Resnet50 and a Stand-alone Self-Attention network, and subsequently test them as feature extractors for downstream classification and segmentation tasks. The Self-Attention encoders pre-trained with the colorization-based BYOL method are able to learn effective features for segmentation of microscopy images, achieving higher results than those of encoders, both Resnet- and Self-Attention-based, trained with the original BYOL. This shows the effectiveness of colorization as pre-text for a downstream segmentation task on microscopy images. We release the code at https://github.com/nis-research/selfsup-byol-colorization.

Original languageEnglish
Title of host publicationImage Analysis and Processing – ICIAP 2022
Subtitle of host publication21st International Conference, Lecce, Italy, May 23-27, 2022. Proceedings, Part II
EditorsStan Sclaroff, Cosimo Distante, Marco Leo, Giovanni M. Farinella, Federico Tombari
Place of PublicationCham, Switzerland
PublisherSpringer
Pages621-632
Number of pages12
ISBN (Electronic) 978-3-031-06430-2
ISBN (Print)978-3-031-06429-6
DOIs
Publication statusE-pub ahead of print/First online - 17 May 2022
Event21st International Conference on Image Analysis and Processing, ICIAP 2022 - Lecce, Italy
Duration: 23 May 202227 May 2022
Conference number: 21

Publication series

NameLecture Notes in Computer Science
Volume13232
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference21st International Conference on Image Analysis and Processing, ICIAP 2022
Abbreviated titleICIAP 2022
Country/TerritoryItaly
CityLecce
Period23/05/2227/05/22

Keywords

  • BYOL
  • Colorization
  • Microscopy images
  • Pre-training
  • Self-supervised learning
  • 22/3 OA procedure

Fingerprint

Dive into the research topics of 'Self-supervised Learning Through Colorization for Microscopy Images'. Together they form a unique fingerprint.

Cite this