Implicit Neural Representations for Generative Modeling of Living Cell Shapes

David Wiesner, Julian Suk, Sven Dummer, David Svoboda, Jelmer M. Wolterink

Research output: Working paperPreprintProfessional

32 Downloads (Pure)

Abstract

Methods allowing the synthesis of realistic cell shapes could help generate training data sets to improve cell tracking and segmentation in biomedical images. Deep generative models for cell shape synthesis require a light-weight and flexible representation of the cell shape. However, commonly used voxel-based representations are unsuitable for high-resolution shape synthesis, and polygon meshes have limitations when modeling topology changes such as cell growth or mitosis. In this work, we propose to use level sets of signed distance functions (SDFs) to represent cell shapes. We optimize a neural network as an implicit neural representation of the SDF value at any point in a 3D+time domain. The model is conditioned on a latent code, thus allowing the synthesis of new and unseen shape sequences. We validate our approach quantitatively and qualitatively on C. elegans cells that grow and divide, and lung cancer cells with growing complex filopodial protrusions. Our results show that shape descriptors of synthetic cells resemble those of real cells, and that our model is able to generate topologically plausible sequences of complex cell shapes in 3D+time.
Original languageEnglish
PublisherArXiv.org
DOIs
Publication statusPublished - 13 Jul 2022

Keywords

  • cs.CV
  • cs.LG

Fingerprint

Dive into the research topics of 'Implicit Neural Representations for Generative Modeling of Living Cell Shapes'. Together they form a unique fingerprint.
  • Implicit Neural Representations for Generative Modeling of Living Cell Shapes

    Wiesner, D., Suk, J., Dummer, S., Svoboda, D. & Wolterink, J. M., 2022, Medical Image Computing and Computer Assisted Intervention – MICCAI 2022: 25th International Conference, Singapore, September 18–22, 2022, Proceedings, Part IV. Wang, L., Dou, Q., Fletcher, P. T., Speidel, S. & Li, S. (eds.). Springer, p. 58-67 10 p. (Lecture Notes in Computer Science; vol. 13434).

    Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review

    Open Access
    File
    10 Citations (Scopus)
    167 Downloads (Pure)

Cite this