Anatomy-aided deep learning for medical image segmentation: A review

Lu Liu*, Jelmer M. Wolterink, Christoph Brune, Raymond N.J. Veldhuis

*Corresponding author for this work

Research output: Contribution to journalReview articleAcademicpeer-review

36 Citations (Scopus)
224 Downloads (Pure)


Deep learning (DL) has become widely used for medical image segmentation in recent years. However, despite these advances, there are still problems for which DL-based segmentation fails. Recently, some DL approaches had a breakthrough by using anatomical information which is the crucial cue for manual segmentation. In this paper, we provide a review of anatomy-aided DL for medical image segmentation which covers systematically summarized anatomical information categories and corresponding representation methods. We address known and potentially solvable challenges in anatomy-aided DL and present a categorized methodology overview on using anatomical information with DL from over 70 papers. Finally, we discuss the strengths and limitations of the current anatomy-aided DL approaches and suggest potential future work.
Original languageEnglish
Article number11TR01
JournalPhysics in medicine and biology
Issue number11
Publication statusPublished - 7 Jun 2021


  • UT-Hybrid-D


Dive into the research topics of 'Anatomy-aided deep learning for medical image segmentation: A review'. Together they form a unique fingerprint.

Cite this