Uncertainty-based quality assurance of carotid artery segmentation

Elina Thibeau-Sutre*, Dieuwertje Alblas, Sophie Buurman, Christoph Brune, Jelmer Maarten Wolterink

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review


The application of deep learning models to large-scale data sets requires means for automatic quality assurance. We have previously developed a fully automatic algorithm for carotid artery wall segmentation in black-blood MRI that we aim to apply to large-scale data sets. This method identifies nested artery walls in 3D patches centered on the carotid artery.
In this study, we investigate to what extent the uncertainty in the model predictions for the contour location can serve as a surrogate for error detection and, consequently, automatic quality assurance.
We express the quality of automatic segmentations using the Dice similarity coefficient. The uncertainty in the model's prediction is estimated using either Monte Carlo dropout or test-time data augmentation.
We found that (1) including uncertainty measurements did not degrade the quality of the segmentations, (2) uncertainty metrics provide a good proxy of the quality of our contours if the center found during the first step is enclosed in the lumen of the carotid artery and (3) they could be used to detect low-quality segmentations at the participant level. This automatic quality assurance tool might enable the application of our model in large-scale data sets.
Original languageEnglish
Title of host publicationUncertainty for Safe Utilization of Machine Learning in Medical Imaging (UNSURE)
Publication statusAccepted/In press - 18 Aug 2023


Dive into the research topics of 'Uncertainty-based quality assurance of carotid artery segmentation'. Together they form a unique fingerprint.

Cite this