TY - JOUR
T1 - Spatio-temporal deep learning for automatic detection of intracranial vessel perforation in digital subtraction angiography during endovascular thrombectomy
AU - Su, Ruisheng
AU - van der Sluijs, Matthijs
AU - Cornelissen, Sandra A.P.
AU - Lycklama, Geert
AU - Hofmeijer, Jeannette
AU - Majoie, Charles B.L.M.
AU - van Doormaal, Pieter Jan
AU - van Es, Adriaan C.G.M.
AU - Ruijters, Danny
AU - Niessen, Wiro J.
AU - van der Lugt, Aad
AU - van Walsum, Theo
N1 - Funding Information:
The authors would like to thank the MR CLEAN Registry investigators, MR CLEAN NoIV investigators, and the HERMES collaboration investigators (including MR CLEAN, ESCAPE, REVASCAT, SWIFT PRIME, THRACE, EXTEND-IA, and PISTE randomized controlled trials) for sharing the DSA image data. The MR CLEAN Registry was funded and carried out by the Erasmus University Medical Centre, Amsterdam UMC location AMC, and Maastricht University Medical Centre. The study was additionally funded by the Applied Scientific Institute for Neuromodulation (Toegepast Wetenschappelijk Instituut voor Neuromodulatie). MR CLEAN NoIV study was performed in the framework of the CONTRAST consortium which acknowledges the support from the Netherlands Cardiovascular Research Initiative, an initiative of the Dutch Heart Foundation (CVON2015-01: CONTRAST), and from the Brain Foundation Netherlands (HA2015.01.06). The collaboration project is additionally financed by the Ministry of Economic Affairs by means of the PPP Allowance made available by the Top Sector Life Sciences & Health to stimulate public-private partnerships (LSHM17016). This work was funded in part through unrestricted funding by Stryker, Medtronic and Cerenovus.
Funding Information:
The current work on perforation detection was supported by Health-Holland (TKI Life Sciences and Health) through the Q-Maestro project under Grant EMCLSH19006 and Philips Healthcare (Best, The Netherlands).
Funding Information:
The authors would like to thank the MR CLEAN Registry investigators, MR CLEAN NoIV investigators, and the HERMES collaboration investigators (including MR CLEAN, ESCAPE, REVASCAT, SWIFT PRIME, THRACE, EXTEND-IA, and PISTE randomized controlled trials) for sharing the DSA image data. The MR CLEAN Registry was funded and carried out by the Erasmus University Medical Centre, Amsterdam UMC location AMC, and Maastricht University Medical Centre. The study was additionally funded by the Applied Scientific Institute for Neuromodulation (Toegepast Wetenschappelijk Instituut voor Neuromodulatie). MR CLEAN NoIV study was performed in the framework of the CONTRAST consortium which acknowledges the support from the Netherlands Cardiovascular Research Initiative, an initiative of the Dutch Heart Foundation (CVON2015-01: CONTRAST), and from the Brain Foundation Netherlands (HA2015.01.06). The collaboration project is additionally financed by the Ministry of Economic Affairs by means of the PPP Allowance made available by the Top Sector Life Sciences & Health to stimulate public-private partnerships (LSHM17016). This work was funded in part through unrestricted funding by Stryker, Medtronic and Cerenovus. The current work on perforation detection was supported by Health-Holland (TKI Life Sciences and Health) through the Q-Maestro project under Grant EMCLSH19006 and Philips Healthcare (Best, The Netherlands).
Publisher Copyright:
© 2022 The Author(s)
PY - 2022/4
Y1 - 2022/4
N2 - Intracranial vessel perforation is a peri-procedural complication during endovascular therapy (EVT). Prompt recognition is important as its occurrence is strongly associated with unfavorable treatment outcomes. However, perforations can be hard to detect because they are rare, can be subtle, and the interventionalist is working under time pressure and focused on treatment of vessel occlusions. Automatic detection holds potential to improve rapid identification of intracranial vessel perforation. In this work, we present the first study on automated perforation detection and localization on X-ray digital subtraction angiography (DSA) image series. We adapt several state-of-the-art single-frame detectors and further propose temporal modules to learn the progressive dynamics of contrast extravasation. Application-tailored loss function and post-processing techniques are designed. We train and validate various automated methods using two national multi-center datasets (i.e., MR CLEAN Registry and MR CLEAN-NoIV Trial), and one international multi-trial dataset (i.e., the HERMES collaboration). With ten-fold cross-validation, the proposed methods achieve an area under the curve (AUC) of the receiver operating characteristic of 0.93 in terms of series level perforation classification. Perforation localization precision and recall reach 0.83 and 0.70 respectively. Furthermore, we demonstrate that the proposed automatic solutions perform at similar level as an expert radiologist.
AB - Intracranial vessel perforation is a peri-procedural complication during endovascular therapy (EVT). Prompt recognition is important as its occurrence is strongly associated with unfavorable treatment outcomes. However, perforations can be hard to detect because they are rare, can be subtle, and the interventionalist is working under time pressure and focused on treatment of vessel occlusions. Automatic detection holds potential to improve rapid identification of intracranial vessel perforation. In this work, we present the first study on automated perforation detection and localization on X-ray digital subtraction angiography (DSA) image series. We adapt several state-of-the-art single-frame detectors and further propose temporal modules to learn the progressive dynamics of contrast extravasation. Application-tailored loss function and post-processing techniques are designed. We train and validate various automated methods using two national multi-center datasets (i.e., MR CLEAN Registry and MR CLEAN-NoIV Trial), and one international multi-trial dataset (i.e., the HERMES collaboration). With ten-fold cross-validation, the proposed methods achieve an area under the curve (AUC) of the receiver operating characteristic of 0.93 in terms of series level perforation classification. Perforation localization precision and recall reach 0.83 and 0.70 respectively. Furthermore, we demonstrate that the proposed automatic solutions perform at similar level as an expert radiologist.
KW - Decision making
KW - Endovascular procedures
KW - Object detection
KW - Stroke
KW - Treatment outcome
KW - Vascular system injuries
KW - X-Rays
UR - http://www.scopus.com/inward/record.url?scp=85123936125&partnerID=8YFLogxK
U2 - 10.1016/j.media.2022.102377
DO - 10.1016/j.media.2022.102377
M3 - Article
C2 - 35124369
AN - SCOPUS:85123936125
VL - 77
JO - Medical image analysis
JF - Medical image analysis
SN - 1361-8415
M1 - 102377
ER -