Bioresorbable scaffold visualization in IVOCT images using CNNs and weakly supervised localization

Nils Gessert; Sarah Latus; Youssef S. Abdelwahed; David M. Leistner; Matthias Lutz; Alexander Schlaefer

doi:10.1117/12.2511869

15 March 2019 Bioresorbable scaffold visualization in IVOCT images using CNNs and weakly supervised localization

Nils Gessert, Sarah Latus, Youssef S. Abdelwahed, David M. Leistner, Matthias Lutz, Alexander Schlaefer

Proceedings Volume 10949, Medical Imaging 2019: Image Processing; 109492C (2019) https://doi.org/10.1117/12.2511869
Event: SPIE Medical Imaging, 2019, San Diego, California, United States

Abstract

Bioresorbable scaffolds have become a popular choice for treatment of coronary heart disease, replacing traditional metal stents. Often, intravascular optical coherence tomography is used to assess potential malapposition after implantation and for follow-up examinations later on. Typically, the scaffold is manually reviewed by an expert, analyzing each of the hundreds of image slices. As this is time consuming, automatic stent detection and visualization approaches have been proposed, mostly for metal stent detection based on classic image processing. As bioresorbable scaffolds are harder to detect, recent approaches have used feature extraction and machine learning methods for automatic detection. However, these methods require detailed, pixel-level labels in each image slice and extensive feature engineering for the particular stent type which might limit the approaches’ generalization capabilities. Therefore, we propose a deep learning-based method for bioresorbable scaffold visualization using only image-level labels. A convolutional neural network is trained to predict whether an image slice contains a metal stent, a bioresorbable scaffold, or no device. Then, we derive local stent strut information by employing weakly supervised localization using saliency maps with guided backpropagation. As saliency maps are generally diffuse and noisy, we propose a novel patch-based method with image shifting which allows for high resolution stent visualization. Our convolutional neural network model achieves a classification accuracy of 99.0 % for image-level stent classification which can be used for both high quality in-slice stent visualization and 3D rendering of the stent structure.

Citation Download Citation

Nils Gessert, Sarah Latus, Youssef S. Abdelwahed, David M. Leistner, Matthias Lutz, and Alexander Schlaefer "Bioresorbable scaffold visualization in IVOCT images using CNNs and weakly supervised localization", Proc. SPIE 10949, Medical Imaging 2019: Image Processing, 109492C (15 March 2019); https://doi.org/10.1117/12.2511869

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Visualization

Image processing

Convolutional neural networks

Data modeling

Image resolution

Tissues

Visual process modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years