A novel technique for assessing the case-specific reliability of decisions made by CAD tools

Piotr A. Habas; Georgia D. Tourassi; Nevine H. Eltonsy; Adel S. Elmaghraby; Jacek M Zurada

doi:10.1117/12.595597

29 April 2005 A novel technique for assessing the case-specific reliability of decisions made by CAD tools

Piotr A. Habas, Georgia D. Tourassi, Nevine H. Eltonsy, Adel S. Elmaghraby, Jacek M Zurada

Proceedings Volume 5747, Medical Imaging 2005: Image Processing; (2005) https://doi.org/10.1117/12.595597
Event: Medical Imaging, 2005, San Diego, California, United States

Abstract

We present a novel technique that provides a case-specific confidence measure for artificial neural network (ANN) based computer-assisted diagnostic (CAD) decisions. The technique relies on the analysis of the feature space neighborhood for each query case and dynamically creates a validation set that allows estimation of a local accuracy of the decisions made by the network. Then a case-specific reliability measure is assigned to each system's response, which can be used to stratify network's predictions according to the acceptable validation error value. The study was performed using a database containing 1,337 mammographic regions of interest (ROIs) with biopsy-proven diagnosis (681 with masses, 656 with normal parenchyma). Two types of neural networks (1) a feed forward network with error back propagation (BPNN) and (2) a generalized regression neural network with RBF nodes (GRNN) were developed to detect masses based on 8 morphological features automatically extracted from each ROI. The performance of the networks was evaluated with Receiver Operating Characteristics (ROC) analysis. The study shows that as the threshold on the acceptable validation error declines, the technique rejects more CAD decisions as not reliable enough. However, the ROC performance for the reliable results steadily improves (from A_z = 0.88 to A_z = 0.98 for BPNN, from A_z = 0.86 to A_z = 0.97 for GRNN). The proposed technique provides a stratification strategy for predictions made by CAD tools and can be applied to any type of decision algorithms.

Citation Download Citation

Piotr A. Habas, Georgia D. Tourassi, Nevine H. Eltonsy, Adel S. Elmaghraby, and Jacek M Zurada "A novel technique for assessing the case-specific reliability of decisions made by CAD tools", Proc. SPIE 5747, Medical Imaging 2005: Image Processing, (29 April 2005); https://doi.org/10.1117/12.595597

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available