Special Section on Development, Challenges, and Opportunities of Positron Emission Tomography

Practical no-gold-standard evaluation framework for quantitative imaging methods: application to lesion segmentation in positron emission tomography

[+] Author Affiliations
Abhinav K. Jha, Esther Mena

Johns Hopkins University, Department of Radiology and Radiological Sciences, Baltimore, Maryland, United States

Brian Caffo

Johns Hopkins University, Department of Biostatistics, Baltimore, Maryland, United States

Saeed Ashrafinia, Arman Rahmim, Eric Frey

Johns Hopkins University, Department of Radiology and Radiological Sciences, Baltimore, Maryland, United States

Johns Hopkins University, Department of Electrical & Computer Engineering, Baltimore, Maryland, United States

Rathan M. Subramaniam

University of Texas Southwestern Medical Center, Department of Radiology and Advanced Imaging Research Center, Dallas, Texas, United States

J. Med. Imag. 4(1), 011011 (Mar 03, 2017). doi:10.1117/1.JMI.4.1.011011
History: Received June 1, 2016; Accepted February 9, 2017
Text Size: A A A

Abstract.  Recently, a class of no-gold-standard (NGS) techniques have been proposed to evaluate quantitative imaging methods using patient data. These techniques provide figures of merit (FoMs) quantifying the precision of the estimated quantitative value without requiring repeated measurements and without requiring a gold standard. However, applying these techniques to patient data presents several practical difficulties including assessing the underlying assumptions, accounting for patient-sampling-related uncertainty, and assessing the reliability of the estimated FoMs. To address these issues, we propose statistical tests that provide confidence in the underlying assumptions and in the reliability of the estimated FoMs. Furthermore, the NGS technique is integrated within a bootstrap-based methodology to account for patient-sampling-related uncertainty. The developed NGS framework was applied to evaluate four methods for segmenting lesions from F-Fluoro-2-deoxyglucose positron emission tomography images of patients with head-and-neck cancer on the task of precisely measuring the metabolic tumor volume. The NGS technique consistently predicted the same segmentation method as the most precise method. The proposed framework provided confidence in these results, even when gold-standard data were not available. The bootstrap-based methodology indicated improved performance of the NGS technique with larger numbers of patient studies, as was expected, and yielded consistent results as long as data from more than 80 lesions were available for the analysis.

Figures in this Article
© 2017 Society of Photo-Optical Instrumentation Engineers

Citation

Abhinav K. Jha ; Esther Mena ; Brian Caffo ; Saeed Ashrafinia ; Arman Rahmim, et al.
"Practical no-gold-standard evaluation framework for quantitative imaging methods: application to lesion segmentation in positron emission tomography", J. Med. Imag. 4(1), 011011 (Mar 03, 2017). ; http://dx.doi.org/10.1117/1.JMI.4.1.011011


Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

PubMed Articles
Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.