Evaluation testbed for ATD performance prediction (ETAPP)

Scott K. Ralph; Ross Eaton; Magnús Snorrason; John Irvine; Steve Vanstone

doi:10.1117/12.719339

7 May 2007 Evaluation testbed for ATD performance prediction (ETAPP)

Scott K. Ralph, Ross Eaton, Magnús Snorrason, John Irvine, Steve Vanstone

Proceedings Volume 6566, Automatic Target Recognition XVII; 656611 (2007) https://doi.org/10.1117/12.719339
Event: Defense and Security Symposium, 2007, Orlando, Florida, United States

Abstract

Automatic target detection (ATD) systems process imagery to detect and locate targets in imagery in support of a variety of military missions. Accurate prediction of ATD performance would assist in system design and trade studies, collection management, and mission planning. A need exists for ATD performance prediction based exclusively on information available from the imagery and its associated metadata. We present a predictor based on image measures quantifying the intrinsic ATD difficulty on an image. The modeling effort consists of two phases: a learning phase, where image measures are computed for a set of test images, the ATD performance is measured, and a prediction model is developed; and a second phase to test and validate performance prediction. The learning phase produces a mapping, valid across various ATR algorithms, which is even applicable when no image truth is available (e.g., when evaluating denied area imagery). The testbed has plug-in capability to allow rapid evaluation of new ATR algorithms. The image measures employed in the model include: statistics derived from a constant false alarm rate (CFAR) processor, the Power Spectrum Signature, and others. We present performance predictors for two trained ATD classifiers, one constructed using using GENIE Pro^TM, a tool developed at Los Alamos National Laboratory, and the other eCognition^TM, developed by Definiens (http://www.definiens.com/products). We present analyses of the two performance predictions, and compare the underlying prediction models. The paper concludes with a discussion of future research.

Citation Download Citation

Scott K. Ralph, Ross Eaton, Magnús Snorrason, John Irvine, and Steve Vanstone "Evaluation testbed for ATD performance prediction (ETAPP)", Proc. SPIE 6566, Automatic Target Recognition XVII, 656611 (7 May 2007); https://doi.org/10.1117/12.719339

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available