Performance measures for summarizing confusion matrices: the AFRL COMPASE approach

Timothy D. Ross; Lori A. Westerkamp; Ronald L. Dilsavor; John C. Mossing

doi:10.1117/12.478692

1 August 2002 Performance measures for summarizing confusion matrices: the AFRL COMPASE approach

Timothy D. Ross, Lori A. Westerkamp, Ronald L. Dilsavor, John C. Mossing

Author Affiliations +

Proceedings Volume 4727, Algorithms for Synthetic Aperture Radar Imagery IX; (2002) https://doi.org/10.1117/12.478692
Event: AeroSense 2002, 2002, Orlando, FL, United States

Abstract

The AFRL COMPASE Center has developed and applied a disciplined methodology for the evaluation of recognition systems. This paper explores an element of that methodology related to the confusion matrix as a tabulation of experiment outcomes and its corresponding summary performance measures. To this end, the paper introduces terminology and the confusion matrix structure for experiment results. It provides several examples - from current Air Force programs - of summary performance measures and their relationship to the confusion matrix. Finally it considers the advantages and disadvantages of these summary performance measures and points to effective strategies for selecting such measures.

Citation Download Citation

Timothy D. Ross, Lori A. Westerkamp, Ronald L. Dilsavor, and John C. Mossing "Performance measures for summarizing confusion matrices: the AFRL COMPASE approach", Proc. SPIE 4727, Algorithms for Synthetic Aperture Radar Imagery IX, (1 August 2002); https://doi.org/10.1117/12.478692

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE