Improving perturbation-based explanation methods with application to face recognition

Yuhang Lu; Touradj Ebrahimi

doi:10.1117/12.3030872

30 September 2024 Improving perturbation-based explanation methods with application to face recognition

Yuhang Lu, Touradj Ebrahimi

Author Affiliations +

Proceedings Volume 13137, Applications of Digital Image Processing XLVII; 131370A (2024) https://doi.org/10.1117/12.3030872
Event: Optical Engineering + Applications, 2024, San Diego, California, United States

Abstract

In recent years, significant advancements in face recognition have been witnessed thanks to the rapid development of artificial intelligence. Despite remarkable performance, predictions made by such techniques tend to be challenging to explain. Considering their wide applications in security-sensitive areas, it is essential to fully understand the decision-making process of AI-based face recognition techniques and make them more acceptable to society. Many studies have been dedicated to offering visual interpretation for face recognition systems’ decisions, such as generating similarity and dissimilarity saliency maps. One of the most promising approaches is based on the perturbation mechanism, which has demonstrated exceptional performance in highlighting similar regions between two matching face images. However, this type of method has shown to be less effective in identifying the dissimilar regions, which are particularly critical in the decision-making process for two nonmatching face images. Therefore, this study focuses on the specific problem of the perturbation-based mechanism when applied to the explainable face recognition task. In particular, we first thoroughly analyze the limitation of a perturbation-based method in generating dissimilarity saliency maps. Then, a new regularization technique is proposed to alleviate this problem, followed by experiments to validate its effectiveness.

Conference Presentation

Citation Download Citation

Yuhang Lu and Touradj Ebrahimi "Improving perturbation-based explanation methods with application to face recognition", Proc. SPIE 13137, Applications of Digital Image Processing XLVII, 131370A (30 September 2024); https://doi.org/10.1117/12.3030872

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE