Gaze-based attention to improve the classification of lung diseases

Maksim Kholiavchenko; Ilya Pershin; Bulat Maksudov; Tamerlan Mustafaev; Yixuan Yuan; Bulat Ibragimov

doi:10.1117/12.2612767

4 April 2022 Gaze-based attention to improve the classification of lung diseases

Maksim Kholiavchenko, Ilya Pershin, Bulat Maksudov, Tamerlan Mustafaev, Yixuan Yuan, Bulat Ibragimov

Proceedings Volume 12032, Medical Imaging 2022: Image Processing; 120320C (2022) https://doi.org/10.1117/12.2612767
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Abstract

Detection of lung diseases from chest X-rays has been of great interest from the research community during the last decade. Despite the existence of large annotated public databases, computer-aided diagnostic solutions still fail on challenging rare abnormality cases. In this study, we investigated the paradigm of combining the analysis of chest X-rays and physician gaze patterns during the analysis of these X-rays to improve the computerized diagnostic accuracy. Tobii Eye Tracker 4C has been mounted to a physician workstation and his eye movements were recorded during the analysis of 400 chest X-rays in two days of work. The X-rays have been sampled from CheXpert, RSNA, and SIIM-ACR public databases labeled with 14 different pathology types. The task was formulated as a binary classification problem. A ResNet34-based neural network has been trained to map the input chest X-ray with the output physician gaze map and binary pathology label. The proposed network improved the diagnostic accuracy to 0.714 of the area under receiving operator curve (AUC) from 0.681 AUC obtained for the same ResNet34 trained to generate binary pathology labels alone. The proposed study has demonstrated the potential benefits of using gaze information in computerized diagnostic solutions.

Conference Presentation

Citation Download Citation

Maksim Kholiavchenko, Ilya Pershin, Bulat Maksudov, Tamerlan Mustafaev, Yixuan Yuan, and Bulat Ibragimov "Gaze-based attention to improve the classification of lung diseases", Proc. SPIE 12032, Medical Imaging 2022: Image Processing, 120320C (4 April 2022); https://doi.org/10.1117/12.2612767

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available