Cross-modal knowledge distillation in deep networks for SAR image classification

Chowdhury Sadman Jahan; Andreas Savakis; Erik Blasch

doi:10.1117/12.2624257

27 May 2022 Cross-modal knowledge distillation in deep networks for SAR image classification

Chowdhury Sadman Jahan, Andreas Savakis, Erik Blasch

Proceedings Volume 12099, Geospatial Informatics XII; 1209904 (2022) https://doi.org/10.1117/12.2624257
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Abstract

We propose Cross-KD, a novel framework for knowledge distillation across modalities from Electro-Optical (EO) to Synthetic Aperture Radar (SAR). The Cross-KD approach is response-based and takes into consideration the differences in network size and feature representations in the two modalities. The proposed training includes two stages consisting of i) EO network training and ii) SAR network training with transfer learning and knowledge distillation from the EO network. Knowledge distillation (KD) is performed at the soft output level, allowing features in the EO and SAR networks to be different. The Cross-KD model is agnostic in the selection of network backbone and does not place any constraints on the network architecture, thus making knowledge transfer applicable even from a smaller network to a larger network. We test our framework on a recent EO-SAR coupled dataset with promising results on SAR image classification. Cross-KD achieves performance gains for each component of the model, as evidenced in our ablation studies resulting in 93.98% mean per class accuracy.

Conference Presentation

Citation Download Citation

Chowdhury Sadman Jahan, Andreas Savakis, and Erik Blasch "Cross-modal knowledge distillation in deep networks for SAR image classification", Proc. SPIE 12099, Geospatial Informatics XII, 1209904 (27 May 2022); https://doi.org/10.1117/12.2624257

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available