A class-driven hierarchical ResNet for classification of multispectral remote sensing images

Giulio Weikmann; Gianmarco Perantoni; Lorenzo Bruzzone

doi:10.1117/12.2679293

19 October 2023 A class-driven hierarchical ResNet for classification of multispectral remote sensing images

Giulio Weikmann, Gianmarco Perantoni, Lorenzo Bruzzone

Proceedings Volume 12733, Image and Signal Processing for Remote Sensing XXIX; 127330D (2023) https://doi.org/10.1117/12.2679293
Event: SPIE Remote Sensing, 2023, Amsterdam, Netherlands

Abstract

This work presents a multitemporal class-driven hierarchical Residual Neural Network (ResNet) designed for modelling the classification of Time Series (TS) of multispectral images at different semantical class levels. The architecture consists of a modification of the ResNet where we introduce additional branches to perform the classification at the different hierarchy levels and leverage on hierarchy-penalty maps to discourage incoherent hierarchical transitions within the classification. In this way, we improve the discrimination capabilities of classes at different levels of semantic details and train a modular architecture that can be used as a backbone network for introducing new specific classes and additional tasks considering limited training samples available. We exploit the class-hierarchy labels to train efficiently the different layers of the architecture, allowing the first layers to train faster on the first levels of the hierarchy modeling general classes (i.e., the macro-classes) and the intermediate classes, while using the last ones to discriminate more specific classes (i.e., the micro-classes). In this way, the targets are constrained in following the hierarchy defined, improving the classification of classes at the most detailed level. The proposed modular network has intrinsic adaptation capability that can be obtained through fine tuning. The experimental results, obtained on two tiles of the Amazonian Forest on 12 monthly composites of Sentinel-2 images acquired during 2019, demonstrate the effectiveness of the hierarchical approach in both generalizing over different hierarchical levels and learning discriminant features for an accurate classification at the micro-class level on a new target area, with a better representation of the minoritarian classes.

Conference Presentation

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Giulio Weikmann, Gianmarco Perantoni, and Lorenzo Bruzzone "A class-driven hierarchical ResNet for classification of multispectral remote sensing images", Proc. SPIE 12733, Image and Signal Processing for Remote Sensing XXIX, 127330D (19 October 2023); https://doi.org/10.1117/12.2679293

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available