Deep hierarchical multiscale attention networks for image super-resolution

Xinxin Meng; Kai Wang; Shu Cao; Wenzhong Yang

doi:10.1117/12.3029717

21 June 2024 Deep hierarchical multiscale attention networks for image super-resolution

Xinxin Meng, Kai Wang, Shu Cao, Wenzhong Yang

Proceedings Volume 13167, International Conference on Remote Sensing, Mapping, and Image Processing (RSMIP 2024); 131672L (2024) https://doi.org/10.1117/12.3029717
Event: International Conference on Remote Sensing, Mapping and Image Processing (RSMIP 2024), 2024, Xiamen, China

Abstract

With the rapid development of deep learning, the task of image super-resolution has made significant progress. However, as model depth increases, training becomes more difficult and fails to capture coarse-grained and fine-grained information simultaneously. To solve these issues, we propose Deep Hierarchical Multiscale Attention Networks (DHMA). First, we use a residual nested residual structure to improve the propagation of gradient information to address the challenge of training deep networks, which consists of multiple residual groups, each composed of multiple residual blocks. In addition, we propose a Hierarchical Multiscale Attention (HMA) module to capture both coarse-grained and fine-grained features in deep networks. This method imitates how humans observe things, first focusing on salient objects and then observing details. Specifically, we first segment the feature map horizontally into several parts and then perform Global Aware Attention (GAA) learning on each part. Where GAA can learn global structural information. Next, we use the Adaptive Feature Fusion (AFF) module to fuse the learned information of each part into the current layer's features. Finally, we stack the features of each layer to construct a hierarchical multiscale structure and obtain features of different scales. HMA is a lightweight plug-and-play module that can be applied to existing models. Extensive experiments demonstrate the effectiveness and outstanding performance of the DHMA.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Xinxin Meng, Kai Wang, Shu Cao, and Wenzhong Yang "Deep hierarchical multiscale attention networks for image super-resolution", Proc. SPIE 13167, International Conference on Remote Sensing, Mapping, and Image Processing (RSMIP 2024), 131672L (21 June 2024); https://doi.org/10.1117/12.3029717

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Super resolution

Performance modeling

Feature fusion

Gallium arsenide

Education and training

Image fusion

Image quality

Show All Keywords

Keywords/Phrases

Search In:

Publication Years