Image quality evaluation method based on multiple path fusion guided by reference images

Ziyao Xu; Tingting Kou; Xinli Zhu; Wenqing Yin

doi:10.1117/12.3048385

3 October 2024 Image quality evaluation method based on multiple path fusion guided by reference images

Ziyao Xu, Tingting Kou, Xinli Zhu, Wenqing Yin

Proceedings Volume 13272, Fifth International Conference on Computer Vision and Data Mining (ICCVDM 2024); 132720W (2024) https://doi.org/10.1117/12.3048385
Event: 5th International Conference on Computer Vision and Data Mining (ICCVDM 2024), 2024, Changchun, China

Abstract

Aiming at the problem that the existing image quality evaluation indexes are sometimes inconsistent with the visual perception of the human eye, this paper proposes an image quality evaluation method based on a reference image-guided multiple path fusion network. Firstly, the fused image (the image to be evaluated) and the reference image are inputted into two network branches respectively, and each network branch contains a Transformer module (VIT-Block), a Convolution module (CNN-Block) and a Center Difference Convolution module (CDC-Block), which are used for extracting the remote information, retaining the background information, and extracting the texture features, and the reference image is used as the output of each module of the fused image branch, and the reference image is used as the output of each module of the fused image branch. The output of each module of the branch is used as the weight of the output feature maps of each module of the fused image branch, and the weighting process is carried out to obtain three groups of feature maps, and then the dimensionality reduction process is carried out by using two 1×1 convolutional layers respectively to obtain three significant feature maps, and then the global average pooling is carried out respectively to obtain three evaluation scores, and finally, the average of the three scores is taken as the final objective evaluation index value of the fused image. The experimental results show that the results obtained by the image evaluation method proposed in this paper are consistent with the subjective visual perception.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Ziyao Xu, Tingting Kou, Xinli Zhu, and Wenqing Yin "Image quality evaluation method based on multiple path fusion guided by reference images", Proc. SPIE 13272, Fifth International Conference on Computer Vision and Data Mining (ICCVDM 2024), 132720W (3 October 2024); https://doi.org/10.1117/12.3048385

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image quality

Image fusion

Image analysis

Transformers

Ablation

Convolution

Education and training

Show All Keywords

Keywords/Phrases

Search In:

Publication Years