Application of a multimodal model optimized by multi-head-attention mechanism in the classification of fishery resource remote sensing data files

Fengwei Zhang; Wenxin Tao

doi:10.1117/12.3004679

9 October 2023 Application of a multimodal model optimized by multi-head-attention mechanism in the classification of fishery resource remote sensing data files

Fengwei Zhang, Wenxin Tao

Author Affiliations +

Proceedings Volume 12791, Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023); 1279128 (2023) https://doi.org/10.1117/12.3004679
Event: Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023), 2023, Qingdao, SD, China

Abstract

Remote sensing data is a complex transformation process from data to information, from acquisition to application. These data come from a variety of sources and have a complex structure. It is extremely difficult for different researchers to access each other, which seriously affects the efficiency of scientific research. How to use artificial intelligence technology to manage these scattered files in a systematic multi-level classification is the key to remote sensing data management. In this paper, we propose a specially optimized file classification method based on deep learning technology, which aims to classify the random heterogeneous data generated by satellite remote sensing and expeditions in the field of fisheries expertise by means of artificial intelligence. The main contributions of this paper are threefold: (1) The binary data itself and its summary information in remote sensing data are input as different modalities for classification. (2) The BiLSTM model and the CNN model are improved for remote sensing data classification scenarios based on the multi-headed attention mechanism. (3) Feature extraction is performed based on the improved model and compared with the model of traditional classification methods.(3) The experimental results show that the improved file classification method has higher accuracy than the traditional machine learning classification methods in classifying fisheries remote sensing data files.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Fengwei Zhang and Wenxin Tao "Application of a multimodal model optimized by multi-head-attention mechanism in the classification of fishery resource remote sensing data files", Proc. SPIE 12791, Third International Conference on Advanced Algorithms and Neural Networks (AANN 2023), 1279128 (9 October 2023); https://doi.org/10.1117/12.3004679

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Data modeling

Image classification

Remote sensing

Binary data

Image processing

Data fusion

Mathematical optimization

Show All Keywords

Keywords/Phrases

Search In:

Publication Years