A UAV reconnaissance method based on visual saliency and multi-scale fusion

Haipeng Chen; Yanfang Liu; Yituo Song; Yujun Chen; Jiayue Chen

doi:10.1117/12.3003869

18 December 2023 A UAV reconnaissance method based on visual saliency and multi-scale fusion

Haipeng Chen, Yanfang Liu, Yituo Song, Yujun Chen, Jiayue Chen

Proceedings Volume 12968, AOPC 2023: Optic Fiber Gyro ; 129680L (2023) https://doi.org/10.1117/12.3003869
Event: Applied Optics and Photonics China 2023 (AOPC2023), 2023, Beijing, China

Abstract

In order to improve the visual reconnaissance ability of unmanned aerial vehicles (UAVs), a method combaning three cameras, namely “Wide-Field”, “Long-Focus”, and “Infrared” cameras, is proposed, in which the wide-field camera simulates the peripheral vision of the human eye, the long-focus camera simulates the human eye gaze, and the infrared camera ensures the robustness of the system in the degraded visual environment (DVE). First, the target’s location is preliminarily determined according to the visual salient information of the infrared image; then, based on the multi-scale image fusion method, the infrared/visible fusion images of the target area are obtained; finally, YOLOv5 and improved SORT algorithm are utilized to complete target detecting and tracking. To verify the effectiveness of the proposed method, the images are rendered in the Unity3D engine, and the simulation experiments of UAV reconnaissance are carried out. Results show that, the performance of image fusion algorithm proposed in this paper is close to the typical methods like ADF and VSMWLS in the sence of the evaluation indicators such as CE, AG, SD, FPS. However, the proposed method only costs about 1/5 of the calculation time.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Haipeng Chen, Yanfang Liu, Yituo Song, Yujun Chen, and Jiayue Chen "A UAV reconnaissance method based on visual saliency and multi-scale fusion", Proc. SPIE 12968, AOPC 2023: Optic Fiber Gyro , 129680L (18 December 2023); https://doi.org/10.1117/12.3003869

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image fusion

Unmanned aerial vehicles

Reconnaissance

Visualization

Cameras

Infrared radiation

Infrared imaging

Show All Keywords

Keywords/Phrases

Search In:

Publication Years