RGB-T pedestrian detection method based on improved illumination-aware weight

Hao Fu; Zhiyu Zhu

doi:10.1117/12.3033557

13 June 2024 RGB-T pedestrian detection method based on improved illumination-aware weight

Hao Fu, Zhiyu Zhu

Proceedings Volume 13180, International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2024); 131802P (2024) https://doi.org/10.1117/12.3033557
Event: International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2024), 2024, Guangzhou, China

Abstract

Aiming to address the issues of low recognition accuracy, limited all-weather usability, and high missed detection rate in RGB-T multimodal pedestrian detection algorithms, this paper proposes an improved illumination-aware weight-based RGB-T pedestrian detection method. Firstly, the mid-term fusion strategy is adopted by changing the fusion point from after five layers of convolution to after the third layer of convolution. This ensures that the fused feature map contains both detailed and semantic features. Secondly, through learnable parameters, the illumination weights w_d and w_n are adjusted to more reasonably map illumination information to fusion weights, resulting in new illumination weights w_r and w_t. Finally, adjustments are made to the network structure of the semantic segmentation module by replacing two-stream semantic segmentation with fused single-stream semantic segmentation using new illumination weights w_r and w_t. The proposed method's detection ability is validated on a cleaned KAIST dataset. Experimental results demonstrate that compared to the original network model, our proposed method reduces average missed detection rate from 15.69% to 13.15% while improving mAP@0.5 by 4.1%, showcasing superior performance.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Hao Fu and Zhiyu Zhu "RGB-T pedestrian detection method based on improved illumination-aware weight", Proc. SPIE 13180, International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2024), 131802P (13 June 2024); https://doi.org/10.1117/12.3033557

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Light sources and illumination

Feature fusion

Detection and tracking algorithms

Semantics

Object detection

Infrared radiation

Visible radiation

Show All Keywords

Keywords/Phrases

Search In:

Publication Years