28 March 2022 Deep learning-based stereo matching using the feature spatial pyramid pooling
Xiaofeng Wang, Feilong Huang, Jun Yu, Hao Qing
Author Affiliations +
Abstract

For deep learning-based stereo matching, despite deep convolution networks possessing rich, high-level semantic features that are usually abstract and low-resolution, it is difficult to accurately calculate per-pixel correspondence without image detail information in challenging regions, such as thin objects, edge contours, reflective surfaces, etc. Motivated by the information propagation capability of the feature pyramid network (FPN), we focus on using FPN to improve the detailed comprehension of spatial pyramid pooling (SPP). We propose a feature SPP (FSPP), which consists of FPN and SPP. FSPP integrates high-frequency details reserved by FPN into multiscale features extracted by SPP to form a feature volume considering both detailed and contextual information. Using FSPP, features become distinct and alleviate the ambiguity of matching progress in challenging regions. Furthermore, we concatenate FSPP to Pyramid Stereo Matching Network with three-dimensional convolution and hourglass architecture. We also evaluate its effectiveness on the KITTI 2012/2015 and the Middlebury 2014/2021 datasets. The results show that the proposed algorithm performs better than current state-of-the-art algorithms in challenging regions while taking on better generalization.

© 2022 SPIE and IS&T 1017-9909/2022/$28.00 © 2022 SPIE and IS&T
Xiaofeng Wang, Feilong Huang, Jun Yu, and Hao Qing "Deep learning-based stereo matching using the feature spatial pyramid pooling," Journal of Electronic Imaging 31(2), 023018 (28 March 2022). https://doi.org/10.1117/1.JEI.31.2.023018
Received: 27 September 2021; Accepted: 4 March 2022; Published: 28 March 2022
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Convolution

Feature extraction

Network on a chip

Data modeling

Performance modeling

3D modeling

Network architectures

Back to Top