Sequentially trained, shallow neural networks for real-time 3D odometry

Frank Rodriguez; Baurzhan Muminov; Luat T. Vuong

doi:10.1117/12.3005250

17 October 2023 Sequentially trained, shallow neural networks for real-time 3D odometry

Frank Rodriguez, Baurzhan Muminov, Luat T. Vuong

Proceedings Volume 12742, Artificial Intelligence for Security and Defence Applications; 127420X (2023) https://doi.org/10.1117/12.3005250
Event: SPIE Security + Defence, 2023, Amsterdam, Netherlands

Abstract

Fourier-domain correlation approaches have been successful in a variety of image comparison approaches but fail when the scenes, patterns, or objects in the images are distorted. Here, we utilize the sequential training of shallow neural networks on Fourier-preprocessed video to infer 3-D movement. The bio-inspired pipeline learns x, y, and z-direction movement from high-frame-rate, low-resolution, Fourier-domain preprocessed inputs (either cross power spectra or phase correlation data). Our pipeline leverages the high sensitivity of Fourier methods in a manner that is resilient to the parallax distortion of a forward-facing camera. Via sequential training over several path trajectories, models generalize to predict the 3-D movement in unseen trajectory environments. Models with no hidden layer are less accurate initially but converge faster with sequential training over different flightpaths. Our results show important considerations and trade-offs between input data preprocessing (compression) and model complexity (convergence).

Citation Download Citation

Frank Rodriguez, Baurzhan Muminov, and Luat T. Vuong "Sequentially trained, shallow neural networks for real-time 3D odometry", Proc. SPIE 12742, Artificial Intelligence for Security and Defence Applications, 127420X (17 October 2023); https://doi.org/10.1117/12.3005250

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

Fourier transforms

3D modeling

Data modeling

Video

3D image processing

Gyroscopes

Show All Keywords

Keywords/Phrases

Search In:

Publication Years