Evaluation of unsupervised optical flow methods for deep learning in real world datasets

Diego Marez; Josh Harguess

doi:10.1117/12.2519228

13 May 2019 Evaluation of unsupervised optical flow methods for deep learning in real world datasets

Diego Marez, Josh Harguess

Proceedings Volume 10992, Geospatial Informatics IX; 109920N (2019) https://doi.org/10.1117/12.2519228
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

The creation of large labeled datasets for optical ow is often infeasible due to the difficulty associated with measuring dynamic objects in real scenes. Current datasets from real world scenes are often sparse in terms of ground truth. Generating synthetic datasets where ground truth can be easily obtained tends to be the easiest way to acquire the large labeled datasets required to achieve good performance. Often, the switch from synthetic to real world imagery leads to a drop-in performance. Recently with the development of differentiable image warping layers, unsupervised methods, which require no ground truth optical ow, can be applied to train a deep neural network (DNN) model for optical ow tasks, and this allows for training with un-labeled video. Brightness constancy assumption is the underlying principle that enables unsupervised learning of optical ow. Violations of the brightness constancy assumption of optical ow in particular at occlusions results in large outlier errors which are harmful to the learning process. The use of robust regression loss function and outlier prediction methods attempt to alleviate the problem of outliers. In this paper, we will conduct experiments to compare performance various unsupervised optical ow methods by exploring the performance of different robust cost functions, and outlier methods.

Citation Download Citation

Diego Marez and Josh Harguess "Evaluation of unsupervised optical flow methods for deep learning in real world datasets", Proc. SPIE 10992, Geospatial Informatics IX, 109920N (13 May 2019); https://doi.org/10.1117/12.2519228

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available