Vehicle tracking in UAV video using multi-spectral spatiogram models

N. E. O'Connor; P. Kehoe; C. O'Conaire; A. F. Smeaton

doi:10.1117/12.777543

17 March 2008 Vehicle tracking in UAV video using multi-spectral spatiogram models

N. E. O'Connor, P. Kehoe, C. O'Conaire, A. F. Smeaton

Proceedings Volume 6974, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2008; 69740B (2008) https://doi.org/10.1117/12.777543
Event: SPIE Defense and Security Symposium, 2008, Orlando, Florida, United States

Abstract

In this paper we present the results of applying a general purpose feature combination framework for tracking to the specific task of tracking vehicles in UAV data sets. In the fusion framework used (previously presented elsewhere1) vehicles' pixel-based features from multiple channels, specifially RGB and thermal IR, are split across separate individual spatiogram trackers. The use of spatiograms allows embedding of some spatial information into the models whilst also avoiding the exponential increase in computational load and memory requirements associated with the more commonly used histogram. This tracking framework is embedded in a complete system for detecting and tracking vehicles. The system first carries out pre-processing to ensure spatially and temporally aligned visible spectrum and IR data prior to tracking. Vehicle detection in the initial two frames is achieved by first compensating for camera motion, followed by frame differencing and post-processing (thresholding and size filtering) to identify vehicle regions. Each vehicle is then described by a bounding box and this is used to generate a set of spatiograms for each of the available data channels. The detected vehicle is then tracked using the spatiogram tracker framework. Results of experiments on a variety of UAV data sets indicate the promising performance of the overall system, even in the presence of significant illumination variation, partial and full occlusions and significant camera motion and focus change. Results are particularly encouraging given that we do not periodically re-initialise the detection phase and this points to the robustness of the tracking framework.

Citation Download Citation

N. E. O'Connor, P. Kehoe, C. O'Conaire, and A. F. Smeaton "Vehicle tracking in UAV video using multi-spectral spatiogram models", Proc. SPIE 6974, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2008, 69740B (17 March 2008); https://doi.org/10.1117/12.777543

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available