Synthetic thermal imagery for UAV-based reconnaissance by change detection

Eva Strauß; Dimitri Bulatov; Peter Stütz

doi:10.1117/12.2679985

17 October 2023 Synthetic thermal imagery for UAV-based reconnaissance by change detection

Eva Strauß, Dimitri Bulatov, Peter Stütz

Proceedings Volume 12742, Artificial Intelligence for Security and Defence Applications; 127420P (2023) https://doi.org/10.1117/12.2679985
Event: SPIE Security + Defence, 2023, Amsterdam, Netherlands

Abstract

While deep learning is well-established in image analysis with regard to the visual domain, processing thermal infrared data still mainly relies on conventional methods. Regarding particularly change detection, one may even rely on statistical approaches. The reason beyond is the limited quantity of adequate thermal imagery needed to train deep learning models and the challenging characteristics of thermal imagery itself, which, unlike RGB data, is strongly dependent on the underlying materials and the temporal evolution of environmental conditions as well as scene composition. We therefore aim at generating a new dataset of synthetic thermal imagery which is specifically designed to allow the application of deep learning methods in the area of UAV-based reconnaissance by change detection. In this paper, we present our technical approach to generate this dataset and our preliminary results. We limit the simulated changes within the dataset to two objects of interest, i.e. tanks and landmines, and both object types are rather simplified for preliminary testing. We outline the state-of-the-art methodologies of generating synthetic thermal data and verify them with respect to the requirements, which we deduced from a comprehensive literature review on both deep-learning-based change detection and thermal imagery simulation. We find that the given methods do not fully comply with the requirements on thermal training data. Therefore, two datasets are generated: thermal imagery based on standard methods and thermal imagery that meets the requirements. By comparison, our preliminary findings show significant differences in image features which potentially affect the training of deep learning models.

Conference Presentation

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Eva Strauß, Dimitri Bulatov, and Peter Stütz "Synthetic thermal imagery for UAV-based reconnaissance by change detection", Proc. SPIE 12742, Artificial Intelligence for Security and Defence Applications, 127420P (17 October 2023); https://doi.org/10.1117/12.2679985

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available