Novel algorithm development for event-based sensing deployment

C. Bjorn Kjellstrand; Lilian K. Casias; Kaylin Hagopian; Christian Pattyn; Christopher Saltonstall; Joshua Shank

doi:10.1117/12.3013043

7 June 2024 Novel algorithm development for event-based sensing deployment

C. Bjorn Kjellstrand, Lilian K. Casias, Kaylin Hagopian, Christian Pattyn, Christopher Saltonstall, Joshua Shank

Proceedings Volume 13040, Pattern Recognition and Prediction XXXV; 1304003 (2024) https://doi.org/10.1117/12.3013043
Event: SPIE Defense + Commercial Sensing, 2024, National Harbor, Maryland, United States

Abstract

Event-based sensors (EBS) consist of a pixelated focal plane array in which each pixel is an independent asynchronous change detector. The analog asynchronous array is read by a synchronous digital readout and written to disk. As a result, EBS pixels consume minimal power and bandwidth unless the scene changes. Furthermore, the change detectors have a very large dynamic range (~120 dB) and rapid response time (~20 us). A framing camera with comparable speed requires ~3 orders of magnitude more power and ~2 orders of magnitude higher bandwidth. These features make EBS an appealing technology for proliferation detection applications. Remote sensing deployed in the field requires low power, low bandwidth, and low complexity algorithms. EBS inherently allows for low power and low bandwidth, but a drawback of event-based sensors is the lack of mature image analysis algorithms. While analysis of conventional imagers draws from decades of image processing algorithms, EBS data is a fundamentally different format; a series of x, y, asynchronous time, and polarization change (increase/decrease) as opposed to x, y, and intensity at a regularly sampled framerate. To leverage the advantages of EBS over conventional imagers, our team has worked to develop and refine image processing algorithms that use EBS data directly. We will discuss these efforts, including frequency and phase detection. We will also discuss the field applications of these algorithms such as degraded visual environments (e.g., fog) and defeating laser dazzling attempts.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

C. Bjorn Kjellstrand, Lilian K. Casias, Kaylin Hagopian, Christian Pattyn, Christopher Saltonstall, and Joshua Shank "Novel algorithm development for event-based sensing deployment", Proc. SPIE 13040, Pattern Recognition and Prediction XXXV, 1304003 (7 June 2024); https://doi.org/10.1117/12.3013043

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available