Presentation + Paper
12 September 2021 A method for behaviour recognition based on long short-term memory (LSTM) and splines
Maria Andersson
Author Affiliations +
Abstract
The paper describes a method for human behaviour recognition in surveillance applications. The method is based on the long short-term memory (LSTM), which is a form of recurrent neural network (RNN). LSTM has a memory function that can learn long-term dependencies by remembering short-term information for a long time. LSTM is therefore suitable for the events that are of interest in this paper. Except for the LSTM, the method also includes a simulation model for producing training and validation datasets. The simulation model describes a real environment with streets, buildings and squares and the motion patterns are represented with mathematical spline curves. The amount of training data are expanded further by creating different small variations of the spline curves. Output from the simulation model are matrices consisting of position, velocity and acceleration for a selected simulation time and sampling frequency. Before the data are used as input data to the LSTM a scaling is done so that the data patterns representing position, velocity and acceleration can contribute fully with useful information to the training process. The paper presents and discusses the method as well as results in the form of recognition accuracy of some simulated surveillance scenarios.
Conference Presentation
© (2021) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Maria Andersson "A method for behaviour recognition based on long short-term memory (LSTM) and splines", Proc. SPIE 11869, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies V, 118690H (12 September 2021); https://doi.org/10.1117/12.2599759
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Sensors

Unmanned aerial vehicles

Back to Top