Research on deep learning-based instruction action recognition method for assistant duty officers

HaoNan Liu; WenZhen Kuang

doi:10.1117/12.2689527

7 September 2023 Research on deep learning-based instruction action recognition method for assistant duty officers

HaoNan Liu, WenZhen Kuang

Proceedings Volume 12790, Eighth International Conference on Electromechanical Control Technology and Transportation (ICECTT 2023); 127901P (2023) https://doi.org/10.1117/12.2689527
Event: 8th International Conference on Electromechanical Control Technology and Transportation (ICECTT 2023), 2023, Hangzhou, China

Abstract

With the vigorous development of railway industry, railway passenger transport and freight has become the most important link in today's transport industry. The operation of receiving and sending trains at the station is related to the transportation safety of the whole railway, so the action standard of the railway assistant on duty is more strict. In this paper, an improved action recognition algorithm for assistant duty officers based on dual flow convolutional neural network embedded attention mechanism is proposed. First, the TV-L1 method was used for optical flow processing of the video, and the mediapipe was used to obtain the coordinate data of human bone points. The two kinds of data were used as network input for training. Then, the trained network model is fused, and the two flow convolutional neural networks embed attention mechanisms. VGG16 network is selected for both spatial network and time network. Finally, the two models were weighted and fused by softmax function as the output result to complete the command action recognition of the assistant on duty. Experiments were carried out on the dataset UCF101, and the accuracy of the model on this dataset was 86.7%. Experimental results show that the improved network model has better recognition effect.

Citation Download Citation

HaoNan Liu and WenZhen Kuang "Research on deep learning-based instruction action recognition method for assistant duty officers", Proc. SPIE 12790, Eighth International Conference on Electromechanical Control Technology and Transportation (ICECTT 2023), 127901P (7 September 2023); https://doi.org/10.1117/12.2689527

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
5 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Video

Action recognition

Convolutional neural networks

Optical flow

Bone

Feature extraction

Video acceleration

Show All Keywords

Keywords/Phrases

Search In:

Publication Years