Research and implementation of dynamic gesture recognition system based on ZYNQ

Jie Li; Qingying Liu; Zengzhen Li; Wei Chen

doi:10.1117/12.2667718

28 March 2023 Research and implementation of dynamic gesture recognition system based on ZYNQ

Jie Li, Qingying Liu, Zengzhen Li, Wei Chen

Proceedings Volume 12566, Fifth International Conference on Computer Information Science and Artificial Intelligence (CISAI 2022); 1256627 (2023) https://doi.org/10.1117/12.2667718
Event: Fifth International Conference on Computer Information Science and Artificial Intelligence (CISAI 2022), 2022, Chongqing, China

Abstract

At present, gesture has become an important channel of human-computer interaction, and gesture recognition has been widely used in various fields. In this paper, the dynamic gesture recognition technology is studied from algorithm and system implementation for portable devices which require high real-time performance. The algorithm mainly uses the region of interest extraction based on face recognition, skin color detection based on HCrCg color space and gesture motion track marking based on scanline seed filling algorithm. The system is implemented by Xilinx ZYNQ, and a SOPC system architecture based on ARM Cortex-A9 hard core and ARM Cortex-M3 soft core and FPGA is proposed. The scanline seed filling algorithm with long running time is designed as a hardware accelerator to improve the running speed. Through the test of the prototype, the recognition accuracy can reach 95.75% in a simple background and 90.83% in a complex background. The average running time of the system is only 0.68 seconds, which is more than 30% faster than using pure software method. The system has good performance in recognition accuracy and running speed.

Citation Download Citation

Jie Li, Qingying Liu, Zengzhen Li, and Wei Chen "Research and implementation of dynamic gesture recognition system based on ZYNQ", Proc. SPIE 12566, Fifth International Conference on Computer Information Science and Artificial Intelligence (CISAI 2022), 1256627 (28 March 2023); https://doi.org/10.1117/12.2667718

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Gesture recognition

Detection and tracking algorithms

Image segmentation

Image processing algorithms and systems

Skin

Field programmable gate arrays

Cameras

Show All Keywords

Keywords/Phrases

Search In:

Publication Years