Adaptive key frame extraction from RGB-D for hand gesture recognition

Hanni Jiang; Xing Ma; Wenyang Li; Shaohu Ding; Chunyang Mu

doi:10.1117/12.2502953

9 August 2018 Adaptive key frame extraction from RGB-D for hand gesture recognition

Hanni Jiang, Xing Ma, Wenyang Li, Shaohu Ding, Chunyang Mu

Proceedings Volume 10806, Tenth International Conference on Digital Image Processing (ICDIP 2018); 108060K (2018) https://doi.org/10.1117/12.2502953
Event: Tenth International Conference on Digital Image Processing (ICDIP 2018), 2018, Shanghai, China

Abstract

Sign language is described by their significance primarily hand posture changes. But traditional colour-based detection methods are possible be influenced by complex background, skin tones and other parts of body. In order to overcome such problems, this article adopted the method based on RGB-D to detect the gesture area in the video. Then, the adaptively extracting key frame of sign language is adopted, according to the change of gesture area. So the problem is converted into obtaining the standard static gesture image. Then the identification results are sent to NAO robot. Well the human-robot interaction is completed. Experimental results showed that combination of colour space and depth threshold can greatly reduce the influence of complex background and skin colour region. Key frame extraction is a steady foundation for improving the rate of hand gesture recognition.

Citation Download Citation

Hanni Jiang, Xing Ma, Wenyang Li, Shaohu Ding, and Chunyang Mu "Adaptive key frame extraction from RGB-D for hand gesture recognition", Proc. SPIE 10806, Tenth International Conference on Digital Image Processing (ICDIP 2018), 108060K (9 August 2018); https://doi.org/10.1117/12.2502953

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available