A hybrid GCN-LSTM model for driver drowsiness detection

Zhendong Gao; Peibo Duan; Renjie Li; Zhenbo Tong

doi:10.1117/12.3012479

21 December 2023 A hybrid GCN-LSTM model for driver drowsiness detection

Zhendong Gao, Peibo Duan, Renjie Li, Zhenbo Tong

Proceedings Volume 12970, Fourth International Conference on Signal Processing and Computer Science (SPCS 2023); 1297003 (2023) https://doi.org/10.1117/12.3012479
Event: Fourth International Conference on Signal Processing and Computer Science (SPCS 2023), 2023, Guilin, China

Abstract

Driver drowsiness detection is essential in the field of intelligent driving and should be solved timely. Although the application of convolutional neural networks has brought about great progress in this field, they do not perform well in complex driving scenarios due to their inability to extract comprehensive spatio-temporal information well. In this paper, a Hybrid model using Graph networks and Long short-term memory networks for Drowsiness Detection (HGLDD) is proposed for the first time to fuse the driver’s facial depth information and head posture information together with eye and mouth information from facial landmark sequence. The model extracts spatio-temporal depth features and determines whether or not the driver is in a drowsy state. On the Nthu-DDD dataset, the proposed model ultimately achieves an average accuracy of 98.01%, demonstrating its applicability to drowsiness detection tasks in real driving scenarios.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Zhendong Gao, Peibo Duan, Renjie Li, and Zhenbo Tong "A hybrid GCN-LSTM model for driver drowsiness detection", Proc. SPIE 12970, Fourth International Conference on Signal Processing and Computer Science (SPCS 2023), 1297003 (21 December 2023); https://doi.org/10.1117/12.3012479

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available