A 3D character animation engine for multimodal interaction on mobile devices

Enrico Sandali; Fabio Lavagetto; Paolo Pisano

doi:10.1117/12.596705

14 March 2005 A 3D character animation engine for multimodal interaction on mobile devices

Enrico Sandali, Fabio Lavagetto, Paolo Pisano

Proceedings Volume 5684, Multimedia on Mobile Devices; (2005) https://doi.org/10.1117/12.596705
Event: Electronic Imaging 2005, 2005, San Jose, California, United States

Abstract

Talking virtual characters are graphical simulations of real or imaginary persons that enable natural and pleasant multimodal interaction with the user, by means of voice, eye gaze, facial expression and gestures. This paper presents an implementation of a 3D virtual character animation and rendering engine, compliant with the MPEG-4 standard, running on Symbian-based SmartPhones. Real-time animation of virtual characters on mobile devices represents a challenging task, since many limitations must be taken into account with respect to processing power, graphics capabilities, disk space and execution memory size. The proposed optimization techniques allow to overcome these issues, guaranteeing a smooth and synchronous animation of facial expressions and lip movements on mobile phones such as Sony-Ericsson's P800 and Nokia's 6600. The animation engine is specifically targeted to the development of new "Over The Air" services, based on embodied conversational agents, with applications in entertainment (interactive story tellers), navigation aid (virtual guides to web sites and mobile services), news casting (virtual newscasters) and education (interactive virtual teachers).

Citation Download Citation

Enrico Sandali, Fabio Lavagetto, and Paolo Pisano "A 3D character animation engine for multimodal interaction on mobile devices", Proc. SPIE 5684, Multimedia on Mobile Devices, (14 March 2005); https://doi.org/10.1117/12.596705

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available