Voice and gesture-based 3D multimedia presentation tool

Hiromichi Fukutake; Yoshiaki Akazawa; Yoshihiro Okada

doi:10.1117/12.734783

10 September 2007 Voice and gesture-based 3D multimedia presentation tool

Hiromichi Fukutake, Yoshiaki Akazawa, Yoshihiro Okada

Proceedings Volume 6777, Multimedia Systems and Applications X; 67770V (2007) https://doi.org/10.1117/12.734783
Event: Optics East, 2007, Boston, MA, United States

Abstract

This paper proposes a 3D multimedia presentation tool that allows the user to manipulate intuitively only through the voice input and the gesture input without using a standard keyboard or a mouse device. The authors developed this system as a presentation tool to be used in a presentation room equipped a large screen like an exhibition room in a museum because, in such a presentation environment, it is better to use voice commands and the gesture pointing input rather than using a keyboard or a mouse device. This system was developed using IntelligentBox, which is a component-based 3D graphics software development system. IntelligentBox has already provided various types of 3D visible, reactive functional components called boxes, e.g., a voice input component and various multimedia handling components. IntelligentBox also provides a dynamic data linkage mechanism called slot-connection that allows the user to develop 3D graphics applications by combining already existing boxes through direct manipulations on a computer screen. Using IntelligentBox, the 3D multimedia presentation tool proposed in this paper was also developed as combined components only through direct manipulations on a computer screen. The authors have already proposed a 3D multimedia presentation tool using a stage metaphor and its voice input interface. This time, we extended the system to make it accept the user gesture input besides voice commands. This paper explains details of the proposed 3D multimedia presentation tool and especially describes its component-based voice and gesture input interfaces.

Citation Download Citation

Hiromichi Fukutake, Yoshiaki Akazawa, and Yoshihiro Okada "Voice and gesture-based 3D multimedia presentation tool", Proc. SPIE 6777, Multimedia Systems and Applications X, 67770V (10 September 2007); https://doi.org/10.1117/12.734783

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Multimedia

Cameras

Human-machine interfaces

3D applications

Video

Composites

Large screens

Show All Keywords

Keywords/Phrases

Search In:

Publication Years