3D story cube: An interactive tangible user interface for storytelling with 3D graphics and audio

Abstract

Appropriate segments of audio and 3D animation are played in a pre-defined sequence when the user unfolds the cube into a specific state. The state transition is invoked only when the contents of current state have been played. The state transition is of a one-way manner, thus, only the first unused story segment will be played back, allowing the story to maintain a continuous narrative progression. The narrative appears to be much more attractive and understandable by introducing 3D graphics and sound, as well as the 3D manipulation and 3D sense of touch. Our application shows that augmented reality technologies can be used to complement tangible user interfaces for a more exciting and entertaining experience.