Please use this identifier to cite or link to this item:
Title: Shared input multimodal mobile interfaces: Interaction modality effects on menu selection in single-task and dual-task environments
Authors: Zhao, S. 
Brumby, D.P.
Chignell, M.
Salvucci, D.
Goyal, S.
Keywords: earPod
shared-input multimodal interfaces
Issue Date: Sep-2013
Citation: Zhao, S., Brumby, D.P., Chignell, M., Salvucci, D., Goyal, S. (2013-09). Shared input multimodal mobile interfaces: Interaction modality effects on menu selection in single-task and dual-task environments. Interacting with Computers 25 (5) : 386-403. ScholarBank@NUS Repository.
Abstract: Audio and visual modalities are two common output channels in the user interfaces embedded in today's mobile devices. However, these user interfaces are typically centered on the visual modality as the primary output channel, with audio output serving a secondary role. This paper argues for an increased need for shared input multimodal user interfaces for mobile devices. A shared input multimodal interface can be operated independently using a specific output modality, leaving users to choose the preferred method of interaction in different scenarios. We evaluate the value of a shared input multimodal menu system both in a single-task desktop setting and in a dynamic dual-task setting, in which the user was required to interact with the shared input multimodal menu system while driving a simulated vehicle. Results indicate that users were faster at locating a target item in the menu when visual feedback was provided in the single-task desktop setting, but in the dual-task driving setting, visual output presented a significant source of visual distraction that interfered with driving performance. In contrast, auditory output mitigated some of the risk associated with menu selection while driving. A shared input multimodal interface allows users to take advantage of multiple feedback modalities properly, providing a better overall experience. © 2013 The Author.
Source Title: Interacting with Computers
ISSN: 09535438
DOI: 10.1093/iwc/iws021
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.


checked on Nov 18, 2018


checked on Oct 17, 2018

Page view(s)

checked on Sep 21, 2018

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.