Please use this identifier to cite or link to this item:
DC FieldValue
dc.titleDesign and implementation of the note-taking style haptic voice recognition for mobile devices
dc.contributor.authorMoon, S.
dc.contributor.authorSim, K.C.
dc.identifier.citationMoon, S.,Sim, K.C. (2012). Design and implementation of the note-taking style haptic voice recognition for mobile devices. ICMI'12 - Proceedings of the ACM International Conference on Multimodal Interaction : 533-538. ScholarBank@NUS Repository. <a href="" target="_blank"></a>
dc.description.abstractThis research proposes the \note-taking style" Haptic Voice Recognition (HVR) technology which incorporates speech and touch sensory inputs in a note-like form to enhance the performance of speech recognition. A note is taken from a user via two different haptic input methods - handwriting and a keyboard. A note consists of some of the key- words in the given utterance, either partially spelled or fully spelled. In order to facilitate fast input, the interface al- lows a shorthand writing system such as Gregg Shorthand. Using this haptic note sequence as an additional knowledge source, the algorithm re-ranks the n-best list generated by a speech engine. The simulation and experimental results show that the proposed HVR method improves the Word Error Rate (WER) and Keyword Error Rate (KER) performance in comparison to an Automatic Speech Recognition (ASR) system. Although it generates an inevitable increase in speech duration due to disfluency and occasional mistakes in haptic input, the compensation is shown to be less than conventional HVR methods. As such, this new note-taking style HVR interaction has the potential to be both natural and effective in increasing the recognition performance by choosing the most likely utterance among multiple hypotheses. This paper discusses the algorithm for the proposed sys- tem, the results from the simulation and the experiments, and the possible applications of this new technology such as aiding spoken document retrieval with haptic notes. Copyright 2012 ACM.
dc.subjectHaptic voice recognition
dc.subjectMulti-modal interface
dc.subjectNote- taking style
dc.subjectSpoken document retrieval
dc.typeConference Paper
dc.contributor.departmentCOMPUTER SCIENCE
dc.description.sourcetitleICMI'12 - Proceedings of the ACM International Conference on Multimodal Interaction
Appears in Collections:Staff Publications

Show simple item record
Files in This Item:
There are no files associated with this item.


checked on Feb 7, 2023

Page view(s)

checked on Feb 2, 2023

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.