Please use this identifier to cite or link to this item:
Title: Video accessibility enhancement for hearing-impaired users
Authors: Hong, R.
Wang, M.
Yuan, X.-T. 
Xu, M.
Jiang, J.
Yan, S. 
Chua, T.-S. 
Keywords: Accessibility
Dynamic Captioning
Hearing impairment
Issue Date: 2011
Citation: Hong, R., Wang, M., Yuan, X.-T., Xu, M., Jiang, J., Yan, S., Chua, T.-S. (2011). Video accessibility enhancement for hearing-impaired users. ACM Transactions on Multimedia Computing, Communications and Applications 7 S (1). ScholarBank@NUS Repository.
Abstract: There are more than 66 million people suffering from hearing impairment and this disability brings them difficulty in video content understanding due to the loss of audio information. If the scripts are available, captioning technology can help them in a certain degree by synchronously illustrating the scripts during the playing of videos. However, we show that the existing captioning techniques are far from satisfactory in assisting the hearing-impaired audience to enjoy videos. In this article, we introduce a scheme to enhance video accessibility using a Dynamic Captioning approach, which explores a rich set of technologies including face detection and recognition, visual saliency analysis, text-speech alignment, etc. Different from the existing methods that are categorized as static captioning, dynamic captioning puts scripts at suitable positions to help the hearing-impaired audience better recognize the speaking characters. In addition, it progressively highlights the scripts word-by-word via aligning them with the speech signal and illustrates the variation of voice volume. In this way, the special audience can better track the scripts and perceive the moods that are conveyed by the variation of volume. We implemented the technology on 20 video clips and conducted an in-depth study with 60 real hearing-impaired users. The results demonstrated the effectiveness and usefulness of the video accessibility enhancement scheme. © 2011 ACM.
Source Title: ACM Transactions on Multimedia Computing, Communications and Applications
ISSN: 15516857
DOI: 10.1145/2037676.2037681
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.


checked on Sep 28, 2022


checked on Sep 28, 2022

Page view(s)

checked on Sep 22, 2022

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.