Please use this identifier to cite or link to this item: https://doi.org/10.1145/2037676.2037681
Title: Video accessibility enhancement for hearing-impaired users
Authors: Hong, R.
Wang, M.
Yuan, X.-T. 
Xu, M.
Jiang, J.
Yan, S. 
Chua, T.-S. 
Keywords: Accessibility
Dynamic Captioning
Hearing impairment
Issue Date: 2011
Source: Hong, R., Wang, M., Yuan, X.-T., Xu, M., Jiang, J., Yan, S., Chua, T.-S. (2011). Video accessibility enhancement for hearing-impaired users. ACM Transactions on Multimedia Computing, Communications and Applications 7 S (1). ScholarBank@NUS Repository. https://doi.org/10.1145/2037676.2037681
Abstract: There are more than 66 million people suffering from hearing impairment and this disability brings them difficulty in video content understanding due to the loss of audio information. If the scripts are available, captioning technology can help them in a certain degree by synchronously illustrating the scripts during the playing of videos. However, we show that the existing captioning techniques are far from satisfactory in assisting the hearing-impaired audience to enjoy videos. In this article, we introduce a scheme to enhance video accessibility using a Dynamic Captioning approach, which explores a rich set of technologies including face detection and recognition, visual saliency analysis, text-speech alignment, etc. Different from the existing methods that are categorized as static captioning, dynamic captioning puts scripts at suitable positions to help the hearing-impaired audience better recognize the speaking characters. In addition, it progressively highlights the scripts word-by-word via aligning them with the speech signal and illustrates the variation of voice volume. In this way, the special audience can better track the scripts and perceive the moods that are conveyed by the variation of volume. We implemented the technology on 20 video clips and conducted an in-depth study with 60 real hearing-impaired users. The results demonstrated the effectiveness and usefulness of the video accessibility enhancement scheme. © 2011 ACM.
Source Title: ACM Transactions on Multimedia Computing, Communications and Applications
URI: http://scholarbank.nus.edu.sg/handle/10635/43078
ISSN: 15516857
DOI: 10.1145/2037676.2037681
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

SCOPUSTM   
Citations

30
checked on Dec 7, 2017

WEB OF SCIENCETM
Citations

19
checked on Nov 29, 2017

Page view(s)

82
checked on Dec 11, 2017

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.