Please use this identifier to cite or link to this item:
|Title:||Video accessibility enhancement for hearing-impaired users|
|Citation:||Hong, R., Wang, M., Yuan, X.-T., Xu, M., Jiang, J., Yan, S., Chua, T.-S. (2011). Video accessibility enhancement for hearing-impaired users. ACM Transactions on Multimedia Computing, Communications and Applications 7 S (1). ScholarBank@NUS Repository. https://doi.org/10.1145/2037676.2037681|
|Abstract:||There are more than 66 million people suffering from hearing impairment and this disability brings them difficulty in video content understanding due to the loss of audio information. If the scripts are available, captioning technology can help them in a certain degree by synchronously illustrating the scripts during the playing of videos. However, we show that the existing captioning techniques are far from satisfactory in assisting the hearing-impaired audience to enjoy videos. In this article, we introduce a scheme to enhance video accessibility using a Dynamic Captioning approach, which explores a rich set of technologies including face detection and recognition, visual saliency analysis, text-speech alignment, etc. Different from the existing methods that are categorized as static captioning, dynamic captioning puts scripts at suitable positions to help the hearing-impaired audience better recognize the speaking characters. In addition, it progressively highlights the scripts word-by-word via aligning them with the speech signal and illustrates the variation of voice volume. In this way, the special audience can better track the scripts and perceive the moods that are conveyed by the variation of volume. We implemented the technology on 20 video clips and conducted an in-depth study with 60 real hearing-impaired users. The results demonstrated the effectiveness and usefulness of the video accessibility enhancement scheme. © 2011 ACM.|
|Source Title:||ACM Transactions on Multimedia Computing, Communications and Applications|
|Appears in Collections:||Staff Publications|
Show full item record
Files in This Item:
There are no files associated with this item.
checked on May 20, 2018
WEB OF SCIENCETM
checked on Apr 16, 2018
checked on Mar 11, 2018
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.