Please use this identifier to cite or link to this item: https://doi.org/10.1145/1873951.1874013
DC FieldValue
dc.titleDynamic captioning: Video accessibility enhancement for hearing impairment
dc.contributor.authorHong, R.
dc.contributor.authorWang, M.
dc.contributor.authorXu, M.
dc.contributor.authorYan, S.
dc.contributor.authorChua, T.-S.
dc.date.accessioned2013-07-23T09:29:27Z
dc.date.available2013-07-23T09:29:27Z
dc.date.issued2010
dc.identifier.citationHong, R.,Wang, M.,Xu, M.,Yan, S.,Chua, T.-S. (2010). Dynamic captioning: Video accessibility enhancement for hearing impairment. MM'10 - Proceedings of the ACM Multimedia 2010 International Conference : 421-430. ScholarBank@NUS Repository. <a href="https://doi.org/10.1145/1873951.1874013" target="_blank">https://doi.org/10.1145/1873951.1874013</a>
dc.identifier.isbn9781605589336
dc.identifier.urihttp://scholarbank.nus.edu.sg/handle/10635/43265
dc.description.abstractThere are more than 66 million people suffering from hearing impairment and this disability brings them di±culty in the video content understanding due to the loss of audio information. If scripts are available, captioning technology can help them in a certain degree by synchronously illustrating the scripts during the playing of videos. However, we show that the existing captioning techniques are far from satisfactory in assisting hearing impaired audience to enjoy videos. In this paper, we introduce a video accessibility enhancement scheme with a Dynamic Captioning approach, which explores a rich set of technologies including face detection and recognition, visual saliency analysis, text-speech alignment, etc. Different from the existing methods that are categorized as static captioning here, dynamic captioning puts scripts at suitable positions to help hearing impaired audience better recognize the speaking characters. In addition, it progressively highlights the scripts word-by-word via aligning them with the speech signal and illustrates the variation of voice volume. In this way, the special audience can better track the scripts and perceive the moods that are conveyed by the variation of volume. We implement the technology on 20 video clips and conduct an in-depth study with 60 real hearing impaired users, and results have demonstrated the effectiveness and usefulness of the video accessibility enhancement scheme. © 2010 ACM.
dc.description.urihttp://libproxy1.nus.edu.sg/login?url=http://dx.doi.org/10.1145/1873951.1874013
dc.sourceScopus
dc.subjectaccessibility
dc.subjectdynamic captioning
dc.subjecthearing impairment
dc.typeConference Paper
dc.contributor.departmentCOMPUTER SCIENCE
dc.contributor.departmentELECTRICAL & COMPUTER ENGINEERING
dc.description.doi10.1145/1873951.1874013
dc.description.sourcetitleMM'10 - Proceedings of the ACM Multimedia 2010 International Conference
dc.description.page421-430
dc.identifier.isiutNOT_IN_WOS
Appears in Collections:Staff Publications

Show simple item record
Files in This Item:
There are no files associated with this item.

SCOPUSTM   
Citations

58
checked on Sep 12, 2019

Page view(s)

236
checked on Sep 9, 2019

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.