Please use this identifier to cite or link to this item: http://scholarbank.nus.edu.sg/handle/10635/41324
Title: LyricAlly: Automatic synchronization of acoustic musical signals and textual lyrics
Authors: Wang, Y. 
Kan, M.-Y. 
Nwe, T.L. 
Shenoy, A.
Yin, J. 
Keywords: Audio/text synergy
Karaoke
Lyric alignment
Music knowledge
Vocal detection
Issue Date: 2004
Source: Wang, Y.,Kan, M.-Y.,Nwe, T.L.,Shenoy, A.,Yin, J. (2004). LyricAlly: Automatic synchronization of acoustic musical signals and textual lyrics. ACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia : 212-219. ScholarBank@NUS Repository.
Abstract: We present a prototype that automatically aligns acoustic musical signals with their corresponding textual lyrics, in a manner similar to manually-aligned karaoke. We tackle this problem using a multimodal approach, where the appropriate pairing of audio and text processing helps create a more accurate system. Our audio processing technique uses a combination of top-down and bottom-up approaches, combining the strength of low-level audio features and high-level musical knowledge to determine the hierarchical rhythm structure, singing voice and chorus sections in the musical audio. Text processing is also employed to approximate the length of the sung passages using the textual lyrics. Results show an average error of less than one bar for per-line alignment of the lyrics on a test bed of 20 songs (sampled from CD audio and carefully selected for variety). We perform holistic and per-component testing and analysis and outline steps for further development.
Source Title: ACM Multimedia 2004 - proceedings of the 12th ACM International Conference on Multimedia
URI: http://scholarbank.nus.edu.sg/handle/10635/41324
ISBN: 1581138938
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

Page view(s)

70
checked on Dec 9, 2017

Google ScholarTM

Check


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.