Please use this identifier to cite or link to this item:
Title: LyricAlly: Automatic synchronization of textual lyrics to acoustic music signals
Authors: Kan, M.-Y. 
Wang, Y. 
Iskandar, D.
Nwe, T.L.
Shenoy, A.
Keywords: Acoustic signal detection
Acoustic signal processing
Text processing
Issue Date: 2008
Citation: Kan, M.-Y., Wang, Y., Iskandar, D., Nwe, T.L., Shenoy, A. (2008). LyricAlly: Automatic synchronization of textual lyrics to acoustic music signals. IEEE Transactions on Audio, Speech and Language Processing 16 (2) : 338-349. ScholarBank@NUS Repository.
Abstract: We present LyricAlly, a prototype that automatically aligns acoustic musical signals with their corresponding textual lyrics, in a manner similar to manually-aligned karaoke. We tackle this problem based on a multimodal approach, using an appropriate pairing of audio and text processing to create the resulting prototype. LyricAlly's acoustic signal processing uses standard audio features but constrained and informed by the musical nature of the signal. The resulting detected hierarchical rhythm structure is utilized in singing voice detection and chorus detection to produce results of higher accuracy and lower computational costs than their respective baselines. Text processing is employed to approximate the length of the sung passages from the lyrics. Results show an average error of less than one bar for per-line alignment of the lyrics on a test bed of 20 songs (sampled from CD audio and carefully selected for variety). We perform a comprehensive set of system-wide and per-component tests and discuss their results. We conclude by outlining steps for further development. © 2008 IEEE.
Source Title: IEEE Transactions on Audio, Speech and Language Processing
ISSN: 15587916
DOI: 10.1109/TASL.2007.911559
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.


checked on Nov 24, 2020


checked on Nov 24, 2020

Page view(s)

checked on Nov 24, 2020

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.