Please use this identifier to cite or link to this item:
|Title:||Building class-based language models with contextual statistics||Authors:||Bai, Shuanghu
|Issue Date:||1998||Citation:||Bai, Shuanghu, Li, Haizhou, Lin, Zhiwei, Yuan, Baosheng (1998). Building class-based language models with contextual statistics. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings 1 : 173-176. ScholarBank@NUS Repository.||Abstract:||In this paper, novel clustering algorithms are proposed by using the contextual statistics of words for class-based language models. The Minimum Discriminative Information (MDI) is used as a distance measure. Three algorithms are implemented to build bigram language models for a vocabulary of 50,000 words over a corpus of over 200 million words. The computational cost of algorithms and resulting LM perplexity are studied. The comparisons between the MDI algorithm and the Maximum Mutual Information algorithm are also given to demonstrate the effectiveness and the efficiency of the new algorithms. It is shown that the MDI approaches make the tree-building clustering possible with large vocabulary.||Source Title:||ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings||URI:||http://scholarbank.nus.edu.sg/handle/10635/129092||ISSN:||07367791|
|Appears in Collections:||Staff Publications|
Show full item record
Files in This Item:
There are no files associated with this item.
checked on Dec 1, 2022
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.