Exploiting untranscribed broadcast data for improved code-switching detection
Yilmaz E. Henk van den Heuvel David van Leeuwen
Henk van den Heuvel
David van Leeuwen
Citations
Altmetric:
Alternative Title
Abstract
We have recently presented an automatic speech recognition (ASR) system operating on Frisian-Dutch code-switched speech. This type of speech requires careful handling of unexpected language switches that may occur in a single utterance. In this paper, we extend this work by using some raw broadcast data to improve multilingually trained deep neural networks (DNN) that have been trained on 11.5 hours of manually annotated bilingual speech. For this purpose, we apply the initial ASR to the untranscribed broadcast data and automatically create transcriptions based on the recognizer output using different language models for rescoring. Then, we train new acoustic models on the combined data, i.e., the manually and automatically transcribed bilingual broadcast data, and investigate the automatic transcription quality based on the recognition accuracies on a separate set of development and test data. Finally, we report code-switching detection performance elaborating on the correlation between the ASR and the code-switching detection performance.
Keywords
Bilingual ASR, Code-switching, Frisian language, Under-resourced languages
Source Title
Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
Publisher
ISCA
Series/Report No.
Collections
Rights
Date
2017-01-01
DOI
10.21437/Interspeech.2017-391
Type
Conference Paper