Please use this identifier to cite or link to this item:
Title: Acoustic and Textual Data Augmentation for Improved ASR of Code-Switching Speech
Authors: Yilmaz E. 
Henk van den Heuvel
David van Leeuwen
Keywords: code-switching, bilingual ASR, under-resourced languages, Frisian language
Issue Date: 2-Sep-2018
Publisher: ISCA
Citation: Yilmaz E., Henk van den Heuvel, David van Leeuwen (2018-09-02). Acoustic and Textual Data Augmentation for Improved ASR of Code-Switching Speech. INTERSPEECH, Hyderabad, India, Sep. 2018. ScholarBank@NUS Repository.
Rights: CC0 1.0 Universal
Abstract: In this paper, we describe several techniques for improving the acoustic and language model of an automatic speech recognition (ASR) system operating on code-switching (CS) speech. We focus on the recognition of Frisian-Dutch radio broadcasts where one of the mixed languages, namely Frisian, is an under-resourced language. In previous work, we have proposed several automatic transcription strategies for CS speech to increase the amount of available training speech data. In this work, we explore how the acoustic modeling (AM) can benefit from monolingual speech data belonging to the high-resourced mixed language. For this purpose, we train state-of-the-art AMs, which were ineffective due to lack of training data, on a significantly increased amount of CS speech and monolingual Dutch speech. Moreover, we improve the language model (LM) by creating code-switching text, which is in practice almost non-existent, by (1) generating text using recurrent LMs trained on the transcriptions of the training CS speech data, (2) adding the transcriptions of the automatically transcribed CS speech data and (3) translating Dutch text extracted from the transcriptions of a large Dutch speech corpora. We report significantly improved CS ASR performance due to the increase in the acoustic and textual training data.
Source Title: INTERSPEECH, Hyderabad, India, Sep. 2018
Rights: CC0 1.0 Universal
Appears in Collections:Elements
Staff Publications

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
Interspeech2018_1.pdf122.78 kBAdobe PDF



Page view(s)

checked on Dec 4, 2020


checked on Dec 4, 2020

Google ScholarTM


This item is licensed under a Creative Commons License Creative Commons