Non-native speech recognition using audio style transfer

Kacper Radzikowski; Mateusz Forc; Le Wang; Osamu Yoshie; Robert M. Nowak

doi:10.1117/12.2536535

6 November 2019 Non-native speech recognition using audio style transfer

Kacper Radzikowski, Mateusz Forc, Le Wang, Osamu Yoshie, Robert M. Nowak

Proceedings Volume 11176, Photonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments 2019; 111762J (2019) https://doi.org/10.1117/12.2536535
Event: Photonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments 2019, 2019, Wilga, Poland

Abstract

Recently automatic speech recognition (ASR) systems achieve higher and higher accuracy rates. However, the score drops significantly, when the ASR system is being used with a non-native speaker of the language to be recognized, mainly because of specific pronunciation and accent features. A limited volume of labeled datasets containing samples of a non-native speech makes it difficult to train any new ASR systems targeted for non-native speakers. In our research, we tried tackling the problem of a non-native accent and its influence on the accuracy of ASR systems, using the style transfer methodology. We designed a pipeline for modifying the speech produced by a nonnative speaker, so that it resembles the native speech to a higher extent, i.e. a method for accent neutralization. Our methodology can be used as a wrapper for any existing ASR system, which reduces the necessity of training new speech recognizers, adapted for non-native speech. The modification can be thus performed on the fly, before passing the data forward to the speech recognition system itself.

Citation Download Citation

Kacper Radzikowski, Mateusz Forc, Le Wang, Osamu Yoshie, and Robert M. Nowak "Non-native speech recognition using audio style transfer", Proc. SPIE 11176, Photonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments 2019, 111762J (6 November 2019); https://doi.org/10.1117/12.2536535

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available