Domain Adaptation for Improving End-to-end ASR Performance of Classroom Speech with Variable Recording Condition

• Item type: SIG Technical Reports(1)
• 公開日: 2023-02-21
• タイトル: Domain Adaptation for Improving End-to-end ASR Performance of Classroom Speech with Variable Recording Condition
• タイトル / 言語: en
• タイトル: Domain Adaptation for Improving End-to-end ASR Performance of Classroom Speech with Variable Recording Condition
• 言語: eng
• キーワード / 主題Scheme: Other
• キーワード / 主題: SP2:音声認識
• 資源タイプ / 資源タイプ識別子: http://purl.org/coar/resource_type/c_18gh
• 資源タイプ: technical report
• 著者所属: Graduate School of Science and Technology, Shizuoka University
• 著者所属: Faculty of Engineering, Shizuoka University
• 著者所属: Graduate School of Science and Technology, Shizuoka University
• 著者所属(英): en
• 著者所属(英): Graduate School of Science and Technology, Shizuoka University
• 著者所属(英): en
• 著者所属(英): Faculty of Engineering, Shizuoka University
• 著者所属(英): en
• 著者所属(英): Graduate School of Science and Technology, Shizuoka University
• 著者名: Raufun, Nahr; ino, Suzuki; Atsuhiko, Kai
• 著者名(英): Raufun, Nahr; ino, Suzuki; Atsuhiko, Kai
• 論文抄録 / 内容記述タイプ: Other
• 論文抄録 / 内容記述: Automatic speech recognition (ASR) of real-world speech recorded in real environment has been a challenge in the field of artificial intelligence (AI). The real environment speech can vary in terms of location, recording medium and devices and so on. In this research, we particularly take interest in recognizing data recorded in university classroom. This real-world classroom situation is simulated by re-recording a small amount of data in classroom by playing through loudspeaker and recording them using low-quality wireless microphone. Previous research on supervised training of ASR indicates the requirement of large-scale transcribed data in target environment. However, it is costly to record and transcribe such amount of data for desired environment. Therefore, we adopt DNN-based data augmentation method for end-to-end ASR model as well as self-supervised-learning (SSL) based feature extraction with implicit end-to-end model to perform ASR task for classroom data. Fine-tuning of SSL-based ASR using target domain data helps achieving 17.9% character error rate for low audibility data.
• 論文抄録(英) / 内容記述タイプ: Other
• 論文抄録(英) / 内容記述: Automatic speech recognition (ASR) of real-world speech recorded in real environment has been a challenge in the field of artificial intelligence (AI). The real environment speech can vary in terms of location, recording medium and devices and so on. In this research, we particularly take interest in recognizing data recorded in university classroom. This real-world classroom situation is simulated by re-recording a small amount of data in classroom by playing through loudspeaker and recording them using low-quality wireless microphone. Previous research on supervised training of ASR indicates the requirement of large-scale transcribed data in target environment. However, it is costly to record and transcribe such amount of data for desired environment. Therefore, we adopt DNN-based data augmentation method for end-to-end ASR model as well as self-supervised-learning (SSL) based feature extraction with implicit end-to-end model to perform ASR task for classroom data. Fine-tuning of SSL-based ASR using target domain data helps achieving 17.9% character error rate for low audibility data.
• 書誌レコードID / 収録物識別子タイプ: NCID
• 書誌レコードID / 収録物識別子: AN10442647
• 書誌情報: 研究報告音声言語情報処理（SLP）; 巻 2023-SLP-146, 号 44, p. 1-6, 発行日 2023-02-21
• ISSN / 収録物識別子タイプ: ISSN
• ISSN / 収録物識別子: 2188-8663
• Notice: SIG Technical Reports are nonrefereed and hence may later appear in any journals, conferences, symposia, etc.
• 出版者 / 言語: ja
• 出版者: 情報処理学会