http://swrc.ontoware.org/ontology#TechnicalReport
Distilling the Class-to-class Distances Encoded in a Classifier to Accelerate DTW of its Posteriorgram
en
ポスターセッション2
The University of Tokyo
The University of Tokyo
The University of Tokyo
The University of Tokyo
Haitong Sun
Jaehyun Choi
Nobuaki Minematsu
Daisuke Saito
In media technology, comparison of a sequential data with another is a fundamental technique for many applications, and dynamic time warping is often conducted. Conventionally, two sequences of raw features were compared. These days, more abstract and sequential representations are used, which are obtained with deep neural networks. One of these representations is posteriorgram, where each frame is composed of n-dimensional class posteriors, and frame-to-frame distance is often calculated using a divergence metric such as Bhattacharyya distance. In this study, a novel method is proposed to distill the class-to-class distances encoded in any classifier used to calculate posteriors, and the distances are effectively used to accelerate posteriorgram-based DTW by approximating it as DTW between two sequences of most likely classes. Utterance comparison experiments showed that the proposed method can accelerate the distance calculation step in posteriorgram-based DTW by a factor of 30.
In media technology, comparison of a sequential data with another is a fundamental technique for many applications, and dynamic time warping is often conducted. Conventionally, two sequences of raw features were compared. These days, more abstract and sequential representations are used, which are obtained with deep neural networks. One of these representations is posteriorgram, where each frame is composed of n-dimensional class posteriors, and frame-to-frame distance is often calculated using a divergence metric such as Bhattacharyya distance. In this study, a novel method is proposed to distill the class-to-class distances encoded in any classifier used to calculate posteriors, and the distances are effectively used to accelerate posteriorgram-based DTW by approximating it as DTW between two sequences of most likely classes. Utterance comparison experiments showed that the proposed method can accelerate the distance calculation step in posteriorgram-based DTW by a factor of 30.
AN10438388
研究報告音楽情報科学（MUS）
2024-MUS-140
57
1-5
2024-06-07
2188-8752