2026-03-12T10:08:48Z https://ipsj.ixsq.nii.ac.jp/oai

oai:ipsj.ixsq.nii.ac.jp:00057136 2025-01-22T04:38:44Z 1164:5159:5186:5190

HMMの変分ベイズ学習によるテキスト文書の話題分割法 An HMM - based text segmentation method using variational Bayes approach 越仲, 孝文 磯, 健一 奥村, 明俊 Takafumi, Koshinaka Ken-Ichi, Iso Akitoshi, Okumura 確率モデルに基づくテキスト分割法を提案する．left-to-right型の離散HMMをテキスト生成モデルと考え，テキスト分割をHMMのパラメータ推定問題として定式化する．パラメータ推定法として，最尤推定およびベイズ推定（変分ベイズ法）を用いて，日本語ニュース番組を各ニュース項目へ分割する評価実験を行い，最尤推定に比べてペイズ推定が精度よくテキストを分割できることを示す．さらに，従来法としてHearst法を取り上げ，従来法と比べた提案法の利点や課題を明らかにする． This paper presents a new text segmentation method based on stochastic modeling. When supposing a generative model of a text document to be a discrete left-to-right hidden Markov model (HMM), a transition between topics in the text document corresponds to a state transition in the HMM, and text segmentation can be formulated as model parameter estimation using the text document. Compared to the traditional maximum likelihood approach, advantage of the Bayes approach (Variational Bayes) is shown by some experiments, which evaluate segmentation accuracy in segmenting Japanese broadcast news programs into each news article. Comparison between the proposed method and a conventional method, well-known Hearst's method, is also presented in this paper. The comparison shows the proposed method to be encouraging. 情報処理学会 2004-05-28 jpn technical report https://ipsj.ixsq.nii.ac.jp/records/57136 AN10442647 情報処理学会研究報告音声言語情報処理（SLP） 2004 57(2004-SLP-051) 49 54 https://ipsj.ixsq.nii.ac.jp/record/57136/files/IPSJ-SLP04051009.pdf application/pdf 565.2 kB 2006-05-28