Item type |
SIG Technical Reports(1) |
公開日 |
2018-09-18 |
タイトル |
|
|
タイトル |
A proposal for a unified corpus of the Ainu language |
タイトル |
|
|
言語 |
en |
|
タイトル |
A proposal for a unified corpus of the Ainu language |
言語 |
|
|
言語 |
eng |
キーワード |
|
|
主題Scheme |
Other |
|
主題 |
言語処理応用 |
資源タイプ |
|
|
資源タイプ識別子 |
http://purl.org/coar/resource_type/c_18gh |
|
資源タイプ |
technical report |
著者所属 |
|
|
|
Kitami Institute of Technology |
著者所属 |
|
|
|
Kitami Institute of Technology |
著者所属 |
|
|
|
Kitami Institute of Technology |
著者所属(英) |
|
|
|
en |
|
|
Kitami Institute of Technology |
著者所属(英) |
|
|
|
en |
|
|
Kitami Institute of Technology |
著者所属(英) |
|
|
|
en |
|
|
Kitami Institute of Technology |
著者名 |
Karol, Nowakowski
Michal, Ptaszynski
Fumito, Masui
|
著者名(英) |
Karol, Nowakowski
Michal, Ptaszynski
Fumito, Masui
|
論文抄録 |
|
|
内容記述タイプ |
Other |
|
内容記述 |
Ainu is an endangered language of the Ainu people, native inhabitants of northern Japan. It has been the subject of many studies, but most scholars work on small amounts of language data. We propose a corpus of Ainu covering a wide range of documents, in a consistent structure that will enable large-scale linguistic analysis and support the development of NLP technologies for Ainu, contributing to the process of its revitalization. The corpus contains parallel text in Ainu and Japanese. Its subset includes POS annotations produced by Ainu language experts. For the remaining parts, annotations will be generated automatically. At present, resources collected for the corpus comprise 1.86M characters (410K tokens) of text in Ainu. Their utility for NLP applications has been verified by applying them in a tokenization system, which achieved average F-score above 95%. |
論文抄録(英) |
|
|
内容記述タイプ |
Other |
|
内容記述 |
Ainu is an endangered language of the Ainu people, native inhabitants of northern Japan. It has been the subject of many studies, but most scholars work on small amounts of language data. We propose a corpus of Ainu covering a wide range of documents, in a consistent structure that will enable large-scale linguistic analysis and support the development of NLP technologies for Ainu, contributing to the process of its revitalization. The corpus contains parallel text in Ainu and Japanese. Its subset includes POS annotations produced by Ainu language experts. For the remaining parts, annotations will be generated automatically. At present, resources collected for the corpus comprise 1.86M characters (410K tokens) of text in Ainu. Their utility for NLP applications has been verified by applying them in a tokenization system, which achieved average F-score above 95%. |
書誌レコードID |
|
|
収録物識別子タイプ |
NCID |
|
収録物識別子 |
AN10115061 |
書誌情報 |
研究報告自然言語処理(NL)
巻 2018-NL-237,
号 2,
p. 1-6,
発行日 2018-09-18
|
ISSN |
|
|
収録物識別子タイプ |
ISSN |
|
収録物識別子 |
2188-8779 |
Notice |
|
|
|
SIG Technical Reports are nonrefereed and hence may later appear in any journals, conferences, symposia, etc. |
出版者 |
|
|
言語 |
ja |
|
出版者 |
情報処理学会 |