CENTAURUS: A Dynamic Parser Generator for Parallel Ad Hoc Data Extraction

• Item type: Trans(1)
• 公開日: 2020-10-23
• タイトル: CENTAURUS: A Dynamic Parser Generator for Parallel Ad Hoc Data Extraction
• タイトル / 言語: en
• タイトル: CENTAURUS: A Dynamic Parser Generator for Parallel Ad Hoc Data Extraction
• 言語: eng
• キーワード / 主題Scheme: Other
• キーワード / 主題: [通常論文] LL(*) grammars, parser generators, parallel processing, ad hoc data extraction, Python
• 資源タイプ / 資源タイプ識別子: http://purl.org/coar/resource_type/c_6501
• 資源タイプ: journal article
• 著者所属: Graduate School of Information Science and Technology, The University of Tokyo
• 著者所属: Center for Technology Innovation, Hitachi Ltd.
• 著者所属: Graduate School of Information Science and Technology, The University of Tokyo
• 著者所属(英): en
• 著者所属(英): Graduate School of Information Science and Technology, The University of Tokyo
• 著者所属(英): en
• 著者所属(英): Center for Technology Innovation, Hitachi Ltd.
• 著者所属(英): en
• 著者所属(英): Graduate School of Information Science and Technology, The University of Tokyo
• 著者名: Shigeyuki, Sato; Hiroka, Ihara; Kenjiro, Taura
• 著者名(英): Shigeyuki, Sato; Hiroka, Ihara; Kenjiro, Taura
• 論文抄録 / 内容記述タイプ: Other
• 論文抄録 / 内容記述: It is important to handle large-scale data in text formats such as XML, JSON, and CSV because these data very often appear in data exchange. For these data, instead of data ingestion to databases, ad hoc data extraction is highly desirable. The main issue of ad hoc data extraction is to serve both the programmability to allow handling various types of data intuitively and the performance for large-scale data. To pursue it, we develop CENTAURUS, a dynamic parser generator library for parallel ad hoc data extraction. This paper presents the design and implementation of CENTAURUS. The experimental results on ad hoc data extraction have demonstrated that CENTAURUS outperformed fast dedicated parser libraries in C++ for XML and JSON, and achieved excellent scalability with actions implemented in Python.; ------------------------------; This is a preprint of an article intended for publication Journal of; Information Processing(JIP). This preprint should not be cited. This; article should be cited as: Journal of Information Processing Vol.28(2020) (online); ------------------------------
• 論文抄録(英) / 内容記述タイプ: Other
• 論文抄録(英) / 内容記述: It is important to handle large-scale data in text formats such as XML, JSON, and CSV because these data very often appear in data exchange. For these data, instead of data ingestion to databases, ad hoc data extraction is highly desirable. The main issue of ad hoc data extraction is to serve both the programmability to allow handling various types of data intuitively and the performance for large-scale data. To pursue it, we develop CENTAURUS, a dynamic parser generator library for parallel ad hoc data extraction. This paper presents the design and implementation of CENTAURUS. The experimental results on ad hoc data extraction have demonstrated that CENTAURUS outperformed fast dedicated parser libraries in C++ for XML and JSON, and achieved excellent scalability with actions implemented in Python.; ------------------------------; This is a preprint of an article intended for publication Journal of; Information Processing(JIP). This preprint should not be cited. This; article should be cited as: Journal of Information Processing Vol.28(2020) (online); ------------------------------
• 書誌レコードID / 収録物識別子タイプ: NCID
• 書誌レコードID / 収録物識別子: AA11464814
• 書誌情報: 情報処理学会論文誌プログラミング（PRO）; 巻 13, 号 4, 発行日 2020-10-23
• ISSN / 収録物識別子タイプ: ISSN
• ISSN / 収録物識別子: 1882-7802
• 出版者 / 言語: ja
• 出版者: 情報処理学会