2026-03-14T20:56:02Z https://ipsj.ixsq.nii.ac.jp/oai

oai:ipsj.ixsq.nii.ac.jp:00202966 2025-01-19T20:42:56Z 934:935:9993:9994

Centaurus: A Just-in-time Parallel-parser Generator for Ad Hoc Data Processing Centaurus: A Just-in-time Parallel-parser Generator for Ad Hoc Data Processing Shigeyuki, Sato Hiroka, Ihara Kenjiro, Taura Shigeyuki, Sato Hiroka, Ihara Kenjiro, Taura [発表概要，Unrefereed Presentation Abstract] It is important to handle data in text formats such as XML, JSON, and CSV because these data very often appear in the context of data exchange. Only parts of these data are typically used afterwards so that it is not worth ingesting the whole of them into databases. It is therefore desired to match and extract the concerned part in a lightweight ad hoc manner. Classically used for such a purpose are linewise regular expression tools such as grep, sed, and awk. These are, however, not powerful enough for text formats commonly used for data exchange because they cannot recognize nested structures in general. To support a lightweight ad hoc data processing, we present Centaurus, a just-in-time parallel-parser generator library. By generating native scannerless LL(*) parsers dynamically, our library enables us to process input data in parallel merely by calling Python functions with LL(*) grammars and Python actions. This presentation gives the design and implementation of Centaurus and reports its experimental performance on data filtering. It is important to handle data in text formats such as XML, JSON, and CSV because these data very often appear in the context of data exchange. Only parts of these data are typically used afterwards so that it is not worth ingesting the whole of them into databases. It is therefore desired to match and extract the concerned part in a lightweight ad hoc manner. Classically used for such a purpose are linewise regular expression tools such as grep, sed, and awk. These are, however, not powerful enough for text formats commonly used for data exchange because they cannot recognize nested structures in general. To support a lightweight ad hoc data processing, we present Centaurus, a just-in-time parallel-parser generator library. By generating native scannerless LL(*) parsers dynamically, our library enables us to process input data in parallel merely by calling Python functions with LL(*) grammars and Python actions. This presentation gives the design and implementation of Centaurus and reports its experimental performance on data filtering. 情報処理学会 2020-01-29 eng journal article https://ipsj.ixsq.nii.ac.jp/records/202966 1882-7802 AA11464814 情報処理学会論文誌プログラミング（PRO） 13 1 18 18 https://ipsj.ixsq.nii.ac.jp/record/202966/files/IPSJ-TPRO1301007.pdf application/pdf 27.7 kB 2022-01-29