| Item type |
SIG Technical Reports(1) |
| 公開日 |
2018-02-21 |
| タイトル |
|
|
タイトル |
Improving the performance of file-based coupling inmulti-component HPC workflows |
| タイトル |
|
|
言語 |
en |
|
タイトル |
Improving the performance of file-based coupling inmulti-component HPC workflows |
| 言語 |
|
|
言語 |
eng |
| キーワード |
|
|
主題Scheme |
Other |
|
主題 |
I/Oシステム |
| 資源タイプ |
|
|
資源タイプ識別子 |
http://purl.org/coar/resource_type/c_18gh |
|
資源タイプ |
technical report |
| 著者所属 |
|
|
|
RIKEN AICS |
| 著者所属 |
|
|
|
RIKEN AICS |
| 著者所属 |
|
|
|
Northwestern University |
| 著者所属 |
|
|
|
RIKEN AICS |
| 著者所属 |
|
|
|
Northwestern University |
| 著者所属(英) |
|
|
|
en |
|
|
RIKEN AICS |
| 著者所属(英) |
|
|
|
en |
|
|
RIKEN AICS |
| 著者所属(英) |
|
|
|
en |
|
|
Northwestern University |
| 著者所属(英) |
|
|
|
en |
|
|
RIKEN AICS |
| 著者所属(英) |
|
|
|
en |
|
|
Northwestern University |
| 著者名 |
Tatiana, V. Martsinkevich
Balazs, Gerofi
Wei-keng, Liao
Yutaka, Ishikawa
Alok, Choudhary
|
| 著者名(英) |
Tatiana, V. Martsinkevich
Balazs, Gerofi
Wei-keng, Liao
Yutaka, Ishikawa
Alok, Choudhary
|
| 論文抄録 |
|
|
内容記述タイプ |
Other |
|
内容記述 |
Efficient coupling of components in multi-component HPC workflows is a common issue especially if the components are loosely coupled via files. A number of solutions have been proposed, mainly in the form of a coupling software. However, such software usually requires the programmer to use its API, which would often mean rewriting the I/O kernel code in case the original program used some other I/O library. We propose a coupling framework called the DTF that replaces file I/O in components with direct sending of data transparently for the user. The DTF works for applications which use the PnetCDF library for file I/O. In this work we present the evaluation of the latest version of the DTF with improved scalability and faster data transfer. |
| 論文抄録(英) |
|
|
内容記述タイプ |
Other |
|
内容記述 |
Efficient coupling of components in multi-component HPC workflows is a common issue especially if the components are loosely coupled via files. A number of solutions have been proposed, mainly in the form of a coupling software. However, such software usually requires the programmer to use its API, which would often mean rewriting the I/O kernel code in case the original program used some other I/O library. We propose a coupling framework called the DTF that replaces file I/O in components with direct sending of data transparently for the user. The DTF works for applications which use the PnetCDF library for file I/O. In this work we present the evaluation of the latest version of the DTF with improved scalability and faster data transfer. |
| 書誌レコードID |
|
|
収録物識別子タイプ |
NCID |
|
収録物識別子 |
AN10463942 |
| 書誌情報 |
研究報告ハイパフォーマンスコンピューティング（HPC）
巻 2018-HPC-163,
号 6,
p. 1-8,
発行日 2018-02-21
|
| ISSN |
|
|
収録物識別子タイプ |
ISSN |
|
収録物識別子 |
2188-8841 |
| Notice |
|
|
|
SIG Technical Reports are nonrefereed and hence may later appear in any journals, conferences, symposia, etc. |
| 出版者 |
|
|
言語 |
ja |
|
出版者 |
情報処理学会 |
IPSJ-HPC18163006.pdf (1.4 MB)
