{"id":212704,"updated":"2025-01-19T17:24:34.782504+00:00","links":{},"created":"2025-01-19T01:13:38.233169+00:00","metadata":{"_oai":{"id":"oai:ipsj.ixsq.nii.ac.jp:00212704","sets":["6164:6165:6522:10650"]},"path":["10650"],"owner":"44499","recid":"212704","title":["Testing-based GPU-Memory Consumption Estimation for Deep Learning"],"pubdate":{"attribute_name":"公開日","attribute_value":"2021-08-30"},"_buckets":{"deposit":"7aed0b62-32a7-4cd2-99b5-0586b3899057"},"_deposit":{"id":"212704","pid":{"type":"depid","value":"212704","revision_id":0},"owners":[44499],"status":"published","created_by":44499},"item_title":"Testing-based GPU-Memory Consumption Estimation for Deep Learning","author_link":["543069","543068","543067","543071","543072","543070"],"item_titles":{"attribute_name":"タイトル","attribute_value_mlt":[{"subitem_title":"Testing-based GPU-Memory Consumption Estimation for Deep Learning"},{"subitem_title":"Testing-based GPU-Memory Consumption Estimation for Deep Learning","subitem_title_language":"en"}]},"item_keyword":{"attribute_name":"キーワード","attribute_value_mlt":[{"subitem_subject":"ソフトウェアテスト","subitem_subject_scheme":"Other"}]},"item_type_id":"18","publish_date":"2021-08-30","item_language":{"attribute_name":"言語","attribute_value_mlt":[{"subitem_language":"eng"}]},"item_18_text_3":{"attribute_name":"著者所属","attribute_value_mlt":[{"subitem_text_value":"Graduate School of Advanced Science and Engineering, Hiroshima University"},{"subitem_text_value":"Graduate School of Advanced Science and Engineering, Hiroshima University"},{"subitem_text_value":"Graduate School of Advanced Science and Engineering, Hiroshima University"}]},"item_18_text_4":{"attribute_name":"著者所属(英)","attribute_value_mlt":[{"subitem_text_value":"Graduate School of Advanced Science and Engineering, Hiroshima University","subitem_text_language":"en"},{"subitem_text_value":"Graduate School of Advanced Science and Engineering, Hiroshima University","subitem_text_language":"en"},{"subitem_text_value":"Graduate School of Advanced Science and Engineering, Hiroshima University","subitem_text_language":"en"}]},"item_publisher":{"attribute_name":"出版者","attribute_value_mlt":[{"subitem_publisher":"情報処理学会","subitem_publisher_language":"ja"}]},"publish_status":"0","weko_shared_id":-1,"item_file_price":{"attribute_name":"Billing file","attribute_type":"file","attribute_value_mlt":[{"url":{"url":"https://ipsj.ixsq.nii.ac.jp/record/212704/files/IPSJ-SES2021031.pdf","label":"IPSJ-SES2021031.pdf"},"date":[{"dateType":"Available","dateValue":"2023-08-30"}],"format":"application/pdf","billing":["billing_file"],"filename":"IPSJ-SES2021031.pdf","filesize":[{"value":"192.5 kB"}],"mimetype":"application/pdf","priceinfo":[{"tax":["include_tax"],"price":"660","billingrole":"5"},{"tax":["include_tax"],"price":"330","billingrole":"6"},{"tax":["include_tax"],"price":"0","billingrole":"12"},{"tax":["include_tax"],"price":"0","billingrole":"44"}],"accessrole":"open_date","version_id":"a2a9d45b-36ba-4d70-95a0-1790feaa6fa4","displaytype":"detail","licensetype":"license_note","license_note":"Copyright (c) 2021 by the Information Processing Society of Japan"}]},"item_18_creator_5":{"attribute_name":"著者名","attribute_type":"creator","attribute_value_mlt":[{"creatorNames":[{"creatorName":"Haiyi, Liu"}],"nameIdentifiers":[{}]},{"creatorNames":[{"creatorName":"Shaoying, Liu"}],"nameIdentifiers":[{}]},{"creatorNames":[{"creatorName":"Ai, Liu"}],"nameIdentifiers":[{}]}]},"item_18_creator_6":{"attribute_name":"著者名(英)","attribute_type":"creator","attribute_value_mlt":[{"creatorNames":[{"creatorName":"Haiyi, Liu","creatorNameLang":"en"}],"nameIdentifiers":[{}]},{"creatorNames":[{"creatorName":"Shaoying, Liu","creatorNameLang":"en"}],"nameIdentifiers":[{}]},{"creatorNames":[{"creatorName":"Ai, Liu","creatorNameLang":"en"}],"nameIdentifiers":[{}]}]},"item_resource_type":{"attribute_name":"資源タイプ","attribute_value_mlt":[{"resourceuri":"http://purl.org/coar/resource_type/c_5794","resourcetype":"conference paper"}]},"item_18_description_7":{"attribute_name":"論文抄録","attribute_value_mlt":[{"subitem_description":"Deep learning(DL) has been successfully applied in many software systems and deployed to a variety of server. The training of DL needs a lot of GPU computing resources. However, it is difficult for developers to accurately calculate the GPU resources that the model may consume before running the model, which brings great inconvenience to the development of DL system. Especially nowadays, a lot of model training runs on cloud services. Therefore, it is very important to estimate the GPU-memory resources that any model may use in a certain computing framework. The existing work mainly focuses on the static analysis method to evaluate the GPU-memory consumption, which is highly coupled with the framework implementation, and lacks the research on the software testing and evaluation method of GPU-memory consumption (It does not depend on the framework implementation itself). In this paper, we propose a new method to estimate the memory consumption of DL framework. The method is based on software testing and static analysis estimation. Firstly, heuristic random search algorithm is used to explore the real GPU-memory consumption of different DL models at runtime. At the same time, the software static analysis method is used to evaluate the theoretical memory consumption of DL model, which can reduce the number of model testing (because the testing model requires computing resources). Finally, the known data is modeled to estimate the real memory consumption of different models in different computing frameworks. To evaluate the effectiveness of our proposed method, we apply it to the mainstream computing framework, i.e., TensorFlow, Pytorch. The results show that our method can achieve more accurate evaluation of GPU-memory consumption without knowing the operation mechanism of the framework.","subitem_description_type":"Other"}]},"item_18_description_8":{"attribute_name":"論文抄録(英)","attribute_value_mlt":[{"subitem_description":"Deep learning(DL) has been successfully applied in many software systems and deployed to a variety of server. The training of DL needs a lot of GPU computing resources. However, it is difficult for developers to accurately calculate the GPU resources that the model may consume before running the model, which brings great inconvenience to the development of DL system. Especially nowadays, a lot of model training runs on cloud services. Therefore, it is very important to estimate the GPU-memory resources that any model may use in a certain computing framework. The existing work mainly focuses on the static analysis method to evaluate the GPU-memory consumption, which is highly coupled with the framework implementation, and lacks the research on the software testing and evaluation method of GPU-memory consumption (It does not depend on the framework implementation itself). In this paper, we propose a new method to estimate the memory consumption of DL framework. The method is based on software testing and static analysis estimation. Firstly, heuristic random search algorithm is used to explore the real GPU-memory consumption of different DL models at runtime. At the same time, the software static analysis method is used to evaluate the theoretical memory consumption of DL model, which can reduce the number of model testing (because the testing model requires computing resources). Finally, the known data is modeled to estimate the real memory consumption of different models in different computing frameworks. To evaluate the effectiveness of our proposed method, we apply it to the mainstream computing framework, i.e., TensorFlow, Pytorch. The results show that our method can achieve more accurate evaluation of GPU-memory consumption without knowing the operation mechanism of the framework.","subitem_description_type":"Other"}]},"item_18_biblio_info_10":{"attribute_name":"書誌情報","attribute_value_mlt":[{"bibliographicPageEnd":"199","bibliographic_titles":[{"bibliographic_title":"ソフトウェアエンジニアリングシンポジウム2021論文集"}],"bibliographicPageStart":"196","bibliographicIssueDates":{"bibliographicIssueDate":"2021-08-30","bibliographicIssueDateType":"Issued"},"bibliographicVolumeNumber":"2021"}]},"relation_version_is_last":true,"weko_creator_id":"44499"}}