Drawing Guidance for Freehand Sketching with Interactive Diffusion Model

• Item type: SIG Technical Reports(1)
• 公開日: 2024-09-02
• タイトル: Drawing Guidance for Freehand Sketching with Interactive Diffusion Model
• タイトル / 言語: en
• タイトル: Drawing Guidance for Freehand Sketching with Interactive Diffusion Model
• 言語: eng
• キーワード / 主題Scheme: Other
• キーワード / 主題: CG一般セッション1
• 資源タイプ / 資源タイプ識別子: http://purl.org/coar/resource_type/c_18gh
• 資源タイプ: technical report
• 著者所属: Japan Advanced Institute of Science and Technology
• 著者所属: Japan Advanced Institute of Science and Technology
• 著者所属: Japan Advanced Institute of Science and Technology
• 著者所属: Japan Advanced Institute of Science and Technology
• 著者所属: Japan Advanced Institute of Science and Technology
• 著者所属(英): en
• 著者所属(英): Japan Advanced Institute of Science and Technology
• 著者所属(英): en
• 著者所属(英): Japan Advanced Institute of Science and Technology
• 著者所属(英): en
• 著者所属(英): Japan Advanced Institute of Science and Technology
• 著者所属(英): en
• 著者所属(英): Japan Advanced Institute of Science and Technology
• 著者所属(英): en
• 著者所属(英): Japan Advanced Institute of Science and Technology
• 著者名: Chuang, Chen; Xiaoxuan, Xie; Yongming, Zhang; Tianyu, Zhang; Haoran, Xie
• 著者名(英): Chuang, Chen; Xiaoxuan, Xie; Yongming, Zhang; Tianyu, Zhang; Haoran, Xie
• 論文抄録 / 内容記述タイプ: Other
• 論文抄録 / 内容記述: Drawing is a universal form of human expression that transcends language barriers. However, the common users may have difficulty to convey their ideas independently due to the necessity of consistent practice and professional guidance. In this work, we proposed our system for freehand sketching. The proposed system adopts an interactive diffusion model, StreamDiffusion for providing real-time user guidance to assist users within the drawing process. We use a diffusion model to generate RGB images based on hand-drawn sketches and prompts, then convert RGB images into sketches using informative drawings line detector to assist users with creative expression in the drawing practice. Our method can generate images in real time that accurately align with the user's intent and provide shadow guidance in the background. This process aids users in their drawing practice by allowing them to create sketches based on prompts and their own coarse drawings. A user study evaluates our method's effectiveness and gathers feedback on interface design.
• 論文抄録(英) / 内容記述タイプ: Other
• 論文抄録(英) / 内容記述: Drawing is a universal form of human expression that transcends language barriers. However, the common users may have difficulty to convey their ideas independently due to the necessity of consistent practice and professional guidance. In this work, we proposed our system for freehand sketching. The proposed system adopts an interactive diffusion model, StreamDiffusion for providing real-time user guidance to assist users within the drawing process. We use a diffusion model to generate RGB images based on hand-drawn sketches and prompts, then convert RGB images into sketches using informative drawings line detector to assist users with creative expression in the drawing practice. Our method can generate images in real time that accurately align with the user's intent and provide shadow guidance in the background. This process aids users in their drawing practice by allowing them to create sketches based on prompts and their own coarse drawings. A user study evaluates our method's effectiveness and gathers feedback on interface design.
• 書誌レコードID / 収録物識別子タイプ: NCID
• 書誌レコードID / 収録物識別子: AN10100541
• 書誌情報: 研究報告コンピュータグラフィックスとビジュアル情報学（CG）; 巻 2024-CG-195, 号 2, p. 1-6, 発行日 2024-09-02
• ISSN / 収録物識別子タイプ: ISSN
• ISSN / 収録物識別子: 2188-8949
• Notice: SIG Technical Reports are nonrefereed and hence may later appear in any journals, conferences, symposia, etc.
• 出版者 / 言語: ja
• 出版者: 情報処理学会