Detecting Distress Variations Using Multimodal Data Obtained through Interaction with A Smart Speaker

• Item type: SIG Technical Reports(1)
• 公開日: 2024-02-22
• タイトル: Detecting Distress Variations Using Multimodal Data Obtained through Interaction with A Smart Speaker
• タイトル / 言語: en
• タイトル: Detecting Distress Variations Using Multimodal Data Obtained through Interaction with A Smart Speaker
• 言語: eng
• キーワード / 主題Scheme: Other
• キーワード / 主題: センシング
• 資源タイプ / 資源タイプ識別子: http://purl.org/coar/resource_type/c_18gh
• 資源タイプ: technical report
• 著者所属: Nara Institute of Science and Technology
• 著者所属: Nara Institute of Science and Technology／RIKEN Center for Advanced Intelligence Project
• 著者所属: Nara Institute of Science and Technology／RIKEN Center for Advanced Intelligence Project
• 著者所属: Nara Institute of Science and Technology／RIKEN Center for Advanced Intelligence Project
• 著者所属(英): en
• 著者所属(英): Nara Institute of Science and Technology
• 著者所属(英): en
• 著者所属(英): Nara Institute of Science and Technology / RIKEN Center for Advanced Intelligence Project
• 著者所属(英): en
• 著者所属(英): Nara Institute of Science and Technology / RIKEN Center for Advanced Intelligence Project
• 著者所属(英): en
• 著者所属(英): Nara Institute of Science and Technology / RIKEN Center for Advanced Intelligence Project
• 著者名: Chingyuan, Lin; Yuki, Matsuda; Hirohiko, Suwa; Keiichi, Yasumoto
• 著者名(英): Chingyuan, Lin; Yuki, Matsuda; Hirohiko, Suwa; Keiichi, Yasumoto
• 論文抄録 / 内容記述タイプ: Other
• 論文抄録 / 内容記述: Mental health significantly affects people, with excessive stress potentially causing depression, low productivity, and suicidal thoughts. It can also harm physical health, impacting appetite and sleep, and may lead to other diseases. In most cases, individuals do not notice stress buildup until their health severely deteriorates. Thus, daily monitoring of stress levels is essential. In this study, we aim to realize a method to estimate people’s distress levels in everyday life through conversation with a smart speaker. We set up a smart speaker in the bedrooms of participants to simulate a home environment and recorded their interactions with it using a webcam. These recordings allowed us to analyze facial expressions, voice, and heart rate data. We processed these features and predicted levels of Happiness, Depression, and Anxiety. Participants completed questionnaires using the Depression and Anxiety Mood Scale (DAMS) after each session, providing emotion labels with scores from 0 to 18. In a 14-day experiment involving seven participants aged 22-24, the MAE for Happiness, Depression, and Anxiety levels were 2.04, 2.59, and 2.31, respectively, while the RMSE for these distress levels were 2.63, 3.20, and 2.91.
• 論文抄録(英) / 内容記述タイプ: Other
• 論文抄録(英) / 内容記述: Mental health significantly affects people, with excessive stress potentially causing depression, low productivity, and suicidal thoughts. It can also harm physical health, impacting appetite and sleep, and may lead to other diseases. In most cases, individuals do not notice stress buildup until their health severely deteriorates. Thus, daily monitoring of stress levels is essential. In this study, we aim to realize a method to estimate people’s distress levels in everyday life through conversation with a smart speaker. We set up a smart speaker in the bedrooms of participants to simulate a home environment and recorded their interactions with it using a webcam. These recordings allowed us to analyze facial expressions, voice, and heart rate data. We processed these features and predicted levels of Happiness, Depression, and Anxiety. Participants completed questionnaires using the Depression and Anxiety Mood Scale (DAMS) after each session, providing emotion labels with scores from 0 to 18. In a 14-day experiment involving seven participants aged 22-24, the MAE for Happiness, Depression, and Anxiety levels were 2.04, 2.59, and 2.31, respectively, while the RMSE for these distress levels were 2.63, 3.20, and 2.91.
• 書誌レコードID / 収録物識別子タイプ: NCID
• 書誌レコードID / 収録物識別子: AA11838947
• 書誌情報: 研究報告ユビキタスコンピューティングシステム（UBI）; 巻 2024-UBI-81, 号 7, p. 1-6, 発行日 2024-02-22
• ISSN / 収録物識別子タイプ: ISSN
• ISSN / 収録物識別子: 2188-8698
• Notice: SIG Technical Reports are nonrefereed and hence may later appear in any journals, conferences, symposia, etc.
• 出版者 / 言語: ja
• 出版者: 情報処理学会