Emotion Recognition in a Closed-Cabin Environment: An Exploratory Study Using Millimeter-Wave Radar and Respiration Signals

Hanyu Wang, Dengkai Chen, Sen Gu, Yao Zhou, Jianghao Xiao, Yiwei Sun, Jianhua Sun, Yuexin Huang, Xian Zhang, Hao Fan

Research output: Contribution to journalArticlepeer-review

Abstract

Featured Application: This study has the potential to provide a reference for improving personnel and system safety and working performance in closed cabin environment. In the field of psychology and cognition within closed cabins, noncontact vital sign detection holds significant potential as it can enhance the user’s experience by utilizing objective measurements to assess emotions, making the process more sustainable and easier to deploy. To evaluate the capability of noncontact methods for emotion recognition in closed spaces, such as submarines, this study proposes an emotion recognition method that employs a millimeter-wave radar to capture respiration signals and uses a machine-learning framework for emotion classification. Respiration signals were collected while the participants watched videos designed to elicit different emotions. An automatic sparse encoder was used to extract features from respiration signals, and two support vector machines were employed for emotion classification. The proposed method was experimentally validated using the FaceReader software, which is based on audiovisual signals, and achieved an emotion classification accuracy of 68.21%, indicating the feasibility and effectiveness of using respiration signals to recognize and assess the emotional states of individuals in closed cabins.

Original languageEnglish
Article number10561
JournalApplied Sciences (Switzerland)
Volume14
Issue number22
DOIs
StatePublished - Nov 2024

Keywords

  • closed cabin
  • emotion recognition
  • machine-learning
  • millimeter-wave radar
  • respiration signal

Fingerprint

Dive into the research topics of 'Emotion Recognition in a Closed-Cabin Environment: An Exploratory Study Using Millimeter-Wave Radar and Respiration Signals'. Together they form a unique fingerprint.

Cite this