EmotionSense: Emotion recognition based on wearable wristband

Bobo Zhao, Zhu Wang, Zhiwen Yu, Bin Guo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

64 Scopus citations

Abstract

In this paper, we develop an automatic emotion recognition system based on a sensor-enriched wearable wristband. Specifically, in order to obtain physiological data from participants, we first adopt a video induction method which can spontaneously evoke human emotions in a real-life environment. Meanwhile, a questionnaire is designed to record the emotion status of the participants, which can be used as the ground-truth for emotion recognition. Second, we collect multi-modal physiological signals by utilizing three different biosensors (including blood volume pause, electrodermal activity, and skin temperature) embedded in the Empatica E4 wristband. Furthermore, we extract time, frequency and nonlinear features from the collected physiological signals, and adopt the sequence forward floating selection (SFFS) method to search for the best emotion-related features. Finally, we classify different emotions base on SVM using the selected features in aspect of arousal, valence, and four emotions. An overall accuracy of 76% for 15 participants demonstrates that the proposed system can recognize human emotions effectively.

Original languageEnglish
Title of host publicationProceedings - 2018 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018
EditorsFrederic Loulergue, Guojun Wang, Md Zakirul Alam Bhuiyan, Xiaoxing Ma, Peng Li, Manuel Roveri, Qi Han, Lei Chen
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages346-355
Number of pages10
ISBN (Electronic)9781538693803
DOIs
StatePublished - 4 Dec 2018
Event4th IEEE SmartWorld, 15th IEEE International Conference on Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018 - Guangzhou, China
Duration: 7 Oct 201811 Oct 2018

Publication series

NameProceedings - 2018 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018

Conference

Conference4th IEEE SmartWorld, 15th IEEE International Conference on Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018
Country/TerritoryChina
CityGuangzhou
Period7/10/1811/10/18

Keywords

  • Arousal
  • Blood volume pause
  • Electrodermal activity
  • Emotion recognition
  • Skin temperature
  • Valence
  • Wearable wristband

Fingerprint

Dive into the research topics of 'EmotionSense: Emotion recognition based on wearable wristband'. Together they form a unique fingerprint.

Cite this