Predicting Image Emotion Distribution by Emotional Region

Yangyu Fan, Hansen Yang, Zuhe Li, Shu Liu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

8 Scopus citations

Abstract

Recent studies on image emotion prediction mainly focus on classifying images into a certain emotion category, but single label cannot reflect peoples' multiple emotion to image. To get more realistic results, we study image emotion distribution problem. In the most image emotion tasks, features are extracted from the whole image, but not each part makes contribution to emotion, so features from the whole image contain noises. In order to get discriminative features, we propose to leverage the heatmap generated by Fully Convolutional Networks (FCN) to select the Region of Interest (ROI) from an image which represents the image emotion most. Both high-level features and hand-crafted features from ROI are fused to train Support Vector Regressors (SVRs) to predict emotion distribution. Extensive experiments conducted on two widely used datasets demonstrate that emotional region is selected out through our method so that emotion distribution prediction performances are improved.

Original languageEnglish
Title of host publicationProceedings - 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2018
EditorsWei Li, Qingli Li, Lipo Wang
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538676042
DOIs
StatePublished - 2 Jul 2018
Event11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2018 - Beijing, China
Duration: 13 Oct 201815 Oct 2018

Publication series

NameProceedings - 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2018

Conference

Conference11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, CISP-BMEI 2018
Country/TerritoryChina
CityBeijing
Period13/10/1815/10/18

Keywords

  • FCN
  • Image emotion distribution
  • SVR
  • emotional region

Fingerprint

Dive into the research topics of 'Predicting Image Emotion Distribution by Emotional Region'. Together they form a unique fingerprint.

Cite this