Fast DCT based expression extraction and lifelike transferring for facial images

Haiyang Li, Chunna Tian, Yuan Bo, Wei Wei

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Facial expression details are important visual cues to interpret expressions, which are also hard to be synthesized. We propose a novel facial expression transferring method to synthesize realistic colorful facial expressions with source-specific expression details. First, we choose YUV color space to represent the expression images. In Y channel of the color space, the expression image of the source object is transformed into frequency domain through discrete cosine transform. Then, the expression details including micro-expressions of the source object are extracted through analyzing their frequency distribution. Finally, those expression details are stitched smoothly to the target object with Poisson image editing method. The transferred result is combined with U and V channels of the warped target expression to synthesize the colorful realistic expressions of the target object, which reduces the effect of illumination and skin color variations. Experiments on the Multi-PIE database show that our method has higher perceptual quality over the state-of-the-art methods.

Original languageEnglish
Title of host publicationICSP 2016 - 2016 IEEE 13th International Conference on Signal Processing, Proceedings
EditorsYuan Baozong, Ruan Qiuqi, Zhao Yao, An Gaoyun
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1697-1700
Number of pages4
ISBN (Electronic)9781509013449
DOIs
StatePublished - 2 Jul 2016
Event13th IEEE International Conference on Signal Processing, ICSP 2016 - Chengdu, China
Duration: 6 Nov 201610 Nov 2016

Publication series

NameInternational Conference on Signal Processing Proceedings, ICSP
Volume0

Conference

Conference13th IEEE International Conference on Signal Processing, ICSP 2016
Country/TerritoryChina
CityChengdu
Period6/11/1610/11/16

Keywords

  • expression detail extraction
  • expression synthesis
  • frequency analysis
  • poisson image editing

Fingerprint

Dive into the research topics of 'Fast DCT based expression extraction and lifelike transferring for facial images'. Together they form a unique fingerprint.

Cite this