TY - GEN
T1 - Fast DCT based expression extraction and lifelike transferring for facial images
AU - Li, Haiyang
AU - Tian, Chunna
AU - Bo, Yuan
AU - Wei, Wei
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2016/7/2
Y1 - 2016/7/2
N2 - Facial expression details are important visual cues to interpret expressions, which are also hard to be synthesized. We propose a novel facial expression transferring method to synthesize realistic colorful facial expressions with source-specific expression details. First, we choose YUV color space to represent the expression images. In Y channel of the color space, the expression image of the source object is transformed into frequency domain through discrete cosine transform. Then, the expression details including micro-expressions of the source object are extracted through analyzing their frequency distribution. Finally, those expression details are stitched smoothly to the target object with Poisson image editing method. The transferred result is combined with U and V channels of the warped target expression to synthesize the colorful realistic expressions of the target object, which reduces the effect of illumination and skin color variations. Experiments on the Multi-PIE database show that our method has higher perceptual quality over the state-of-the-art methods.
AB - Facial expression details are important visual cues to interpret expressions, which are also hard to be synthesized. We propose a novel facial expression transferring method to synthesize realistic colorful facial expressions with source-specific expression details. First, we choose YUV color space to represent the expression images. In Y channel of the color space, the expression image of the source object is transformed into frequency domain through discrete cosine transform. Then, the expression details including micro-expressions of the source object are extracted through analyzing their frequency distribution. Finally, those expression details are stitched smoothly to the target object with Poisson image editing method. The transferred result is combined with U and V channels of the warped target expression to synthesize the colorful realistic expressions of the target object, which reduces the effect of illumination and skin color variations. Experiments on the Multi-PIE database show that our method has higher perceptual quality over the state-of-the-art methods.
KW - expression detail extraction
KW - expression synthesis
KW - frequency analysis
KW - poisson image editing
UR - http://www.scopus.com/inward/record.url?scp=85016302188&partnerID=8YFLogxK
U2 - 10.1109/ICSP.2016.7878117
DO - 10.1109/ICSP.2016.7878117
M3 - 会议稿件
AN - SCOPUS:85016302188
T3 - International Conference on Signal Processing Proceedings, ICSP
SP - 1697
EP - 1700
BT - ICSP 2016 - 2016 IEEE 13th International Conference on Signal Processing, Proceedings
A2 - Baozong, Yuan
A2 - Qiuqi, Ruan
A2 - Yao, Zhao
A2 - Gaoyun, An
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 13th IEEE International Conference on Signal Processing, ICSP 2016
Y2 - 6 November 2016 through 10 November 2016
ER -