Full Face Texture Generation of Virtual Human

Yang Liu, Yangyu Fan, Guoyun Lv, Shiya Liu, Anam Zaman

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Face texture completion plays a significant role in virtual human research, and the quality of face texture needs to be improved urgently. One of the major obstacles to single-face texture generation is that the generated textures are always incomplete for self-occlusion of the input face, and the other is that pixel details are limited by the illumination. To address this, we propose a method for complete face texture generation based on generative adversarial networks. The face parameters obtained from 3D Morphable Model are processed as conditional vectors in the encoder, and the multivariate Gaussian distribution of the latent code is used in the networks to learn the complete texture features. We established a face texture dataset CFT for training the network. Meanwhile, we show the effectiveness of the proposed approach in qualitative and quantitative experiments. The visual results under different tasks show superior performances compared with the state-of-the-art approaches.

Original languageEnglish
Title of host publication2022 IEEE 24th International Workshop on Multimedia Signal Processing, MMSP 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665471893
DOIs
StatePublished - 2022
Event24th IEEE International Workshop on Multimedia Signal Processing, MMSP 2022 - Shanghai, China
Duration: 26 Sep 202228 Sep 2022

Publication series

Name2022 IEEE 24th International Workshop on Multimedia Signal Processing, MMSP 2022

Conference

Conference24th IEEE International Workshop on Multimedia Signal Processing, MMSP 2022
Country/TerritoryChina
CityShanghai
Period26/09/2228/09/22

Keywords

  • 3D face model
  • face texture generation
  • texture completion
  • UV texture map

Fingerprint

Dive into the research topics of 'Full Face Texture Generation of Virtual Human'. Together they form a unique fingerprint.

Cite this