TY - JOUR
T1 - Going the Extra Mile in Face Image Quality Assessment
T2 - A Novel Database and Model
AU - Su, Shaolin
AU - Lin, Hanhe
AU - Hosu, Vlad
AU - Wiedemann, Oliver
AU - Sun, Jinqiu
AU - Zhu, Yu
AU - Liu, Hantao
AU - Zhang, Yanning
AU - Saupe, Dietmar
N1 - Publisher Copyright:
© 1999-2012 IEEE.
PY - 2024
Y1 - 2024
N2 - An accurate computational model for image quality assessment (IQA) benefits many vision applications, such as image filtering, image processing, and image generation. Although the study of face images is an important subfield in computer vision research, the lack of face IQA data and models limits the precision of current IQA metrics on face image processing tasks such as face superresolution, face enhancement, and face editing. To narrow this gap, in this article, we first introduce the largest annotated IQA database developed to date, which contains 20,000 human faces - an order of magnitude larger than all existing rated datasets of faces - of diverse individuals in highly varied circumstances. Based on the database, we further propose a novel deep learning model to accurately predict face image quality, which, for the first time, explores the use of generative priors for IQA. By taking advantage of rich statistics encoded in well pretrained off-the-shelf generative models, we obtain generative prior information and use it as latent references to facilitate blind IQA. The experimental results demonstrate both the value of the proposed dataset for face IQA and the superior performance of the proposed model.
AB - An accurate computational model for image quality assessment (IQA) benefits many vision applications, such as image filtering, image processing, and image generation. Although the study of face images is an important subfield in computer vision research, the lack of face IQA data and models limits the precision of current IQA metrics on face image processing tasks such as face superresolution, face enhancement, and face editing. To narrow this gap, in this article, we first introduce the largest annotated IQA database developed to date, which contains 20,000 human faces - an order of magnitude larger than all existing rated datasets of faces - of diverse individuals in highly varied circumstances. Based on the database, we further propose a novel deep learning model to accurately predict face image quality, which, for the first time, explores the use of generative priors for IQA. By taking advantage of rich statistics encoded in well pretrained off-the-shelf generative models, we obtain generative prior information and use it as latent references to facilitate blind IQA. The experimental results demonstrate both the value of the proposed dataset for face IQA and the superior performance of the proposed model.
KW - face quality
KW - GAN
KW - generative priors
KW - Image quality assessment
KW - subjective study
UR - http://www.scopus.com/inward/record.url?scp=85166766844&partnerID=8YFLogxK
U2 - 10.1109/TMM.2023.3301276
DO - 10.1109/TMM.2023.3301276
M3 - 文章
AN - SCOPUS:85166766844
SN - 1520-9210
VL - 26
SP - 2671
EP - 2685
JO - IEEE Transactions on Multimedia
JF - IEEE Transactions on Multimedia
ER -