TY - JOUR
T1 - Screen content image quality assessment based on the most preferred structure feature
AU - Wu, Jun
AU - Li, Huifang
AU - Xia, Zhaoqiang
AU - Xia, Zhifang
N1 - Publisher Copyright:
© 2018 SPIE and IS&T.
PY - 2018/5/1
Y1 - 2018/5/1
N2 - The quality of screen content images (SCIs) plays a crucial benchmark of displaying the system and directly affects the user experience of multidevice communication. However, accurately predicting the quality of SCIs with an objective algorithm still has many challenges. Hence, we propose a new no-reference method for evaluating the quality of SCIs effectively and efficiently. Specifically, we first propose a simple but effective strategy to partition the SCIs into the rough and smooth regions. Then, a most preferred structure (MPS) metric is derived to represent the meaningful part of each image patch according to the free-energy theory of human brain. Subsequently, the MPSs of the rough and smooth regions are pooled for constructing the rough and smooth features of SCIs, separately. Finally, to evaluate the final visual quality, the rough and smooth features are combined as the quality-aware features of SCIs, and a learning-based framework is employed to map the quality-aware features to objective quality scores. The experimental results show that the performance of the proposed method is highly consistent with the human perception and superior to the state-of-the-art quality assessment methods on the SCI-oriented databases. Furthermore, the proposed method delivers a high computational efficiency and is very suitable to be integrated into the displaying system.
AB - The quality of screen content images (SCIs) plays a crucial benchmark of displaying the system and directly affects the user experience of multidevice communication. However, accurately predicting the quality of SCIs with an objective algorithm still has many challenges. Hence, we propose a new no-reference method for evaluating the quality of SCIs effectively and efficiently. Specifically, we first propose a simple but effective strategy to partition the SCIs into the rough and smooth regions. Then, a most preferred structure (MPS) metric is derived to represent the meaningful part of each image patch according to the free-energy theory of human brain. Subsequently, the MPSs of the rough and smooth regions are pooled for constructing the rough and smooth features of SCIs, separately. Finally, to evaluate the final visual quality, the rough and smooth features are combined as the quality-aware features of SCIs, and a learning-based framework is employed to map the quality-aware features to objective quality scores. The experimental results show that the performance of the proposed method is highly consistent with the human perception and superior to the state-of-the-art quality assessment methods on the SCI-oriented databases. Furthermore, the proposed method delivers a high computational efficiency and is very suitable to be integrated into the displaying system.
KW - free-energy theory
KW - image quality assessment
KW - screen content image
KW - sparse representation
UR - http://www.scopus.com/inward/record.url?scp=85047923867&partnerID=8YFLogxK
U2 - 10.1117/1.JEI.27.3.033025
DO - 10.1117/1.JEI.27.3.033025
M3 - 文章
AN - SCOPUS:85047923867
SN - 1017-9909
VL - 27
JO - Journal of Electronic Imaging
JF - Journal of Electronic Imaging
IS - 3
M1 - 033025
ER -