TY - JOUR
T1 - Multiscale Attention Network for Detection and Localization of Image Splicing Forgery
AU - Xu, Yanzhi
AU - Irfan, Muhammad
AU - Fang, Aiqing
AU - Zheng, Jiangbin
N1 - Publisher Copyright:
© 1963-2012 IEEE.
PY - 2023
Y1 - 2023
N2 - Image forgery detection and localization have become a research topic of increasing interest with the enormous spread of manipulated images on the web. Most previous methods related to image forgery focus on one particular attribute or neglect the importance of multiscale information. Such approaches are considered not suitable for detecting and locating multiscale splicing forgeries. This article presents a novel approach that exploits residual attention and integrates multiscale local and global information to improve detection accuracy. In the proposed method, we first aggregate multilevel convolutional feature maps extracted by the encoder to enrich the feature representations and improve the ability of the model to locate multiscale forged areas. Then, we design a residual attention block (RAB) to purify the features, which enhances the response of task-related regions and suppresses noise information. Furthermore, a global feature mining block (GFMB) is proposed to capture the long-range dependencies between different regions of the image, enabling the model to handle complex tampering scenarios effectively. The multiscale splicing forgery regions are precisely detected and located by utilizing the proposed method. The extensive experiments are conducted on three benchmark datasets, CASIA, COLUMB, and NIST'16. Specifically, our model achieves the F1 score of 84.3%, 87.9%, and 80.8% on CASIA, COLUMB, and NIST'16 test sets, respectively, outperforming state-of-the-art methods.
AB - Image forgery detection and localization have become a research topic of increasing interest with the enormous spread of manipulated images on the web. Most previous methods related to image forgery focus on one particular attribute or neglect the importance of multiscale information. Such approaches are considered not suitable for detecting and locating multiscale splicing forgeries. This article presents a novel approach that exploits residual attention and integrates multiscale local and global information to improve detection accuracy. In the proposed method, we first aggregate multilevel convolutional feature maps extracted by the encoder to enrich the feature representations and improve the ability of the model to locate multiscale forged areas. Then, we design a residual attention block (RAB) to purify the features, which enhances the response of task-related regions and suppresses noise information. Furthermore, a global feature mining block (GFMB) is proposed to capture the long-range dependencies between different regions of the image, enabling the model to handle complex tampering scenarios effectively. The multiscale splicing forgery regions are precisely detected and located by utilizing the proposed method. The extensive experiments are conducted on three benchmark datasets, CASIA, COLUMB, and NIST'16. Specifically, our model achieves the F1 score of 84.3%, 87.9%, and 80.8% on CASIA, COLUMB, and NIST'16 test sets, respectively, outperforming state-of-the-art methods.
KW - Global contextual information
KW - image splicing forgery
KW - multilevel convolutional features
KW - multiscale information
KW - residual attention
UR - http://www.scopus.com/inward/record.url?scp=85166757616&partnerID=8YFLogxK
U2 - 10.1109/TIM.2023.3300434
DO - 10.1109/TIM.2023.3300434
M3 - 文章
AN - SCOPUS:85166757616
SN - 0018-9456
VL - 72
JO - IEEE Transactions on Instrumentation and Measurement
JF - IEEE Transactions on Instrumentation and Measurement
M1 - 5026315
ER -