TY - JOUR
T1 - WeGAN
T2 - Deep Image Hashing with Weighted Generative Adversarial Networks
AU - Wang, Yuebin
AU - Zhang, Liqiang
AU - Nie, Feiping
AU - Li, Xingang
AU - Chen, Zhijun
AU - Wang, Faqiang
N1 - Publisher Copyright:
© 1999-2012 IEEE.
PY - 2020/6
Y1 - 2020/6
N2 - Image hashing has been widely used in image retrieval tasks. Many existing methods generate hashing codes based on image feature representations. They rarely consider the rich information such as image clustering information contained in the image set as well as uncertain relationships between images and tags simultaneously. In this paper, we develop a Weighted Generative Adversarial Networks (WeGAN) to transfer the clustering information of images to construct the hashing code. WeGAN consists three modules: 1) a hashing learning process for transferring knowledge of the image set to hashing codes of single images; 2) by means of hashing codes, a module to generate image content, tag representation, and their joint information which reflects the correlation between the image and the corresponding tags; 3) a discriminator to distinguish the generated data from the original source, and then formulating three loss functions. Different weights are assigned to these loss functions in order to deal with the uncertainties between images and tags. Through introducing the image set to process the image hashing with different tags, WeGAN can naturally provide the information of clustering results, which is useful for image hashing with multi-tags. The generated hashing code has the ability to dynamically process the uncertain relationships between images and tags. Experiments on three challenging datasets show that WeGAN outperforms the state-of-the-art methods.
AB - Image hashing has been widely used in image retrieval tasks. Many existing methods generate hashing codes based on image feature representations. They rarely consider the rich information such as image clustering information contained in the image set as well as uncertain relationships between images and tags simultaneously. In this paper, we develop a Weighted Generative Adversarial Networks (WeGAN) to transfer the clustering information of images to construct the hashing code. WeGAN consists three modules: 1) a hashing learning process for transferring knowledge of the image set to hashing codes of single images; 2) by means of hashing codes, a module to generate image content, tag representation, and their joint information which reflects the correlation between the image and the corresponding tags; 3) a discriminator to distinguish the generated data from the original source, and then formulating three loss functions. Different weights are assigned to these loss functions in order to deal with the uncertainties between images and tags. Through introducing the image set to process the image hashing with different tags, WeGAN can naturally provide the information of clustering results, which is useful for image hashing with multi-tags. The generated hashing code has the ability to dynamically process the uncertain relationships between images and tags. Experiments on three challenging datasets show that WeGAN outperforms the state-of-the-art methods.
KW - generative adversarial networks
KW - Image hashing
KW - image set
KW - uncertainties between images and tags
UR - http://www.scopus.com/inward/record.url?scp=85085598876&partnerID=8YFLogxK
U2 - 10.1109/TMM.2019.2947197
DO - 10.1109/TMM.2019.2947197
M3 - 文章
AN - SCOPUS:85085598876
SN - 1520-9210
VL - 22
SP - 1458
EP - 1469
JO - IEEE Transactions on Multimedia
JF - IEEE Transactions on Multimedia
IS - 6
M1 - 8867954
ER -