跳到主要导航 跳到搜索 跳到主要内容

Weakly-Supervised Salient Object Detection via Scribble Annotations

  • Jing Zhang
  • , Xin Yu
  • , Aixuan Li
  • , Peipei Song
  • , Bowen Liu
  • , Yuchao Dai
  • Australian National University
  • ACRV
  • CSIRO
  • University of Technology Sydney
  • Northwestern Polytechnical University Xian

科研成果: 期刊稿件 › 会议文章 › 同行评审

346 引用 (Scopus)

摘要

Compared with laborious pixel-wise dense labeling, it is much easier to label data by scribbles, which only costs 1~2 seconds to label one image. However, using scribble labels to learn salient object detection has not been explored. In this paper, we propose a weakly-supervised salient object detection model to learn saliency from such annotations. In doing so, we first relabel an existing large-scale salient object detection dataset with scribbles, namely S-DUTS dataset. Since object structure and detail information is not identified by scribbles, directly training with scribble labels will lead to saliency maps of poor boundary localization. To mitigate this problem, we propose an auxiliary edge detection task to localize object edges explicitly, and a gated structure-Aware loss to place constraints on the scope of structure to be recovered. Moreover, we design a scribble boosting scheme to iteratively consolidate our scribble annotations, which are then employed as supervision to learn high-quality saliency maps. As existing saliency evaluation metrics neglect to measure structure alignment of the predictions, the saliency map ranking may not comply with human perception. We present a new metric, termed saliency structure measure, as a complementary metric to evaluate sharpness of the prediction. Extensive experiments on six benchmark datasets demonstrate that our method not only outperforms existing weakly-supervised/unsupervised methods, but also is on par with several fully-supervised state-of-The-Art models (Our code and data is publicly available at: https://github.com/JingZhang617/Scribble Saliency).

源语言英语
期刊论文编号9157788
页(从-至)12543-12552
页数10
期刊Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
DOI
出版状态已出版 - 2020
活动2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020 - Virtual, Online, 美国
期限: 14 6月 2020 → 19 6月 2020

学术指纹

探究 'Weakly-Supervised Salient Object Detection via Scribble Annotations' 的科研主题。它们共同构成独一无二的学术指纹。

引用此