Weakly Supervised Object Detection Using Proposal- and Semantic-Level Relationships

Dingwen Zhang, Wenyuan Zeng, Jieru Yao, Junwei Han

Research output: Contribution to journalArticlepeer-review

95 Scopus citations

Abstract

In recent years, weakly supervised object detection has attracted great attention in the computer vision community. Although numerous deep learning-based approaches have been proposed in the past few years, such an ill-posed problem is still challenging and the learning performance is still behind the expectation. In fact, most of the existing approaches only consider the visual appearance of each proposal region but ignore to make use of the helpful context information. To this end, this paper introduces two levels of context into the weakly supervised learning framework. The first one is the proposal-level context, i.e., the relationship of the spatially adjacent proposals. The second one is the semantic-level context, i.e., the relationship of the co-occurring object categories. Therefore, the proposed weakly supervised learning framework contains not only the cognition process on the visual appearance but also the reasoning process on the proposal- and semantic-level relationships, which leads to the novel deep multiple instance reasoning framework. Specifically, built upon a conventional CNN-based network architecture, the proposed framework is equipped with two additional graph convolutional network-based reasoning models to implement object location reasoning and multi-label reasoning within an end-to-end network training procedure. Comprehensive experiments on the widely used PASCAL VOC and MS COCO benchmarks have been implemented, which demonstrate the superior capacity of the proposed approach when compared with other state-of-the-art methods and baseline models.

Original languageEnglish
Pages (from-to)3349-3363
Number of pages15
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume44
Issue number6
DOIs
StatePublished - 1 Jun 2022

Keywords

  • Weakly supervised object detection
  • graphical convolutional network
  • multiple-instance learning

Fingerprint

Dive into the research topics of 'Weakly Supervised Object Detection Using Proposal- and Semantic-Level Relationships'. Together they form a unique fingerprint.

Cite this