Interactive object-based image retrieval and annotation on iPad

Junwei Han, Ming Xu, Xin Li, Lei Guo, Tianming Liu

Research output: Contribution to journalArticlepeer-review

10 Scopus citations

Abstract

Apple iPad is a portable tablet computer that offers users a generic platform for consumer media including games, books, and movies. Though iPad is gaining popularity very quickly, its application in content-based image retrieval and annotation is still in its infancy. This paper aims to develop an interactive system to efficiently retrieve and annotate image objects on iPad, which mainly consists of two components of the front-end GUI (graphical user interface) and the back-end retrieval model. In the first component, an iPad-based GUI is implemented, which can provide users with an efficient way to select query objects and facilitate annotations. In the second component, we propose an object-based image retrieval algorithm that combines a novel feature descriptor based on context-preserving bags-of-words (BoW) and a two-stage re-ranking technique to measure the similarity between the query image and each image in the database. The retrieval results are returned and visualized on the iPad-based GUI, and annotations offered by users can be propagated among them. The communication between the front-end GUI and the back-end module is through the use of wireless networks. Comprehensive experiments on several benchmark datasets demonstrated the effectiveness of the proposed framework.

Original languageEnglish
Pages (from-to)2275-2297
Number of pages23
JournalMultimedia Tools and Applications
Volume72
Issue number3
DOIs
StatePublished - Oct 2014

Keywords

  • iPad
  • Multi-Touch
  • Object Retrieval and Annotation
  • Spatial Context
  • Visual Bag-of-Words

Fingerprint

Dive into the research topics of 'Interactive object-based image retrieval and annotation on iPad'. Together they form a unique fingerprint.

Cite this