Layered RGBD scene flow estimation with global non-rigid local rigid assumption

Xiuxiu Li, Yanjuan Liu, Haiyan Jin, Lei Cai, Jiangbin Zheng

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

RGBD scene flow has attracted increasing attention in the computer vision community with the popularity of depth sensor. To accurately estimate three-dimensional motion of object, a layered scene flow estimation with global non-rigid, local rigid motion assumption is presented in this paper. Firstly, depth image is inpainted based on RGB image due to original depth image contains noises. Secondly, depth image is layered according to K-means clustering algorithm, which can quickly and simply layer the depth image. Thirdly, scene flow is estimated based on the assumption we proposed. Finally, experiments are implemented on RGBD tracking dataset and deformable 3D reconstruction dataset, and the analysis of quantitative indicators, RMS (Root Mean Square error) and AAE (Average Angular Error). The results show that the proposed method can distinguish moving regions from the static background better, and more accurately estimate the motion information of the scene by comparing with the global rigid, local non-rigid assumption.

Original languageEnglish
Title of host publicationAdvances in Brain Inspired Cognitive Systems - 10th International Conference, BICS 2019, Proceedings
EditorsJinchang Ren, Amir Hussain, Huimin Zhao, Jun Cai, Rongjun Chen, Yinyin Xiao, Kaizhu Huang, Jiangbin Zheng
PublisherSpringer
Pages224-232
Number of pages9
ISBN (Print)9783030394301
DOIs
StatePublished - 2020
Event10th International Conference on Brain Inspired Cognitive Systems, BICS 2019 - Guangzhou, China
Duration: 13 Jul 201914 Jul 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11691 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference10th International Conference on Brain Inspired Cognitive Systems, BICS 2019
Country/TerritoryChina
CityGuangzhou
Period13/07/1914/07/19

Keywords

  • Global non-rigid
  • Local rigid
  • RGBD image
  • Scene flow

Fingerprint

Dive into the research topics of 'Layered RGBD scene flow estimation with global non-rigid local rigid assumption'. Together they form a unique fingerprint.

Cite this