Dense light field reconstruction based on epipolar focus spectrum

Yaning Li, Xue Wang, Hao Zhu, Guoqing Zhou, Qing Wang

科研成果: 期刊稿件文章同行评审

4 引用 (Scopus)

摘要

Existing light field (LF) representations, such as epipolar plane image (EPI) and sub-aperture images, do not consider the structural characteristics across the views, so they usually require additional disparity and spatial structure cues for follow-up tasks. Besides, they have difficulties dealing with occlusions or large disparity scenes. To this end, this paper proposes a novel Epipolar Focus Spectrum (EFS) representation by rearranging the EPI spectrum. Different from the classical EPI representation where an EPI line corresponds to a specific depth, there is a one-to-one mapping from the EFS line to the view. By exploring the EFS sampling task, the analytical function is derived for constructing a non-aliasing EFS. To demonstrate its effectiveness, we develop a trainable EFS-based pipeline for light field reconstruction, where a dense light field can be reconstructed by compensating the missing EFS lines given a sparse light field, yielding promising results with cross-view consistency, especially in the presence of severe occlusion and large disparity. Experimental results on both synthetic and real-world datasets demonstrate the validity and superiority of the proposed method over SOTA methods.

源语言英语
文章编号109551
期刊Pattern Recognition
140
DOI
出版状态已出版 - 8月 2023

指纹

探究 'Dense light field reconstruction based on epipolar focus spectrum' 的科研主题。它们共同构成独一无二的指纹。

引用此