Light field camera self-calibration and registration

The multi-view light fields (MVLF) provide new solutions to the existing problems in monocular light field, such as the limited field of view. However as key steps in MVLF, the calibration and registration have been limited studied. In this paper, we propose a method to calibrate the camera and register different LFs without the checkboard at the same time, which we call the self-calibrating method. We model the LF structure as a 5-parameter two-parallel-plane (2PP) model, then represent the associations between rays and reconstructed points as a 3D projective transformation. With the constraints of ray-ray correspondences in different LFs, the parameters can be solved with a linear initialization and a nonlinear refinement. The result in real scene and 3D point clouds registration error of MVLF in simulated data verify the high performance of the proposed model.