Disparity estimation for focused light field camera using cost aggregation in micro-images

Unlike conventional light field camera that records spatial and angular information explicitly, the focused light field camera implicitly collects angular samplings in microimages behind the micro-lens array. Without directly decoded sub-Apertures, it is difficult to estimate disparity for focused light field camera. On the other hand, disparity estimation is a critical step for sub-Aperture rendering from raw image. It is hence a typical 'chicken-And-egg' problem. In this paper we propose a two-stage method for disparity estimation from the raw image. Compared with previous approaches which treat all pixels in a micro-image as a same disparity label, a segmentation-Tree based cost aggregation is introduced to provide a more robust disparity estimation for each pixel, which optimizes the disparity of low-Texture areas and yields sharper occlusion boundaries. After sub-Apertures are rendered from the raw image using initial estimation, the optimal one is globally regularized using the reference sub-Aperture image. Experimental results on real scene datasets have demonstrated advantages of our method over previous work, especially in low-Texture areas and occlusion boundaries.