Method of visual and infrared fusion for moving object detection

A method based on low rank and sparse decomposition is proposed for moving object detection by the fusion of visual and infrared video. The visual and infrared image sequences are decomposed into the joint low rank background term, the uncorrelated sparse moving nonobject term, and the common sparse moving object term via a joint minimization cost of nuclear norm, F norm, and l1 norm. This method provides a flexible framework that can easily fuse information from visual and infrared video. The prior fusion strategies are not required. The complementary information on visual and infrared images can be naturally fused in the procedure of object detection. The experimental results show that the proposed algorithm is effective.