Facial expression recognition based on spatial transformer siamese networks

As the development of the computer vision, we could employ the facial expressions recognition technique in the human-computer interaction domain, such as chatting robot, psychological counselling robot and so on. In this paper, we propose a novel method to jointly learn the facial expression features based the combination of Siamese networks and spatial transformer networks. We posit that learning the features from both networks may make them more robust to the image variation especially illumination and viewpoint variation. Particularly, we construct the structure of the Spatial Transformer Siamese Networks(STSN) and learn the features robust to the facial expression image variation. The experimental results show that the proposed method outperforms the-state-of-art method on the MDLTI-PIE dataset.