Research on Somatosensory Interaction Based on Convolutional Neural Network

Somatosensory interaction is an important part of human-computer interaction. The core of somatosensory interaction must accurately obtain the 3D spatial information of the human body. This article uses an RGBD camera to acquire both color and depth images. We Perform 2D human pose estimation in color images using hourglass network with residual structure. At the same time, we use the sparse feature points to align the color map with the depth map in order to accurately map the detection results in color images to the corresponding depth images. The experimental results show that this method can accurately and quickly obtain the 3-dimensional posture information of the human body, which is an important guarantee for somatosensory interaction.