TY - GEN
T1 - Space target docking ring recognition and center point positioning based on Tiny Darknet YOLOv3 fusion CenterNet
AU - Cao, Shuqing
AU - Luo, Jianjun
AU - Wang, Guopeng
AU - Tan, Longyu
AU - Pan, Han
N1 - Publisher Copyright:
© 2023 SPIE.
PY - 2023
Y1 - 2023
N2 - Aiming at the visual measurement requirements of space manipulators for grasping non-cooperative targets, a space target docking ring recognition and center point positioning method based on Tiny Darknet YOLOv3 fusion CenterNet is proposed. First, training network model based on open source ImageNet VOC 2007 and self-built spatial non-cooperative target data set and use optimized Tiny Darknet YOLOv3 fusion CenterNet deep learning algorithm to identify space target docking and obtain two-dimensional pixel coordinates of the docking center point; secondly, using the EnsensoN10-408-18 depth camera to obtain the 3*3 neighborhood data of the depth value corresponding to the center point and calculate the neighborhood weighted optimal value to get docking center spatial coordinates in the camera coordinate system. Combined with the hand-eye calibration relationship, the docking center spatial coordinates are converted to the UR5 manipulator base coordinate system. A ground verification system for manipulator to capture the target was built to test the target docking ring identification and center point positioning, and the accuracy error evaluation is completed based on the OptiTrack motion capture global measurement benchmark system. The experimental results show that target positioning accuracy is better than 10mm, and real-time data update rate is better than 2Hz in the dynamic approximation process from 1.5m to 0.2m, which can effectively solve the slow speed and poor accuracy caused by the influence of environmental lighting, target surface material, target attitude scale changes and other factors in traditional feature extraction methods. It lays a foundation for the safe arrival, capture and other manipulator fine operations.
AB - Aiming at the visual measurement requirements of space manipulators for grasping non-cooperative targets, a space target docking ring recognition and center point positioning method based on Tiny Darknet YOLOv3 fusion CenterNet is proposed. First, training network model based on open source ImageNet VOC 2007 and self-built spatial non-cooperative target data set and use optimized Tiny Darknet YOLOv3 fusion CenterNet deep learning algorithm to identify space target docking and obtain two-dimensional pixel coordinates of the docking center point; secondly, using the EnsensoN10-408-18 depth camera to obtain the 3*3 neighborhood data of the depth value corresponding to the center point and calculate the neighborhood weighted optimal value to get docking center spatial coordinates in the camera coordinate system. Combined with the hand-eye calibration relationship, the docking center spatial coordinates are converted to the UR5 manipulator base coordinate system. A ground verification system for manipulator to capture the target was built to test the target docking ring identification and center point positioning, and the accuracy error evaluation is completed based on the OptiTrack motion capture global measurement benchmark system. The experimental results show that target positioning accuracy is better than 10mm, and real-time data update rate is better than 2Hz in the dynamic approximation process from 1.5m to 0.2m, which can effectively solve the slow speed and poor accuracy caused by the influence of environmental lighting, target surface material, target attitude scale changes and other factors in traditional feature extraction methods. It lays a foundation for the safe arrival, capture and other manipulator fine operations.
KW - center point positioning
KW - CenterNet
KW - docking ring recognition
KW - hand-eye calibration
KW - Tiny Darknet YOLOv3
UR - http://www.scopus.com/inward/record.url?scp=85148103440&partnerID=8YFLogxK
U2 - 10.1117/12.2647668
DO - 10.1117/12.2647668
M3 - 会议稿件
AN - SCOPUS:85148103440
T3 - Proceedings of SPIE - The International Society for Optical Engineering
BT - AOPC 2022
A2 - Jiang, Yadong
A2 - Wang, Xiaoyong
A2 - Wang, Yongtian
A2 - Liu, Dong
A2 - Xue, Bin
PB - SPIE
T2 - 2022 Applied Optics and Photonics China: Optical Sensing, Imaging, and Display Technology, AOPC 2022
Y2 - 18 December 2022 through 19 December 2022
ER -