3D Human Target Tracking and Localization Based on Millimeter Wave Radar and Visual Fusion

Haochen Chai, Zhenghao Zou, Chunhui Zhao, Quan Pan, Yang Lyu

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

In recent years, 3D object detection has become an important component in the fields of autonomous driving and mobile robots. Current vision-based methods may fail to achieving reliable positioning of a 3D object due to the sensing limitations of a camera sensor. In this paper, we consider a more practical object perception pipeline using combined information from both a monocular camera and a 4D millimeter-wave radar (MMWR). Initially, the human body is detected in the 2D image plane of camera to aid the human body segmentation in 4D radar point clouds. Then the detection results from both the camera and the MMWR, including the doppler velocity of the point cloud, are used as measurement to feed an Kalman filter estimator backend to realize the rapid localization of human targets.

源语言英语
主期刊名Proceedings of 3rd International Conference on Autonomous Unmanned Systems, ICAUS 2023 - Volume 7
编辑Yi Qu, Mancang Gu, Yifeng Niu, Wenxing Fu
出版商Springer Science and Business Media Deutschland GmbH
392-402
页数11
ISBN(印刷版)9789819711024
DOI
出版状态已出版 - 2024
活动3rd International Conference on Autonomous Unmanned Systems, ICAUS 2023 - Nanjing, 中国
期限: 9 9月 202311 9月 2023

出版系列

姓名Lecture Notes in Electrical Engineering
1177 LNEE
ISSN(印刷版)1876-1100
ISSN(电子版)1876-1119

会议

会议3rd International Conference on Autonomous Unmanned Systems, ICAUS 2023
国家/地区中国
Nanjing
时期9/09/2311/09/23

指纹

探究 '3D Human Target Tracking and Localization Based on Millimeter Wave Radar and Visual Fusion' 的科研主题。它们共同构成独一无二的指纹。

引用此