3D Human Target Tracking and Localization Based on Millimeter Wave Radar and Visual Fusion

Haochen Chai, Zhenghao Zou, Chunhui Zhao, Quan Pan, Yang Lyu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In recent years, 3D object detection has become an important component in the fields of autonomous driving and mobile robots. Current vision-based methods may fail to achieving reliable positioning of a 3D object due to the sensing limitations of a camera sensor. In this paper, we consider a more practical object perception pipeline using combined information from both a monocular camera and a 4D millimeter-wave radar (MMWR). Initially, the human body is detected in the 2D image plane of camera to aid the human body segmentation in 4D radar point clouds. Then the detection results from both the camera and the MMWR, including the doppler velocity of the point cloud, are used as measurement to feed an Kalman filter estimator backend to realize the rapid localization of human targets.

Original languageEnglish
Title of host publicationProceedings of 3rd International Conference on Autonomous Unmanned Systems, ICAUS 2023 - Volume 7
EditorsYi Qu, Mancang Gu, Yifeng Niu, Wenxing Fu
PublisherSpringer Science and Business Media Deutschland GmbH
Pages392-402
Number of pages11
ISBN (Print)9789819711024
DOIs
StatePublished - 2024
Event3rd International Conference on Autonomous Unmanned Systems, ICAUS 2023 - Nanjing, China
Duration: 9 Sep 202311 Sep 2023

Publication series

NameLecture Notes in Electrical Engineering
Volume1177 LNEE
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119

Conference

Conference3rd International Conference on Autonomous Unmanned Systems, ICAUS 2023
Country/TerritoryChina
CityNanjing
Period9/09/2311/09/23

Keywords

  • 3D object tracking
  • Kalman filter
  • Millimeter wave Radar
  • Monocular camera
  • YOLOv8

Fingerprint

Dive into the research topics of '3D Human Target Tracking and Localization Based on Millimeter Wave Radar and Visual Fusion'. Together they form a unique fingerprint.

Cite this