Research on target detection method based on attention mechanism and reinforcement learning

Quanhu Wang, Chenxi Xu, Hongwei Du, Yuxuan Liu, Yang Liu, Yujia Fu, Kai Li, Haobin Shi

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The development of intelligent manufacturing promotes the intellectualization of traditional navigation technology. Because actor-critic (AC) algorithm is difficult to converge in the actual application process, this paper uses the optimization algorithm of this method, which is called deep deterministic policy gradient (DDPG). Through the use of experience playback and dual network design, the learning rate can be greatly improved compared with the original algorithm. Because curiosity strategy has more advantages in alleviating sparse reward problem, this paper also takes curiosity mechanism as an internal reward exploration strategy and proposes the DDPG method based on improved curiosity mechanism to solve the problem that robots lack external reward in some complex environments and tasks cannot be completed. The simulation and real experiment results show that the proposed method is more stable when completing the navigation task and performs well in the long-distance autonomous navigation task.

Original languageEnglish
Title of host publicationInternational Conference on Artificial Intelligence, Virtual Reality, and Visualization, AIVRV 2022
EditorsYuanchang Zhong, Chuanjun Zhao
PublisherSPIE
ISBN (Electronic)9781510662988
DOIs
StatePublished - 2023
Event2022 International Conference on Artificial Intelligence, Virtual Reality, and Visualization, AIVRV 2022 - Chongqing, China
Duration: 23 Sep 202225 Sep 2022

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12588
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference2022 International Conference on Artificial Intelligence, Virtual Reality, and Visualization, AIVRV 2022
Country/TerritoryChina
CityChongqing
Period23/09/2225/09/22

Keywords

  • actor-critic architecture
  • autonomous navigation
  • Curiosity mechanism

Fingerprint

Dive into the research topics of 'Research on target detection method based on attention mechanism and reinforcement learning'. Together they form a unique fingerprint.

Cite this