An Intelligent Penetration Guidance Law Based on DDPG for Hypersonic Vehicle

Rongyi Guo, Yibo Ding, Xiaokui Yue

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

A novel intelligent guidance law based on Deep Deterministic Policy Gradient (DDPG) is devised in this paper to deal with problems of penetration for hypersonic boost glide vehicle (HBGV). Firstly, an agent based on DDPG algorithm is designed by setting a model of Markov decision process. Interacting with environment, the agent is trained to produce continuous overload command to avoid interception by one interceptor and ensure successful penetration for HBGV. Compared with traditional penetration guidance law, the new guidance law can intelligently deal with the complex offensive and defensive game problem. In addition, the designed reward of agent avoids excessive overloading which can save energy of HBGV. Finally, simulations are carried out, which prove that the guidance law enables HBGV to avoid interception by interceptor. The results in different test scenarios also illustrate that the intelligent guidance law has great generalization ability which can meet need of penetration in other offensive and defensive situations.

Original languageEnglish
Title of host publicationComputational and Experimental Simulations in Engineering - Proceedings of ICCES 2023—Volume 3
EditorsShaofan Li
PublisherSpringer Science and Business Media B.V.
Pages1349-1361
Number of pages13
ISBN (Print)9783031449468
DOIs
StatePublished - 2024
Event29th International Conference on Computational and Experimental Engineering and Sciences, ICCES 2023 - Shenzhen, China
Duration: 26 May 202329 May 2023

Publication series

NameMechanisms and Machine Science
Volume146
ISSN (Print)2211-0984
ISSN (Electronic)2211-0992

Conference

Conference29th International Conference on Computational and Experimental Engineering and Sciences, ICCES 2023
Country/TerritoryChina
CityShenzhen
Period26/05/2329/05/23

Keywords

  • DDPG
  • Guidance law
  • Hypersonic boost glide vehicle
  • Penetration
  • Reinforcement learning

Fingerprint

Dive into the research topics of 'An Intelligent Penetration Guidance Law Based on DDPG for Hypersonic Vehicle'. Together they form a unique fingerprint.

Cite this