TY - GEN
T1 - An Intelligent Penetration Guidance Law Based on DDPG for Hypersonic Vehicle
AU - Guo, Rongyi
AU - Ding, Yibo
AU - Yue, Xiaokui
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
PY - 2024
Y1 - 2024
N2 - A novel intelligent guidance law based on Deep Deterministic Policy Gradient (DDPG) is devised in this paper to deal with problems of penetration for hypersonic boost glide vehicle (HBGV). Firstly, an agent based on DDPG algorithm is designed by setting a model of Markov decision process. Interacting with environment, the agent is trained to produce continuous overload command to avoid interception by one interceptor and ensure successful penetration for HBGV. Compared with traditional penetration guidance law, the new guidance law can intelligently deal with the complex offensive and defensive game problem. In addition, the designed reward of agent avoids excessive overloading which can save energy of HBGV. Finally, simulations are carried out, which prove that the guidance law enables HBGV to avoid interception by interceptor. The results in different test scenarios also illustrate that the intelligent guidance law has great generalization ability which can meet need of penetration in other offensive and defensive situations.
AB - A novel intelligent guidance law based on Deep Deterministic Policy Gradient (DDPG) is devised in this paper to deal with problems of penetration for hypersonic boost glide vehicle (HBGV). Firstly, an agent based on DDPG algorithm is designed by setting a model of Markov decision process. Interacting with environment, the agent is trained to produce continuous overload command to avoid interception by one interceptor and ensure successful penetration for HBGV. Compared with traditional penetration guidance law, the new guidance law can intelligently deal with the complex offensive and defensive game problem. In addition, the designed reward of agent avoids excessive overloading which can save energy of HBGV. Finally, simulations are carried out, which prove that the guidance law enables HBGV to avoid interception by interceptor. The results in different test scenarios also illustrate that the intelligent guidance law has great generalization ability which can meet need of penetration in other offensive and defensive situations.
KW - DDPG
KW - Guidance law
KW - Hypersonic boost glide vehicle
KW - Penetration
KW - Reinforcement learning
UR - http://www.scopus.com/inward/record.url?scp=85184110270&partnerID=8YFLogxK
U2 - 10.1007/978-3-031-44947-5_101
DO - 10.1007/978-3-031-44947-5_101
M3 - 会议稿件
AN - SCOPUS:85184110270
SN - 9783031449468
T3 - Mechanisms and Machine Science
SP - 1349
EP - 1361
BT - Computational and Experimental Simulations in Engineering - Proceedings of ICCES 2023—Volume 3
A2 - Li, Shaofan
PB - Springer Science and Business Media B.V.
T2 - 29th International Conference on Computational and Experimental Engineering and Sciences, ICCES 2023
Y2 - 26 May 2023 through 29 May 2023
ER -