Multi-Pursuer Multi-Target Encirclement Strategy Based on Multi-Agent Deep Deterministic Policy Gradient

Xuanyu Luo, Chuang Liu, Xiaokui Yue, Chenhao Ouyang

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

This paper proposes a multi-pursuer multi-target encirclement approach based on multi-agent deep deterministic policy gradient (MADDPG) algorithm, within the context of orbital game for satellite swarms. First, the multiconstraint impulsive orbital game model between the satellite swarm and non-cooperative targets is established using the CW equation and game theory. Then, through analyzing the orbital game process and integrating the Markov decision process (MDP), the MDP model between the multi-pursuer and multi-target encirclement game is developed. A corresponding reward function is designed and the training process of the network based on the MADDPG algorithm is examined for the orbital game mission. Finally, the MADDPG algorithm is applied to solve a typical multi-target orbital game problem, and comparisons with traditional numerical algorithms are performed, which demonstrates the effectiveness and feasibility in multi-target encirclement game for satellite swarms.

源语言英语
主期刊名IAF Space Operations Symposium - Held at the 75th International Astronautical Congress, IAC 2024
出版商International Astronautical Federation, IAF
785-791
页数7
ISBN(电子版)9798331312183
DOI
出版状态已出版 - 2024
活动2024 IAF Space Operations Symposium at the 75th International Astronautical Congress, IAC 2024 - Milan, 意大利
期限: 14 10月 202418 10月 2024

出版系列

姓名Proceedings of the International Astronautical Congress, IAC
ISSN(印刷版)0074-1795

会议

会议2024 IAF Space Operations Symposium at the 75th International Astronautical Congress, IAC 2024
国家/地区意大利
Milan
时期14/10/2418/10/24

指纹

探究 'Multi-Pursuer Multi-Target Encirclement Strategy Based on Multi-Agent Deep Deterministic Policy Gradient' 的科研主题。它们共同构成独一无二的指纹。

引用此