An improved approach towards multi-agent pursuit–evasion game decision-making using deep reinforcement learning

Kaifang Wan, Dingwei Wu, Yiwei Zhai, Bo Li, Xiaoguang Gao, Zijian Hu

Research output: Contribution to journalArticlepeer-review

44 Scopus citations

Abstract

A pursuit–evasion game is a classical maneuver confrontation problem in the multi-agent systems (MASs) domain. An online decision technique based on deep reinforcement learning (DRL) was developed in this paper to address the problem of environment sensing and decision-making in pursuit–evasion games. A control-oriented framework developed from the DRL-based multi-agent deep deterministic policy gradient (MADDPG) algorithm was built to implement multi-agent cooperative decision-making to overcome the limitation of the tedious state variables required for the traditionally complicated modeling process. To address the effects of errors between a model and a real scenario, this paper introduces adversarial disturbances. It also proposes a novel adversarial attack trick and adversarial learning MADDPG (A2-MADDPG) algorithm. By introducing an adversarial attack trick for the agents themselves, uncertainties of the real world are modeled, thereby optimizing robust training. During the training process, adversarial learning was incorporated into our algorithm to preprocess the actions of multiple agents, which enabled them to properly respond to uncertain dynamic changes in MASs. Experimental results verified that the proposed approach provides superior performance and effectiveness for pursuers and evaders, and both can learn the corresponding confrontational strategy during training.

Original languageEnglish
Article number1433
JournalEntropy
Volume23
Issue number11
DOIs
StatePublished - Nov 2021

Keywords

  • Adversarial learning
  • Decision-making
  • Deep reinforcement learning
  • MADDPG
  • Multi-agent
  • Pursuit–evasion

Fingerprint

Dive into the research topics of 'An improved approach towards multi-agent pursuit–evasion game decision-making using deep reinforcement learning'. Together they form a unique fingerprint.

Cite this