Research on Informative Path Planning Using Deep Reinforcement learning

Wajid Iqbal, Bo Li, Amirreza Rouhbakhshmeghrazi

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Efficient data gathering is important for mapping and surveilling for many applications on the Earth's surface. In large-area monitoring situations, executing a crew of Unmanned Aerial Vehicles (UAVs) provides enhanced spatial coverage and reliability against individual malfunctions. Yet, a major obstacle is developing cooperative path-planning strategies that allow UAVs to accomplish a collaborative mission objective. We present a new Multi-Agent Deep Reinforcement Learning-based (MARL) informative path planning approach for adjustable landscape surveilling using UAV crews. Our approach presents innovative network representations facilitating effective path planning in 3D workspaces. By utilizing a counterfactual baseline, our method effectively resolves the problem of credit assignment to learn cooperative behavior. Our findings demonstrate that enhanced planning performance. Experimental results show that our method outclasses other non-learning-based techniques while generalizing well to various team sizes and communication scenarios.

Original languageEnglish
Title of host publication2024 International Conference on Cyber-Physical Social Intelligence, ICCSI 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350376739
DOIs
StatePublished - 2024
Event2024 International Conference on Cyber-Physical Social Intelligence, ICCSI 2024 - Doha, Qatar
Duration: 8 Nov 202412 Nov 2024

Publication series

Name2024 International Conference on Cyber-Physical Social Intelligence, ICCSI 2024

Conference

Conference2024 International Conference on Cyber-Physical Social Intelligence, ICCSI 2024
Country/TerritoryQatar
CityDoha
Period8/11/2412/11/24

Keywords

  • cooperative mission planning
  • deep reinforcement learning
  • generalization ability
  • multi-agent reinforcement learning
  • path planning
  • UAVs

Fingerprint

Dive into the research topics of 'Research on Informative Path Planning Using Deep Reinforcement learning'. Together they form a unique fingerprint.

Cite this