TY - GEN
T1 - Heterogeneous Multi-Agent Reinforcement Learning for Joint Active and Passive Beamforming in IRS Assisted Communications
AU - Gao, Ang
AU - Sun, Xinshun
AU - Xu, Yongshuai
AU - Liang, Wei
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Ahstract-The Intelligent Reflecting Surface (IRS) has the potential to reconstruct the electromagnetic propagation environment, paving the way for a new multi-IRS assisted communications paradigm that beams scattered signals for improved spectrum efficiency (SE). However, accurate channel estimation and sharing becomes a challenge when a large number of IRS elements are involved, leading to extra hardware complexity and communication overhead. Moreover, due to the cross-interference caused by massive reflecting paths when multiple IRSs are introduced, SE optimization becomes challenging to achieve a close-formed solution because of non-convexity. This paper improves a heterogeneous based multi-agent deep deterministic policy gradient (MADDPG) approach for joint active and passive beamforming optimization without channel estimation, where base station (BS) and multiple IRSs cooperatively learn to enhance SE and suppress the interference. Due to the centralized-training and distributed-execution feature of MADDPG, the well-trained BS and IRSs can execute both the active and passive beamforming optimization independently without referring to other agents, which can greatly reduce the communication overhead and simplify the IRS deployment. Numeral simulations demonstrate the effectiveness of the proposed approach on enhancing SE and suppressing interference in the multi-IRS assisted communications system.
AB - Ahstract-The Intelligent Reflecting Surface (IRS) has the potential to reconstruct the electromagnetic propagation environment, paving the way for a new multi-IRS assisted communications paradigm that beams scattered signals for improved spectrum efficiency (SE). However, accurate channel estimation and sharing becomes a challenge when a large number of IRS elements are involved, leading to extra hardware complexity and communication overhead. Moreover, due to the cross-interference caused by massive reflecting paths when multiple IRSs are introduced, SE optimization becomes challenging to achieve a close-formed solution because of non-convexity. This paper improves a heterogeneous based multi-agent deep deterministic policy gradient (MADDPG) approach for joint active and passive beamforming optimization without channel estimation, where base station (BS) and multiple IRSs cooperatively learn to enhance SE and suppress the interference. Due to the centralized-training and distributed-execution feature of MADDPG, the well-trained BS and IRSs can execute both the active and passive beamforming optimization independently without referring to other agents, which can greatly reduce the communication overhead and simplify the IRS deployment. Numeral simulations demonstrate the effectiveness of the proposed approach on enhancing SE and suppressing interference in the multi-IRS assisted communications system.
KW - Intelligent Reflecting Surface
KW - Multi-Agent Deep Deterministic Policy Gradient
KW - Passive Beam-forming
UR - http://www.scopus.com/inward/record.url?scp=85162621264&partnerID=8YFLogxK
U2 - 10.1109/WOCC58016.2023.10139667
DO - 10.1109/WOCC58016.2023.10139667
M3 - 会议稿件
AN - SCOPUS:85162621264
T3 - 32nd Wireless and Optical Communications Conference, WOCC 2023
BT - 32nd Wireless and Optical Communications Conference, WOCC 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 32nd Wireless and Optical Communications Conference, WOCC 2023
Y2 - 5 May 2023 through 6 May 2023
ER -