TY - JOUR
T1 - Simplifying communication control
T2 - a cooperative multi-agent reinforcement learning framework based on group decision-making
AU - Wang, Quantao
AU - He, Ziming
AU - Shi, Haobin
N1 - Publisher Copyright:
© The Author(s) 2025.
PY - 2025/12
Y1 - 2025/12
N2 - Multi-agent cooperative systems face fundamental challenges in distributed learning due to environmental non-stationarity and partial observability. While existing approaches employ communication mechanisms or hybrid action spaces to enhance collaboration, they often rely on complex policy networks processing state features from limited-bandwidth messaging. We propose a simplified cooperative multi-agent reinforcement learning framework that directly generates coordinated actions through customized communication protocols. Building on independent deep Q-learning, our method introduces three key components: i) a structured unidirectional communication network with normalized message formats, ii) a relationship mapping mechanism converting individual decisions into collective behaviors, and iii) group decision-making rules for consensus formation through opinion aggregation. Experimental evaluations across varying cooperation intensities demonstrate superior convergence performance and higher expected discounted rewards compared to baseline methods, particularly in large-scale multi-agent scenarios. The framework’s clear consensus generation and stable group architecture address critical challenges in distributed coordination while maintaining computational efficiency. These advancements offer conceptual and practical contributions for scalable cooperative systems in intelligent transportation and automated production domains.
AB - Multi-agent cooperative systems face fundamental challenges in distributed learning due to environmental non-stationarity and partial observability. While existing approaches employ communication mechanisms or hybrid action spaces to enhance collaboration, they often rely on complex policy networks processing state features from limited-bandwidth messaging. We propose a simplified cooperative multi-agent reinforcement learning framework that directly generates coordinated actions through customized communication protocols. Building on independent deep Q-learning, our method introduces three key components: i) a structured unidirectional communication network with normalized message formats, ii) a relationship mapping mechanism converting individual decisions into collective behaviors, and iii) group decision-making rules for consensus formation through opinion aggregation. Experimental evaluations across varying cooperation intensities demonstrate superior convergence performance and higher expected discounted rewards compared to baseline methods, particularly in large-scale multi-agent scenarios. The framework’s clear consensus generation and stable group architecture address critical challenges in distributed coordination while maintaining computational efficiency. These advancements offer conceptual and practical contributions for scalable cooperative systems in intelligent transportation and automated production domains.
KW - Cooperative multi-agent system
KW - Group decision-making
KW - Reinforcement learning
UR - https://www.scopus.com/pages/publications/105022055681
U2 - 10.1007/s44443-025-00326-6
DO - 10.1007/s44443-025-00326-6
M3 - 文章
AN - SCOPUS:105022055681
SN - 1319-1578
VL - 37
JO - Journal of King Saud University - Computer and Information Sciences
JF - Journal of King Saud University - Computer and Information Sciences
IS - 10
M1 - 317
ER -