跳到主要导航 跳到搜索 跳到主要内容

Efficient Reinforcement Learning for Satellite Evasion Tasks in Limited Observable and Orbit-Constrained Environments

  • Linsen Wei
  • , Xin Ning
  • , Xiaobin Lian
  • , Kaiyuan Yang
  • , Tao Ni
  • , Feng Chen
  • , Rugang Tang
  • , Zhansheng Chen
  • , Liteng Bo
  • Northwestern Polytechnical University Xian
  • Shanghai Institute of Satellite Engineering
  • Hong Kong Polytechnic University
  • Ltd.

科研成果: 期刊稿件 › 文章 › 同行评审

摘要

Reinforcement learning (RL) holds promise for the automated control of satellite orbits and the avoidance of spatial obstacles due to its ability to learn and adapt to dynamic environments through interaction, enabling autonomous, real-time decision-making for orbit adjustments. Satellite orbit control tasks manifest strong nonlinear characteristics, for which algorithms grounded on neural networks are more adept at handling. However, RL methods based on neural networks, which are highly nonconvex and nonsmooth functions, sometimes yield extreme action values that are not conducive to the orbit-constrained task at hand. In addition, in practical satellite task environments, limited observability is often faced. This limited observability not only increases the complexity of the algorithm but also affects the efficiency of identifying appropriate actions. To address this issue, we introduce a hierarchical parameterization mechanism to accelerate the search for appropriate actions. Hence, we introduce the integration of selfattention mechanisms with the Kalman filter into RL frameworks to accommodate scenarios with limited observability. Experimental results demonstrate a marked increase in the success rate of automated evasion maneuvers in environments with limited observability and orbital constraints, when facing pursuing satellites. Then, we performed a comparative analysis, applying Lambert guidance and RL-based guidance as control strategies for powerful confinement environment to validate our algorithm’s robustness.

源语言英语
期刊论文编号0501
期刊Space: Science and Technology (United States)
卷6
DOI
出版状态已出版 - 2026

学术指纹

探究 'Efficient Reinforcement Learning for Satellite Evasion Tasks in Limited Observable and Orbit-Constrained Environments' 的科研主题。它们共同构成独一无二的学术指纹。

引用此