基于改进Q学习的IMA系统重构蓝图生成方法

Reconfiguration blueprint defines the reconfiguration scheme of system hardware and software resources in the fault status, and is critical to reconfiguration fault tolerance of the integrated modular avionics system. In this paper, we propose an approach for generating reconfiguration blueprints based on improved Q-learning, which considers multiple optimization objectives such as load balance, reconfiguration impact, reconfiguration time, and reconfiguration degradation. The simulated annealing framework is utilized to enhance the convergence performance of the traditional Q-learning strategy. Experimental results demonstrate that compared with the simulated annealing algorithm, the differential evolution algorithm, and the traditional Q-learning algorithm, the algorithm proposed has higher efficiency, and can generate the reconfiguration blueprints of better quality.