TY - JOUR
T1 - Interpretable intelligent fault diagnosis strategy for fixed-wing UAV elevator fault diagnosis based on improved cross entropy loss
AU - Li, Yang
AU - Jia, Zhen
AU - Liu, Zhenbao
AU - Shao, Haidong
AU - Zhao, Wen
AU - Liu, Zhiqi
AU - Wang, Baodong
N1 - Publisher Copyright:
© 2024 IOP Publishing Ltd
PY - 2024/7
Y1 - 2024/7
N2 - The current popular machine learning-based fault diagnosis methods make it difficult to explain the diagnostic results, leading to low user trust in such diagnostic techniques. In this regard, this paper explores the study of the interpretability of intelligent fault diagnosis algorithms using the elevator of a fixed-wing unmanned aerial vehicle (UAV) as a diagnostic object. The Transformer model combines excellent modeling capability and efficient sequence data processing, is chosen to mine fault signal features to guarantee accurate diagnosis. Among the proposed interpretable fault diagnosis models, the local interpretable model-agnostic explanations (LIME) model is used to provide explicit interpretability for the decision-making process of the diagnosis model. In addition, a loss function called RDCE (reinforced diagnostic cross-entropy) Loss is designed to minimize the negative impact of different sample sizes for different fault types on the diagnostic performance. This loss function is designed to weigh the various types of faults to speed up the convergence of the model and improve the diagnostic accuracy. By comparing the proposed diagnostic strategy with other commonly used machine learning models, including long short term memory and recurrent neural network (RNN), the average diagnostic accuracy of the proposed diagnostic strategy is 99.97%, significantly better than that of the comparison algorithms. At the same time, this paper provides an in-depth interpretable analysis of the diagnostic process of the Transformer. The diagnostic process of the Transformer model gives the reasons for the diagnostic results from the point of view of the kind of features processed by the model. Based on this, the diagnostic model is simplified. After streamlining the number of features from 40 to 24 according to their importance, the diagnostic accuracy of the model is improved by 0.26%, and the diagnostic efficiency is improved. In addition, the proposed diagnostic strategy also shows significant advantages in terms of noise robustness.
AB - The current popular machine learning-based fault diagnosis methods make it difficult to explain the diagnostic results, leading to low user trust in such diagnostic techniques. In this regard, this paper explores the study of the interpretability of intelligent fault diagnosis algorithms using the elevator of a fixed-wing unmanned aerial vehicle (UAV) as a diagnostic object. The Transformer model combines excellent modeling capability and efficient sequence data processing, is chosen to mine fault signal features to guarantee accurate diagnosis. Among the proposed interpretable fault diagnosis models, the local interpretable model-agnostic explanations (LIME) model is used to provide explicit interpretability for the decision-making process of the diagnosis model. In addition, a loss function called RDCE (reinforced diagnostic cross-entropy) Loss is designed to minimize the negative impact of different sample sizes for different fault types on the diagnostic performance. This loss function is designed to weigh the various types of faults to speed up the convergence of the model and improve the diagnostic accuracy. By comparing the proposed diagnostic strategy with other commonly used machine learning models, including long short term memory and recurrent neural network (RNN), the average diagnostic accuracy of the proposed diagnostic strategy is 99.97%, significantly better than that of the comparison algorithms. At the same time, this paper provides an in-depth interpretable analysis of the diagnostic process of the Transformer. The diagnostic process of the Transformer model gives the reasons for the diagnostic results from the point of view of the kind of features processed by the model. Based on this, the diagnostic model is simplified. After streamlining the number of features from 40 to 24 according to their importance, the diagnostic accuracy of the model is improved by 0.26%, and the diagnostic efficiency is improved. In addition, the proposed diagnostic strategy also shows significant advantages in terms of noise robustness.
KW - fault diagnosis
KW - fixed-wing UAV elevator
KW - interpretable
KW - loss function
KW - transformer
UR - http://www.scopus.com/inward/record.url?scp=85190287374&partnerID=8YFLogxK
U2 - 10.1088/1361-6501/ad3666
DO - 10.1088/1361-6501/ad3666
M3 - 文章
AN - SCOPUS:85190287374
SN - 0957-0233
VL - 35
JO - Measurement Science and Technology
JF - Measurement Science and Technology
IS - 7
M1 - 076110
ER -