TY - JOUR
T1 - Trustworthy Fault Diagnosis with Uncertainty Estimation Through Evidential Convolutional Neural Networks
AU - Zhou, Hanting
AU - Chen, Wenhe
AU - Cheng, Longsheng
AU - Liu, Jing
AU - Xia, Min
N1 - Publisher Copyright:
© 2005-2012 IEEE.
PY - 2023/11/1
Y1 - 2023/11/1
N2 - Deep neural networks (DNNs) have been widely used for intelligent fault diagnosis under the closed-world assumption that any testing data are within classes of the training data. However, in reality, out-of-distribution (OOD) cases, such as new fault conditions, can happen after the original trained model is deployed. Most of the current DNNs are deterministic, which can misclassify with high confidence in the open-world scenario. This overconfident behavior would not guarantee the reliability and robustness of fault diagnosis results in practice. Therefore, trustworthy intelligent fault diagnosis with uncertainty estimation is crucial for real applications. In this article, we develop a novel convolutional neural network integrating evidence theory to achieve fault classifications with prediction uncertainty estimation. The estimated prediction uncertainty can identify potential OOD samples. This approach allows a minimal modification of the state-of-the-art DNN model by using a risk-calibrated evidential loss function and Dirichlet distribution that replaces the classification probabilities. The experimental results show that the proposed approach can not only achieve accurate classification of known classes but also detect unknown classes effectively. The proposed method shows significant potential in detecting OOD patterns and provides trustworthy fault diagnosis in open and nonstationary environments.
AB - Deep neural networks (DNNs) have been widely used for intelligent fault diagnosis under the closed-world assumption that any testing data are within classes of the training data. However, in reality, out-of-distribution (OOD) cases, such as new fault conditions, can happen after the original trained model is deployed. Most of the current DNNs are deterministic, which can misclassify with high confidence in the open-world scenario. This overconfident behavior would not guarantee the reliability and robustness of fault diagnosis results in practice. Therefore, trustworthy intelligent fault diagnosis with uncertainty estimation is crucial for real applications. In this article, we develop a novel convolutional neural network integrating evidence theory to achieve fault classifications with prediction uncertainty estimation. The estimated prediction uncertainty can identify potential OOD samples. This approach allows a minimal modification of the state-of-the-art DNN model by using a risk-calibrated evidential loss function and Dirichlet distribution that replaces the classification probabilities. The experimental results show that the proposed approach can not only achieve accurate classification of known classes but also detect unknown classes effectively. The proposed method shows significant potential in detecting OOD patterns and provides trustworthy fault diagnosis in open and nonstationary environments.
KW - Evidential convolutional neural networks (CNNs)
KW - fault diagnosis
KW - open-set recognition (OSR)
KW - trustworthy AI
KW - uncertainty estimation
UR - http://www.scopus.com/inward/record.url?scp=85148455949&partnerID=8YFLogxK
U2 - 10.1109/TII.2023.3241587
DO - 10.1109/TII.2023.3241587
M3 - 文章
AN - SCOPUS:85148455949
SN - 1551-3203
VL - 19
SP - 10842
EP - 10852
JO - IEEE Transactions on Industrial Informatics
JF - IEEE Transactions on Industrial Informatics
IS - 11
ER -