TY - JOUR
T1 - Abnormal flow detection in industrial control network based on deep reinforcement learning
AU - Wang, Weiping
AU - Guo, Junjiang
AU - Wang, Zhen
AU - Wang, Hao
AU - Cheng, Jun
AU - Wang, Chunyang
AU - Yuan, Manman
AU - Kurths, Jürgen
AU - Luo, Xiong
AU - Gao, Yang
N1 - Publisher Copyright:
© 2021
PY - 2021/11/15
Y1 - 2021/11/15
N2 - Industrial control systems are the brain and central nervous system of a country's vital infrastructure. Once the control system collapses, the consequences are unimaginable. Therefore, the safety of industrial control system has become the top priority in the field of safety. Aiming at the problem that the traditional abnormal flow detection model in the industrial control system is not accurate in identifying abnormalities, we combine the perception ability of deep learning with the decision-making ability of reinforcement learning, and propose an abnormal flow detection model based on deep reinforcement learning. The neural network is used to extract the features of the preprocessed dataset, and then the learning strategy can be adjusted according to the special advantages of strengthening the decision-making ability of learning and feedback. The experimental results show that the model based on deep reinforcement learning can achieve 98.06% accuracy in abnormal flow detection.Compared with various methods proposed by peers in current literature, this method is superior to other technologies in four evaluation indexes including accuracy rate, accuracy rate, recall rate and F1 score, among which the accuracy is increased by 2 percentage points.
AB - Industrial control systems are the brain and central nervous system of a country's vital infrastructure. Once the control system collapses, the consequences are unimaginable. Therefore, the safety of industrial control system has become the top priority in the field of safety. Aiming at the problem that the traditional abnormal flow detection model in the industrial control system is not accurate in identifying abnormalities, we combine the perception ability of deep learning with the decision-making ability of reinforcement learning, and propose an abnormal flow detection model based on deep reinforcement learning. The neural network is used to extract the features of the preprocessed dataset, and then the learning strategy can be adjusted according to the special advantages of strengthening the decision-making ability of learning and feedback. The experimental results show that the model based on deep reinforcement learning can achieve 98.06% accuracy in abnormal flow detection.Compared with various methods proposed by peers in current literature, this method is superior to other technologies in four evaluation indexes including accuracy rate, accuracy rate, recall rate and F1 score, among which the accuracy is increased by 2 percentage points.
KW - Abnormal flow detection
KW - Deep reinforcement learning
KW - Industrial control systems
KW - The learning strategy
UR - http://www.scopus.com/inward/record.url?scp=85110364893&partnerID=8YFLogxK
U2 - 10.1016/j.amc.2021.126379
DO - 10.1016/j.amc.2021.126379
M3 - 文章
AN - SCOPUS:85110364893
SN - 0096-3003
VL - 409
JO - Applied Mathematics and Computation
JF - Applied Mathematics and Computation
M1 - 126379
ER -