TY - JOUR
T1 - Recognizing Diverse Construction Activities in Site Images via Relevance Networks of Construction-Related Objects Detected by Convolutional Neural Networks
AU - Luo, Xiaochun
AU - Li, Heng
AU - Cao, Dongping
AU - Dai, Fei
AU - Seo, Joonoh
AU - Lee, Sanghyun
N1 - Publisher Copyright:
© 2018 American Society of Civil Engineers.
PY - 2018/5/1
Y1 - 2018/5/1
N2 - Timely and overall knowledge of the states and resource allocation of diverse activities on construction sites is critical to resource leveling, progress tracking, and productivity analysis. Despite its importance, this task is still performed manually. Previous studies have taken a significant step forward in introducing computer vision technologies, although they have been oriented toward limited classes of objects or limited types of activities. Furthermore, they especially focus on single activity recognition, where an image contains only the execution of an activity by one or a few objects. This paper introduces a two-step method for recognizing diverse construction activities in still site images. It detects 22 classes of construction-related objects using convolutional neural networks. With objects detected, semantic relevance representing the likelihood of the cooperation or coexistence between two objects in a construction activity, spatial relevance representing the two-dimensional pixel proximity in the image coordinates, and activity patterns are defined to recognize 17 types of construction activities. The advantage of the proposed method is its potential to recognize diverse concurrent construction activities in a fully automatic way. Therefore, it is possible to save managers' valuable time in manual data collection and concentrate their attention on solving problems that necessarily demand their expertise.
AB - Timely and overall knowledge of the states and resource allocation of diverse activities on construction sites is critical to resource leveling, progress tracking, and productivity analysis. Despite its importance, this task is still performed manually. Previous studies have taken a significant step forward in introducing computer vision technologies, although they have been oriented toward limited classes of objects or limited types of activities. Furthermore, they especially focus on single activity recognition, where an image contains only the execution of an activity by one or a few objects. This paper introduces a two-step method for recognizing diverse construction activities in still site images. It detects 22 classes of construction-related objects using convolutional neural networks. With objects detected, semantic relevance representing the likelihood of the cooperation or coexistence between two objects in a construction activity, spatial relevance representing the two-dimensional pixel proximity in the image coordinates, and activity patterns are defined to recognize 17 types of construction activities. The advantage of the proposed method is its potential to recognize diverse concurrent construction activities in a fully automatic way. Therefore, it is possible to save managers' valuable time in manual data collection and concentrate their attention on solving problems that necessarily demand their expertise.
KW - Construction activity recognition
KW - Convolutional neural networks
KW - Relevance networks
KW - Semantic relevance
KW - Spatial relevance
UR - https://www.scopus.com/pages/publications/85042173488
U2 - 10.1061/(ASCE)CP.1943-5487.0000756
DO - 10.1061/(ASCE)CP.1943-5487.0000756
M3 - 文章
AN - SCOPUS:85042173488
SN - 0887-3801
VL - 32
JO - Journal of Computing in Civil Engineering
JF - Journal of Computing in Civil Engineering
IS - 3
M1 - 04018012
ER -