TY - GEN
T1 - Video Pedestrian Re-identification Based on Human-Machine Collaboration
AU - Wang, Yanfei
AU - Yu, Zhiwen
AU - Yang, Fan
AU - Wang, Liang
AU - Guo, Bin
N1 - Publisher Copyright:
© 2021, Springer Nature Singapore Pte Ltd.
PY - 2021
Y1 - 2021
N2 - The purpose of pedestrian re-identification is to find pedestrian targets from many real surveillance videos. It has multiple realistic application scenarios such as criminal search, intelligent security, and cross-camera tracking. However, the current stage of pedestrian re-identification faces many challenges, including blurring of surveillance video, changes in surveillance angles, changes in pedestrian posture, and pedestrian occlusion. Although the existing research methods have a good performance on some datasets, there is still a big gap from the practical application. Taking into account the advanced intelligence, flexibility, and adaptability of human beings in the face of complex problems and environmental changes, this paper attempts to establish a model based on human-machine collaboration, in order to improve the accuracy and enhance the practicability. Along this line, we first construct a new human-machine collaboration video pedestrian re-identification model (HMRM) and design the task allocation strategies and result fusion strategies accordingly. Then, based on the YOLOv3 object detection algorithm and the ResNet-50 network structure, we perform the pedestrian detection part and the pedestrian re-identification part respectively. Moreover, since HMRM allocates human-machine tasks based on overlapping thresholds, we do exploratory experiments on human workload, overlapping thresholds, and model accuracy. Finally, based on pyqt5 and multi-threading technology, a human-machine collaboration video pedestrian re-identification interface is developed. Experiments on the public datasets show that HMRM is superior to other pedestrian re-identification approaches.
AB - The purpose of pedestrian re-identification is to find pedestrian targets from many real surveillance videos. It has multiple realistic application scenarios such as criminal search, intelligent security, and cross-camera tracking. However, the current stage of pedestrian re-identification faces many challenges, including blurring of surveillance video, changes in surveillance angles, changes in pedestrian posture, and pedestrian occlusion. Although the existing research methods have a good performance on some datasets, there is still a big gap from the practical application. Taking into account the advanced intelligence, flexibility, and adaptability of human beings in the face of complex problems and environmental changes, this paper attempts to establish a model based on human-machine collaboration, in order to improve the accuracy and enhance the practicability. Along this line, we first construct a new human-machine collaboration video pedestrian re-identification model (HMRM) and design the task allocation strategies and result fusion strategies accordingly. Then, based on the YOLOv3 object detection algorithm and the ResNet-50 network structure, we perform the pedestrian detection part and the pedestrian re-identification part respectively. Moreover, since HMRM allocates human-machine tasks based on overlapping thresholds, we do exploratory experiments on human workload, overlapping thresholds, and model accuracy. Finally, based on pyqt5 and multi-threading technology, a human-machine collaboration video pedestrian re-identification interface is developed. Experiments on the public datasets show that HMRM is superior to other pedestrian re-identification approaches.
KW - Deep learning
KW - Human-machine collaboration
KW - Pedestrian detection
KW - Pedestrian re-identification
UR - http://www.scopus.com/inward/record.url?scp=85111154624&partnerID=8YFLogxK
U2 - 10.1007/978-981-16-2540-4_30
DO - 10.1007/978-981-16-2540-4_30
M3 - 会议稿件
AN - SCOPUS:85111154624
SN - 9789811625398
T3 - Communications in Computer and Information Science
SP - 410
EP - 423
BT - Computer Supported Cooperative Work and Social Computing - 15th CCF Conference, Chinese CSCW 2020, Revised Selected Papers
A2 - Sun, Yuqing
A2 - Liu, Dongning
A2 - Liao, Hao
A2 - Fan, Hongfei
A2 - Gao, Liping
PB - Springer Science and Business Media Deutschland GmbH
T2 - 15th CCF Conference on Computer Supported Cooperative Work and Social Computing, Chinese CSCW 2020
Y2 - 7 November 2020 through 9 November 2020
ER -