TY - GEN
T1 - Mixed Global and Local Attention Alleviates Domain Shift Between Terahertz Image Datasets
AU - Fu, Rao
AU - Cui, Shaoxing
AU - Feng, Xiaoyi
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Terahertz imaging technology has a broad application prospect in the field of security inspection due to its strong penetrability and negligible radiation effect on people. With the development of machine learning in recent years, the application of machine learning methods to security inspection can save labor costs and ensure the accuracy of long-time security inspection. However, terahertz imagers produce different bottom noise at different temperatures, which leads to a significant domain offset problem between data sets collected at different temperatures. This domain shift makes the model trained on the source domain dataset to have a significant error when applied to the target domain dataset. Therefore, how to overcome the temperature-induced domain offset is an urgent problem for terahertz imaging techniques. In this paper, we innovatively propose to apply the attention mechanism to solve the problem of domain bias in object detection. We propose a lightweight attention mechanism Mixed global and local attention(MGLA) aimed at mitigating the domain shift between the target and source domains without affecting the source domain detection effect. MGLA can take into account the local information while fusing the channel information and spatial information and global information to improve the representation of the network. The experiment results show a 10% improvement in mAP0.5 and a 6.3% improvement in mAP50:95 compared to YOLOV8 baseline.
AB - Terahertz imaging technology has a broad application prospect in the field of security inspection due to its strong penetrability and negligible radiation effect on people. With the development of machine learning in recent years, the application of machine learning methods to security inspection can save labor costs and ensure the accuracy of long-time security inspection. However, terahertz imagers produce different bottom noise at different temperatures, which leads to a significant domain offset problem between data sets collected at different temperatures. This domain shift makes the model trained on the source domain dataset to have a significant error when applied to the target domain dataset. Therefore, how to overcome the temperature-induced domain offset is an urgent problem for terahertz imaging techniques. In this paper, we innovatively propose to apply the attention mechanism to solve the problem of domain bias in object detection. We propose a lightweight attention mechanism Mixed global and local attention(MGLA) aimed at mitigating the domain shift between the target and source domains without affecting the source domain detection effect. MGLA can take into account the local information while fusing the channel information and spatial information and global information to improve the representation of the network. The experiment results show a 10% improvement in mAP0.5 and a 6.3% improvement in mAP50:95 compared to YOLOV8 baseline.
KW - Attention mechanism
KW - Domain shift
KW - Terahertz image object detection
KW - YOLOV8
UR - http://www.scopus.com/inward/record.url?scp=85214869089&partnerID=8YFLogxK
U2 - 10.1109/ICSPCC62635.2024.10770373
DO - 10.1109/ICSPCC62635.2024.10770373
M3 - 会议稿件
AN - SCOPUS:85214869089
T3 - 2024 IEEE International Conference on Signal Processing, Communications and Computing, ICSPCC 2024
BT - 2024 IEEE International Conference on Signal Processing, Communications and Computing, ICSPCC 2024
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 14th IEEE International Conference on Signal Processing, Communications and Computing, ICSPCC 2024
Y2 - 19 August 2024 through 22 August 2024
ER -