TY - JOUR
T1 - ADMNet
T2 - Adaptive-Weighting Dual Mapping for Online Tracking With Respiratory Motion Estimation in Contrast-Enhanced Ultrasound
AU - Li, Ming De
AU - Hu, Hang Tong
AU - Ruan, Si Min
AU - Cheng, Mei Qing
AU - Chen, Li Da
AU - Huang, Ze Rong
AU - Li, Wei
AU - Lin, Peng
AU - Yang, Hong
AU - Kuang, Ming
AU - Lu, Ming De
AU - Huang, Qing Hua
AU - Wang, Wei
N1 - Publisher Copyright:
© 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
PY - 2024
Y1 - 2024
N2 - — Lesion localization and tracking are critical for accurate, automated medical imaging analysis. Contrast-enhanced ultrasound (CEUS) significantly enriches traditional B-mode ultrasound with contrast agents to provide high-resolution, real-time images of blood flow in tissues and organs. However, many trackers, designed primarily for natural RGB or B-mode ultrasound images, underutilize the extensive data from dual-screen enhanced images and fail to account for respiratory motion, thus facing challenges in achieving accurate target tracking. To address the existing challenges, we propose an adaptive-weighted dual mapping (ADMNet), an online tracking framework tailored for CEUS. Firstly, we introduced a novel Multimodal Atrous Attention Fusion (MAAF) module, innovatively designed to adapt the weightage between B-mode and enhanced images in dual-screen CEUS, reflecting the clinician’s dynamic focus shifts between screens. Secondly, we proposed a Respiratory Motion Compensation (RMC) module to correct motion trajectory interferences due to respiratory motion, effectively leveraging temporal information. We utilized two newly established CEUS datasets, totaling 35,082 frames, to benchmark the ADMNet against various advanced B-mode ultrasound trackers. Our extensive experiments revealed that ADMNet achieves new state-of-the-art performance in CEUS tracking. Ablation studies and visualizations further underline the effectiveness of MAAF and RMC modules, demonstrating the promising potential of ADMNet in clinical CEUS tracing, thus providing novel research avenues in this field.
AB - — Lesion localization and tracking are critical for accurate, automated medical imaging analysis. Contrast-enhanced ultrasound (CEUS) significantly enriches traditional B-mode ultrasound with contrast agents to provide high-resolution, real-time images of blood flow in tissues and organs. However, many trackers, designed primarily for natural RGB or B-mode ultrasound images, underutilize the extensive data from dual-screen enhanced images and fail to account for respiratory motion, thus facing challenges in achieving accurate target tracking. To address the existing challenges, we propose an adaptive-weighted dual mapping (ADMNet), an online tracking framework tailored for CEUS. Firstly, we introduced a novel Multimodal Atrous Attention Fusion (MAAF) module, innovatively designed to adapt the weightage between B-mode and enhanced images in dual-screen CEUS, reflecting the clinician’s dynamic focus shifts between screens. Secondly, we proposed a Respiratory Motion Compensation (RMC) module to correct motion trajectory interferences due to respiratory motion, effectively leveraging temporal information. We utilized two newly established CEUS datasets, totaling 35,082 frames, to benchmark the ADMNet against various advanced B-mode ultrasound trackers. Our extensive experiments revealed that ADMNet achieves new state-of-the-art performance in CEUS tracking. Ablation studies and visualizations further underline the effectiveness of MAAF and RMC modules, demonstrating the promising potential of ADMNet in clinical CEUS tracing, thus providing novel research avenues in this field.
KW - Contrast-enhanced ultrasound
KW - deep learning
KW - dual-screen mapping
KW - respiratory motion compensation
KW - tracking
UR - http://www.scopus.com/inward/record.url?scp=85178030728&partnerID=8YFLogxK
U2 - 10.1109/TIP.2023.3333195
DO - 10.1109/TIP.2023.3333195
M3 - 文章
C2 - 37988213
AN - SCOPUS:85178030728
SN - 1057-7149
VL - 33
SP - 58
EP - 68
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
ER -