TY - JOUR
T1 - Disentangle First, Then Distill
T2 - A Unified Framework for Missing Modality Imputation and Alzheimer's Disease Diagnosis
AU - Chen, Yuanyuan
AU - Pan, Yongsheng
AU - Xia, Yong
AU - Yuan, Yixuan
N1 - Publisher Copyright:
© 1982-2012 IEEE.
PY - 2023/12/1
Y1 - 2023/12/1
N2 - Multi-modality medical data provide complementary information, and hence have been widely explored for computer-aided AD diagnosis. However, the research is hindered by the unavoidable missing-data problem, i.e., one data modality was not acquired on some subjects due to various reasons. Although the missing data can be imputed using generative models, the imputation process may introduce unrealistic information to the classification process, leading to poor performance. In this paper, we propose the Disentangle First, Then Distill (DFTD) framework for AD diagnosis using incomplete multi-modality medical images. First, we design a region-aware disentanglement module to disentangle each image into inter-modality relevant representation and intra-modality specific representation with emphasis on disease-related regions. To progressively integrate multi-modality knowledge, we then construct an imputation-induced distillation module, in which a lateral inter-modality transition unit is created to impute representation of the missing modality. The proposed DFTD framework has been evaluated against six existing methods on an ADNI dataset with 1248 subjects. The results show that our method has superior performance in both AD-CN classification and MCI-to-AD prediction tasks, substantially over-performing all competing methods.
AB - Multi-modality medical data provide complementary information, and hence have been widely explored for computer-aided AD diagnosis. However, the research is hindered by the unavoidable missing-data problem, i.e., one data modality was not acquired on some subjects due to various reasons. Although the missing data can be imputed using generative models, the imputation process may introduce unrealistic information to the classification process, leading to poor performance. In this paper, we propose the Disentangle First, Then Distill (DFTD) framework for AD diagnosis using incomplete multi-modality medical images. First, we design a region-aware disentanglement module to disentangle each image into inter-modality relevant representation and intra-modality specific representation with emphasis on disease-related regions. To progressively integrate multi-modality knowledge, we then construct an imputation-induced distillation module, in which a lateral inter-modality transition unit is created to impute representation of the missing modality. The proposed DFTD framework has been evaluated against six existing methods on an ADNI dataset with 1248 subjects. The results show that our method has superior performance in both AD-CN classification and MCI-to-AD prediction tasks, substantially over-performing all competing methods.
KW - Alzheimer's disease
KW - mild cognitive impairment
KW - modality imputation
KW - multi-modality diagnosis
UR - http://www.scopus.com/inward/record.url?scp=85164800656&partnerID=8YFLogxK
U2 - 10.1109/TMI.2023.3295489
DO - 10.1109/TMI.2023.3295489
M3 - 文章
C2 - 37450359
AN - SCOPUS:85164800656
SN - 0278-0062
VL - 42
SP - 3566
EP - 3578
JO - IEEE Transactions on Medical Imaging
JF - IEEE Transactions on Medical Imaging
IS - 12
ER -