跳到主要导航 跳到搜索 跳到主要内容

Disentangle First, Then Distill: A Unified Framework for Missing Modality Imputation and Alzheimer's Disease Diagnosis

  • Yuanyuan Chen
  • , Yongsheng Pan
  • , Yong Xia
  • , Yixuan Yuan
  • Northwestern Polytechnical University Xian
  • ShanghaiTech University
  • Chinese University of Hong Kong

科研成果: 期刊稿件文章同行评审

46 引用 (Scopus)

摘要

Multi-modality medical data provide complementary information, and hence have been widely explored for computer-aided AD diagnosis. However, the research is hindered by the unavoidable missing-data problem, i.e., one data modality was not acquired on some subjects due to various reasons. Although the missing data can be imputed using generative models, the imputation process may introduce unrealistic information to the classification process, leading to poor performance. In this paper, we propose the Disentangle First, Then Distill (DFTD) framework for AD diagnosis using incomplete multi-modality medical images. First, we design a region-aware disentanglement module to disentangle each image into inter-modality relevant representation and intra-modality specific representation with emphasis on disease-related regions. To progressively integrate multi-modality knowledge, we then construct an imputation-induced distillation module, in which a lateral inter-modality transition unit is created to impute representation of the missing modality. The proposed DFTD framework has been evaluated against six existing methods on an ADNI dataset with 1248 subjects. The results show that our method has superior performance in both AD-CN classification and MCI-to-AD prediction tasks, substantially over-performing all competing methods.

源语言英语
页(从-至)3566-3578
页数13
期刊IEEE Transactions on Medical Imaging
42
12
DOI
出版状态已出版 - 1 12月 2023

学术指纹

探究 'Disentangle First, Then Distill: A Unified Framework for Missing Modality Imputation and Alzheimer's Disease Diagnosis' 的科研主题。它们共同构成独一无二的学术指纹。

引用此