TY - JOUR
T1 - MHKD
T2 - Multi-Step Hybrid Knowledge Distillation for Low-Resolution Whole Slide Images Glomerulus Detection
AU - Zhang, Xiangsen
AU - Han, Longfei
AU - Xu, Chenchu
AU - Zheng, Zhaohui
AU - Ding, Jin
AU - Fu, Xianghui
AU - Zhang, Dingwen
AU - Han, Junwei
N1 - Publisher Copyright:
© 2013 IEEE.
PY - 2025
Y1 - 2025
N2 - Glomerulus detection is a critical component of renal histopathology assessment, essential for diagnosing glomerulonephritis. To mitigate the increasing workload on pathologists, AI-assisted diagnostic methods based on high-resolution digital pathology whole slide images have been developed. However, these current AI-assisted approaches are limited to high-resolution whole slide images, necessitating expensive digital scanner equipment, high image storage costs, and significant computational complexity. To address this limitation, this paper pioneers a method for facilitating glomerulus detection in low-resolution human kidney pathology images. Specifically, we propose a novel multi-step hybrid knowledge distillation method. Our method distills both the global features and the semantic information through a hybrid knowledge distillation strategy that integrates offline and online knowledge distillation, where the information from high-resolution pathological images is successively transferred to student model from the global features in the shallow network layers to the semantic information of the back-end through a multi-step training strategy. Experimental results on two datasets show that the proposed method achieves effective detection outcomes for low-resolution kidney pathology images. Compared to other state-of-the-art detection techniques, our method achieves an AP0.5:0.95 improvement of 23.1% on the private LN dataset and 15.9% on the public HUBMAP dataset.
AB - Glomerulus detection is a critical component of renal histopathology assessment, essential for diagnosing glomerulonephritis. To mitigate the increasing workload on pathologists, AI-assisted diagnostic methods based on high-resolution digital pathology whole slide images have been developed. However, these current AI-assisted approaches are limited to high-resolution whole slide images, necessitating expensive digital scanner equipment, high image storage costs, and significant computational complexity. To address this limitation, this paper pioneers a method for facilitating glomerulus detection in low-resolution human kidney pathology images. Specifically, we propose a novel multi-step hybrid knowledge distillation method. Our method distills both the global features and the semantic information through a hybrid knowledge distillation strategy that integrates offline and online knowledge distillation, where the information from high-resolution pathological images is successively transferred to student model from the global features in the shallow network layers to the semantic information of the back-end through a multi-step training strategy. Experimental results on two datasets show that the proposed method achieves effective detection outcomes for low-resolution kidney pathology images. Compared to other state-of-the-art detection techniques, our method achieves an AP0.5:0.95 improvement of 23.1% on the private LN dataset and 15.9% on the public HUBMAP dataset.
KW - Glomerulus detection
KW - hybrid knowledge distillation
KW - low-resolution pathology image
KW - multi-step training strategy
UR - http://www.scopus.com/inward/record.url?scp=85212277494&partnerID=8YFLogxK
U2 - 10.1109/JBHI.2024.3513716
DO - 10.1109/JBHI.2024.3513716
M3 - 文章
AN - SCOPUS:85212277494
SN - 2168-2194
VL - 29
SP - 767
EP - 774
JO - IEEE Journal of Biomedical and Health Informatics
JF - IEEE Journal of Biomedical and Health Informatics
IS - 2
ER -