TY - JOUR
T1 - Topology-Guided Graph-Visual Fusion for Interpretable Skin Lesion Diagnosis
AU - Dai, Duwei
AU - Dong, Caixia
AU - Dai, Guowei
AU - Huang, Haolin
AU - Yang, Xu
AU - Ren, Pengyu
AU - Wang, Liang
AU - Yan, Qingsen
AU - Zeng, Wei
N1 - Publisher Copyright:
© 1991-2012 IEEE.
PY - 2026
Y1 - 2026
N2 - Accurate skin lesion diagnosis requires interpreting the complex spatial distributions and topological relationships of pathological structures. However, prevalent deep learning paradigms process images as regular grids or flattened sequences, severely limiting their capacity to explicitly model these non-Euclidean clinical priors. To bridge this semantic gap, we propose DermPrism, a topology-guided graph-visual fusion framework with distinct visual and topological pathways that are coupled within one predictive network. Central to our approach is a novel architecture that dynamically mines sparse, diagnostically salient keypoints, structuring them into a hierarchical graph. This enables explicit geometric reasoning over both microscopic feature interactions and macroscopic regional layouts. Furthermore, a dedicated modulation mechanism seamlessly injects these learned topological priors back into the dense visual representations. Comprehensive evaluations on multiple benchmarks show that DermPrism achieves state-of-the-art performance and improved cross-dataset transfer. Its visualizations expose hierarchical topology and attention flow that are qualitatively consistent with annotated dermoscopic structures, without implying equivalence to dermatologist reasoning.
AB - Accurate skin lesion diagnosis requires interpreting the complex spatial distributions and topological relationships of pathological structures. However, prevalent deep learning paradigms process images as regular grids or flattened sequences, severely limiting their capacity to explicitly model these non-Euclidean clinical priors. To bridge this semantic gap, we propose DermPrism, a topology-guided graph-visual fusion framework with distinct visual and topological pathways that are coupled within one predictive network. Central to our approach is a novel architecture that dynamically mines sparse, diagnostically salient keypoints, structuring them into a hierarchical graph. This enables explicit geometric reasoning over both microscopic feature interactions and macroscopic regional layouts. Furthermore, a dedicated modulation mechanism seamlessly injects these learned topological priors back into the dense visual representations. Comprehensive evaluations on multiple benchmarks show that DermPrism achieves state-of-the-art performance and improved cross-dataset transfer. Its visualizations expose hierarchical topology and attention flow that are qualitatively consistent with annotated dermoscopic structures, without implying equivalence to dermatologist reasoning.
KW - Graph neural networks
KW - Interpretable deep learning
KW - Pathological keypoint mining
KW - Skin lesion diagnosis
KW - Visual-topological representation
UR - https://www.scopus.com/pages/publications/105047004865
U2 - 10.1109/TCSVT.2026.3720674
DO - 10.1109/TCSVT.2026.3720674
M3 - 文章
AN - SCOPUS:105047004865
SN - 1051-8215
JO - IEEE Transactions on Circuits and Systems for Video Technology
JF - IEEE Transactions on Circuits and Systems for Video Technology
ER -