TY - GEN
T1 - Single-Cell Spatial Analysis of Histopathology Images for Survival Prediction via Graph Attention Network
AU - Li, Zhe
AU - Jiang, Yuming
AU - Liu, Leon
AU - Xia, Yong
AU - Li, Ruijiang
N1 - Publisher Copyright:
© 2024, The Author(s), under exclusive license to Springer Nature Switzerland AG.
PY - 2024
Y1 - 2024
N2 - The tumor microenvironment is a complex ecosystem consisting of various immune and stromal cells in addition to neoplastic cells. The spatial interaction and organization of these cells play a critical role in tumor progression. Single-cell analysis of histopathology images offers an intrinsic advantage over traditional patch-based approach by providing fine-grained cellular information. However, existing studies do not perform explicit cell classification, and therefore still suffer from limited interpretability and lack biological relevance, which may negatively affect the performance for clinical outcome prediction. To address these challenges, we propose a cell-level contextual learning approach to explicitly capture the major cell types and their spatial interaction in the tumor microenvironment. To do this, we first segmented and classified each cell into tumor cells, lymphocytes, fibroblasts, macrophages, neutrophils, and other nonmalignant cells on histopathology images. Given this single-cell map, we constructed a graph and trained a graph attention network to learn the cell-level contextual features for survival prediction. Extensive experiments demonstrate that our model consistently outperform existing patch-based and cell graph-based approaches in two independent datasets. Further, we used the feature attribution method to discover distinct spatial patterns that are associated with prognosis, leading to biologically meaningful and interpretable results.
AB - The tumor microenvironment is a complex ecosystem consisting of various immune and stromal cells in addition to neoplastic cells. The spatial interaction and organization of these cells play a critical role in tumor progression. Single-cell analysis of histopathology images offers an intrinsic advantage over traditional patch-based approach by providing fine-grained cellular information. However, existing studies do not perform explicit cell classification, and therefore still suffer from limited interpretability and lack biological relevance, which may negatively affect the performance for clinical outcome prediction. To address these challenges, we propose a cell-level contextual learning approach to explicitly capture the major cell types and their spatial interaction in the tumor microenvironment. To do this, we first segmented and classified each cell into tumor cells, lymphocytes, fibroblasts, macrophages, neutrophils, and other nonmalignant cells on histopathology images. Given this single-cell map, we constructed a graph and trained a graph attention network to learn the cell-level contextual features for survival prediction. Extensive experiments demonstrate that our model consistently outperform existing patch-based and cell graph-based approaches in two independent datasets. Further, we used the feature attribution method to discover distinct spatial patterns that are associated with prognosis, leading to biologically meaningful and interpretable results.
KW - Cell type identification
KW - Gastric cancer
KW - Graph neural network
KW - Spatial pattern analysis
KW - Survival analysis
UR - http://www.scopus.com/inward/record.url?scp=85177171002&partnerID=8YFLogxK
U2 - 10.1007/978-3-031-47076-9_12
DO - 10.1007/978-3-031-47076-9_12
M3 - 会议稿件
AN - SCOPUS:85177171002
SN - 9783031470752
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 114
EP - 124
BT - Applications of Medical Artificial Intelligence - 2nd International Workshop, AMAI 2023, Held in Conjunction with MICCAI 2023, Proceedings
A2 - Wu, Shandong
A2 - Shabestari, Behrouz
A2 - Xing, Lei
PB - Springer Science and Business Media Deutschland GmbH
T2 - 2nd International Workshop on Applications of Medical Artificial Intelligence, AMAI 2023
Y2 - 8 October 2023 through 8 October 2023
ER -