Abstract
The characterization of Tumor MicroEnvironment (TME) is challenging due to its complexity and heterogeneity. Relatively consistent TME characteristics embedded within highly specific tissue features, render them difficult to predict. The capability to accurately classify TME subtypes is of critical significance for clinical tumor diagnosis and precision medicine. Based on the observation that tumors with different origins share similar microenvironment patterns, we propose PathoTME, a genomics-guided Siamese representation learning framework employing Whole Slide Image (WSI) for pan-cancer TME subtypes prediction. Specifically, we utilize Siamese network to leverage genomic information as a regularization factor to assist WSI embeddings learning during the training phase. Additionally, we employ Domain Adversarial Neural Network (DANN) to mitigate the impact of tissue type variations. To eliminate domain bias, a dynamic WSI prompt is designed to further unleash the model’s capabilities. Our model achieves better performance than other state-of-the-art methods across 23 cancer types on TCGA dataset. Our code is available at https://github.com/bm2-lab/PathoTME.
Original language | English |
---|---|
Title of host publication | Medical Image Computing and Computer Assisted Intervention – MICCAI 2024 |
Subtitle of host publication | 27th International Conference, Marrakesh, Morocco, October 6–10, 2024, Proceedings, Part III |
Editors | Marius George Linguraru, Qi Dou, Aasa Feragen, Stamatia Giannarou, Ben Glocker, Karim Lekadir, Julia A. Schabel |
Place of Publication | Cham |
Publisher | Springer |
Chapter | 20 |
Pages | 206-216 |
Number of pages | 11 |
Edition | 1 |
ISBN (Electronic) | 9783031723841 |
ISBN (Print) | 9783031723834 |
DOIs | |
Publication status | Published - 3 Oct 2024 |
Event | 27th International Conference on Medical Image Computing and Computer-Assisted Intervention - Palmeraie Conference Centre, Marrakesh, Morocco Duration: 6 Oct 2024 → 10 Oct 2024 Conference number: 27th https://conferences.miccai.org/2024/en/ (Conference Website) |
Publication series
Name | Lecture Notes in Computer Science (LNCS) |
---|---|
Publisher | Springer |
Volume | 15003 |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Conference
Conference | 27th International Conference on Medical Image Computing and Computer-Assisted Intervention |
---|---|
Abbreviated title | MICCAI 2024 |
Country/Territory | Morocco |
City | Marrakesh |
Period | 6/10/24 → 10/10/24 |
Internet address |
|