Multi-task Learning of Histology and Molecular Markers for Classifying Diffuse Glioma

Xiaofei Wang, Stephen Price, Chao Li (Lead / Corresponding author)

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Most recently, the pathology diagnosis of cancer is shifting to integrating molecular makers with histology features. It is a urgent need for digital pathology methods to effectively integrate molecular markers with histology, which could lead to more accurate diagnosis in the real world scenarios. This paper presents a first attempt to jointly predict molecular markers and histology features and model their interactions for classifying diffuse glioma bases on whole slide images. Specifically, we propose a hierarchical multi-task multi-instance learning framework to jointly predict histology and molecular markers. Moreover, we propose a co-occurrence probability-based label correction graph network to model the co-occurrence of molecular markers. Lastly, we design an inter-omic interaction strategy with the dynamical confidence constraint loss to model the interactions of histology and molecular markers. Our experiments show that our method outperforms other state-of-the-art methods in classifying diffuse glioma, as well as related histology and molecular markers on a multi-institutional dataset.

Original languageEnglish
Title of host publicationMedical Image Computing and Computer Assisted Intervention – MICCAI 2023
Subtitle of host publication26th International Conference, Vancouver, BC, Canada, October 8–12, 2023, Proceedings, Part VII
EditorsHayit Greenspan, Anant Madabhushi, Parvin Mousavi, Septimiu Salcudean, James Duncan, Tanveer Syeda-Mahmood, Russell Taylor
Number of pages11
ISBN (Electronic)9783031439902
ISBN (Print)9783031439896
Publication statusPublished - 1 Oct 2023
Event26th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2023 - Vancouver Convention Centre Canada, Vancouver, Canada
Duration: 8 Oct 202312 Oct 2023
Conference number: 26 (Link to conference information)

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference26th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2023
Abbreviated titleMICCAI
Internet address


  • Diffuse Glioma
  • Digital Pathology
  • Multi-task learning
  • Muti-label Classification

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)


Dive into the research topics of 'Multi-task Learning of Histology and Molecular Markers for Classifying Diffuse Glioma'. Together they form a unique fingerprint.

Cite this