Background and Objective: Ulcerative colitis (UC) is an inflammatory bowel disease (IBD) affecting the colon and the rectum characterized by a remitting-relapsing course. To detect mucosal inflammation as-sociated with UC, histology is considered the most stringent criteria. In turn, histologic remission (HR) correlates with improved clinical outcomes and has been recently recognized as a desirable treatment target. The leading biomarker for assessing histologic remission is the presence or absence of neutrophils. Therefore, the finding of this cell in specific colon structures indicates that the patient has UC activity. However, no previous studies based on deep learning have been developed to identify UC based on neu-trophils detection using whole-slide images (WSI). Methods: The methodological core of this work is a novel multiple instance learning (MIL) framework with location constraints able to determine the presence of UC activity using WSI. In particular, we put forward an effective way to introduce constraints about positive instances to effectively explore additional weakly supervised information that is easy to obtain and enjoy a significant boost to the learning process. In addition, we propose a new weighted embedding to enlarge the relevance of the positive instances. Results: Extensive experiments on a multi-center dataset of colon and rectum WSIs, PICASSO-MIL, demon-strate that using the location information we can improve considerably the results at WSI-level. In com-parison with prior MIL settings, our method allows for 10% improvements in bag-level accuracy. Conclusion : Our model, which introduces a new form of constraints, surpass the results achieved from current state-of-the-art methods that focus on the MIL paradigm. Our method can be applied to other histological concerns where the morphological features determining a positive WSI are tiny and similar to others in the image. (c) 2022 Elsevier B.V. All rights reserved.

Constrained multiple instance learning for ulcerative colitis prediction using histological images / R. Del Amor, P. Meseguer, T.L. Parigi, V. Villanacci, A. Colomer, L. Launet, A. Bazarova, G.E. Tontini, R. Bisschops, G. de Hertogh, J.G. Ferraz, M. Götz, X. Gui, B. Hayee, M. Lazarev, R. Panaccione, A. Parra-Blanco, P. Bhandari, L. Pastorelli, T. Rath, E.S. Røyset, M. Vieth, D. Zardo, E. Grisan, S. Ghosh, M. Iacucci, V. Naranjo. - In: COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE. - ISSN 0169-2607. - 224:(2022 Sep), pp. 107012.1-107012.8. [10.1016/j.cmpb.2022.107012]

Constrained multiple instance learning for ulcerative colitis prediction using histological images

G.E. Tontini;L. Pastorelli;
2022

Abstract

Background and Objective: Ulcerative colitis (UC) is an inflammatory bowel disease (IBD) affecting the colon and the rectum characterized by a remitting-relapsing course. To detect mucosal inflammation as-sociated with UC, histology is considered the most stringent criteria. In turn, histologic remission (HR) correlates with improved clinical outcomes and has been recently recognized as a desirable treatment target. The leading biomarker for assessing histologic remission is the presence or absence of neutrophils. Therefore, the finding of this cell in specific colon structures indicates that the patient has UC activity. However, no previous studies based on deep learning have been developed to identify UC based on neu-trophils detection using whole-slide images (WSI). Methods: The methodological core of this work is a novel multiple instance learning (MIL) framework with location constraints able to determine the presence of UC activity using WSI. In particular, we put forward an effective way to introduce constraints about positive instances to effectively explore additional weakly supervised information that is easy to obtain and enjoy a significant boost to the learning process. In addition, we propose a new weighted embedding to enlarge the relevance of the positive instances. Results: Extensive experiments on a multi-center dataset of colon and rectum WSIs, PICASSO-MIL, demon-strate that using the location information we can improve considerably the results at WSI-level. In com-parison with prior MIL settings, our method allows for 10% improvements in bag-level accuracy. Conclusion : Our model, which introduces a new form of constraints, surpass the results achieved from current state-of-the-art methods that focus on the MIL paradigm. Our method can be applied to other histological concerns where the morphological features determining a positive WSI are tiny and similar to others in the image. (c) 2022 Elsevier B.V. All rights reserved.
Attention-embedding weights; Histologic remission; Location constraints; Neutrophils; Ulcerative colitis
Settore MED/12 - Gastroenterologia
set-2022
Article (author)
File in questo prodotto:
File Dimensione Formato  
1-s2.0-S0169260722003947-main.pdf

accesso aperto

Descrizione: Article
Tipologia: Publisher's version/PDF
Dimensione 2.02 MB
Formato Adobe PDF
2.02 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2434/962506
Citazioni
  • ???jsp.display-item.citation.pmc??? 0
  • Scopus 15
  • ???jsp.display-item.citation.isi??? 10
social impact