Backgrounds and Aims Mucosal healing (MH) in inflammatory bowel diseases (IBD) is an important landmark for clinical decision making. Artificial intelligence systems (AI) that automatically deliver the grade of endoscopic inflammation may solve moderate interobserver agreement and the need of central reading in clinical trials. Methods We performed a systematic review of EMBASE and MEDLINE databases up to 01/12/2022 following PRISMA and the Joanna Briggs Institute methodologies to answer the following question: “Can AI replace endoscopists when assessing MH in IBD?”. The research was restricted to ulcerative colitis (UC), and a diagnostic odds ratio (DOR) meta-analysis was performed. Risk of bias was evaluated with QUADAS-2 tool. Results A total of 21 / 739 records were selected for full text evaluation, and 12 were included in the meta-analysis. Deep learning algorithms based on convolutional neural networks architecture achieved a satisfactory performance in evaluating MH on UC, with sensitivity, specificity, DOR and SROC of respectively 0.91(CI95 %:0.86–0.95);0.89(CI95 %:0.84–0.93);92.42(CI95 %:54.22–157.53) and 0.957 when evaluating fixed images (n = 8) and 0.86(CI95 %:0.75–0.93);0.91(CI95 %:0.87–0.94);70.86(CI95 %:24.63–203.86) and 0.941 when evaluating videos (n = 6). Moderate-high levels of heterogeneity were noted, limiting the quality of the evidence. Conclusions AI systems showed high potential in detecting MH in UC with optimal diagnostic performance, although moderate-high heterogeneity of the data was noted. Standardised and shared AI training may reduce heterogeneity between systems.
Can artificial intelligence replace endoscopists when assessing mucosal healing in ulcerative colitis? A systematic review and diagnostic test accuracy meta-analysis / A. Rimondi, K. Gottlieb, E.J. Despott, M. Iacucci, A. Murino, G.E. Tontini. - In: DIGESTIVE AND LIVER DISEASE. - ISSN 1590-8658. - 99:2(2024), pp. 137-145.e3. [Epub ahead of print] [10.1016/j.dld.2023.11.005]
Can artificial intelligence replace endoscopists when assessing mucosal healing in ulcerative colitis? A systematic review and diagnostic test accuracy meta-analysis
G.E. TontiniUltimo
2024
Abstract
Backgrounds and Aims Mucosal healing (MH) in inflammatory bowel diseases (IBD) is an important landmark for clinical decision making. Artificial intelligence systems (AI) that automatically deliver the grade of endoscopic inflammation may solve moderate interobserver agreement and the need of central reading in clinical trials. Methods We performed a systematic review of EMBASE and MEDLINE databases up to 01/12/2022 following PRISMA and the Joanna Briggs Institute methodologies to answer the following question: “Can AI replace endoscopists when assessing MH in IBD?”. The research was restricted to ulcerative colitis (UC), and a diagnostic odds ratio (DOR) meta-analysis was performed. Risk of bias was evaluated with QUADAS-2 tool. Results A total of 21 / 739 records were selected for full text evaluation, and 12 were included in the meta-analysis. Deep learning algorithms based on convolutional neural networks architecture achieved a satisfactory performance in evaluating MH on UC, with sensitivity, specificity, DOR and SROC of respectively 0.91(CI95 %:0.86–0.95);0.89(CI95 %:0.84–0.93);92.42(CI95 %:54.22–157.53) and 0.957 when evaluating fixed images (n = 8) and 0.86(CI95 %:0.75–0.93);0.91(CI95 %:0.87–0.94);70.86(CI95 %:24.63–203.86) and 0.941 when evaluating videos (n = 6). Moderate-high levels of heterogeneity were noted, limiting the quality of the evidence. Conclusions AI systems showed high potential in detecting MH in UC with optimal diagnostic performance, although moderate-high heterogeneity of the data was noted. Standardised and shared AI training may reduce heterogeneity between systems.File | Dimensione | Formato | |
---|---|---|---|
1-s2.0-S159086582301023X-main.pdf
accesso riservato
Descrizione: online first
Tipologia:
Publisher's version/PDF
Dimensione
1.77 MB
Formato
Adobe PDF
|
1.77 MB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.