Deep Learning Multi-Domain Model Provides Accurate Detection and Grading of Mucosal Ulcers in Different Capsule Endoscopy Types

Tom Kratter, Noam Shapira, Yarden Lev, Or Mauda, Yehonatan Moshkovitz, Roni Shitrit, Shani Konyo, Offir Ukashi, Lior Dar, Oranit Shlomi, Ahmad Albshesh, Shelly Soffer, Eyal Klang, Shomron Ben Horin, Rami Eliakim, Uri Kopylov, Reuma Margalit Yehuda*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Background and Aims: The aim of our study was to create an accurate patient-level combined algorithm for the identification of ulcers on CE images from two different capsules. Methods: We retrospectively collected CE images from PillCam-SB3′s capsule and PillCam-Crohn’s capsule. ML algorithms were trained to classify small bowel CE images into either normal or ulcerated mucosa: a separate model for each capsule type, a cross-domain model (training the model on one capsule type and testing on the other), and a combined model. Results: The dataset included 33,100 CE images: 20,621 PillCam-SB3 images and 12,479 PillCam-Crohn’s images, of which 3582 were colonic images. There were 15,684 normal mucosa images and 17,416 ulcerated mucosa images. While the separate model for each capsule type achieved excellent accuracy (average AUC 0.95 and 0.98, respectively), the cross-domain model achieved a wide range of accuracies (0.569–0.88) with an AUC of 0.93. The combined model achieved the best results with an average AUC of 0.99 and average mean patient accuracy of 0.974. Conclusions: A combined model for two different capsules provided high and consistent diagnostic accuracy. Creating a holistic AI model for automated capsule reading is an essential part of the refinement required in ML models on the way to adapting them to clinical practice.

Original languageEnglish
Article number2490
JournalDiagnostics
Volume12
Issue number10
DOIs
StatePublished - Oct 2022

Keywords

  • Crohn’s disease
  • capsule endoscopy
  • machine learning

Fingerprint

Dive into the research topics of 'Deep Learning Multi-Domain Model Provides Accurate Detection and Grading of Mucosal Ulcers in Different Capsule Endoscopy Types'. Together they form a unique fingerprint.

Cite this