TY - JOUR
T1 - Advancing automated digital pathology by rapid spectral imaging and AI for nuclear segmentation
AU - Soker, Adam
AU - Brozgol, Eugene
AU - Barshack, Iris
AU - Garini, Yuval
N1 - Publisher Copyright:
© 2024 The Author(s)
PY - 2025/2
Y1 - 2025/2
N2 - Cancer is one of the leading causes of death worldwide and stained tissues’ biopsy analysis remains the standard method for pathology diagnostics. Major optical developments have improved pathological diagnostics lately. High quality microscopic optical scanners now allow whole-slide imaging of tissue sections and with the accessibility of datasets, digital imaging becomes attractive for biopsy analysis. Beyond its user-friendly features for image review and telepathology, digital imaging also enables the utilization of image processing and artificial intelligence (AI) which are advantageous for numerous applications. Nevertheless, AI faces significant barriers to widespread adoption. In order to extend the use of AI for clinical use in pathology, here we present an advanced approach for analyzing Hematoxylin and Eosin-stained biopsies and identify cancer cells. Our approach relies on the fusion of rapid spectral imaging measurements of biopsies with tailored machine learning algorithms designed explicitly for spectral images. The spectrum measured at each pixel provides much more information than standard color, that contains only three values of red, green, and blue intensities. We lately found that the spectral information provides high separability of normal and cancerous cells in Hematoxylin and Eosin-stained biopsies. This breakthrough surpasses previous obstacles, marking the potential for utilizing spectral imaging for cancer identification. Nevertheless, the method required identifying the nuclei in the tissue, a complex task that has not yet been addressed. Here, we demonstrate a rapid spectral imaging system combining artificial intelligence procedures for spectral-based nuclear segmentation using U-net models, with an adjusted input layer for the spectral imaging size. We trained two models; one with the full measured spectrum, and one based on color produced from the spectra. Excellent segmentation performance is achieved with both models, but the model trained on the full spectrum achieved significantly better results. The high performance of spectral image-based segmentation together with the simplicity of the system makes it applicable for tissue analysis and cancer classification in the clinical arena.
AB - Cancer is one of the leading causes of death worldwide and stained tissues’ biopsy analysis remains the standard method for pathology diagnostics. Major optical developments have improved pathological diagnostics lately. High quality microscopic optical scanners now allow whole-slide imaging of tissue sections and with the accessibility of datasets, digital imaging becomes attractive for biopsy analysis. Beyond its user-friendly features for image review and telepathology, digital imaging also enables the utilization of image processing and artificial intelligence (AI) which are advantageous for numerous applications. Nevertheless, AI faces significant barriers to widespread adoption. In order to extend the use of AI for clinical use in pathology, here we present an advanced approach for analyzing Hematoxylin and Eosin-stained biopsies and identify cancer cells. Our approach relies on the fusion of rapid spectral imaging measurements of biopsies with tailored machine learning algorithms designed explicitly for spectral images. The spectrum measured at each pixel provides much more information than standard color, that contains only three values of red, green, and blue intensities. We lately found that the spectral information provides high separability of normal and cancerous cells in Hematoxylin and Eosin-stained biopsies. This breakthrough surpasses previous obstacles, marking the potential for utilizing spectral imaging for cancer identification. Nevertheless, the method required identifying the nuclei in the tissue, a complex task that has not yet been addressed. Here, we demonstrate a rapid spectral imaging system combining artificial intelligence procedures for spectral-based nuclear segmentation using U-net models, with an adjusted input layer for the spectral imaging size. We trained two models; one with the full measured spectrum, and one based on color produced from the spectra. Excellent segmentation performance is achieved with both models, but the model trained on the full spectrum achieved significantly better results. The high performance of spectral image-based segmentation together with the simplicity of the system makes it applicable for tissue analysis and cancer classification in the clinical arena.
KW - AI pathology
KW - Digital pathology
KW - H&E-stained biopsies
KW - Segmentation
KW - Spectral imaging
KW - Tissue diagnostics
KW - Whole slide imaging
UR - http://www.scopus.com/inward/record.url?scp=85207896399&partnerID=8YFLogxK
U2 - 10.1016/j.optlastec.2024.111988
DO - 10.1016/j.optlastec.2024.111988
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
AN - SCOPUS:85207896399
SN - 0030-3992
VL - 181
JO - Optics and Laser Technology
JF - Optics and Laser Technology
M1 - 111988
ER -