TY - JOUR
T1 - Classification of Pediatric Posterior Fossa Tumors Using Convolutional Neural Network and Tabular Data
AU - Artzi, Moran
AU - Redmard, Erez
AU - Tzemach, Oron
AU - Zeltser, Jonathan
AU - Gropper, Omri
AU - Roth, Jonathan
AU - Shofty, Ben
AU - Kozyrev, Danil A.
AU - Constantini, Shlomi
AU - Ben-Sira, Liat
N1 - Publisher Copyright:
© 2013 IEEE.
PY - 2021
Y1 - 2021
N2 - Posterior fossa tumors (PFT) are the most common tumors in children. Differentiation between the various PFT types is critical, as different tumors have diverse treatment approaches. This study proposes the use of fused architecture comprising two neural networks, a pre-trained ResNet-50 Convolutional Neural Network (CNN) and a tabular based network for the classification of PFT. The study included data for 158 MRI scans of 22 healthy controls and 136 pediatric patients with newly diagnosed PFT (63 Pilocytic Astrocytoma, 57 Medulloblastoma and 16 Ependymoma). The input data for classification were from magnetic resonance imaging: post contrast T1-weighted, fluid attenuated inversion recovery and diffusion Trace images, and tabular data: subject's age. Evaluation of the model was performed in a stratified 5-fold cross-validation manner, based on accuracy, precision, recall and F1 score metrics. Model explanation was performed in terms of visual explanation of the CNN by Gradient-weighted Class Activation Mapping (Grad-CAM) and by testing the contribution to the classification results of the different imaging input data sets and the proposed fused architectures relative to CNN only and tabular only architectures. The best classification results were obtained with the fused CNN + tabular data architecture, and based on diffusion Trace images, achieving mean cross-validation accuracy of 0.88 ± 0.04 for the validation and 0.87 ± 0.02 for the test dataset. Overall, the proposed architecture achieved improvement in accuracy and F1 score compared to CNN method for this dataset. The source code is available on the GitHub repository: https://github.com/artzimy/CNNTabular.
AB - Posterior fossa tumors (PFT) are the most common tumors in children. Differentiation between the various PFT types is critical, as different tumors have diverse treatment approaches. This study proposes the use of fused architecture comprising two neural networks, a pre-trained ResNet-50 Convolutional Neural Network (CNN) and a tabular based network for the classification of PFT. The study included data for 158 MRI scans of 22 healthy controls and 136 pediatric patients with newly diagnosed PFT (63 Pilocytic Astrocytoma, 57 Medulloblastoma and 16 Ependymoma). The input data for classification were from magnetic resonance imaging: post contrast T1-weighted, fluid attenuated inversion recovery and diffusion Trace images, and tabular data: subject's age. Evaluation of the model was performed in a stratified 5-fold cross-validation manner, based on accuracy, precision, recall and F1 score metrics. Model explanation was performed in terms of visual explanation of the CNN by Gradient-weighted Class Activation Mapping (Grad-CAM) and by testing the contribution to the classification results of the different imaging input data sets and the proposed fused architectures relative to CNN only and tabular only architectures. The best classification results were obtained with the fused CNN + tabular data architecture, and based on diffusion Trace images, achieving mean cross-validation accuracy of 0.88 ± 0.04 for the validation and 0.87 ± 0.02 for the test dataset. Overall, the proposed architecture achieved improvement in accuracy and F1 score compared to CNN method for this dataset. The source code is available on the GitHub repository: https://github.com/artzimy/CNNTabular.
KW - Deep learning
KW - convolutional neural networks
KW - posterior fossa tumors
KW - tabular data
UR - http://www.scopus.com/inward/record.url?scp=85107328080&partnerID=8YFLogxK
U2 - 10.1109/ACCESS.2021.3085771
DO - 10.1109/ACCESS.2021.3085771
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
AN - SCOPUS:85107328080
SN - 2169-3536
VL - 9
SP - 91966
EP - 91973
JO - IEEE Access
JF - IEEE Access
M1 - 9446147
ER -