Login Register Cart 0
Generic placeholder image

Current Medical Imaging

Editor-in-Chief

ISSN (Print): 1573-4056
ISSN (Online): 1875-6603

Back
Journal Home About Journal Editorial Board Journal Insight Current Issue Volumes/Issues
Subscribe
Research Article

New Explainable Deep CNN Design for Classifying Breast Tumor Response Over Neoadjuvant Chemotherapy

Author(s): Mohammed El Adoui*, Stylianos Drisis and Mohammed Benjelloun

Volume 19, Issue 5, 2023

Published on: 26 September, 2022

Article ID: e030822207244 Pages: 8

DOI: 10.2174/1573405618666220803124426

Price: $65

Abstract

Purpose: To reduce breast tumor size before surgery, Neoadjuvant Chemotherapy (NAC) is applied systematically to patients with local breast cancer. However, with the existing clinical protocols, it is not yet possible to have an early prediction of the effect of chemotherapy on a breast tumor. Predicting the response to chemotherapy could reduce toxicity and delay effective treatment. Computational analysis of Dynamic Contrast-Enhanced Magnetic Resonance Images (DCE-MRI) through Deep Convolution Neural Network (CNN) has proved a significant performance in classifying responders and no responder’s patients. This study intends to present a new explainable Deep Learning (DL) model predicting the breast cancer response to chemotherapy based on multiple MRI inputs.

Material and Methods: In this study, a cohort of 42 breast cancer patients who underwent chemotherapy was used to train and validate the proposed DL model. This dataset was provided by the Jules Bordet institute of radiology in Brussels, Belgium. 14 external subjects were used to validate the DL model to classify responding or non-responding patients on temporal DCE-MRI volumes. The model performance was assessed by the Area Under the receiver operating characteristic Curve (AUC), accuracy, and features map visualization according to pathological complete response (Ground truth).

Results: The developed deep learning architecture was able to predict the responding breast tumors to chemotherapy treatment in the external validation dataset with an AUC of 0.93 using parallel learning MRI images acquired at different moments. The visual results showed that the most important extracted features from non-responding tumors are in the peripheral and external tumor regions. The model proposed in this study is more efficient compared to those proposed in the literature.

Conclusion: Even with a limited training dataset size, the developed multi-input CNN model using DCE-MR images acquired before and following the first chemotherapy was able to predict responding and non-responding tumors with higher accuracy. Thanks to the visualization of the extracted characteristics by the DL model on the responding and non-responding tumors, the latter could be used henceforth in clinical analysis after its evaluation based on more extra data.

Keywords: Deep learning, CNN, explainable DL, MRI, breast cancer.

Graphical Abstract

[1]
Dutoit JC, Verstraete KL. Whole-body MRI, dynamic contrast-enhanced MRI, and diffusion-weighted imaging for the staging of multiple myeloma. Skeletal Radiol 2017; 46(6): 733-50.
[http://dx.doi.org/10.1007/s00256-017-2609-6] [PMID: 28289855]
[2]
KhanSanaUllahNaveedIslamZahoorJanIkramUd DinRodriguesJ JP CA novel deep learning based framework for the detection and classification of breast cancer using transfer learning. Pattern Recognit Lett 2019; 125: 1-6.
[http://dx.doi.org/10.1016/j.patrec.2019.03.022]
[3]
Ker J, Wang L, Rao J, Lim T. Deep learning applications in medical image analysis. IEEE Access 2017; 6: 9375-89.
[http://dx.doi.org/10.1109/ACCESS.2017.2788044]
[4]
Kuutti S, Bowden R, Jin Y, Barber P, Fallah S. A survey of deep learning applications to autonomous vehicle control. IEEE Trans Intell Transp Syst 2020.
[5]
Chen A, Saouaf J, Zhou B, et al. A deep learning- facilitated radiomics solution for the prediction of lung lesion shrinkage in nonsmall cell lung cancer trials. IEEE 17th International Symposium on Biomedical Imaging (ISBI). 678-82.
[http://dx.doi.org/10.1109/ISBI45749.2020.9098561]
[6]
Arefan D, Mohamed AA, Berg WA, Zuley ML, Sumkin JH, Wu S. Deep learning modeling using normal mammograms for predicting breast cancer risk. Med Phys 2020; 47(1): 110-8.
[http://dx.doi.org/10.1002/mp.13886] [PMID: 31667873]
[7]
Swapna G, Soman KP, Vinayakumar R. Automated detection of cardiac arrhythmia using deep learning techniques. Procedia Comput Sci 2018; 132: 1192-201.
[http://dx.doi.org/10.1016/j.procs.2018.05.034]
[8]
Adoui E. Mohammed, Drisis Stylianos, Mohammed Benjelloun Predict Breast Tumor Response to Chemotherapy Using a 3D Deep Learning Architecture Applied to DCE-MRI DataInternational Work-Conference on Bioinformatics and Biomedical Engineering. Cham: Springer 2019; pp. 33-40.
[http://dx.doi.org/10.1007/978-3-030-17935-9_4]
[9]
Mohammed Adoui E, Mohamed Amine Larhmam, Stylianos Drisis, Mohammed Benjelloun. Deep Learning approach predicting breast tumor response to neoadjuvant treatment using DCE-MRI volumes acquired before and after chemotherapy.Medical Imaging 2019: Computer-Aided Diagnosis. International Society for Optics and Photonics 2019; 10950: 109502I.
[10]
Schettini F, Pascual T, Conte B, et al. HER2-enriched subtype and pathological complete response in HER2-positive breast cancer: A systematic review and meta-analysis. Cancer Treat Rev 2020; 84: 101965.
[http://dx.doi.org/10.1016/j.ctrv.2020.101965] [PMID: 32000054]
[11]
König L, Mairinger FD, Hoffmann O, et al. Dissimilar patterns of tumor-infiltrating immune cells at the invasive tumor front and tumor center are associated with response to neoadjuvant chemotherapy in primary breast cancer. BMC Cancer 2019; 19(1): 120.
[http://dx.doi.org/10.1186/s12885-019-5320-2] [PMID: 30717704]
[12]
Eun NL, Kang D, Son EJ, et al. Texture analysis with 3.0-T MRI for association of response to neoadjuvant chemotherapy in breast cancer. Radiology 2020; 294(1): 31-41.
[http://dx.doi.org/10.1148/radiol.2019182718] [PMID: 31769740]
[13]
El Adoui M, Drisis S, Benjelloun M. A PRM approach for early prediction of breast cancer response to chemotherapy based on regis-tered MR images. Int J CARS 2018; 13(8): 1233-43.
[http://dx.doi.org/10.1007/s11548-018-1790-y] [PMID: 29790078]
[14]
Jahani N, Cohen E, Hsieh M-K, et al. prediction of treatment response to neoadjuvant chemotherapy for Breast cancer via early changes in tumor heterogeneity captured by Dce-MRi registration. Sci Rep 2019; 9(1): 12114.
[http://dx.doi.org/10.1038/s41598-019-48465-x] [PMID: 31431633]
[15]
Ha R, Chin C, Karcich J, et al. Prior to initiation of chemotherapy, can we predict breast tumor response? Deep learning convolutional neural networks approach using a breast MRI tumor dataset. J Digit Imaging 2019; 32(5): 693-701.
[http://dx.doi.org/10.1007/s10278-018-0144-1] [PMID: 30361936]
[16]
El Adoui M, Drisis S, Benjelloun M. Multi-input deep learning architecture for predicting breast tumor response to chemotherapy using quantitative MR images. Int J CARS 2020; 15(9): 1491-500.
[http://dx.doi.org/10.1007/s11548-020-02209-9] [PMID: 32556920]
[17]
Liu MZ, Mutasa S, Chang P, Siddique M, Jambawalikar S, Ha R. A novel CNN algorithm for pathological complete response prediction using an I-SPY trial breast MRI database. Magn Reson Imaging 2020; 73: 148-51.
[http://dx.doi.org/10.1016/j.mri.2020.08.021] [PMID: 32889091]
[18]
Al-Masni MA, Al-Antari MA, Park JM, et al. Simultaneous detection and classification of breast masses in digital mammograms via a deep learning YOLO-based CAD system. Comput Methods Programs Biomed 2018; 157: 85-94.
[http://dx.doi.org/10.1016/j.cmpb.2018.01.017] [PMID: 29477437]
[19]
Joseph Redmon, Divvala Santosh, Girshick Ross, et al. You only look once: Unified, real-time object detection. Proceedings of the IEEE conference on computer vision and pattern recognition. 779-88.
[20]
El Adoui M, Drisis S, Larhmam MA, Lemort M, Benjelloun M. Breast cancer heterogeneity analysis as index of response to treatment using MRI images: A review. Imaging Med 2017; 9(4): 109-19.
[21]
El Adoui M, Drisis S, Benjelloun M. Analyzing breast tumor heterogeneity to predict the response to chemotherapy using 3D MR images registration. Proceedings of the 2017 International Conference on Smart Digital Environment 56-63.
[http://dx.doi.org/10.1145/3128128.3128137]
[22]
Cho N, Im SA, Park IA, et al. Breast cancer: Early prediction of response to neoadjuvant chemotherapy using parametric response maps for MR imaging. Radiology 2014; 272(2): 385-96.
[http://dx.doi.org/10.1148/radiol.14131332] [PMID: 24738612]
[23]
Drisis S, El Adoui M, Flamen P, et al. Early prediction of neoadjuvant treatment outcome in locally advanced breast cancer using para-metric response mapping and radial heterogeneity from breast MRI. J Magn Reson Imaging 2020; 51(5): 1403-11.
[http://dx.doi.org/10.1002/jmri.26996] [PMID: 31737963]
[24]
Little RA, Barjat H, Hare JI, et al. Evaluation of dynamic contrast-enhanced MRI biomarkers for stratified cancer medicine: How do permeability and perfusion vary between human tumours? Magn Reson Imaging 2018; 46: 98-105.
[http://dx.doi.org/10.1016/j.mri.2017.11.008] [PMID: 29154898]
[25]
Drisis S, Metens T, Ignatiadis M, Stathopoulos K, Chao S-L, Lemort M. Quantitative DCE-MRI for prediction of pathological complete response following neoadjuvant treatment for locally advanced breast cancer: The impact of breast cancer subtypes on the diagnostic accuracy. Eur Radiol 2016; 26(5): 1474-84.
[http://dx.doi.org/10.1007/s00330-015-3948-0] [PMID: 26310583]
[26]
Kerwin WS, Zhao X, Yuan C, et al. Contrast-enhanced MRI of carotid atherosclerosis: Dependence on contrast agent. J Magn Reson Imaging 2009; 30(1): 35-40.
[http://dx.doi.org/10.1002/jmri.21826] [PMID: 19557844]
[27]
Qassim H, Verma A, Feinzimer D. Compressed residual-VGG16 CNN model for big data places image recognition. IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC). IEEE 2018; 169-75.
[http://dx.doi.org/10.1109/CCWC.2018.8301729]
[28]
Glorot Xavier et, Bengio Yoshua. Understanding the difficulty of training deep feedforward neural networks. Proceedings of the thir-teenth international conference on artificial intelligence and statistics 249-56.
[29]
Zhang S, Choromanska AE, LeCun Y. Deep learning with elastic averaging SGD. Adv Neural Inf Process Syst 2015; 685-93.
[30]
Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE international conference on computer vision. 618-26.
[http://dx.doi.org/10.1109/ICCV.2017.74]
[31]
Mahmoudi SA, El Adoui M, Belarbi MA, Larhmam MA, Lecron F. Cloud-based platform for computer vision applications. Proceedings of the 2017 International Conference on Smart Digital Environment 195-200.
[http://dx.doi.org/10.1145/3128128.3128158]

Rights & Permissions Print Cite
Article Metrics
1
© 2024 Bentham Science Publishers | Privacy Policy