Abstract
Background: Computer vision in general and semantic segmentation has experienced many achievements in recent years. Consequently, the emergence of medical imaging has provided new opportunities for conducting artificial intelligence research. Since cancer is the second-leading cause of death in the world, early-stage diagnosis is an essential process that directly slows down the development speed of cancer.
Methods: Deep neural network-based methods are anticipated to reduce diagnosis time for pathologists.
Results: In this research paper, an approach to liver tumor identification based on two types of medical images has been presented: computed tomography scans and whole-slide. It is constructed based on the improvement of U-Net and GLNet architectures. It also includes sub-modules that are combined with segmentation models to boost up the overall performance during inference phases.
Conclusion: Based on the experimental results, the proposed unified framework has been emerging to be used in the production environment.
Keywords: Tumor segmentation, radiology, histopathology, neural networks, framework, deep learning.
Graphical Abstract
[2]
Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical image computing and computer-assisted intervention. 234-41.
[http://dx.doi.org/10.1007/978-3-319-24574-4_28]
[http://dx.doi.org/10.1007/978-3-319-24574-4_28]
[3]
Milletari F, Navab N, Ahmadi S-A. V-net: Fully convolutional neural networks for volumetric medical image segmentation. 2016 4th International Conference on 3D vision (3DV). 565-71.
[http://dx.doi.org/10.1109/3DV.2016.79]
[http://dx.doi.org/10.1109/3DV.2016.79]
[4]
Li X, Chen H, Qi X, Dou Q, Fu CW, Heng P-A. H-denseunet: Hybrid densely connected unet for liver and tumor segmentation from ct volumes. IEEE Trans Med Imaging 2018; 37(12): 2663-74.
[http://dx.doi.org/10.1109/TMI.2018.2845918] [PMID: 29994201]
[http://dx.doi.org/10.1109/TMI.2018.2845918] [PMID: 29994201]
[5]
Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J. Unet++: A nested unet architecture for medical image segmentation.Deep learning in medical image analysis and multimodal learning for clinical decision support DLMIA 2018, ML-CDS. 2018; pp. 3-11.
[http://dx.doi.org/10.1007/978-3-030-00889-5_1]
[http://dx.doi.org/10.1007/978-3-030-00889-5_1]
[6]
Weng Y, Zhou T, Li Y, Qiu X. Nas-unet: Neural architecture search for medical image segmentation. IEEE Access 2019; (7): 44247-57.
[http://dx.doi.org/10.1109/ACCESS.2019.2908991]
[http://dx.doi.org/10.1109/ACCESS.2019.2908991]
[7]
Nguyen H, Huynh T, Hoang S, et al. Language-oriented sentiment analysis based on the grammar structure and improved Self-attention network. Proceedings of 15th International Conference on Evaluation of Novel Approaches to Software Engineering.
[http://dx.doi.org/10.5220/0009358803390346]
[http://dx.doi.org/10.5220/0009358803390346]
[8]
Phan T, Pham V, et al. Ontology-based resume searching system for job applicants in information technology. Proceedings of 34th International Conference on. In publishing.
[9]
Khan A, Narejo G. Analysis of abdominal computed tomography images for automatic liver cancer diagnosis using image processing algorithm. Curr Med Imaging 2019; 15(10): 972-82.
[http://dx.doi.org/10.2174/1573405615666190716122040]
[http://dx.doi.org/10.2174/1573405615666190716122040]
[10]
Wu W, Wu S, Zhou Z, Zhang R, Zhang Y. 3D liver tumor segmentation in CT images using improved fuzzy C-means and graph cuts. BioMed Res Int 2017; 2017: 5207685.
[http://dx.doi.org/10.1155/2017/5207685] [PMID: 29090220]
[http://dx.doi.org/10.1155/2017/5207685] [PMID: 29090220]
[11]
Haralick RM, Shapiro LG. Image segmentation techniques. Computer vision, graphics, and image processing 1985; 29(1): 100-32.
[http://dx.doi.org/10.1117/12.948400]
[http://dx.doi.org/10.1117/12.948400]
[12]
Yuheng S, Hao Y. Image segmentation algorithms overview. 2017 Asia Modelling Symposium (AMS). 103-97.
[13]
Nguyen B, Trinh M, Phan T, Nguyen H. An efficient real-time emotion detection using camera and facial landmarks. Proceedings of The Seventh International Conference on Information Science and Technology.
[http://dx.doi.org/10.1109/ICIST.2017.7926765]
[http://dx.doi.org/10.1109/ICIST.2017.7926765]
[14]
Huynh A, Nguyen BT, Nguyen HT, Vu S, Nguyen HD. A method of deep reinforcement learning for simulated autonomous vehicle control. Proceedings of 16th International Conference on Evaluation of Novel Approaches to Software Engineering.
[http://dx.doi.org/10.5220/0010478903720379]
[http://dx.doi.org/10.5220/0010478903720379]
[15]
Srimathi S, Yamuna G, Nanmaran R. An efficient cancer classification model for CT/MRI/PET fused images. Curr Med Imaging 2021; 17(3): 319-30.
[16]
Ker J, Wang L, Rao J, Lim T. Deep learning applications in medical analysis. IEEE Access 2018; (6): 9375-89.
[http://dx.doi.org/10.1109/ACCESS.2017.2788044]
[http://dx.doi.org/10.1109/ACCESS.2017.2788044]
[17]
Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition.
[18]
Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O. 3d unet: learning dense volumetric segmentation from sparse annotation. International conference on medical image computing and computer-assisted intervention.
[19]
Chen H, Dou Q, Yu L, Qin J, Heng P-A. VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images. Neuroimage 2018; 170(170): 446-55.
[http://dx.doi.org/10.1016/j.neuroimage.2017.04.041] [PMID: 28445774]
[http://dx.doi.org/10.1016/j.neuroimage.2017.04.041] [PMID: 28445774]
[20]
Meng L, Tian Y, Bu S. Liver tumor segmentation based on 3D convolutional neural network with dual scale. J Appl Clin Med Phys 2020; 21(1): 144-57.
[http://dx.doi.org/10.1002/acm2.12784]
[http://dx.doi.org/10.1002/acm2.12784]
[21]
Nguyen H, Tran P, Pham V, Nguyen H. Design a learning model of mobile vision to detect diabetic retinopathy based on the improvement of mobilenetv2.Int J Digital Enterprise Technology IJDET. 2021.
[22]
Sandler M, Howard A, Zhu M, Zhmoginov A, L C. Mobilenetv2: Inverted residuals and linear bottlenecks. IEEE International Conferene on Computer Vision and Pattern Recognition.
[http://dx.doi.org/10.1109/CVPR.2018.00474]
[http://dx.doi.org/10.1109/CVPR.2018.00474]
[23]
Litjens G, Kooi T, Bejnordi BE, et al. A survey on deep learning in medical image analysis. Med Image Anal 2017; 42(42): 60-88.
[http://dx.doi.org/10.1016/j.media.2017.07.005] [PMID: 28778026]
[http://dx.doi.org/10.1016/j.media.2017.07.005] [PMID: 28778026]
[25]
Kim YJ, Jang H, Lee K, et al. PAIP 2019: Liver cancer segmentation challenge. Med Image Anal 2021; 67(67): 101854.
[http://dx.doi.org/10.1016/j.media.2020.101854] [PMID: 33091742]
[http://dx.doi.org/10.1016/j.media.2020.101854] [PMID: 33091742]
[26]
Aresta G, Araújo T, Kwok S, et al. BACH: Grand challenge on breast cancer histology images. Med Image Anal 2019; 56(56): 122-39.
[http://dx.doi.org/10.1016/j.media.2019.05.010] [PMID: 31226662]
[http://dx.doi.org/10.1016/j.media.2019.05.010] [PMID: 31226662]
[27]
Li J, Yang S, Huang X, Da Q, et al. Signet ring cell detection with a semi-supervised learning framework. International Conference on Information Processing in Medical Imaging.
[http://dx.doi.org/10.1007/978-3-030-20351-1_66]
[http://dx.doi.org/10.1007/978-3-030-20351-1_66]
[28]
Sirinukunwattana K, Raza S E A, et al. Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images. IEEE Trans Med Imaging 2019; 35(5): 1196-206.
[29]
Schlemper J, Oktay O, Schaap M, et al. 2019.
[http://dx.doi.org/10.1016/j.media.2019.01.012] [PMID: 30802813]
[http://dx.doi.org/10.1016/j.media.2019.01.012] [PMID: 30802813]
[30]
Chen W, Jiang Z, Wang Z, Cui K, Qian X. Collaborative global-local networks for memory-efficient segmentation of ultra-high resolution images. IEEE International Conference of Computer Vision and Pattern Recognition (CVPR).
[http://dx.doi.org/10.1109/CVPR.2019.00913]
[http://dx.doi.org/10.1109/CVPR.2019.00913]
[31]
Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. 3rd International Conference on Learning Representations (ICLR).
[32]
He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. IEEE International conference on Computer Vision and Pattern Recognition (CVPR).
[http://dx.doi.org/10.1109/CVPR.2016.90]
[http://dx.doi.org/10.1109/CVPR.2016.90]
[33]
Szegedy C, Ioffe S, Vanhoucke V, Alemi A. Inception-v4, inception-ResNet and the impact of residual connections on learning. 31st AAAI Conference on Artificial Intelligence (AAAI). 4278-84.
[34]
Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need. 31st Conference on Neural Information Processing Systems (NIPS).
[35]
Schlemper J, Oktay O, Schaap M, et al. Attention gated networks: Learning to leverage salient regions in medical images. Med Image Anal 2019; 53(53): 197-207.
[http://dx.doi.org/10.1016/j.media.2019.01.012] [PMID: 30802813]
[http://dx.doi.org/10.1016/j.media.2019.01.012] [PMID: 30802813]
[36]
Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille A L. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFS. IEEE Trans Pattern Anal Mach Intell 2017; 40(4): 834-48.
[37]
Zhao H, Shi J, Qi X, Wang X, Jia J. Pyramid scene parsing network. IEEE International conference on Computer Vision and Pattern Recognition (CVPR).
[http://dx.doi.org/10.1109/CVPR.2017.660]
[http://dx.doi.org/10.1109/CVPR.2017.660]
[38]
Demir I, Koperski K, Lindenbaum D, et al. Deepglobe 2018: A challenge to parse the earth through satellite images. IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops.
[http://dx.doi.org/10.1109/CVPRW.2018.00031]
[http://dx.doi.org/10.1109/CVPRW.2018.00031]
[39]
Codella NC, Gutman D, Celebi ME, et al. Skin lesion analysis toward melanoma detection: A challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), hosted by the International Skin Imaging Collaboration (ISIC). IEEE 15th International Symposium on Biomedical Imaging. 168-72.
[40]
Maggiori E, Tarabalka Y, Charpiat G, Alliez P. Can semantic labeling methods generalize to any city? the inria aerial image labeling benchmark. IEEE International Geoscience and Remote Sensing Symposium. 3226-9.
[http://dx.doi.org/10.1109/IGARSS.2017.8127684]
[http://dx.doi.org/10.1109/IGARSS.2017.8127684]
[41]
Bilic P, Christ P F, Vorontsov E. The liver tumor segmentation benchmark (LiTS). arXiv preprint arXiv:190104056.
[http://dx.doi.org/10.1109/IGARSS.2017.8127684]
[http://dx.doi.org/10.1109/IGARSS.2017.8127684]
[42]
Lin T, Goyal P, Girshick R, He , Doll'ar . Focal loss for dense object detection. IEEE International Conference on Computer Vision (ICCV) 2017.
[43]
Do N, Nguyen H, Selamat A. Knowledge-based model of expert systems using rela-model. Int J Softw Eng Knowl Eng 2018; 28(8): 1047-90.
[http://dx.doi.org/10.1142/S0218194018500304]
[http://dx.doi.org/10.1142/S0218194018500304]
[44]
Nguyen HD, Tran DA, Do HP, Pham V. Design an intelligent system to automatically tutor the method for solving problems. Int J Integr Eng 2020; 12(7): 211-23.
[http://dx.doi.org/10.30880/ijie.2020.12.07.024]
[http://dx.doi.org/10.30880/ijie.2020.12.07.024]
Article Metrics
2