Generic placeholder image

Current Bioinformatics

Editor-in-Chief

ISSN (Print): 1574-8936
ISSN (Online): 2212-392X

Research Article

A Skin Cancer Detector Based on Transfer Learning and Feature Fusion

Author(s): Hongguo Cai, Norriza Brinti Hussin, Huihong Lan* and Hong Li

Volume 18, Issue 6, 2023

Published on: 17 May, 2023

Page: [517 - 526] Pages: 10

DOI: 10.2174/1574893618666230403115540

Price: $65

conference banner
Abstract

Background: With the rapid development of advanced artificial intelligence technologies which have been applied in varying types of applications, especially in the medical field. Cancer is one of the biggest problems in medical sciences. If cancer can be detected and treated early, the possibility of a cure will be greatly increased. Malignant skin cancer is one of the cancers with the highest mortality rate, which cannot be diagnosed in time only through doctors’ experience. We can employ artificial intelligence algorithms to detect skin cancer at an early stage, for example, patients are determined whether suffering from skin cancer by detecting skin damage or spots.

Objective: We use the real HAM10000 image dataset to analyze and predict skin cancer.

Methods: (1) We introduce a lightweight attention module to discover the relationships between features, and we fine-tune the pre-trained model (i.e., ResNet-50) on the HAM10000 dataset to extract the hidden high-level features from the images; (2) we integrate these high-level features with generic statistical features, and use the SMOTE oversampling technique to augment samples from the minority classes; and (3) we input the augmented samples into the XGBoost model for training and predicting.

Results: The experimental results show that the accuracy, sensitivity, and specificity of the proposed SkinDet (Skin cancer detector based on transfer learning and feature fusion) model reached 98.24%, 97.84%, and 98.13%. The proposed model has stronger classification capability for the minority classes, such as dermato fibroma and actinic keratoses.

Conclusion: SkinDet contains a lightweight attention module and can extract the hidden high-level features of the images by fine-tuning the pretrained model on the skin cancer dataset. In particular, SkinDet integrates high-level features with statistical features and augments samples of these minority classes. Importantly, SkinDet can be applied to classify the samples into minority classes.

Graphical Abstract

[1]
Meng Y, Feng L, Shan J, Yuan Z, Jin L. Application of high-frequency ultrasound to assess facial skin thickness in association with gender, age, and BMI in healthy adults. BMC Med Imaging 2022; 22(1): 113-26.
[http://dx.doi.org/10.1186/s12880-022-00839-w] [PMID: 35710358]
[2]
Chang J, Ren Q, Ji Y, Xu M, Xue R. Secure medical data management with privacy-preservation and authentication properties in smart healthcare system. Comput Netw 2022; 212(5): 109013.
[http://dx.doi.org/10.1016/j.comnet.2022.109013]
[3]
Ranga Swamy S, Phani Praveen S, Ahmed S, Naga Srinivasu P, Alhumam A. Multi-features disease analysis based smart diagnosis for COVID-19. Comput Syst Sci Eng 2023; 45(1): 869-86.
[http://dx.doi.org/10.32604/csse.2023.029822]
[4]
Reddy SS, Rajender R, Sethi N. A data mining scheme for detection and classification of diabetes mellitus using voting expert strategy. Int J Knowl -Based Intell 2019; 23(2): 103-8.
[http://dx.doi.org/10.3233/KES-190403]
[5]
Estella F, Suarez E, Lozano B, et al. Design and application of automated algorithms for diagnosis and treatment optimization in neurodegenerative diseases. Neuroinformatics 2022; 20(3): 765-75.
[http://dx.doi.org/10.1007/s12021-022-09578-3] [PMID: 35262881]
[6]
Noor Rehman. A comprehensive study of upward fuzzy preference relation based fuzzy rough set models: Properties and applications in treatment of coronavirus disease. Int J Intell Syst 2021; 45(1): 869-86.
[7]
Boulad A, Daher OA, Al-Badarneh A, et al. The impact of environmental and economic factors on skin cancer. International Conference on Computer Science and Information Technologies. Lviv, Ukraine. 2021; pp. 177-84.
[http://dx.doi.org/10.1109/CSIT52700.2021.9648743]
[8]
Marks R. Epidemiology of melanoma. Clin Exp Dermatol 2000; 25(6): 459-63.
[http://dx.doi.org/10.1046/j.1365-2230.2000.00693.x] [PMID: 11044179]
[9]
A A. A deep learning approach to skin cancer detection in dermoscopy image. J Biomed Phys Eng 2020; 10(6): 801-6.
[PMID: 33364218]
[10]
Mohammed AT. Big data analytics with optimal deep learning model for medical image classification. Comput Syst Sci Eng 2023; 44(2): 1433-49.
[http://dx.doi.org/10.32604/csse.2023.025594]
[11]
Mata C, Munuera J, Lalande A, Ochoa-Ruiz G, Benitez R. MedicalSeg: A medical GUI application for image segmentation management. Algorithms 2022; 15(6): 200-12.
[http://dx.doi.org/10.3390/a15060200]
[12]
Wang F, Jiang MQ, Chen Q, et al. Residual attention network for image classification. IEEE Conference on Computer Vision and Pattern Recognition. 2017; Honolulu, HI, USA. pp. 6450-8.
[13]
Huang G, Liu Z, Maaten LV, et al. Densely connected convolutional networks. IEEE Conference on Computer Vision and Pattern Recognition. 2017; Honolulu, HI, USA. pp. 2261-9.
[14]
Marques G, Ferreras A, de la Torre-Diez I. An ensemble-based approach for automated medical diagnosis of malaria using EfficientNet. Multimedia Tools Appl 2022; 81(19): 28061-78.
[http://dx.doi.org/10.1007/s11042-022-12624-6] [PMID: 35368860]
[15]
Kumar Shukla R, Kumar Tiwari A. Masked face recognition using MobileNet V2 with transfer learning. Comput Syst Sci Eng 2023; 45(1): 293-309.
[http://dx.doi.org/10.32604/csse.2023.027986]
[16]
Mahbod A, Schaefer G, Wang C, Dorffner G, Ecker R, Ellinger I. Transfer learning using a multi-scale and multi-network ensemble for skin lesion classification. Comput Methods Programs Biomed 2020; 193: 105475.
[http://dx.doi.org/10.1016/j.cmpb.2020.105475] [PMID: 32268255]
[17]
Wang L, Chen A, Zhang Y, et al. AK-DL: A shallow neural network model for diagnosing actinic keratosis with better performance than deep neural networks. Diagnostics 2020; 10(4): 217.
[http://dx.doi.org/10.3390/diagnostics10040217] [PMID: 32294962]
[18]
Khan MA, Sharif M, Akram T, Damaševičius R, Maskeliūnas R. Skin lesion segmentation and multiclass classification using deep learning features and improved moth flame optimization. Diagnostics 2021; 11(5): 811.
[http://dx.doi.org/10.3390/diagnostics11050811] [PMID: 33947117]
[19]
Hosny KM, Kassem MA, Fouad MM. Classification of skin lesions into seven classes using transfer learning with AlexNet. J Digit Imaging 2020; 33(5): 1325-34.
[http://dx.doi.org/10.1007/s10278-020-00371-9] [PMID: 32607904]
[20]
Huang HW, Hsu BWY, Lee CH, Tseng VS. Development of a light‐weight deep learning model for cloud applications and remote diagnosis of skin cancers. J Dermatol 2021; 48(3): 310-6.
[http://dx.doi.org/10.1111/1346-8138.15683] [PMID: 33211346]
[21]
Mobiny A, Singh A, Van Nguyen H. Risk-aware machine learning classifier for skin lesion diagnosis. J Clin Med 2019; 8(8): 1241.
[http://dx.doi.org/10.3390/jcm8081241] [PMID: 31426482]
[22]
Liu Y, Yang G, Qiao S, et al. Imbalanced data classification: Using transfer learning and active sampling. Eng Appl Artif Intell 2023; 117: 105621.
[http://dx.doi.org/10.1016/j.engappai.2022.105621]
[23]
Lan ZL, Cai SB, He X, et al. FixCaps: An improved capsules network for diagnosis of skin cancer. IEEE Access 2022; 10: 76261-7.
[http://dx.doi.org/10.1109/ACCESS.2022.3181225]
[24]
Srinivasu PN, SivaSai JG, Ijaz MF, Bhoi AK, Kim W, Kang JJ. Classification of skin disease using deep learning neural networks with MobileNetV2 and LSTM. Sensors 2021; 21(8): 2852.
[http://dx.doi.org/10.3390/s21082852] [PMID: 33919583]
[25]
Al-masni MA, Kim DH, Kim TS. Multiple skin lesions diagnostics via integrated deep convolutional networks for segmentation and classification. Comput Methods Programs Biomed 2020; 190: 105351.
[http://dx.doi.org/10.1016/j.cmpb.2020.105351] [PMID: 32028084]
[26]
Kaur R, Gholamhosseini H, Sinha R. Synthetic images generation using conditional generative adversarial network for skin cancer classification TENCON. Auckland: IEEE 2021; pp. 381-6.
[27]
He KM, Zhang XY, Ren SQ, et al. Deep residual learning for image recognition. IEEE Conference on Computer Vision and Pattern Recognition. 2016; Las Vegas, Nevada, USA. pp. 770-8.
[28]
Chen TQ, Guestrin C. XGBoost: A scalable tree boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016; San Fransisco, USA. pp. 785-94.
[http://dx.doi.org/10.1145/2939672.2939785]
[29]
Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. SMOTE: Synthetic minority over-sampling technique. J Artif Intell Res 2002; 16: 321-57.
[http://dx.doi.org/10.1613/jair.953]
[30]
Tschandl P, Rosendahl C, Kittler H. The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci Data 2018; 5(1): 180161.
[http://dx.doi.org/10.1038/sdata.2018.161] [PMID: 30106392]
[31]
Deng J, Dong W, Socher R, et al. ImageNet: A large-scale hierarchical image database. IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2009; Miami, FL, USA. pp. 248-55.
[32]
Wang QL, Wu BG, Zhu PF, et al. ECA-Net: Efficient channel attention for deep convolutional neural networks. IEEE Conference on Computer Vision and Pattern Recognition. 2020; Seattle, WA, USA. pp. 11531-9.
[http://dx.doi.org/10.1109/CVPR42600.2020.01155]
[33]
Kingma DP, Ba J. Adam: A method for stochastic optimization. Proceedings of 3rd International Conference on Learning Representations. 2015; San Diego, USA.
[34]
Liu B, Zhang XY, Gao ZY, et al. Weld defect images classification with VGG16-based neural network. International Forum on Digital TV and Wireless Multimedia Communications. 2017; Shanghai, China. pp. 215-23.
[http://dx.doi.org/10.1007/978-981-10-8108-8_20]
[35]
Carvalho T, Rezende ERS, Alves MTP, et al. Exposing computer generated images by eye’s region classification via transfer learning of VGG19 CNN. Proceedings of 16th IEEE International Conference on Machine Learning and Applications. 2017; Cancun, Mexico. pp. 866-70.
[http://dx.doi.org/10.1109/ICMLA.2017.00-47]
[36]
Hu MH, Guo H, Ji XY. Automatic driving of end-to-end convolutional neural network based on MobileNet-V2 migration learning. Proceedings of the 12th International Symposium on Visual Information Communication and Interaction. 2019; New York, USA. pp. 1-36.
[http://dx.doi.org/10.1145/3356422.3356458]
[37]
Mednikov Y, Nehemia S, Zheng B, et al. Transfer representation learning using Inception-V3 for the detection of masses in mammography. Proceedings of 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 2018; Honolulu, HI, USA. pp. 2587-90.
[http://dx.doi.org/10.1109/EMBC.2018.8512750]
[38]
Chollet F. Xception: Deep learning with depthwise separable convolutions. IEEE Conference on Computer Vision and Pattern Recognition. 2017; Honolulu, HI, USA. pp. 1800-7.
[http://dx.doi.org/10.1109/CVPR.2017.195]

Rights & Permissions Print Cite
© 2024 Bentham Science Publishers | Privacy Policy