Abstract
Malignant melanoma is considered as one of the most deadly cancers, which has broadly increased worldwide since the last decade. In 2018, around 91,270 cases of melanoma were reported and 9,320 people died in the US. However, diagnosis at the initial stage indicates a high survival rate. The conventional diagnostic methods are expensive, inconvenient and subject to the dermatologist’s expertise as well as a highly equipped environment. Recent achievements in computerized based systems are highly promising with improved accuracy and efficiency. Several measures such as irregularity, contrast stretching, change in origin, feature extraction and feature selection are considered for accurate melanoma detection and classification. Typically, digital dermoscopy comprises four fundamental image processing steps including preprocessing, segmentation, feature extraction and reduction, and lesion classification. Our survey is compared with the existing surveys in terms of preprocessing techniques (hair removal, contrast stretching) and their challenges, lesion segmentation methods, feature extraction methods with their challenges, features selection techniques, datasets for the validation of the digital system, classification methods and performance measure. Also, a brief summary of each step is presented in the tables. The challenges for each step are also described in detail, which clearly indicate why the digital systems are not performing well. Future directions are also given in this survey.
Keywords: Skin lesion, segmentation, feature extraction, classification, melanoma, cancer.
Graphical Abstract
[http://dx.doi.org/10.1016/j.medengphy.2005.07.001] [PMID: 16099191]
[http://dx.doi.org/10.1002/9780470750520.ch3]
[http://dx.doi.org/10.1016/j.ultrasmedbio.2013.04.006] [PMID: 23993172]
[http://dx.doi.org/10.1002/jemt.23220] [PMID: 30768826]
[http://dx.doi.org/10.1002/jemt.23301] [PMID: 31168871]
[http://dx.doi.org/10.1186/1477-7819-6-32] [PMID: 18328106]
[PMID: 10929700]
[http://dx.doi.org/10.7314/APJCP.2013.14.4.2155] [PMID: 23725105]
[http://dx.doi.org/10.1016/S0190-9622(99)70010-1] [PMID: 10534637]
[http://dx.doi.org/10.1007/978-981-10-6614-6_12]
[http://dx.doi.org/10.1358/dot.2005.41.1.875777] [PMID: 15753968]
[http://dx.doi.org/10.1034/j.1600-0846.2000.006001001.x] [PMID: 11428935]
[http://dx.doi.org/10.1001/jama.292.22.2771] [PMID: 15585738]
[http://dx.doi.org/10.1001/archderm.134.12.1563] [PMID: 9875194]
[http://dx.doi.org/10.1016/j.patrec.2019.11.034]
[http://dx.doi.org/10.1016/j.jaad.2010.12.039] [PMID: 21757257]
[http://dx.doi.org/10.1111/j.1600-0846.2011.00503.x] [PMID: 21342292]
[http://dx.doi.org/10.1016/S0895-6111(02)00048-4] [PMID: 12573891]
[http://dx.doi.org/10.1111/j.1365-4632.2008.03556.x] [PMID: 18613881]
[http://dx.doi.org/10.1067/mjd.2003.281] [PMID: 12734496]
[http://dx.doi.org/10.1016/j.jaad.2008.10.065] [PMID: 19389517]
[PMID: 28632800]
[PMID: 27354886]
[http://dx.doi.org/10.1111/bjd.15595] [PMID: 28421597]
[http://dx.doi.org/10.1002/lsm.22600] [PMID: 27785781]
[http://dx.doi.org/10.1002/jbio.201200085] [PMID: 22711418]
[http://dx.doi.org/10.1136/bmjopen-2016-012730] [PMID: 27993903]
[http://dx.doi.org/10.1016/j.infrared.2014.09.017]
[http://dx.doi.org/10.1111/j.1365-2133.2007.07932.x] [PMID: 17535234]
[http://dx.doi.org/10.1016/j.det.2017.06.011] [PMID: 28886806]
[http://dx.doi.org/10.1016/j.det.2017.06.008] [PMID: 28886803]
[http://dx.doi.org/10.5694/j.1326-5377.1997.tb138847.x] [PMID: 9293268]
[http://dx.doi.org/10.1016/S1470-2045(02)00679-4] [PMID: 11902502]
[http://dx.doi.org/10.1109/JSYST.2013.2271540]
[http://dx.doi.org/10.1016/S0738-081X(02)00220-1] [PMID: 12074871]
[http://dx.doi.org/10.1111/j.1365-2133.2009.09093.x] [PMID: 19302072]
[http://dx.doi.org/10.1016/0895-6111(92)90068-K] [PMID: 1623489]
[http://dx.doi.org/10.1111/j.1365-2133.1995.tb08664.x] [PMID: 7718448]
[http://dx.doi.org/10.1001/archderm.139.3.361] [PMID: 12622631]
[http://dx.doi.org/10.1109/ICTTA.2006.1684373]
[http://dx.doi.org/10.1145/972639.972644]
[http://dx.doi.org/10.1016/j.artmed.2012.08.002] [PMID: 23063256]
[http://dx.doi.org/10.1109/ICCICCT.2014.6993179]
[http://dx.doi.org/10.1109/TITB.2009.2017529] [PMID: 19304487]
[http://dx.doi.org/10.1007/s10916-015-0354-8] [PMID: 26411929]
[http://dx.doi.org/10.1109/ICCPCT.2016.7530350]
[http://dx.doi.org/10.1109/GCCT.2015.7342710]
[http://dx.doi.org/10.1016/j.bspc.2011.01.003]
[http://dx.doi.org/10.1201/b19107-5]
[http://dx.doi.org/10.1016/j.cmpb.2016.03.032] [PMID: 27265054]
[http://dx.doi.org/10.1016/j.compmedimag.2008.11.002] [PMID: 19121917]
[http://dx.doi.org/10.1088/1742-6596/787/1/012034]
[http://dx.doi.org/10.1016/S0010-4825(97)00020-6] [PMID: 9437554]
[http://dx.doi.org/10.1109/ICCICCT.2014.6993162]
[http://dx.doi.org/10.1016/j.suscom.2019.08.002]
[http://dx.doi.org/10.1109/CSNT.2014.173]
[http://dx.doi.org/10.1016/j.compbiomed.2011.01.003] [PMID: 21316042]
[http://dx.doi.org/10.1109/JBHI.2017.2653179] [PMID: 28092585]
[http://dx.doi.org/10.1109/EMBC.2014.6945107]
[http://dx.doi.org/10.1109/EMBC.2015.7319013]
[http://dx.doi.org/10.1109/TBME.2012.2209423] [PMID: 22829364]
[http://dx.doi.org/10.1007/978-3-319-11755-3_18]
[http://dx.doi.org/10.1111/j.1600-0846.2011.00544.x] [PMID: 21507072]
[http://dx.doi.org/10.1016/S0895-6111(98)00048-2] [PMID: 9890182]
[http://dx.doi.org/10.1109/isbi.2016.7493447]
[http://dx.doi.org/10.1016/j.patrec.2011.06.015]
[http://dx.doi.org/10.1117/12.770776]
[http://dx.doi.org/10.1109/TIP.2004.833105] [PMID: 15449582]
[http://dx.doi.org/10.1109/TITB.2011.2150758] [PMID: 21550892]
[http://dx.doi.org/10.1109/iccomm.2014.6866757]
[http://dx.doi.org/10.1109/pria.2015.7161640]
[http://dx.doi.org/10.1109/IEMBS.2009.5334045]
[http://dx.doi.org/10.1109/ICRTIT.2016.7569538]
[http://dx.doi.org/10.1109/IAICT.2014.6922110]
[http://dx.doi.org/10.1109/ICIP.2014.7025180]
[http://dx.doi.org/10.1109/TPAMI.2012.213] [PMID: 23599054]
[http://dx.doi.org/10.1109/TPAMI.2007.1177] [PMID: 18084055]
[http://dx.doi.org/10.1109/EMBC.2013.6610250]
[http://dx.doi.org/10.1109/ISBI.2012.6235545]
[http://dx.doi.org/10.1109/34.908974]
[http://dx.doi.org/10.1109/TIP.2014.2362054] [PMID: 25312927]
[http://dx.doi.org/10.1109/CVPR.2010.5540051]
[http://dx.doi.org/10.1007/s10916-019-1413-3] [PMID: 31327058]
[http://dx.doi.org/10.1109/ICCCNT.2013.6726775]
[http://dx.doi.org/10.1016/j.compmedimag.2010.08.001] [PMID: 20832992]
[http://dx.doi.org/10.1109/MeMeA.2015.7145213]
[http://dx.doi.org/10.1109/ICIP.1999.817154]
[http://dx.doi.org/10.1111/srt.12015] [PMID: 23560826]
[http://dx.doi.org/10.1109/WACV.2017.94]
[http://dx.doi.org/10.1007/s12652-018-1075-x]
[http://dx.doi.org/10.1117/12.844572]
[http://dx.doi.org/10.1109/ICIP.2013.6738299]
[http://dx.doi.org/10.1109/IEMBS.2011.6091274]
[http://dx.doi.org/10.1117/12.770824]
[http://dx.doi.org/10.1016/j.cmpb.2010.06.016] [PMID: 20663582]
[http://dx.doi.org/10.1111/j.1600-0846.2010.00472.x] [PMID: 21226876]
[http://dx.doi.org/10.1201/b19107-12]
[http://dx.doi.org/10.1111/j.1600-0846.2011.00562.x] [PMID: 22093020]
[http://dx.doi.org/10.1109/ICTAI.2015.117]
[http://dx.doi.org/10.1016/j.compmedimag.2010.09.006] [PMID: 20970307]
[http://dx.doi.org/10.1109/WGEC.2009.96]
[http://dx.doi.org/10.1109/I2MTC.2015.7151526]
[PMID: 25073179]
[http://dx.doi.org/10.1109/ICIP.2014.7025716]
[http://dx.doi.org/10.1111/j.1600-0846.2011.00504.x] [PMID: 21338405]
[http://dx.doi.org/10.1016/j.compmedimag.2010.08.004] [PMID: 21035303]
[http://dx.doi.org/10.1038/scientificamerican1277-108]
[http://dx.doi.org/10.1016/0016-0032(80)90058-7]
[http://dx.doi.org/10.1016/j.compmedimag.2010.07.002] [PMID: 20724109]
[http://dx.doi.org/10.1016/j.compmedimag.2010.07.007] [PMID: 20800995]
[http://dx.doi.org/10.1111/j.1600-0846.2012.00670.x] [PMID: 22882675]
[http://dx.doi.org/10.1155/2016/2082589]
[http://dx.doi.org/10.1016/j.compmedimag.2011.02.007] [PMID: 21489751]
[http://dx.doi.org/10.1080/09674845.2010.11730316] [PMID: 21294444]
[http://dx.doi.org/10.1109/LSP.2014.2357015]
[http://dx.doi.org/10.1111/j.1600-0846.2011.00569.x] [PMID: 22092500]
[http://dx.doi.org/10.1117/1.JEI.22.4.043037]
[http://dx.doi.org/10.1136/jcp.56.8.619] [PMID: 12890815]
[http://dx.doi.org/10.1111/j.0909-725X.2005.00127.x] [PMID: 16221140]
[http://dx.doi.org/10.1109/TBME.2007.910651] [PMID: 18232357]
[http://dx.doi.org/10.1109/ICIP.2009.5413990]
[http://dx.doi.org/10.1016/j.compmedimag.2011.03.006] [PMID: 21531539]
[http://dx.doi.org/10.1016/j.compmedimag.2010.08.003] [PMID: 20933366]
[http://dx.doi.org/10.1007/978-981-13-1165-9_81]
[http://dx.doi.org/10.1002/jemt.23238] [PMID: 30801840]
[http://dx.doi.org/10.1002/jemt.23320] [PMID: 31209970]
[http://dx.doi.org/10.1007/s10916-019-1466-3] [PMID: 31676931]
[http://dx.doi.org/10.1016/j.amc.2009.04.081]
[http://dx.doi.org/10.2174/157340561101150423103441]
[http://dx.doi.org/10.1109/TITB.2011.2157829] [PMID: 21622078]
[http://dx.doi.org/10.1109/LISATl.2014.6845199]
[http://dx.doi.org/10.1109/ISSPIT.2011.6151559]
[http://dx.doi.org/10.1111/srt.12216] [PMID: 25809473]
[http://dx.doi.org/10.1109/TBME.2013.2283803] [PMID: 24081839]
[http://dx.doi.org/10.1109/ICPEICES.2016.7853624]
[http://dx.doi.org/10.1109/CIBEC.2014.7020931]
[http://dx.doi.org/10.1007/s10489-013-0474-0]
[http://dx.doi.org/10.1016/j.patcog.2016.10.031]
[http://dx.doi.org/10.1109/ICSIPA.2013.6708034]
[http://dx.doi.org/10.1109/TMI.2014.2305769] [PMID: 24770918]
[http://dx.doi.org/10.1109/ICCEET.2012.6203833]
[http://dx.doi.org/10.1109/AISP.2015.7123482]
[http://dx.doi.org/10.1007/978-3-319-11755-3_22]
[http://dx.doi.org/10.1109/ICOSP.2014.7015166]
[http://dx.doi.org/10.1109/ICBDSC.2016.7460367]
[http://dx.doi.org/10.1109/TIP.2016.2615291] [PMID: 27723590]
[http://dx.doi.org/10.1109/EMBC.2015.7319042]
[PMID: 27959832]
[http://dx.doi.org/10.1109/GCCT.2015.7342692]
[http://dx.doi.org/10.1109/ISBI.2017.7950583]
[http://dx.doi.org/10.1109/ISBI.2017.7950514]
[http://dx.doi.org/10.1109/TMI.2016.2528162] [PMID: 26886976]
[http://dx.doi.org/10.1308/147870804290] [PMID: 15333167]
[http://dx.doi.org/10.1016/S0895-6111(03)00054-5] [PMID: 15127750]
[http://dx.doi.org/10.1016/j.bspc.2008.02.003]
[http://dx.doi.org/10.1109/ICIP.2010.5653514]
[http://dx.doi.org/10.1109/CISP.2013.6744054]
[http://dx.doi.org/10.1109/ICCPS.2013.6893488]
[http://dx.doi.org/10.1023/B:VISI.0000022288.19776.77]
[http://dx.doi.org/10.1109/TSMC.1979.4310076]
[http://dx.doi.org/10.1109/JSTSP.2008.2011119]
[http://dx.doi.org/10.1109/IEMBS.2007.4353865]
[http://dx.doi.org/10.1109/EMBC.2015.7319025]
[http://dx.doi.org/10.1109/ISBI.2016.7493448]
[http://dx.doi.org/10.1109/JBHI.2015.2390032] [PMID: 25585429]
[http://dx.doi.org/10.1109/IEMBS.2010.5626500]
[http://dx.doi.org/10.1109/TIM.2012.2192349]
[http://dx.doi.org/10.1109/MeMeA.2011.5966741]
[http://dx.doi.org/10.1109/TFUZZ.2009.2018300]
[http://dx.doi.org/10.1111/j.1600-0846.2012.00636.x] [PMID: 22676490]
[http://dx.doi.org/10.1109/TMI.2017.2695227] [PMID: 28436853]
[http://dx.doi.org/10.3390/s18020556] [PMID: 29439500]
[http://dx.doi.org/10.3233/THC-174633] [PMID: 29758959]
[http://dx.doi.org/10.1016/j.cmpb.2018.05.027] [PMID: 29903489]
[http://dx.doi.org/10.1109/TBME.2012.2227478] [PMID: 23193305]
[http://dx.doi.org/10.1007/978-3-319-47157-0_31]
[http://dx.doi.org/10.1016/j.ultrasmedbio.2016.08.029] [PMID: 27720519]
[PMID: 29993589]
[http://dx.doi.org/10.1109/SIBGRAPI.2010.18]
[http://dx.doi.org/10.1049/cp.2011.0461]
[http://dx.doi.org/10.1109/JSTSP.2008.2010631]
[http://dx.doi.org/10.1109/ITAB.2009.5394389]
[http://dx.doi.org/10.1007/s00521-019-04514-0]
[http://dx.doi.org/10.1109/IEMBS.2011.6090929]
[http://dx.doi.org/10.1109/ACPR.2013.102]
[http://dx.doi.org/10.1109/ICIP.2007.4379575]
[http://dx.doi.org/10.1016/j.patrec.2018.01.021]
[http://dx.doi.org/10.1186/s13640-017-0236-8]
[http://dx.doi.org/10.1049/iet-ipr.2017.0368]
[http://dx.doi.org/10.1016/j.future.2018.05.002]
[http://dx.doi.org/10.1016/j.compag.2018.04.023]
[http://dx.doi.org/10.1016/j.future.2018.04.065]
[http://dx.doi.org/10.1016/j.future.2018.04.074]
[http://dx.doi.org/10.1140/epjp/i2018-11941-0]
[http://dx.doi.org/10.1016/j.cmpb.2018.01.013] [PMID: 29477434]
[http://dx.doi.org/10.1109/10.312091] [PMID: 7959811]
[http://dx.doi.org/10.1109/JSYST.2014.2313671]
[http://dx.doi.org/10.1109/IEMBS.2010.5626500]
[http://dx.doi.org/10.1007/s12293-014-0144-8]
[http://dx.doi.org/10.1109/EMBC.2015.7318937]
[http://dx.doi.org/10.1016/j.compbiomed.2013.11.002] [PMID: 24314859]
[http://dx.doi.org/10.1109/BIBE.2008.4696799]
[http://dx.doi.org/10.1109/PROC.1979.11328]
[http://dx.doi.org/10.1016/j.compmedimag.2009.10.003] [PMID: 19942406]
[http://dx.doi.org/10.1109/ISABEL.2010.5702825]
[http://dx.doi.org/10.1109/MMBIA.2012.6164758]
[http://dx.doi.org/10.1016/j.csda.2011.07.009]
[http://dx.doi.org/10.1109/TBME.2014.2348323] [PMID: 25137721]
[http://dx.doi.org/10.1109/TSMC.1973.4309314]
[http://dx.doi.org/10.1201/b19107-11]
[http://dx.doi.org/10.1007/978-94-007-5389-1_2]
[http://dx.doi.org/10.1109/DICTA.2009.15]
[http://dx.doi.org/10.1109/IEMBS.2006.260056]
[http://dx.doi.org/10.1002/tee.20246]
[http://dx.doi.org/10.1016/j.compmedimag.2015.02.011] [PMID: 25797605]
[http://dx.doi.org/10.1016/j.compmedimag.2007.01.003] [PMID: 17387001]
[http://dx.doi.org/10.1016/j.cmpb.2014.12.001] [PMID: 25540998]
[http://dx.doi.org/10.1111/j.1600-0846.2009.00403.x] [PMID: 20384885]
[http://dx.doi.org/10.1016/j.patcog.2012.07.001]
[http://dx.doi.org/10.1016/S1361-8415(02)00090-7] [PMID: 12467721]
[http://dx.doi.org/10.1111/j.1600-0846.2007.00219.x] [PMID: 17374053]
[http://dx.doi.org/10.1109/JTEHM.2017.2648797] [PMID: 28512610]
[http://dx.doi.org/10.1016/j.compmedimag.2010.09.005] [PMID: 21036538]
[http://dx.doi.org/10.1016/j.cmpb.2017.07.009] [PMID: 28802329]
[http://dx.doi.org/10.1007/s11042-019-07875-9]
[http://dx.doi.org/10.1007/978-3-642-83069-3_1]
[http://dx.doi.org/10.1109/TMI.2016.2633551] [PMID: 27913337]
[http://dx.doi.org/10.1016/S0004-3702(97)00043-X]
[http://dx.doi.org/10.1016/S0031-3203(99)00041-2]
[http://dx.doi.org/10.3233/IDA-1997-1302]
[http://dx.doi.org/10.1038/jid.2008.28] [PMID: 18323788]
[http://dx.doi.org/10.1186/s13640-015-0099-9]
[http://dx.doi.org/10.1109/IEMBS.2010.5626776]
[http://dx.doi.org/10.1109/IEMBS.2010.5627798]
[http://dx.doi.org/10.1109/IPTA.2012.6469560]
[http://dx.doi.org/10.1109/TITB.2012.2212282] [PMID: 22893445]
[http://dx.doi.org/10.1109/TMI.2013.2239307] [PMID: 23335664]
[http://dx.doi.org/10.1109/SPA.2015.7365135]
[http://dx.doi.org/10.5120/20398-2699]
[http://dx.doi.org/10.1109/CoDIT.2016.7593529]
[http://dx.doi.org/10.1109/ICCPCT.2016.7530182]
[http://dx.doi.org/10.1016/j.eswa.2017.08.010]
[http://dx.doi.org/10.1002/jemt.23009] [PMID: 29464868]
[PMID: 29993849]
[http://dx.doi.org/10.1007/s10916-017-0885-2] [PMID: 29318397]
[http://dx.doi.org/10.1186/s12885-018-4465-8] [PMID: 29871593]
[http://dx.doi.org/10.1109/MEMEA.2006.1644462]
[http://dx.doi.org/10.1109/VECIMS.2008.4592778]
[http://dx.doi.org/10.1109/HICSS.2010.76]
[http://dx.doi.org/10.1007/978-3-642-15699-1_49]
[http://dx.doi.org/10.1016/j.compmedimag.2004.04.002] [PMID: 15249068]
[http://dx.doi.org/10.1109/ICPR.2006.764]
[http://dx.doi.org/10.1111/j.1600-0846.2009.00402.x] [PMID: 20384884]
[http://dx.doi.org/10.1016/j.irbm.2013.12.010]
[http://dx.doi.org/10.2174/1874372201004010110]
[http://dx.doi.org/10.1016/j.compmedimag.2010.09.009] [PMID: 21074971]
[http://dx.doi.org/10.1109/SSD.2009.4956770]
[http://dx.doi.org/10.1016/j.patcog.2012.07.027]
[http://dx.doi.org/10.1109/ISBI.2016.7493284]
[http://dx.doi.org/10.1016/j.compmedimag.2008.10.001] [PMID: 19027266]
[http://dx.doi.org/10.1002/1097-0142(20010415)91:8+<1615:AID-CNCR1175>3.0.CO;2-L] [PMID: 11309760]
[http://dx.doi.org/10.1097/00008390-199806000-00009] [PMID: 9664148]
[http://dx.doi.org/10.1002/jemt.22961] [PMID: 29143395]
[http://dx.doi.org/10.1007/978-3-540-69812-8_44]
[http://dx.doi.org/10.1109/JSTSP.2008.2011156]
[http://dx.doi.org/10.1016/j.bspc.2017.09.028]
[http://dx.doi.org/10.1016/j.artmed.2013.11.006] [PMID: 24382424]
[http://dx.doi.org/10.1016/j.ijmedinf.2017.05.016] [PMID: 28750902]
[http://dx.doi.org/10.1007/978-3-319-71767-8_30]
[http://dx.doi.org/10.1109/IEMBS.2011.6090866]
[http://dx.doi.org/10.1109/TBME.2014.2365518] [PMID: 25361498]
[http://dx.doi.org/10.1109/BIC-TA.2011.51]
[http://dx.doi.org/10.1109/IndiaCom.2014.6828177]
[http://dx.doi.org/10.1016/j.jaad.2015.07.028] [PMID: 26386631]
[http://dx.doi.org/10.1109/IMTC.2010.5488165]
[http://dx.doi.org/10.1109/34.667881]
[http://dx.doi.org/10.1016/S0933-3657(02)00087-8] [PMID: 12473390]
[http://dx.doi.org/10.1007/978-94-007-5389-1_4]
[http://dx.doi.org/10.1006/jbin.2001.1004] [PMID: 11376540]
[http://dx.doi.org/10.1002/ima.20261]
[http://dx.doi.org/10.1186/1472-6947-4-4] [PMID: 15113418]
[PMID: 18211602]
[http://dx.doi.org/10.1109/TITB.2004.837859] [PMID: 15787011]
[http://dx.doi.org/10.1109/IEMBS.2008.4649862]
[http://dx.doi.org/10.1016/j.eswa.2011.05.079]
[http://dx.doi.org/10.1007/978-981-10-5547-8_36]
[http://dx.doi.org/10.1109/ATSIP.2017.8075590]
[http://dx.doi.org/10.1016/j.eswa.2013.01.002]
[http://dx.doi.org/10.1109/EMBC.2014.6945106]
[http://dx.doi.org/10.1109/JBHI.2018.2824327]
[http://dx.doi.org/10.1117/12.911664]
[http://dx.doi.org/10.1038/sdata.2018.161]
[http://dx.doi.org/10.1111/j.1365-2133.2006.07396.x] [PMID: 16911283]