Abstract
Background: Interpretation of medical images for the diagnosis and treatment of complex diseases from high-dimensional and heterogeneous data remains a key challenge in transforming healthcare. In the last few years, both supervised and unsupervised deep learning achieved promising results in the area of medical image analysis. Several reviews on supervised deep learning are published, but hardly any rigorous review on unsupervised deep learning for medical image analysis is available.
Objective: The objective of this review is to systematically present various unsupervised deep learning models, tools, and benchmark datasets applied to medical image analysis. Some of the discussed models are autoencoders and their variants, Restricted Boltzmann Machines (RBM), Deep Belief Networks (DBN), Deep Boltzmann Machine (DBM), and Generative Adversarial Network (GAN). Future research opportunities and challenges of unsupervised deep learning techniques for medical image analysis are also discussed.
Conclusion: Currently, interpretation of medical images for diagnostic purposes is usually performed by human experts that may be replaced by computer-aided diagnosis due to advancement in machine learning techniques, including deep learning, and the availability of cheap computing infrastructure through cloud computing. Both supervised and unsupervised machine learning approaches are widely applied in medical image analysis, each of them having certain pros and cons. Since human supervisions are not always available or are inadequate or biased, therefore, unsupervised learning algorithms give a big hope with lots of advantages for biomedical image analysis.
Keywords: Unsupervised learning, medical image analysis, autoencoders, restricted boltzmann machine, deep belief network, MRI.
Graphical Abstract
[http://dx.doi.org/10.1016/B978-0-12-813087-2.00002-6]
[http://dx.doi.org/10.1007/978-3-319-65981-7_6]
[http://dx.doi.org/10.1007/BF00332918] [PMID: 3196773]
[http://dx.doi.org/10.1109/TPAMI.2013.50] [PMID: 23787338]
[http://dx.doi.org/10.1109/TPAMI.2012.277] [PMID: 23787345]
[http://dx.doi.org/10.1016/j.media.2017.07.005] [PMID: 28778026]
[http://dx.doi.org/10.1126/science.1127647] [PMID: 16873662]
[http://dx.doi.org/10.1162/neco.2006.18.7.1527] [PMID: 16764513]
[http://dx.doi.org/10.1016/j.patcog.2018.05.019]
[http://dx.doi.org/10.1016/j.neucom.2017.02.028]
[http://dx.doi.org/10.1016/j.neucom.2015.11.044]
[http://dx.doi.org/10.1145/1390156.1390294]
[http://dx.doi.org/10.1007/978-3-642-40763-5_72]
[http://dx.doi.org/10.1007/s00429-013-0687-3] [PMID: 24363140]
[http://dx.doi.org/10.1016/j.neuroimage.2016.01.005] [PMID: 26774612]
[http://dx.doi.org/10.1002/mp.12116] [PMID: 28107548]
[http://dx.doi.org/10.1109/TMI.2016.2532122] [PMID: 26915120]
[http://dx.doi.org/10.1016/j.compbiomed.2019.103527] [PMID: 31765915]
[http://dx.doi.org/10.1007/978-3-030-59728-3_50]
[http://dx.doi.org/10.3390/app10186427]
[http://dx.doi.org/10.1007/978-3-030-59728-3_49]
[http://dx.doi.org/10.1109/ICACCS48705.2020.9074172]
[http://dx.doi.org/10.1007/978-3-319-10470-6_39]
[http://dx.doi.org/10.1109/TMI.2016.2535222] [PMID: 26930677]
[http://dx.doi.org/10.1007/978-3-319-46976-8_11]
[http://dx.doi.org/10.1007/s10489-020-02002-w]
[http://dx.doi.org/10.1109/TMI.2015.2458702] [PMID: 26208307]
[http://dx.doi.org/10.1016/j.compmedimag.2016.05.003] [PMID: 27373749]
[http://dx.doi.org/10.1007/s11517-017-1630-1] [PMID: 28247185]
[http://dx.doi.org/10.1002/mrm.26631] [PMID: 28205298]
[http://dx.doi.org/10.1109/TMI.2020.3005297] [PMID: 32746125]
[http://dx.doi.org/10.1109/ISBI.2014.6868045]
[http://dx.doi.org/10.1007/s10916-019-1483-2] [PMID: 31848728]
[http://dx.doi.org/10.1038/srep24454] [PMID: 27079888]
[http://dx.doi.org/10.1038/srep26094] [PMID: 27185194]
[http://dx.doi.org/10.1080/21681163.2015.1135299]
[http://dx.doi.org/10.1109/TMI.2017.2715285] [PMID: 28641247]
[http://dx.doi.org/10.1007/978-3-030-58219-7_12]
[http://dx.doi.org/10.1016/j.patcog.2018.09.007] [PMID: 30631215]
[http://dx.doi.org/10.1007/978-3-319-10581-9_15]
[http://dx.doi.org/10.1109/ISBI.2016.7493348]
[http://dx.doi.org/10.1016/j.compmedimag.2016.02.002] [PMID: 27104497]
[http://dx.doi.org/10.3233/BME-151453] [PMID: 26405918]
[http://dx.doi.org/10.1016/j.ultras.2016.08.004] [PMID: 27529139]
[http://dx.doi.org/10.1109/TMI.2016.2526687] [PMID: 26886968]
[http://dx.doi.org/10.1016/j.compbiomed.2018.05.013] [PMID: 29886261]
[http://dx.doi.org/10.1016/j.media.2017.12.009] [PMID: 29289703]
[http://dx.doi.org/10.1109/TNSRE.2016.2601240] [PMID: 27542114]
[http://dx.doi.org/10.1561/2200000006]
[http://dx.doi.org/10.1126/science.7761831] [PMID: 7761831]
[http://dx.doi.org/10.1145/2001269.2001295]
[http://dx.doi.org/10.1007/978-3-642-40763-5_78] [PMID: 24579194]
[http://dx.doi.org/10.1007/978-3-319-10470-6_58] [PMID: 25485412]
[http://dx.doi.org/10.3389/fnins.2014.00229] [PMID: 25191215]
[http://dx.doi.org/10.1038/srep38897] [PMID: 27941946]
[http://dx.doi.org/10.1142/S0129065716500258] [PMID: 27478060]
[http://dx.doi.org/10.1109/TIP.2011.2169273] [PMID: 21947526]
[http://dx.doi.org/10.1109/TPAMI.2013.96] [PMID: 24051722]
[http://dx.doi.org/10.1016/j.media.2016.05.009] [PMID: 27423113]
[http://dx.doi.org/10.1007/s11548-016-1395-2] [PMID: 27059021]
[http://dx.doi.org/10.1007/s10278-018-0093-8] [PMID: 29736781]
[http://dx.doi.org/10.1016/j.ymeth.2014.06.011] [PMID: 24979059]
[http://dx.doi.org/10.1186/s40537-020-00311-y]
[http://dx.doi.org/10.1162/NECO_a_00311] [PMID: 22509963]
[http://dx.doi.org/10.1146/annurev-statistics-010814-020120]
[http://dx.doi.org/10.1016/j.neuroimage.2014.06.077] [PMID: 25042445]
[PMID: 26309389]
[http://dx.doi.org/10.1109/ISBI.2018.8363775]
[http://dx.doi.org/10.1049/ccs.2019.0004]
[http://dx.doi.org/10.1007/978-3-319-67564-0_11]
[http://dx.doi.org/10.1007/978-3-319-67564-0_5]
[http://dx.doi.org/10.1007/s00371-018-1519-5]
[http://dx.doi.org/10.1007/s10916-018-1072-9] [PMID: 30315368]
[http://dx.doi.org/10.1145/3219104.3229261]
[http://dx.doi.org/10.1109/TMI.2018.2858752] [PMID: 30040634]
[http://dx.doi.org/10.1016/j.neuroimage.2018.03.045] [PMID: 29571715]
[http://dx.doi.org/10.1364/JOSAA.375595] [PMID: 32118926]
[http://dx.doi.org/10.1002/mp.13284] [PMID: 30449055]
[http://dx.doi.org/10.1016/j.neucom.2018.09.013]
[http://dx.doi.org/10.1109/ISBI.2018.8363564]
[http://dx.doi.org/10.1109/ICASSP.2018.8461430]
[http://dx.doi.org/10.1109/ICIP40778.2020.9190882]
[http://dx.doi.org/10.1109/TMI.2017.2759102] [PMID: 28981409]
[http://dx.doi.org/10.1016/j.media.2018.07.001] [PMID: 30007254]
[http://dx.doi.org/10.1007/978-3-030-00536-8_1]
[http://dx.doi.org/10.1007/978-3-030-11723-8_7]
[http://dx.doi.org/10.1109/ISBI.2018.8363780]
[http://dx.doi.org/10.1109/JBHI.2020.3042523] [PMID: 33275588]
[http://dx.doi.org/10.1016/j.media.2020.101664] [PMID: 32120268]
[http://dx.doi.org/10.1007/s11042-019-7305-1]
[http://dx.doi.org/10.1016/j.media.2020.101716] [PMID: 32492581]
[http://dx.doi.org/10.2174/1573405614666191115102318] [PMID: 33059556]
[http://dx.doi.org/10.1016/j.media.2019.101552] [PMID: 31521965]
[http://dx.doi.org/10.1016/j.artmed.2020.101938]
[http://dx.doi.org/10.1504/IJHPCN.2019.097508]
[http://dx.doi.org/10.4018/IJCAC.2018010108]
[http://dx.doi.org/10.4018/IJSSCI.2018040103]
[http://dx.doi.org/10.1007/s11042-017-5277-6]
[http://dx.doi.org/10.1109/MCOM.2018.1700817]
[http://dx.doi.org/10.1109/TMI.2019.2935018] [PMID: 31425022]
[http://dx.doi.org/10.1155/2018/4185279]