Abstract
Deep learning has attracted great attention in the medical imaging community as a promising solution for automated, fast and accurate medical image analysis, which is mandatory for quality healthcare. Convolutional neural networks and its variants have become the most preferred and widely used deep learning models in medical image analysis. In this paper, concise overviews of the modern deep learning models applied in medical image analysis are provided and the key tasks performed by deep learning models, i.e. classification, segmentation, retrieval, detection, and registration are reviewed in detail. Some recent researches have shown that deep learning models can outperform medical experts in certain tasks. With the significant breakthroughs made by deep learning methods, it is expected that patients will soon be able to safely and conveniently interact with AI-based medical systems and such intelligent systems will actually improve patient healthcare. There are various complexities and challenges involved in deep learning-based medical image analysis, such as limited datasets. But researchers are actively working in this area to mitigate these challenges and further improve health care with AI.
Keywords: Classification, deep learning, detection, medical image analysis, segmentation, retrieval, registration.
Graphical Abstract
[http://dx.doi.org/10.18043/ncm.75.2.111 ] [PMID: 24663131]
[http://dx.doi.org/10.1097/RCT.0b013e31818dda6e ] [PMID: 19638837]
[http://dx.doi.org/10.1609/AIMAG.V11I3.840]
[http://dx.doi.org/10.1186/s13104-019-4121-7 ] [PMID: 30755250]
[http://dx.doi.org/10.1007/s11263-015-0816-y]
[http://dx.doi.org/10.1038/nature16961 ] [PMID: 26819042]
[http://dx.doi.org/10.1109/LRA.2018.2795643]
[http://dx.doi.org/10.1109/TITB.2008.2009441 ] [PMID: 19171527]
[http://dx.doi.org/10.4103/2152-7806.101801 ] [PMID: 23087828]
[http://dx.doi.org/10.4103/0975-1475.172453 ] [PMID: 26814053]
[http://dx.doi.org/10.1371/journal.pone.0177544 ] [PMID: 28570557]
[http://dx.doi.org/10.1016/j.neunet.2014.09.003 ] [PMID: 25462637]
[http://dx.doi.org/10.1136/svn-2017-000101 ] [PMID: 29507784]
[http://dx.doi.org/10.1162/neco.1989.1.4.541]
[http://dx.doi.org/10.1109/5.726791]
[http://dx.doi.org/10.1037/h0042519 ] [PMID: 13602029]
[http://dx.doi.org/10.1109/5.784219]
[http://dx.doi.org/10.1109/2.485891]
[http://dx.doi.org/10.1038/89044 ] [PMID: 11385503]
[http://dx.doi.org/10.1016/j.media.2017.07.005]
[http://dx.doi.org/10.1109/ACCESS.2018.2812999]
[http://dx.doi.org/10.1117/1.JEI.27.5.053001]
[http://dx.doi.org/10.1162/neco.1997.9.8.1735 ] [PMID: 9377276]
[http://dx.doi.org/10.3115/v1/D14-1179]
[http://dx.doi.org/10.1109/DAS.2018.26]
[http://dx.doi.org/10.1162/neco.2006.18.7.1527 ] [PMID: 16764513]
[http://dx.doi.org/10.1038/nature14539 ] [PMID: 26017442]
[http://dx.doi.org/10.1038/nature21056 ] [PMID: 28117445]
[http://dx.doi.org/10.3389/fnins.2014.00229 ] [PMID: 25191215]
[http://dx.doi.org/10.1016/j.procs.2016.07.014]
[http://dx.doi.org/10.1016/j.compmedimag.2016.02.002 ] [PMID: 27104497]
[http://dx.doi.org/10.1007/978-3-319-46726-9_27]
[http://dx.doi.org/10.1007/978-3-319-46726-9_31]
[http://dx.doi.org/10.1109/TNNLS.2019.2892409]
[http://dx.doi.org/10.1007/978-3-642-40763-5_51]
[http://dx.doi.org/10.1038/s41592-018-0261-2 ] [PMID: 30559429]
[http://dx.doi.org/10.1109/LGRS.2018.2802944]
[http://dx.doi.org/10.1007/978-3-319-46723-8_22]
[http://dx.doi.org/10.1007/978-3-319-46976-8_15]
[http://dx.doi.org/10.1109/TMI.2016.2528821 ] [PMID: 26886978]
[http://dx.doi.org/10.1007/s10278-017-9983-4 ] [PMID: 28577131]
[http://dx.doi.org/10.1109/TMI.2016.2548501 ] [PMID: 27046893]
[http://dx.doi.org/10.1080/21681163.2015.1135299]
[http://dx.doi.org/10.1007/978-3-319-46726-9_2]
[http://dx.doi.org/10.1109/TMI.2016.2521800 ] [PMID: 26829785]
[http://dx.doi.org/10.1016/j.patcog.2017.05.023]
[http://dx.doi.org/10.1016/j.neunet.2005.06.042 ] [PMID: 16112549]
[http://dx.doi.org/10.1007/978-3-319-46466-4_50]
[http://dx.doi.org/10.1007/978-3-319-66179-7_77]
[http://dx.doi.org/10.1016/j.neuroimage.2016.01.005 ] [PMID: 26774612]
[http://dx.doi.org/10.2172/1366924]
[http://dx.doi.org/10.1016/j.neuroimage.2017.03.057 ] [PMID: 28414186]
[http://dx.doi.org/10.1109/MSP.2017.2739299]
[http://dx.doi.org/10.1038/s41551-018-0195-0 ] [PMID: 31015713]
[http://dx.doi.org/10.1038/s41598-017-05300-5 ] [PMID: 28698556]
[http://dx.doi.org/10.1038/nature12346 ] [PMID: 23925239]
[http://dx.doi.org/10.1162/neco.2009.10-08-881 ] [PMID: 19922289]
[http://dx.doi.org/10.1109/TMI.2018.2872031 ] [PMID: 30273145]
[http://dx.doi.org/10.1016/j.compbiomed.2018.04.004 ] [PMID: 29665537]
[http://dx.doi.org/10.1016/j.media.2019.05.010 ] [PMID: 31226662]
[http://dx.doi.org/10.1016/j.media.2016.07.007 ] [PMID: 27497072]
[http://dx.doi.org/10.2147/IJWH.S49332 ] [PMID: 25152634]
[PMID: 29215311]
[http://dx.doi.org/10.1109/TMI.2008.916959 ] [PMID: 18450541]
[http://dx.doi.org/10.1016/S0140-6736(05)66481-1 ] [PMID: 15910949]
[http://dx.doi.org/10.1016/j.acra.2011.06.011 ] [PMID: 21893296]
[http://dx.doi.org/10.1118/1.4967345 ] [PMID: 27908154]
[http://dx.doi.org/10.1109/TMI.2016.2528120 ] [PMID: 26891484]
[http://dx.doi.org/10.1038/s41598-019-40414-y ] [PMID: 30846758]
[http://dx.doi.org/10.1038/s41598-019-44839-3 ] [PMID: 31186466]
[http://dx.doi.org/10.1016/j.media.2016.02.004 ] [PMID: 26974042]
[http://dx.doi.org/10.1259/dmfr.20170344 ] [PMID: 30004241]
[http://dx.doi.org/10.1007/s12553-019-00348-x]
[http://dx.doi.org/10.1097/NUR.0000000000000315 ] [PMID: 28806228]