Login Register Cart 0
Generic placeholder image

Current Medical Imaging

Editor-in-Chief

ISSN (Print): 1573-4056
ISSN (Online): 1875-6603

Back
Journal Home About Journal Editorial Board Journal Insight Current Issue Volumes/Issues
Subscribe
Research Article

A Comparison of the Performances of Artificial Intelligence System and Radiologists in the Ultrasound Diagnosis of Thyroid Nodules

Author(s): Lian-Tu He, Feng-Juan Chen, Da-Zhi Zhou, Yu-Xin Zhang, Ying-Shan Li, Min-Xuan Tang, Jia-Xin Tang, Shuo Liu, Zhi-Jie Chen and Qing Tang*

Volume 18, Issue 13, 2022

Published on: 01 August, 2022

Article ID: e220422203949 Pages: 9

DOI: 10.2174/1573405618666220422132251

Price: $65

Abstract

Aims: The purpose of this paper is to prospectively evaluate the performance of an artificial intelligence (AI) system in diagnosing thyroid nodules and to assess its potential value in comparison with the performance of radiologists with different levels of experience, as well as the factors affecting its diagnostic accuracy.

Background: In recent years, medical imaging diagnosis using AI has become a popular topic in clinical application research.

Objective: This study aimed to evaluate the performance of an AI system in diagnosing thyroid nodules and compare it with the performance levels of different radiologists.

Methods: This study involved 426 patients screened for thyroid nodules at the First Affiliated Hospital of Guangzhou Medical University between July 2017 and March 2019. All of the nodules were evaluated by radiologists with various levels of experience and an AI system. The diagnostic performances of two junior and two senior radiologists, an AI system, and an AI-assisted junior radiologist were compared, as were their diagnostic results with respect to nodules of different sizes.

Results: The senior radiologists, the AI system, and the AI-assisted junior radiologist performed better than the junior radiologist (p < 0.05). The area under the curves of the AI system and the AI-assisted junior radiologist were similar to the curve of the senior radiologists (p > 0.05). The diagnostic results concerning the two nodule sizes showed that the diagnostic error rates of the AI system, junior radiologists, and senior radiologists for nodules with a maximum diameter of ≤1 cm (Dmax ≤ 1 cm) were higher than those for nodules with a maximum diameter of 1 cm (Dmax > 1 cm) (23.4% vs. 12.1%, p = 0.002; 26.6% vs. 7.3%, p < 0.001; and 38.3% vs. 14.6%, p < 0.001).

Conclusion: The AI system is a decision-making tool that could potentially improve the diagnostic efficiency of junior radiologists. Micronodules with Dmax ≤ 1cm were significantly correlated with diagnostic accuracy; accordingly, more micronodules of this size, in particular, should be added to the AI system as training samples.

Other: The system could be a potential decision-making tool for effectively improving the diagnostic efficiency of junior radiologists in the community.

Keywords: Artificial intelligence, deep learning, thyroid nodule, ultrasound, diagnosis, decision-making.

Graphical Abstract

[1]
Gharib H, Papini E, Paschke R, et al. AACE/AME/ETA Task Force on Thyroid Nodules. American Association of clinical endocrinologists, associazione medici endocrinologi, and european thyroid association medical guidelines for clinical practice for the diagnosis and management of thyroid nodules: Executive summary of recommendations. J Endocrinol Invest 2010; 33(5)(Suppl.): 51-6.
[http://dx.doi.org/10.1007/BF03346587] [PMID: 20543551]
[2]
Zou B, Sun L, Wang X, Chen Z. The prevalence of single and multiple thyroid nodules and its association with metabolic diseases in chinese: A cross-sectional study. Int J Endocrinol 2020; 2020: 5381012.
[http://dx.doi.org/10.1155/2020/5381012] [PMID: 32148489]
[3]
Tan GH, Gharib H. Thyroid incidentalomas: Management approaches to nonpalpable nodules discovered incidentally on thyroid imaging. Ann Intern Med 1997; 126(3): 226-31.
[http://dx.doi.org/10.7326/0003-4819-126-3-199702010-00009] [PMID: 9027275]
[4]
Cooper Doherty, Haugen BR, et al. Revised American thyroid association management guidelines for patients with thyroid nodules and differentiated thyroid cancer. Thyroid 2009; 19: 1167-214.
[5]
Siegel R, Naishadham D, Jemal A. Cancer statistics, 2013. CA Cancer J Clin 2013; 63(1): 11-30.
[http://dx.doi.org/10.3322/caac.21166] [PMID: 23335087]
[6]
Gharib H, Papini E, Valcavi R, et al. AACE/AME Task Force on Thyroid Nodules. American association of clinical endocrinologists and associazione medici endocrinologi medical guidelines for clinical practice for the diagnosis and management of thyroid nodules. Endocr Pract 2006; 12(1): 63-102.
[http://dx.doi.org/10.4158/EP.12.1.63] [PMID: 16596732]
[7]
Haugen BR, Alexander EK, Bible KC, et al. 2015 American Thyroid Association management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer. Thyroid 2016; 26(1): 1-133.
[http://dx.doi.org/10.1089/thy.2015.0020] [PMID: 26462967]
[8]
Carmeci C, Jeffrey RB, McDougall IR, Nowels KW, Weigel RJ. Ultrasound-guided fine-needle aspiration biopsy of thyroid masses. Thyroid 1998; 8(4): 283-9.
[http://dx.doi.org/10.1089/thy.1998.8.283] [PMID: 9588492]
[9]
Yoo YJ, Ha EJ, Cho YJ, Kim HL, Han M, Kang SY. Computer-aided diagnosis of thyroid nodules via ultrasonography: Initial clinical experience. Korean J Radiol 2018; 19(4): 665-72.
[http://dx.doi.org/10.3348/kjr.2018.19.4.665] [PMID: 29962872]
[10]
Peng S, Liu Y, Lv W, et al. Deep learning-based artificial intelligence model to assist thyroid nodule diagnosis and management: A multicentre diagnostic study. Lancet Digit Health 2021; 3(4): e250-9.
[http://dx.doi.org/10.1016/S2589-7500(21)00041-8] [PMID: 33766289]
[11]
Li LR, Du B, Liu HQ, Chen C. Artificial intelligence for personalized medicine in thyroid cancer: Current status and future perspectives. Front Oncol 2021; 10: 604051.
[http://dx.doi.org/10.3389/fonc.2020.604051] [PMID: 33634025]
[12]
Tessler FN, Middleton WD, Grant EG, et al. ACR Thyroid imaging, reporting and data system (TI-RADS): White paper of the ACR TI-RADS committee. J Am Coll Radiol 2017; 14(5): 587-95.
[http://dx.doi.org/10.1016/j.jacr.2017.01.046] [PMID: 28372962]
[13]
Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. ICLR. 2015. Avaialble from: https://arxiv.org/abs/1409.1556
[14]
Camacho PM, Petak SM, Binkley N, et al. American association of clinical endocrinologists and american college of endocrinology clinical practice guidelines for the diagnosis and treatment of postmenopausal osteoporosis - 2016. Endocr Pract 2016; 22(Suppl. 4): 1-42.
[http://dx.doi.org/10.4158/EP161435.GL] [PMID: 27662240]
[15]
Shin JH, Baek JH, Chung J, et al. Korean Society of Thyroid Radiology (KSThR) and Korean Society of Radiology. Ultrasonography diagnosis and imaging-based management of thyroid nodules: Revised korean society of thyroid radiology consensus statement and recommendations. Korean J Radiol 2016; 17(3): 370-95.
[http://dx.doi.org/10.3348/kjr.2016.17.3.370] [PMID: 27134526]
[16]
Park CS, Kim SH, Jung SL, et al. Observer variability in the sonographic evaluation of thyroid nodules. J Clin Ultrasound 2010; 38(6): 287-93.
[http://dx.doi.org/10.1002/jcu.20689] [PMID: 20544863]
[17]
Chai YJ, Song J, Shaear M, Yi KH. Artificial intelligence for thyroid nodule ultrasound image analysis. Ann Thyroid 2020; 5: 8.
[http://dx.doi.org/10.21037/aot.2020.04.01]
[18]
Gao L, Liu R, Jiang Y, et al. Computer-aided system for diagnosing thyroid nodules on ultrasound: A comparison with radiologist-based clinical assessments. Head Neck 2018; 40(4): 778-83.
[http://dx.doi.org/10.1002/hed.25049] [PMID: 29286180]
[19]
Du L, Wang Y, Sun X, et al. Thyroid cancer: Trends in incidence, mortality and clinical-pathological patterns in Zhejiang Province, South-east China. BMC Cancer 2018; 18(1): 291.
[http://dx.doi.org/10.1186/s12885-018-4081-7] [PMID: 29544469]
[20]
Chen W, Zheng R, Baade PD, et al. Cancer statistics in China, 2015. CA Cancer J Clin 2016; 66(2): 115-32.
[http://dx.doi.org/10.3322/caac.21338] [PMID: 26808342]
[21]
Davies L, Welch HG. Current thyroid cancer trends in the United States. JAMA Otolaryngol Head Neck Surg 2014; 140(4): 317-22.
[http://dx.doi.org/10.1001/jamaoto.2014.1] [PMID: 24557566]
[22]
Liu Z, Wang L, Yi P, Wang CY, Huang T. Risk factors for central lymph node metastasis of patients with papillary thyroid microcarcinoma: A meta-analysis. Int J Clin Exp Pathol 2014; 7(3): 932-7.
[PMID: 24696711]
[23]
Liu C, Wang S, Zeng W, Guo Y, Liu Z, Huang T. Total tumour diameter is superior to unifocal diameter as a predictor of papillary thyroid microcarcinoma prognosis. Sci Rep 2017; 7(1): 1846.
[http://dx.doi.org/10.1038/s41598-017-02165-6] [PMID: 28500312]
[24]
Wang HL, Zhang S, Xin XJ, Xu Y, Wei X. Factors of color ultrasound diagnosis of false negative thyroid cancer: an analysis of 176 cases. Chin J Prac Surg 2011; 31: 426-8.

Rights & Permissions Print Cite
Article Metrics
10
© 2024 Bentham Science Publishers | Privacy Policy