Performance of a Deep-Learning Neural Network Model in Assessing Skeletal Maturity on Pediatric Hand Radiographs
- PMID: 29095675
- DOI: 10.1148/radiol.2017170236
Performance of a Deep-Learning Neural Network Model in Assessing Skeletal Maturity on Pediatric Hand Radiographs
Abstract
Purpose To compare the performance of a deep-learning bone age assessment model based on hand radiographs with that of expert radiologists and that of existing automated models. Materials and Methods The institutional review board approved the study. A total of 14 036 clinical hand radiographs and corresponding reports were obtained from two children's hospitals to train and validate the model. For the first test set, composed of 200 examinations, the mean of bone age estimates from the clinical report and three additional human reviewers was used as the reference standard. Overall model performance was assessed by comparing the root mean square (RMS) and mean absolute difference (MAD) between the model estimates and the reference standard bone ages. Ninety-five percent limits of agreement were calculated in a pairwise fashion for all reviewers and the model. The RMS of a second test set composed of 913 examinations from the publicly available Digital Hand Atlas was compared with published reports of an existing automated model. Results The mean difference between bone age estimates of the model and of the reviewers was 0 years, with a mean RMS and MAD of 0.63 and 0.50 years, respectively. The estimates of the model, the clinical report, and the three reviewers were within the 95% limits of agreement. RMS for the Digital Hand Atlas data set was 0.73 years, compared with 0.61 years of a previously reported model. Conclusion A deep-learning convolutional neural network model can estimate skeletal maturity with accuracy similar to that of an expert radiologist and to that of existing automated models. © RSNA, 2017 An earlier incorrect version of this article appeared online. This article was corrected on January 19, 2018.
Comment in
-
Deep Learning Lends a Hand to Pediatric Radiology.Radiology. 2018 Apr;287(1):323-325. doi: 10.1148/radiol.2018172898. Radiology. 2018. PMID: 29558310 Free PMC article. No abstract available.
Similar articles
-
MABAL: a Novel Deep-Learning Architecture for Machine-Assisted Bone Age Labeling.J Digit Imaging. 2018 Aug;31(4):513-519. doi: 10.1007/s10278-018-0053-3. J Digit Imaging. 2018. PMID: 29404850 Free PMC article.
-
Skeletal development of the hand and wrist: digital bone age companion-a suitable alternative to the Greulich and Pyle atlas for bone age assessment?Skeletal Radiol. 2017 Jun;46(6):785-793. doi: 10.1007/s00256-017-2616-7. Epub 2017 Mar 25. Skeletal Radiol. 2017. PMID: 28343328 Free PMC article.
-
The RSNA Pediatric Bone Age Machine Learning Challenge.Radiology. 2019 Feb;290(2):498-503. doi: 10.1148/radiol.2018180736. Epub 2018 Nov 27. Radiology. 2019. PMID: 30480490 Free PMC article.
-
Automated Bone Age Assessment Using Artificial Intelligence: The Future of Bone Age Assessment.Korean J Radiol. 2021 May;22(5):792-800. doi: 10.3348/kjr.2020.0941. Epub 2021 Jan 19. Korean J Radiol. 2021. PMID: 33569930 Free PMC article. Review.
-
Bone age assessment: automated techniques coming of age?Acta Radiol. 2013 Nov;54(9):1024-9. doi: 10.1258/ar.2012.120443. Acta Radiol. 2013. PMID: 24179234 Review.
Cited by
-
A critical comparative study of the performance of three AI-assisted programs for bone age determination.Eur Radiol. 2025 Mar;35(3):1190-1196. doi: 10.1007/s00330-024-11169-6. Epub 2024 Nov 5. Eur Radiol. 2025. PMID: 39499301 Free PMC article.
-
Evaluation of the Artificial Neural Network and Naive Bayes Models Trained with Vertebra Ratios for Growth and Development Determination.Turk J Orthod. 2020 Dec 2;34(1):2-9. doi: 10.5152/TurkJOrthod.2020.20059. eCollection 2021. Turk J Orthod. 2020. PMID: 33828872 Free PMC article.
-
The Implications of Artificial Intelligence in Pedodontics: A Scoping Review of Evidence-Based Literature.Healthcare (Basel). 2024 Jun 30;12(13):1311. doi: 10.3390/healthcare12131311. Healthcare (Basel). 2024. PMID: 38998846 Free PMC article.
-
An overview of deep learning applications in precocious puberty and thyroid dysfunction.Front Endocrinol (Lausanne). 2022 Oct 20;13:959546. doi: 10.3389/fendo.2022.959546. eCollection 2022. Front Endocrinol (Lausanne). 2022. PMID: 36339395 Free PMC article. Review.
-
Assessment of Convolutional Neural Networks for Automated Classification of Chest Radiographs.Radiology. 2019 Feb;290(2):537-544. doi: 10.1148/radiol.2018181422. Epub 2018 Nov 13. Radiology. 2019. PMID: 30422093 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources