Performance of a Deep-Learning Neural Network Model in Assessing Skeletal Maturity on Pediatric Hand Radiographs
- PMID: 29095675
- DOI: 10.1148/radiol.2017170236
Performance of a Deep-Learning Neural Network Model in Assessing Skeletal Maturity on Pediatric Hand Radiographs
Abstract
Purpose To compare the performance of a deep-learning bone age assessment model based on hand radiographs with that of expert radiologists and that of existing automated models. Materials and Methods The institutional review board approved the study. A total of 14 036 clinical hand radiographs and corresponding reports were obtained from two children's hospitals to train and validate the model. For the first test set, composed of 200 examinations, the mean of bone age estimates from the clinical report and three additional human reviewers was used as the reference standard. Overall model performance was assessed by comparing the root mean square (RMS) and mean absolute difference (MAD) between the model estimates and the reference standard bone ages. Ninety-five percent limits of agreement were calculated in a pairwise fashion for all reviewers and the model. The RMS of a second test set composed of 913 examinations from the publicly available Digital Hand Atlas was compared with published reports of an existing automated model. Results The mean difference between bone age estimates of the model and of the reviewers was 0 years, with a mean RMS and MAD of 0.63 and 0.50 years, respectively. The estimates of the model, the clinical report, and the three reviewers were within the 95% limits of agreement. RMS for the Digital Hand Atlas data set was 0.73 years, compared with 0.61 years of a previously reported model. Conclusion A deep-learning convolutional neural network model can estimate skeletal maturity with accuracy similar to that of an expert radiologist and to that of existing automated models. © RSNA, 2017 An earlier incorrect version of this article appeared online. This article was corrected on January 19, 2018.
Comment in
-
Deep Learning Lends a Hand to Pediatric Radiology.Radiology. 2018 Apr;287(1):323-325. doi: 10.1148/radiol.2018172898. Radiology. 2018. PMID: 29558310 Free PMC article. No abstract available.
Similar articles
-
MABAL: a Novel Deep-Learning Architecture for Machine-Assisted Bone Age Labeling.J Digit Imaging. 2018 Aug;31(4):513-519. doi: 10.1007/s10278-018-0053-3. J Digit Imaging. 2018. PMID: 29404850 Free PMC article.
-
Skeletal development of the hand and wrist: digital bone age companion-a suitable alternative to the Greulich and Pyle atlas for bone age assessment?Skeletal Radiol. 2017 Jun;46(6):785-793. doi: 10.1007/s00256-017-2616-7. Epub 2017 Mar 25. Skeletal Radiol. 2017. PMID: 28343328 Free PMC article.
-
The RSNA Pediatric Bone Age Machine Learning Challenge.Radiology. 2019 Feb;290(2):498-503. doi: 10.1148/radiol.2018180736. Epub 2018 Nov 27. Radiology. 2019. PMID: 30480490 Free PMC article.
-
Automated Bone Age Assessment Using Artificial Intelligence: The Future of Bone Age Assessment.Korean J Radiol. 2021 May;22(5):792-800. doi: 10.3348/kjr.2020.0941. Epub 2021 Jan 19. Korean J Radiol. 2021. PMID: 33569930 Free PMC article. Review.
-
Bone age assessment: automated techniques coming of age?Acta Radiol. 2013 Nov;54(9):1024-9. doi: 10.1258/ar.2012.120443. Acta Radiol. 2013. PMID: 24179234 Review.
Cited by
-
Charting the growth through intelligence: A SWOC analysis on AI-assisted radiologic bone age estimation.Int J Legal Med. 2024 Oct 26. doi: 10.1007/s00414-024-03356-3. Online ahead of print. Int J Legal Med. 2024. PMID: 39460772 Review.
-
Lateral elbow tendinopathy and artificial intelligence: Binary and multilabel findings detection using machine learning algorithms.Front Med (Lausanne). 2022 Sep 23;9:945698. doi: 10.3389/fmed.2022.945698. eCollection 2022. Front Med (Lausanne). 2022. PMID: 36213676 Free PMC article.
-
A newly developed deep learning-based system for automatic detection and classification of small bowel lesions during double-balloon enteroscopy examination.BMC Gastroenterol. 2024 Jan 2;24(1):10. doi: 10.1186/s12876-023-03067-w. BMC Gastroenterol. 2024. PMID: 38166722 Free PMC article.
-
Challenges Related to Artificial Intelligence Research in Medical Imaging and the Importance of Image Analysis Competitions.Radiol Artif Intell. 2019 Jan 30;1(1):e180031. doi: 10.1148/ryai.2019180031. eCollection 2019 Jan. Radiol Artif Intell. 2019. PMID: 33937783 Free PMC article.
-
Rethinking Greulich and Pyle: A Deep Learning Approach to Pediatric Bone Age Assessment Using Pediatric Trauma Hand Radiographs.Radiol Artif Intell. 2020 Jul 29;2(4):e190198. doi: 10.1148/ryai.2020190198. eCollection 2020 Jul. Radiol Artif Intell. 2020. PMID: 33937834 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources