{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T17:03:43Z","timestamp":1726851823581},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,10,16]],"date-time":"2023-10-16T00:00:00Z","timestamp":1697414400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,16]],"date-time":"2023-10-16T00:00:00Z","timestamp":1697414400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"Abstract<\/jats:title>Image quality variation is a prominent cause of performance degradation for intelligent disease diagnostic models in clinical applications. Image quality issues are particularly prominent in infantile fundus photography due to poor patient cooperation, which poses a high risk of misdiagnosis. Here, we developed a deep learning-based image quality assessment and enhancement system (DeepQuality) for infantile fundus images to improve infant retinopathy screening. DeepQuality can accurately detect various quality defects concerning integrity, illumination, and clarity with area under the curve (AUC) values ranging from 0.933 to 0.995. It can also comprehensively score the overall quality of each fundus photograph. By analyzing 2,015,758 infantile fundus photographs from real-world settings using DeepQuality, we found that 58.3% of them had varying degrees of quality defects, and large variations were observed among different regions and categories of hospitals. Additionally, DeepQuality provides quality enhancement based on the results of quality assessment. After quality enhancement, the performance of retinopathy of prematurity (ROP) diagnosis of clinicians was significantly improved. Moreover, the integration of DeepQuality and AI diagnostic models can effectively improve the model performance for detecting ROP. This study may be an important reference for the future development of other image-based intelligent disease screening systems.<\/jats:p>","DOI":"10.1038\/s41746-023-00943-3","type":"journal-article","created":{"date-parts":[[2023,10,16]],"date-time":"2023-10-16T19:02:06Z","timestamp":1697482926000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["DeepQuality improves infant retinopathy screening"],"prefix":"10.1038","volume":"6","author":[{"ORCID":"http:\/\/orcid.org\/0009-0009-7533-5642","authenticated-orcid":false,"given":"Longhui","family":"Li","sequence":"first","affiliation":[]},{"ORCID":"http:\/\/orcid.org\/0000-0002-7214-1801","authenticated-orcid":false,"given":"Duoru","family":"Lin","sequence":"additional","affiliation":[]},{"given":"Zhenzhe","family":"Lin","sequence":"additional","affiliation":[]},{"given":"Mingyuan","family":"Li","sequence":"additional","affiliation":[]},{"given":"Zhangkai","family":"Lian","sequence":"additional","affiliation":[]},{"ORCID":"http:\/\/orcid.org\/0000-0002-5182-3678","authenticated-orcid":false,"given":"Lanqin","family":"Zhao","sequence":"additional","affiliation":[]},{"given":"Xiaohang","family":"Wu","sequence":"additional","affiliation":[]},{"given":"Lixue","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Jiali","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Xiaoyue","family":"Wei","sequence":"additional","affiliation":[]},{"given":"Mingjie","family":"Luo","sequence":"additional","affiliation":[]},{"given":"Danqi","family":"Zeng","sequence":"additional","affiliation":[]},{"given":"Anqi","family":"Yan","sequence":"additional","affiliation":[]},{"given":"Wai Cheng","family":"Iao","sequence":"additional","affiliation":[]},{"given":"Yuanjun","family":"Shang","sequence":"additional","affiliation":[]},{"given":"Fabao","family":"Xu","sequence":"additional","affiliation":[]},{"given":"Wei","family":"Xiang","sequence":"additional","affiliation":[]},{"given":"Muchen","family":"He","sequence":"additional","affiliation":[]},{"given":"Zhe","family":"Fu","sequence":"additional","affiliation":[]},{"given":"Xueyu","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Yaru","family":"Deng","sequence":"additional","affiliation":[]},{"given":"Xinyan","family":"Fan","sequence":"additional","affiliation":[]},{"given":"Zhijun","family":"Ye","sequence":"additional","affiliation":[]},{"given":"Meirong","family":"Wei","sequence":"additional","affiliation":[]},{"given":"Jianping","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Baohai","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Jianqiao","family":"Li","sequence":"additional","affiliation":[]},{"given":"Xiaoyan","family":"Ding","sequence":"additional","affiliation":[]},{"ORCID":"http:\/\/orcid.org\/0000-0003-4672-9721","authenticated-orcid":false,"given":"Haotian","family":"Lin","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,10,16]]},"reference":[{"key":"943_CR1","doi-asserted-by":"publisher","first-page":"1579","DOI":"10.1016\/S0140-6736(20)30226-9","volume":"395","author":"N Schwalbe","year":"2020","unstructured":"Schwalbe, N. & Wahl, B. Artificial intelligence and the future of global health. Lancet 395, 1579\u20131586 (2020).","journal-title":"Lancet"},{"key":"943_CR2","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1136\/svn-2017-000101","volume":"2","author":"F Jiang","year":"2017","unstructured":"Jiang, F. et al. Artificial intelligence in healthcare: past, present and future. Stroke Vasc. Neurol. 2, 230\u2013243 (2017).","journal-title":"Stroke Vasc. Neurol."},{"key":"943_CR3","doi-asserted-by":"publisher","unstructured":"Kermany, D. S. et al. Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172, https:\/\/doi.org\/10.1016\/j.cell.2018.02.010 (2018).","DOI":"10.1016\/j.cell.2018.02.010"},{"key":"943_CR4","doi-asserted-by":"publisher","first-page":"2402","DOI":"10.1001\/jama.2016.17216","volume":"316","author":"V Gulshan","year":"2016","unstructured":"Gulshan, V. et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402\u20132410 (2016).","journal-title":"JAMA"},{"key":"943_CR5","doi-asserted-by":"publisher","first-page":"2211","DOI":"10.1001\/jama.2017.18152","volume":"318","author":"DSW Ting","year":"2017","unstructured":"Ting, D. S. W. et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA 318, 2211\u20132223 (2017).","journal-title":"JAMA"},{"key":"943_CR6","doi-asserted-by":"publisher","first-page":"651","DOI":"10.2337\/dc18-0148","volume":"42","author":"FD Verbraak","year":"2019","unstructured":"Verbraak, F. D. et al. Diagnostic accuracy of a device for the automated detection of diabetic retinopathy in a primary care setting. Diabetes Care 42, 651\u2013656 (2019).","journal-title":"Diabetes Care"},{"key":"943_CR7","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1038\/s41746-018-0040-6","volume":"1","author":"MD Abr\u00e0moff","year":"2018","unstructured":"Abr\u00e0moff, M. D., Lavin, P. T., Birch, M., Shah, N. & Folk, J. C. Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. npj Digital Med. 1, 39 (2018).","journal-title":"npj Digital Med."},{"key":"943_CR8","doi-asserted-by":"publisher","first-page":"e229960","DOI":"10.1001\/jamanetworkopen.2022.9960","volume":"5","author":"L Dong","year":"2022","unstructured":"Dong, L. et al. Artificial intelligence for screening of multiple retinal and optic nerve diseases. JAMA Netw. Open 5, e229960 (2022).","journal-title":"JAMA Netw. Open"},{"key":"943_CR9","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-25138-w","volume":"12","author":"L-P Cen","year":"2021","unstructured":"Cen, L.-P. et al. Automatic detection of 39 fundus diseases and conditions in retinal photographs using deep neural networks. Nat. Commun. 12, 4828 (2021).","journal-title":"Nat. Commun."},{"key":"943_CR10","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1016\/j.ophtha.2019.05.029","volume":"127","author":"J Son","year":"2020","unstructured":"Son, J. et al. Development and validation of deep learning models for screening multiple abnormal findings in retinal fundus images. Ophthalmology 127, 85\u201394 (2020).","journal-title":"Ophthalmology"},{"key":"943_CR11","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1056\/NEJMc2104626","volume":"385","author":"SG Finlayson","year":"2021","unstructured":"Finlayson, S. G. et al. The clinician and dataset shift in artificial intelligence. N. Engl. J. Med. 385, 283\u2013286 (2021).","journal-title":"N. Engl. J. Med."},{"key":"943_CR12","doi-asserted-by":"publisher","first-page":"444","DOI":"10.1016\/j.oret.2019.01.015","volume":"3","author":"AS Coyner","year":"2019","unstructured":"Coyner, A. S. et al. Automated fundus image quality assessment in retinopathy of prematurity using deep convolutional neural networks. Ophthalmol. Retina 3, 444\u2013450 (2019).","journal-title":"Ophthalmol. Retina"},{"key":"943_CR13","doi-asserted-by":"publisher","first-page":"1445","DOI":"10.1016\/S0140-6736(13)60178-6","volume":"382","author":"A Hellstrom","year":"2013","unstructured":"Hellstrom, A., Smith, L. E. & Dammann, O. Retinopathy of prematurity. Lancet 382, 1445\u20131457 (2013).","journal-title":"Lancet"},{"key":"943_CR14","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1016\/j.jaapos.2020.01.014","volume":"24","author":"MF Greenwald","year":"2020","unstructured":"Greenwald, M. F. et al. Evaluation of artificial intelligence-based telemedicine screening for retinopathy of prematurity. J. AAPOS 24, 160\u2013162 (2020).","journal-title":"J. AAPOS"},{"key":"943_CR15","doi-asserted-by":"publisher","first-page":"1070","DOI":"10.1016\/j.ophtha.2020.10.025","volume":"128","author":"JP Campbell","year":"2021","unstructured":"Campbell, J. P. et al. Evaluation of a deep learning-derived quantitative retinopathy of prematurity severity scale. Ophthalmology 128, 1070\u20131076 (2021).","journal-title":"Ophthalmology"},{"key":"943_CR16","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1097\/ICU.0000000000000680","volume":"31","author":"RH Gensure","year":"2020","unstructured":"Gensure, R. H., Chiang, M. F. & Campbell, J. P. Artificial intelligence for retinopathy of prematurity. Curr. Opin. Ophthalmol. 31, 312\u2013317 (2020).","journal-title":"Curr. Opin. Ophthalmol."},{"key":"943_CR17","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1016\/j.compbiomed.2018.10.004","volume":"103","author":"GT Zago","year":"2018","unstructured":"Zago, G. T., Andreao, R. V., Dorizzi, B. & Teatini Salles, E. O. Retinal image quality assessment using deep learning. Comput. Biol. Med. 103, 64\u201370 (2018).","journal-title":"Comput. Biol. Med."},{"key":"943_CR18","first-page":"1304","volume":"2016","author":"D Mahapatra","year":"2016","unstructured":"Mahapatra, D., Roy, P. K., Sedai, S. & Garnavi, R. A CNN based neurobiology inspired approach for retinal image quality assessment. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2016, 1304\u20131307 (2016).","journal-title":"Annu. Int. Conf. IEEE Eng. Med. Biol. Soc."},{"key":"943_CR19","doi-asserted-by":"publisher","first-page":"806","DOI":"10.1109\/ACCESS.2017.2776126","volume":"6","author":"F Shao","year":"2018","unstructured":"Shao, F., Yang, Y., Jiang, Q., Jiang, G. & Ho, Y.-S. Automated quality assessment of fundus images via analysis of illumination, naturalness and structure. IEEE Access 6, 806\u2013817 (2018).","journal-title":"IEEE Access"},{"key":"943_CR20","doi-asserted-by":"publisher","first-page":"101654","DOI":"10.1016\/j.media.2020.101654","volume":"61","author":"Y Shen","year":"2020","unstructured":"Shen, Y. et al. Domain-invariant interpretable fundus image quality assessment. Med. Image Anal. 61, 101654 (2020).","journal-title":"Med. Image Anal."},{"key":"943_CR21","doi-asserted-by":"publisher","unstructured":"Bouris, E. et al. A neural network for automated image quality assessment of optic disc photographs. J. Clin. Med. 12, https:\/\/doi.org\/10.3390\/jcm12031217 (2023).","DOI":"10.3390\/jcm12031217"},{"key":"943_CR22","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1038\/s41746-020-00350-y","volume":"3","author":"Z Li","year":"2020","unstructured":"Li, Z. et al. Deep learning from \u201cpassive feeding\u201d to \u201cselective eating\u201d of real-world data. npj Digital Med. 3, 143 (2020).","journal-title":"npj Digital Med."},{"key":"943_CR23","doi-asserted-by":"publisher","unstructured":"Liu, L. et al. DeepFundus: a flow-cytometry-like image quality classifier for boosting the whole life cycle of medical artificial intelligence. Cell Rep. Med. 100912. https:\/\/doi.org\/10.1016\/j.xcrm.2022.100912 (2023).","DOI":"10.1016\/j.xcrm.2022.100912"},{"key":"943_CR24","doi-asserted-by":"publisher","unstructured":"K\u00f6nig, M. et al. Quality assessment of colour fundus and fluorescein angiography images using deep learning. Br. J. Ophthalmol. https:\/\/doi.org\/10.1136\/bjo-2022-321963 (2022).","DOI":"10.1136\/bjo-2022-321963"},{"key":"943_CR25","doi-asserted-by":"publisher","first-page":"e51","DOI":"10.1016\/j.ophtha.2021.05.031","volume":"128","author":"MF Chiang","year":"2021","unstructured":"Chiang, M. F. et al. International classification of retinopathy of prematurity, third edition. Ophthalmology 128, e51\u2013e68 (2021).","journal-title":"Ophthalmology"},{"key":"943_CR26","first-page":"125","volume":"57","author":"YJ Peng","year":"2023","unstructured":"Peng, Y. J. et al. [Exploration and practice of artificial intelligence assisted primary vision health management]. Zhonghua Yu Fang Yi Xue Za Zhi 57, 125\u2013130 (2023).","journal-title":"Zhonghua Yu Fang Yi Xue Za Zhi"},{"key":"943_CR27","doi-asserted-by":"crossref","unstructured":"Zuiderveld, Karel J.. Contrast Limited Adaptive Histogram Equalization. Graphics gems. 474\u2013485 (Academic Press, 1994).","DOI":"10.1016\/B978-0-12-336156-1.50061-6"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00943-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00943-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00943-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,19]],"date-time":"2023-11-19T00:26:59Z","timestamp":1700353619000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00943-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,16]]},"references-count":27,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["943"],"URL":"https:\/\/doi.org\/10.1038\/s41746-023-00943-3","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,16]]},"assertion":[{"value":"6 June 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"192"}}