{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,14]],"date-time":"2024-09-14T23:18:09Z","timestamp":1726355889940},"reference-count":53,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,11,15]],"date-time":"2021-11-15T00:00:00Z","timestamp":1636934400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"Automatic severity assessment and progression prediction can facilitate admission, triage, and referral of COVID-19 patients. This study aims to explore the potential use of lung lesion features in the management of COVID-19, based on the assumption that lesion features may carry important diagnostic and prognostic information for quantifying infection severity and forecasting disease progression. A novel LesionEncoder framework is proposed to detect lesions in chest CT scans and to encode lesion features for automatic severity assessment and progression prediction. The LesionEncoder framework consists of a U-Net module for detecting lesions and extracting features from individual CT slices, and a recurrent neural network (RNN) module for learning the relationship between feature vectors and collectively classifying the sequence of feature vectors. Chest CT scans of two cohorts of COVID-19 patients from two hospitals in China were used for training and testing the proposed framework. When applied to assessing severity, this framework outperformed baseline methods achieving a sensitivity of 0.818, specificity of 0.952, accuracy of 0.940, and AUC of 0.903. It also outperformed the other tested methods in disease progression prediction with a sensitivity of 0.667, specificity of 0.838, accuracy of 0.829, and AUC of 0.736. The LesionEncoder framework demonstrates a strong potential for clinical application in current COVID-19 management, particularly in automatic severity assessment of COVID-19 patients. This framework also has a potential for other lesion-focused medical image analyses.<\/jats:p>","DOI":"10.3390\/info12110471","type":"journal-article","created":{"date-parts":[[2021,11,16]],"date-time":"2021-11-16T01:46:47Z","timestamp":1637027207000},"page":"471","source":"Crossref","is-referenced-by-count":7,"title":["Severity Assessment and Progression Prediction of COVID-19 Patients Based on the LesionEncoder Framework and Chest CT"],"prefix":"10.3390","volume":"12","author":[{"given":"You-Zhen","family":"Feng","sequence":"first","affiliation":[{"name":"Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou 510630, China"}]},{"given":"Sidong","family":"Liu","sequence":"additional","affiliation":[{"name":"Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney 2113, Australia"}]},{"given":"Zhong-Yuan","family":"Cheng","sequence":"additional","affiliation":[{"name":"Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou 510630, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-0241-5376","authenticated-orcid":false,"given":"Juan C.","family":"Quiroz","sequence":"additional","affiliation":[{"name":"Centre for Big Data Research in Health, University of New South Wales, Sydney 1466, Australia"}]},{"given":"Dana","family":"Rezazadegan","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Software Engineering, Swinburne University of Technology, Melbourne 3000, Australia"}]},{"given":"Ping-Kang","family":"Chen","sequence":"additional","affiliation":[{"name":"Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou 510630, China"}]},{"given":"Qi-Ting","family":"Lin","sequence":"additional","affiliation":[{"name":"Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou 510630, China"}]},{"given":"Long","family":"Qian","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Peking University, Beijing 100871, China"}]},{"given":"Xiao-Fang","family":"Liu","sequence":"additional","affiliation":[{"name":"Tianjin Key Laboratory of Intelligent Robotics, Institute of Robotics and Automatic Information System, College of Artificial Intelligence, Nankai University, Tianjin 300350, China"}]},{"given":"Shlomo","family":"Berkovsky","sequence":"additional","affiliation":[{"name":"Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney 2113, Australia"}]},{"given":"Enrico","family":"Coiera","sequence":"additional","affiliation":[{"name":"Centre for Health Informatics, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney 2113, Australia"}]},{"given":"Lei","family":"Song","sequence":"additional","affiliation":[{"name":"Department of Radiology, Xiangyang Central Hospital, Affiliated Hospital of Hubei University of Arts and Science, Xiangyang 441003, China"}]},{"given":"Xiao-Ming","family":"Qiu","sequence":"additional","affiliation":[{"name":"Department of Radiology, Huangshi Central Hospital, Affiliated Hospital of Hubei Polytechnic University, Edong Healthcare Group, Huangshi 435002, China"}]},{"given":"Xiang-Ran","family":"Cai","sequence":"additional","affiliation":[{"name":"Medical Imaging Centre, The First Affiliated Hospital of Jinan University, Guangzhou 510630, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e480","DOI":"10.1016\/S2214-109X(20)30068-1","article-title":"Potential association between COVID-19 mortality and health-care resource availability","volume":"8","author":"Ji","year":"2020","journal-title":"Lancet Glob. Health"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"E115","DOI":"10.1148\/radiol.2020200432","article-title":"Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR","volume":"296","author":"Fang","year":"2020","journal-title":"Radiology"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1016\/S1473-3099(20)30086-4","article-title":"Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: A descriptive study","volume":"20","author":"Shi","year":"2020","journal-title":"Lancet Infect. Dis."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e200034","DOI":"10.1148\/ryct.2020200034","article-title":"Imaging Profile of the COVID-19 Infection: Radiologic Findings and Literature Review","volume":"2","author":"Ng","year":"2020","journal-title":"Radiol. Cardiothorac. Imaging"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"E32E40","DOI":"10.1148\/radiol.2020200642","article-title":"Correlation of chest CT and PT-PCR testing in coronavirus disease 2019 (COVID-19) in China: A report of 1014 cases","volume":"296","author":"Ai","year":"2020","journal-title":"Radiology"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1016\/S0140-6736(20)30183-5","article-title":"Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China","volume":"395","author":"Huang","year":"2020","journal-title":"Lancet"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e200110","DOI":"10.1148\/ryct.2020200110","article-title":"Chest CT Findings in Cases from the Cruise Ship \u201cDiamond Princess\u201d with Coronavirus Disease 2019 (COVID-19)","volume":"2","author":"Inui","year":"2020","journal-title":"Radiol. Cardiothorac. Imaging"},{"key":"ref_8","unstructured":"The Royal Australian and New Zealand Colleague of Radiologists (2020, April 09). Advice on Appropriate Use of CT Throughout the COVID-19 Pandemic. Available online: https:\/\/www.ranzcr.com\/college\/document-library\/advice-on-appropriate-use-of-ct-throughout-the-covid-19-pandemic."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"E65","DOI":"10.1148\/radiol.2020200905","article-title":"Artificial intelligence distinguishes COVID-19 from community acquired pneumonia on chest CT","volume":"296","author":"Li","year":"2020","journal-title":"Radiology"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Song, Y., Zheng, S., Li, L., Zhang, X., Zhang, X., Huang, Z., Chen, J., Wang, R., Zhao, H., and Zha, Y. (2020). Deep learning Enables Accurate Diagnosis of Novel Coronavirus (COVID-19) with CT images. medRxiv.","DOI":"10.1109\/TCBB.2021.3065361"},{"key":"ref_11","unstructured":"Gozes, O., Frid-Adar, M., Greenspan, H., Browning, P.D., Zhang, H., Ji, W., Bernheim, A., and Siegel, E. (2020). Rapid AI Development Cycle for the Coronavirus (COVID-19) Pandemic: Initial Results for Automated Detection & Patient Monitoring using Deep Learning CT Image Analysis. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Xu, X., Jiang, X., Ma, C., Du, P., Li, X., Lv, S., Yu, L., Ni, Q., Chen, Y., and Su, J. (2020). Deep Learning System to Screen Coronavirus Disease 2019 Pneumonia. arXiv.","DOI":"10.1016\/j.eng.2020.04.010"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"6096","DOI":"10.1007\/s00330-021-07715-1","article-title":"A deep learning algorithm using CT images to screen for Corona Virus Disease (COVID-19)","volume":"31","author":"Wang","year":"2021","journal-title":"Eur. Radiol."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Chen, J., Wu, L., Zhang, J., Zhang, L., Gong, D., Zhao, Y., Chen, Q., Huang, S., Yang, M., and Yang, X. (2020). Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography: A prospective study. medRxiv.","DOI":"10.1038\/s41598-020-76282-0"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, L., and Wong, A. (2020). COVID-Net: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest radiography images. arXiv.","DOI":"10.1038\/s41598-020-76550-z"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/RBME.2020.2987975","article-title":"Review of Artificial Intelligence Techniques in Imaging Data Acquisition, Segmentation, and Diagnosis for COVID-19","volume":"14","author":"Shi","year":"2021","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yuan, M., Yin, W., Tao, Z., Tan, W., and Hu, Y. (2020). Association of radiologic findings with mortality of patients infected with 2019 novel coronavirus in Wuhan, China. PLoS ONE, 15.","DOI":"10.1183\/13993003.congress-2020.2392"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Qi, X., Jiang, Z., Yu, Q., Shao, C., Zhang, H., Yue, H., Ma, B., Wang, Y., Liu, C., and Meng, X. (2020). Machine learning-based CT radiomics model for predicting hospital stay in patients with pneumonia associated with SARS-CoV-2 infection: A multicenter study. medRxiv.","DOI":"10.1101\/2020.02.29.20029603"},{"key":"ref_19","unstructured":"Shan, F., Gao, Y., Wang, J., Shi, W., Shi, N., Han, M., Xue, Z., Shen, D., and Shi, Y. (2020). Lung Infection Quantification of COVID-19 in CT Images with Deep Learning. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Chaganti, S., Balachandran, A., Chabin, G., Cohen, S., Flohr, T., Georgescu, B., Grenier, P., Grbic, S., Liu, S., and Mellot, F. (2020). Quantification of tomographic patterns associated with COVID-19 from chest CT. arXiv.","DOI":"10.1148\/ryai.2020200048"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1016\/j.eng.2020.03.002","article-title":"Core outcome set for clinical trials on coronavirus disease 2019 (COS-COVID)","volume":"6","author":"Jin","year":"2020","journal-title":"Engineering"},{"key":"ref_22","unstructured":"Cascella, M., Rajnik, M., Cuomo, A., and Scott, C. (2020, September 02). Features, Evaluation and Treatment Coronavirus (COVID-19), Available online: https:\/\/www.ncbi.nlm.nih.gov\/books\/NBK554776\/."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/neuros\/nyab103","article-title":"Machine learning for the prediction of molecular markers in glioma on magnetic resonance imaging: A systematic review and meta-analysis","volume":"89","author":"Jian","year":"2021","journal-title":"Neurosurgery"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e19805","DOI":"10.2196\/19805","article-title":"Deep learning methodology for differentiating glioma recurrence from radiation necrosis using magnetic resonance imaging: Algorithm development and validation","volume":"8","author":"Gao","year":"2020","journal-title":"JMRI Med. Info."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, C., Song, Y., Liu, S., Lill, S., Wang, C., Tang, Z., You, Y., Gao, Y., Klistorner, A., and Barnett, M. (2018, January 10\u201313). MS-GAN: GAN-based semantic segmentation of multiple sclerosis lesions in brain magnetic resonance imaging. Proceedings of the 2018 Digital Image Computing: Techniques and Applications (DICTA), Canberra, ACT, Australia.","DOI":"10.1109\/DICTA.2018.8615771"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1016\/j.compmedimag.2014.05.003","article-title":"Multi-channel neurodegenerative pattern analysis and its application in Alzheimer\u2019s disease characterization","volume":"38","author":"Liu","year":"2014","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/TBME.2015.2478028","article-title":"Pairwise latent semantic association for similarity computation in medical imaging","volume":"63","author":"Zhang","year":"2016","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.ogla.2018.04.002","article-title":"A deep learning-based algorithm identifies glaucomatous discs using monoscopic fundus photographs","volume":"1","author":"Liu","year":"2018","journal-title":"Ophthal. Glaucoma"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"e24572","DOI":"10.2196\/24572","article-title":"Development and Validation of a Machine Learning Approach for Automated Severity Assessment of COVID-19 Based on Clinical and Imaging Data: Retrospective Study","volume":"9","author":"Quiroz","year":"2021","journal-title":"JMIR Med. Inform."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"7733","DOI":"10.1038\/s41598-020-64588-y","article-title":"Isocitrate dehydrogenase (IDH) status prediction in histopathology images of gliomas using deep learning","volume":"10","author":"Liu","year":"2020","journal-title":"Sci. Rep."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hofmanninger, J., Prayer, F., Pan, J., Rohrich, S., Prosch, H., and Langs, G. (2020). Automatic lung segmentation in routine imaging is a data diversity problem, not a methodology problem. arXiv.","DOI":"10.1186\/s41747-020-00173-2"},{"key":"ref_32","unstructured":"(2020, April 01). COVID-19 CT Segmentation Dataset. Available online: http:\/\/medicalsegmentation.com\/covid19\/."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation. arXiv.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_34","unstructured":"Tan, M., and Le, Q.V. (2019). Efficientnet: Rethinking model scaling for convolutional neural networks. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Li, F.F. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Buslaev, A., Iglovikov, V.I., Khvedchenya, E., Parinov, A., Druzhinin, M., and Kalinin, A.A. (2020). Albumentations: Fast and Flexible Image Augmentations. Information, 11.","DOI":"10.3390\/info11020125"},{"key":"ref_37","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2445","DOI":"10.1016\/j.ygeno.2020.01.017","article-title":"Using extreme gradient boosting to identify origin of replication in Saccharomyces cerevisiae via hybrid features","volume":"112","author":"Do","year":"2020","journal-title":"Genomics"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Le, N.Q.K., Kha, Q.H., Nguyen, V.H., Chen, Y.-C., Cheng, S.-J., and Chen, C.-Y. (2021). Machine Learning-Based Radiomics Signatures for EGFR and KRAS Mutations Prediction in Non-Small-Cell Lung Cancer. Int. J. Mol. Sci., 22.","DOI":"10.3390\/ijms22179254"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1323","DOI":"10.1016\/j.mri.2012.05.001","article-title":"3D Slicer as an image computing platform for the Quantitative Imaging Network","volume":"30","author":"Fedorov","year":"2012","journal-title":"Magn. Reson. Imaging"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.ijid.2020.03.020","article-title":"Estimation of the asymptomatic ratio of novel coronavirus infections (COVID-19)","volume":"94","author":"Nishiura","year":"2020","journal-title":"Int. J. Infect. Dis."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1126\/science.abb3221","article-title":"Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARS-CoV2)","volume":"368","author":"Li","year":"2020","journal-title":"Science"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Qiu, J. (2020). Covert coronavirus infections could be seeding new outbreaks. Nature.","DOI":"10.1038\/d41586-020-00822-x"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"m1328","DOI":"10.1136\/bmj.m1328","article-title":"Systematic review and critical appraisal of prediction models for diagnosis and prognosis of COVID-19 infection","volume":"369","author":"Wynants","year":"2020","journal-title":"BMJ"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1117\/12.387164","article-title":"Medical image perception: Evaluating the role of experience","volume":"3959","author":"Krupinski","year":"2000","journal-title":"Proc. SPIE"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"S111","DOI":"10.1148\/radiol.14140130","article-title":"History and Evolution of Brain Tumor Imaging: Insights throughRadiology","volume":"273","author":"Castillo","year":"2014","journal-title":"Radiology"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1007\/s10916-007-9113-9","article-title":"Automated Identification of Diabetic Retinopathy Stages Using Digital Fundus Images","volume":"32","author":"Nayak","year":"2007","journal-title":"J. Med. Syst."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Brunye, T., Carney, P.A., Allison, K.H., Shapiro, L.G., Weaver, D.L., and Elmore, J.G. (2014). Eye Movements as an Index of Pathologist Visual Expertise: A Pilot Study. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0103447"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Russo, C., Liu, S., and Di Ieva, A. (2020). Spherical coordinates transformation pre-processing in Deep Convolution Neural Networks for brain tumor segmentation in MRI. arXiv.","DOI":"10.1007\/978-3-030-72084-1_27"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"43","DOI":"10.4103\/jpi.jpi_103_20","article-title":"Generative adversarial networks in digital pathology and histopathological image processing: A review","volume":"12","author":"Jose","year":"2021","journal-title":"J. Pathol. Inform."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"625176","DOI":"10.3389\/fmed.2020.625176","article-title":"Short-Term Variations in Neutrophil-to-Lymphocyte and Urea-to-Creatinine Ratios Anticipate Intensive Care Unit Admission of COVID-19 Patients in the Emergency Department","volume":"7","author":"Solimando","year":"2021","journal-title":"Front. Med."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Ye, Q., Xia, J., and Yang, G. (2021, January 7\u20139). Explainable AI for COVID-19 CT Classifiers: An Initial Comparison Study. Proceedings of the 2021 IEEE 34th International Symposium on Computer-Based Medical Systems (CBMS), Aveiro, Portugal.","DOI":"10.1109\/CBMS52027.2021.00103"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Voulodimos, A., Protopapadakis, E., Katsamenis, I., Doulamis, A., and Doulamis, N. (2021). A Few-Shot U-Net Deep Learning Model for COVID-19 Infected Area Segmentation in CT Images. Sensors, 21.","DOI":"10.3390\/s21062215"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/11\/471\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,21]],"date-time":"2024-07-21T15:05:58Z","timestamp":1721574358000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/11\/471"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,15]]},"references-count":53,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["info12110471"],"URL":"https:\/\/doi.org\/10.3390\/info12110471","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.08.03.20167007","asserted-by":"object"},{"id-type":"doi","id":"10.2196\/preprints.28903","asserted-by":"object"}]},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,15]]}}}