{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,17]],"date-time":"2024-08-17T12:30:21Z","timestamp":1723897821190},"reference-count":49,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T00:00:00Z","timestamp":1652140800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["NRF-2021R1F1A1059554"],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002597","name":"Kyung Hee University","doi-asserted-by":"publisher","award":["KHU-20210489"],"id":[{"id":"10.13039\/501100002597","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"The detection and segmentation of thrombi are essential for monitoring the disease progression of abdominal aortic aneurysms (AAAs) and for patient care and management. As they have inherent capabilities to learn complex features, deep convolutional neural networks (CNNs) have been recently introduced to improve thrombus detection and segmentation. However, investigations into the use of CNN methods is in the early stages and most of the existing methods are heavily concerned with the segmentation of thrombi, which only works after they have been detected. In this work, we propose a fully automated method for the whole process of the detection and segmentation of thrombi, which is based on a well-established mask region-based convolutional neural network (Mask R-CNN) framework that we improve with optimized loss functions. The combined use of complete intersection over union (CIoU) and smooth L1 loss was designed for accurate thrombus detection and then thrombus segmentation was improved with a modified focal loss. We evaluated our method against 60 clinically approved patient studies (i.e., computed tomography angiography (CTA) image volume data) by conducting 4-fold cross-validation. The results of comparisons to multiple other state-of-the-art methods suggested the superior performance of our method, which achieved the highest F1 score for thrombus detection (0.9197) and outperformed most metrics for thrombus segmentation.<\/jats:p>","DOI":"10.3390\/s22103643","type":"journal-article","created":{"date-parts":[[2022,5,11]],"date-time":"2022-05-11T01:52:11Z","timestamp":1652233931000},"page":"3643","source":"Crossref","is-referenced-by-count":14,"title":["Automatic Detection and Segmentation of Thrombi in Abdominal Aortic Aneurysms Using a Mask Region-Based Convolutional Neural Network with Optimized Loss Functions"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"http:\/\/orcid.org\/0000-0003-4337-4451","authenticated-orcid":false,"given":"Byunghoon","family":"Hwang","sequence":"first","affiliation":[{"name":"Department of Software Convergence, Kyung Hee University, Yongin 17104, Korea"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-4491-6438","authenticated-orcid":false,"given":"Jihu","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Software, Gachon University, Seongnam 13120, Korea"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-4901-5794","authenticated-orcid":false,"given":"Sungmin","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Software, Gachon University, Seongnam 13120, Korea"}]},{"given":"Eunyoung","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Radiology, Gachon University Gil Medical Center, Incheon 21565, Korea"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-1404-2821","authenticated-orcid":false,"given":"Jeongho","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Radiology, Gachon University Gil Medical Center, Incheon 21565, Korea"}]},{"given":"Younhyun","family":"Jung","sequence":"additional","affiliation":[{"name":"Department of Software, Gachon University, Seongnam 13120, Korea"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-3241-8455","authenticated-orcid":false,"given":"Hyoseok","family":"Hwang","sequence":"additional","affiliation":[{"name":"Department of Software Convergence, Kyung Hee University, Yongin 17104, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"031001","DOI":"10.1115\/1.3005200","article-title":"Abdominal aortic aneurysm risk of rupture: Patient-specific FSI simulations using anisotropic model","volume":"131","author":"Rissland","year":"2009","journal-title":"J. Biomech. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"ITC5-1","DOI":"10.7326\/0003-4819-150-9-200905050-01005","article-title":"Abdominal aortic aneurysm","volume":"150","author":"Lederle","year":"2009","journal-title":"Ann. Intern. Med."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1053\/ejvs.2000.1285","article-title":"The incidence of small abdominal aortic aneurysms and the change in normal infrarenal aortic diameter: Implications for screening","volume":"21","author":"Wilmink","year":"2001","journal-title":"Eur. J. Vasc. Endovasc. Surg."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1425","DOI":"10.1001\/archinte.160.10.1425","article-title":"The aneurysm detection and management study screening program: Validation cohort and final results","volume":"160","author":"Lederle","year":"2000","journal-title":"Arch. Intern. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1038\/nrcardio.2010.180","article-title":"Pathophysiology and epidemiology of abdominal aortic aneurysms","volume":"8","author":"Nordon","year":"2011","journal-title":"Nat. Rev. Cardiol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/j.jvs.2006.04.037","article-title":"Increasing incidence of ruptured abdominal aortic aneurysm: A population-based study","volume":"44","author":"Acosta","year":"2006","journal-title":"J. Vasc. Surg."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.jvs.2017.10.044","article-title":"The Society for Vascular Surgery practice guidelines on the care of patients with an abdominal aortic aneurysm","volume":"67","author":"Chaikof","year":"2018","journal-title":"J. Vasc. Surg."},{"key":"ref_8","first-page":"327","article-title":"Postoperative imaging after endovascular AAA repair","volume":"Volume 12","author":"Fillinger","year":"1999","journal-title":"Seminars in Vascular Surgery"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.neucom.2013.01.051","article-title":"Random forest active learning for AAA thrombus segmentation in computed tomography angiography images","volume":"126","author":"Maiora","year":"2014","journal-title":"Neurocomputing"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1016\/j.cpcardiol.2010.08.004","article-title":"Diagnosis and monitoring of abdominal aortic aneurysm: Current status and future prospects","volume":"35","author":"Moxon","year":"2010","journal-title":"Curr. Probl. Cardiol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1016\/j.compmedimag.2011.12.001","article-title":"3D segmentation of abdominal aorta from CT-scan and MR images","volume":"36","author":"Duquette","year":"2012","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Freiman, M., Esses, S.J., Joskowicz, L., and Sosna, J. (2010, January 14\u201317). An iterative model-constrained graph-cut algorithm for abdominal aortic aneurysm thrombus segmentation. Proceedings of the 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Rotterdam, The Netherlands.","DOI":"10.1109\/ISBI.2010.5490085"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Demirci, S., Lejeune, G., and Navab, N. (July, January 28). Hybrid deformable model for aneurysm segmentation. Proceedings of the 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Boston, MA, USA.","DOI":"10.1109\/ISBI.2009.5192976"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1501","DOI":"10.1007\/s11548-017-1591-8","article-title":"Generic thrombus segmentation from pre-and post-operative CTA","volume":"12","author":"Lalys","year":"2017","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1007\/s10278-018-0049-z","article-title":"Outer wall segmentation of abdominal aortic aneurysm by variable neighborhood search through intensity and gradient spaces","volume":"31","author":"Siriapisith","year":"2018","journal-title":"J. Digit. Imaging"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.cmpb.2011.06.009","article-title":"Geometrical methods for level set based abdominal aortic aneurysm thrombus and outer wall 2D image segmentation","volume":"107","author":"Zohios","year":"2012","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1637","DOI":"10.1016\/j.jvs.2016.11.044","article-title":"Measuring abdominal aortic diameters in routine abdominal computed tomography scans and implications for abdominal aortic aneurysm screening","volume":"65","author":"Claridge","year":"2017","journal-title":"J. Vasc. Surg."},{"key":"ref_18","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs","volume":"40","author":"Chen","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Minaee, S., Boykov, Y.Y., Porikli, F., Plaza, A.J., Kehtarnavaz, N., and Terzopoulos, D. (2021). Image segmentation using deep learning: A survey. IEEE Trans. Pattern Anal. Mach. Intell.","DOI":"10.1109\/TPAMI.2021.3059968"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 11\u201318). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zheng, Z., Wang, P., Liu, W., Li, J., Ye, R., and Ren, D. (2020, January 7\u201312). Distance-IoU loss: Faster and better learning for bounding box regression. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i07.6999"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.compbiomed.2017.12.011","article-title":"Skeletonization method for vessel delineation of arteriovenous malformation","volume":"93","author":"Babin","year":"2018","journal-title":"Comput. Biol. Med."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Babin, D., Vansteenkiste, E., Pi\u017eurica, A., and Philips, W. (September, January 28). Centerline calculation for extracting abdominal aorta in 3-D MRI images. Proceedings of the 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, USA.","DOI":"10.1109\/EMBC.2012.6346839"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/j.compmedimag.2013.12.001","article-title":"Robust segmentation methods with an application to aortic pulse wave velocity calculation","volume":"38","author":"Babin","year":"2014","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Babin, D., Devos, D., Plati\u0161a, L., Jovanov, L., Habijan, M., Leventi\u0107, H., and Philips, W. (2020, January 10\u201314). Segmentation of phase-contrast mr images for aortic pulse wave velocity measurements. Proceedings of the International Conference on Advanced Concepts for Intelligent Vision Systems, Auckland, New Zealand.","DOI":"10.1007\/978-3-030-40605-9_7"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Babin, D., Vansteenkiste, E., Pizurica, A., and Philips, W. (2009, January 3\u20136). Segmentation and length measurement of the abdominal blood vessels in 3-D MRI images. Proceedings of the 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN, USA.","DOI":"10.1109\/IEMBS.2009.5333689"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.media.2004.01.001","article-title":"Interactive segmentation of abdominal aortic aneurysms in CTA images","volume":"8","author":"Viergever","year":"2004","journal-title":"Med. Image Anal."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mac\u00eda, I., Legarreta, J.H., Paloc, C., Gra\u00f1a, M., Maiora, J., Garc\u00eda, G., and Blas, M.D. (2009, January 23\u201326). Segmentation of abdominal aortic aneurysms in CT images using a radial model approach. Proceedings of the International Conference on Intelligent Data Engineering and Automated Learning, Burgos, Spain.","DOI":"10.1007\/978-3-642-04394-9_81"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-017-04699-1","article-title":"BioPARR: A software system for estimating the rupture potential index for abdominal aortic aneurysms","volume":"7","author":"Joldes","year":"2017","journal-title":"Sci. Rep."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zheng, J.Q., Zhou, X.Y., Li, Q.B., Riga, C., and Yang, G.Z. (2018). Abdominal aortic aneurysm segmentation with a small number of training subjects. arXiv.","DOI":"10.31256\/HSMR2018.23"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Hong, H.A., and Sheikh, U. (2016, January 4\u20136). Automatic detection, segmentation and classification of abdominal aortic aneurysm using deep learning. Proceedings of the 2016 IEEE 12th International Colloquium on Signal Processing & Its Applications (CSPA), Melaka, Malaysia.","DOI":"10.1109\/CSPA.2016.7515839"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Wang, D., Zhang, R., Zhu, J., Teng, Z., Huang, Y., Spiga, F., Du, M.H.F., Gillard, J.H., Lu, Q., and Li\u00f2, P. (2018, January 10\u201315). Neural network fusion: A novel CT-MR aortic aneurysm image segmentation method. Proceedings of the Medical Imaging 2018: Image Processing; International Society for Optics and Photonics, Houston, TX, USA.","DOI":"10.1117\/12.2293371"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.media.2018.03.010","article-title":"Fully automatic detection and segmentation of abdominal aortic thrombus in post-operative CTA images using deep convolutional neural networks","volume":"46","author":"Aranjuelo","year":"2018","journal-title":"Med. Image Anal."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Lu, J.T., Brooks, R., Hahn, S., Chen, J., Buch, V., Kotecha, G., Andriole, K.P., Ghoshhajra, B., Pinto, J., and Vozila, P. (2019, January 13\u201317). DeepAAA: Clinically applicable and generalizable detection of abdominal aortic aneurysm using deep learning. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Shenzhen, China.","DOI":"10.1007\/978-3-030-32245-8_80"},{"key":"ref_36","unstructured":"Nanni, L., Cuza, D., Lumini, A., Loreggia, A., and Brahnam, S. (2021). Deep ensembles in bioimage segmentation. arXiv."},{"key":"ref_37","unstructured":"Dong, B., Wang, W., Fan, D.P., Li, J., Fu, H., and Shao, L. (2021). Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformers. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., and Savarese, S. (2019, January 15\u201320). Generalized intersection over union: A metric and a loss for bounding box regression. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00075"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Xu, C., Wang, J., Yang, W., and Yu, L. (2021, January 20\u201325). Dot Distance for Tiny Object Detection in Aerial Images. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPRW53098.2021.00130"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/S1550-8579(08)80006-X","article-title":"Current issues in the treatment of women with abdominal aortic aneurysm","volume":"5","author":"Harthun","year":"2008","journal-title":"Gend. Med."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1046\/j.1365-2168.2000.01353.x","article-title":"Quantifying the risks of hypertension, age, sex and smoking in patients with abdominal aortic aneurysm","volume":"87","author":"Vardulaki","year":"2000","journal-title":"J. Br. Surg."},{"key":"ref_48","first-page":"707","article-title":"Introducing Dice, Jaccard, and other label overlap measures to ITK","volume":"2","author":"Tustison","year":"2009","journal-title":"Insight J."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1111\/cts.12478","article-title":"The Burden of the \u201cFalse-Negatives\u201d in Clinical Development: Analyses of Current and Alternative Scenarios and Corrective Measures","volume":"10","author":"Burt","year":"2017","journal-title":"Clin. Transl. Sci."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/10\/3643\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,29]],"date-time":"2024-07-29T11:13:35Z","timestamp":1722251615000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/10\/3643"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,10]]},"references-count":49,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["s22103643"],"URL":"https:\/\/doi.org\/10.3390\/s22103643","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,10]]}}}