Abstract
Computed tomography (CT) and chest X-ray (CXR) have been the two dominant imaging modalities deployed for improved management of Coronavirus disease 2019 (COVID-19). Due to faster imaging, less radiation exposure, and being cost-effective CXR is preferred over CT. However, the interpretation of CXR images, compared to CT, is more challenging due to low image resolution and COVID-19 image features being similar to regular pneumonia. Computer-aided diagnosis via deep learning has been investigated to help mitigate these problems and help clinicians during the decision-making process. The requirement for a large amount of labeled data is one of the major problems of deep learning methods when deployed in the medical domain. To provide a solution to this, in this work, we propose a semi-supervised learning (SSL) approach using minimal data for training. We integrate local-phase CXR image features into a multi-feature convolutional neural network architecture where the training of SSL method is obtained with a teacher/student paradigm. Quantitative evaluation is performed on 8,851 normal (healthy), 6,045 pneumonia, and 3,795 COVID-19 CXR scans. By only using 7.06% labeled and 16.48% unlabeled data for training, 5.53% for validation, our method achieves 93.61% mean accuracy on a large-scale (70.93%) test data. We provide comparison results against fully supervised and SSL methods. The code and dataset will be made available after acceptance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alessandrini, M., Basarab, A., Liebgott, H., Bernard, O.: Myocardial motion estimation from medical images using the monogenic signal. IEEE Trans. Image Process. 22(3), 1084–1095 (2012)
Alsinan, A.Z., Patel, V.M., Hacihaliloglu, I.: Automatic segmentation of bone surfaces from ultrasound using a filter-layer-guided CNN. Int. J. Comput. Assist. Radiol. Surg. 14(5), 775–783 (2019)
Arazo, E., Ortego, D., Albert, P., O’Connor, N.E., McGuinness, K.: Pseudo-labeling and confirmation bias in deep semi-supervised learning (2020)
Aviles-Rivero, A.I., et al.: GraphX\(^{{\bf {NET}}}\): chest x-ray classification under extreme minimal supervision. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11769, pp. 504–512. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32226-7_56
Baumgartner, C.F., et al.: Sononet: real-time detection and localisation of fetal standard scan planes in freehand ultrasound. IEEE Trans. Med. Imaging 36(11), 2204–2215 (2017)
Chollet, F.: Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017)
Clark, K., et al.: The cancer imaging archive (TCIA): maintaining and operating a public information repository. J. Digit. Imaging 26(6), 1045–1057 (2013). https://doi.org/10.1007/s10278-013-9622-7
Desai, S., et al.: Chest imaging representing a COVID-19 positive rural US population. Sci. Data 7, 1–6 (2020). https://doi.org/10.1038/s41597-020-00741-6
Gyawali, P.K., Ghimire, S., Bajracharya, P., Li, Z., Wang, L.: Semi-supervised medical image classification with global latent mixing. In: Martel, A.L., et al. (eds.) MICCAI 2020. LNCS, vol. 12261, pp. 604–613. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-59710-8_59
Gyawali, P.K., Li, Z., Ghimire, S., Wang, L.: Semi-supervised learning by disentangling and self-ensembling over stochastic latent space. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11769, pp. 766–774. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32226-7_85
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778 (2016)
de la Iglesia Vayá, M.,et al.: Bimcv COVID-19+: a large annotated dataset of RX and CT images from COVID-19 patients. arXiv preprint arXiv:2006.01174 (2020)
Laine, S., Aila, T.: Temporal ensembling for semi-supervised learning. arXiv preprint arXiv:1610.02242 (2016)
Laine, S., Aila, T.: Temporal ensembling for semi-supervised learning (2017)
Lee, D.H., et al.: Pseudo-label: the simple and efficient semi-supervised learning method for deep neural networks. In: Workshop on challenges in representation learning. In: ICML, vol. 3 (2013)
Li, Z., van Vliet, L.J., Stoker, J., Vos, F.M.: A hybrid optimization strategy for registering images with large local deformations and intensity variations. Int. J. Comput. Assist. Radiol. Surg. 13(3), 343–351 (2017). https://doi.org/10.1007/s11548-017-1697-z
Mahsereci, M., Balles, L., Lassner, C., Hennig, P.: Early stopping without a validation set. CoRR abs/1703.09580 (2017). http://arxiv.org/abs/1703.09580
Natarajan, N., Dhillon, I.S., Ravikumar, P., Tewari, A.: Learning with noisy labels. In: Proceedings of the 26th International Conference on Neural Information Processing Systems, NIPS 2013, vol. 1. pp. 1196–1204. Curran Associates Inc., Red Hook (2013)
Oliver, A., Odena, A., Raffel, C., Cubuk, E.D., Goodfellow, I.J.: Realistic evaluation of deep semi-supervised learning algorithms. arXiv preprint arXiv:1804.09170 (2018)
Ozturk, T., Talo, M., Yildirim, E.A., Baloglu, U.B., Yildirim, O., Acharya, U.R.: Automated detection of COVID-19 cases using deep neural networks with X-ray images. Comput. Biol. Med. 121, 103792 (2020)
Qi, X., Brown, L.G., Foran, D.J., Nosher, J., Hacihaliloglu, I.: Chest X-ray image phase features for improved diagnosis of COVID-19 using convolutional neural network. Int. J. Comput. Assist. Radiol. Surg. 1–10 (2020)
Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.: Inception-v4, inception-resnet and the impact of residual connections on learning (2016)
Tan, M., Le, Q.V.: Efficientnet: Rethinking model scaling for convolutional neural networks. arXiv preprint arXiv:1905.11946 (2019)
Tsai, E.B., et al.: The RSNA international COVID-19 open annotated radiology database (RICORD). Radiology 203957. https://doi.org/10.1148/radiol.2021203957, pMID: 33399506
Unnikrishnan, B., Nguyen, C.M., Balaram, S., Foo, C.S., Krishnaswamy, P.: Semi-supervised classification of diagnostic radiographs with noteacher: a teacher that is not mean. In: Martel, A.L., et al. (eds.) MICCAI 2020. LNCS, vol. 12261, pp. 624–634. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-59710-8_61
Wang, L., Lin, Z.Q., Wong, A.: Covid-net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest x-ray images. Sci. Reports 10(1), 1–12 (2020)
Yalniz, I.Z., Jégou, H., Chen, K., Paluri, M., Mahajan, D.: Billion-scale semi-supervised learning for image classification. CoRR abs/1905.00546 (2019). http://arxiv.org/abs/1905.00546
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Qi, X., Foran, D.J., Nosher, J.L., Hacihaliloglu, I. (2021). Multi-Feature Semi-Supervised Learning for COVID-19 Diagnosis from Chest X-Ray Images. In: Lian, C., Cao, X., Rekik, I., Xu, X., Yan, P. (eds) Machine Learning in Medical Imaging. MLMI 2021. Lecture Notes in Computer Science(), vol 12966. Springer, Cham. https://doi.org/10.1007/978-3-030-87589-3_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-87589-3_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87588-6
Online ISBN: 978-3-030-87589-3
eBook Packages: Computer ScienceComputer Science (R0)
