Abstract
Recently, deep learning has shown promising results in medical image processing. However, computer-aided diagnosis (CAD) systems based on deep learning still struggle for the real-world deployment, due to its low generalizability and reliability. It is essential to improve the generalization performance to enable them to be used routinely in clinical practice. In this paper, we propose a capsule network with a multi-scale setting to achieve better generalization performance in the differential diagnosis of breast tumors using ultrasonography. The proposed network utilizes a Gaussian pyramid to learn multi-scale features of breast tumors and dynamic routing to improve its robustness against image quality with severe noises. To evaluate the generalizability of the proposed method, we collected breast ultrasound images from 4 different hospitals and used one dataset from 1 hospital as a train set and the rest as external validation sets. We compared the classification performance with other networks, which were employed for the ultrasound diagnosis in previous studies, on the external validation sets. We also conducted additional experiments: feature space visualization and robustness evaluation study with respect to the image noise. Our model showed better classification results than other networks, such as GoogLeNet and Inception-v3, in the external validation. Experimental results also indicate that the proposed network can learn more robust and noise-invariant features from breast ultrasound imaging.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abd-Elmoniem, K.Z., Youssef, A.B., Kadah, Y.M.: Real-time speckle reduction and coherence enhancement in ultrasound imaging via nonlinear anisotropic diffusion. IEEE Trans. Biomed. Eng. 49(9), 997–1014 (2002)
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)
Drukker, K., Gruszauskas, N.P., Sennett, C.A., Giger, M.L.: Breast us computer-aided diagnosis workstation: performance with a large clinical diagnostic population. Radiology 248(2), 392–397 (2008)
Gatys, L.A., Ecker, A.S., Bethge, M.: Image style transfer using convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2414–2423 (2016)
Geirhos, R., Rubisch, P., Michaelis, C., Bethge, M., Wichmann, F.A., Brendel, W.: Imagenet-trained cnns are biased towards texture; increasing shape bias improves accuracy and robustness. arXiv preprint arXiv:1811.12231 (2018)
Han, S., et al.: A deep learning framework for supporting the classification of breast lesions in ultrasound images. Phys. Med. Biol. 62(19), 7714 (2017)
Hinton, G.E., Krizhevsky, A., Wang, S.D.: Transforming auto-encoders. In: Honkela, T., Duch, W., Girolami, M., Kaski, S. (eds.) ICANN 2011. LNCS, vol. 6791, pp. 44–51. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21735-7_6
Huang, X., Belongie, S.: Arbitrary style transfer in real-time with adaptive instance normalization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1501–1510 (2017)
Kim, C., Kim, W.H., Kim, H.J., Kim, J.: Weakly-supervised us breast tumor characterization and localization with a box convolution network. In: Medical Imaging 2020: Computer-Aided Diagnosis. vol. 11314, p. 1131419. International Society for Optics and Photonics (2020)
Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Moore, S.K.: Better breast cancer detection. IEEE Spectr. 38(5), 50–54 (2001)
Sabour, S., Frosst, N., Hinton, G.E.: Dynamic routing between capsules. arXiv preprint arXiv:1710.09829 (2017)
Shin, S.Y., Lee, S., Yun, I.D., Kim, S.M., Lee, K.M.: Joint weakly and semi-supervised deep learning for localization and classification of masses in breast ultrasound images. IEEE Trans. Med. Imaging 38(3), 762–774 (2018)
Stavros, A.T., Thickman, D., Rapp, C.L., Dennis, M.A., Parker, S.H., Sisney, G.A.: Solid breast nodules: use of sonography to distinguish between benign and malignant lesions. Radiology 196(1), 123–134 (1995)
Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818–2826 (2016)
Wang, L.: Early diagnosis of breast cancer. Sensors 17(7), 1572 (2017)
Wang, S., Huang, T.Z., Zhao, X.L., Mei, J.J., Huang, J.: Speckle noise removal in ultrasound images by first-and second-order total variation. Numer. Algorithms 78(2), 513–533 (2018)
Yap, M.H., Edirisinghe, E., Bez, H.: Processed images in human perception: a case study in ultrasound breast imaging. Eur. J. Radiol. 73(3), 682–687 (2010)
Acknowledgement
This research was supported by Basic Science Research Program through the National Research Foundation of Korea(NRF), funded by the Ministry of Education(2020R1I1A3074639) and the Ministry of Science and ICT (2020R1C1C1006453), and the Technology Innovation Program (Development of AI based diagnostic technology for medical imaging devices, 20011875), funded By the Ministry of Trade, Industry & Energy(MOTIE, Korea).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Kim, C., Kim, W.H., Kim, H.J., Kim, J. (2021). A Multi-scale Capsule Network for Improving Diagnostic Generalizability in Breast Cancer Diagnosis Using Ultrasonography. In: Rekik, I., Adeli, E., Park, S.H., Schnabel, J. (eds) Predictive Intelligence in Medicine. PRIME 2021. Lecture Notes in Computer Science(), vol 12928. Springer, Cham. https://doi.org/10.1007/978-3-030-87602-9_17
Download citation
DOI: https://doi.org/10.1007/978-3-030-87602-9_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87601-2
Online ISBN: 978-3-030-87602-9
eBook Packages: Computer ScienceComputer Science (R0)
