Prototype Consistency Learning for Medical Image Segmentation by Cross Pseudo Supervision | Cognitive Computation Skip to main content
Springer Nature Link
Log in

Prototype Consistency Learning for Medical Image Segmentation by Cross Pseudo Supervision

  • Published:
Cognitive Computation Aims and scope Submit manuscript

Abstract

Due to the acquisition of anatomical/pathological labels is expensive and time-consuming, semi-supervised semantic segmentation is commonly utilized in medical image analysis. Previous studies have overlooked the high similarity of the pixels in medical images, resulting in many models cannot effectively distinguish the pixels of different categories. A new semi-supervised semantic segmentation framework based on prototype learning is proposed in this paper. It contains a feature extractor and a superpixel-based graph convolutional network (GCN). Two consistency loss functions are proposed in our paper. The prototype cyclic consistency loss is utilized to incorporate explicit guidance of the labeled data; the cross pseudo supervised loss is applied to make full use of the context information of the unlabeled data. We evaluate the effectiveness of our proposed method on two classical public medical image datasets (MC and JSRT). On MC dataset, the predicted IoU of our method is 94.92 ±0.5% with only 25% annotated data; on JSRT dataset, the MIoU of our method reaches 89.51 ±0.37% (with 25% annotated data) and 90.98 ±0.4% (with 50% annotated data). Our proposed method outperforms most existing semi-supervised semantic segmentation methods, even exceeds the fully supervised semantic segmentation methods, and achieves high-precision semi-supervised semantic segmentation effectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability

The authors declare that all other data supporting the findings of this study are available within the article.

References

  1. Wang Z, Zhao Z, Xing X, Xu D, Kong X, Zhou L. Conflict-based cross-view consistency for semi-supervised semantic segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2023. pp. 19585–19595.

  2. Dutta SK, Saikia S, Barman A, Roy R, Bora K, Mahanta LB, Suresh R. Study on enhanced deep learning approaches for value-added identification and segmentation of striation marks in bullets for precise firearm classification. Appl Soft Comput. 2021;112:107789.

    Article  Google Scholar 

  3. Mohajerani S, Saeedi P. Cloud-net: An end-to-end cloud detection algorithm for landsat 8 imagery. In: IGARSS 2019-2019 IEEE International Geoscience and Remote Sensing Symposium; 2019. pp. 1029–1032. IEEE.

  4. Yu Q, Gao Y, Zheng Y, Zhu J, Dai Y, Shi Y. Crossover-net: Leveraging vertical-horizontal crossover relation for robust medical image segmentation. Pattern Recogn. 2021;113:107756.

    Article  Google Scholar 

  5. Mittal S, Tatarchenko M, Brox T. Semi-supervised semantic segmentation with high-and low-level consistency. IEEE Trans Pattern Anal Mach Intell. 2019;43(4):1369–79.

    Article  Google Scholar 

  6. Sun L, Wu J, Ding X, Huang Y, Wang G, Yu Y. A teacher-student framework for semi-supervised medical image segmentation from mixed supervision. IEEE Trans Med Imaging. 2020.

  7. Kurakin A, Raffel C, Berthelot D, Cubuk ED, Zhang H, Sohn K, Carlini N. Remixmatch: Semi-supervised learning with distribution matching and augmentation anchoring. ICLR. 2020.

  8. Miyato T, Maeda S-I, Koyama M, Ishii S. Virtual adversarial training: a regularization method for supervised and semi-supervised learning. IEEE Trans Pattern Anal Mach Intell. 2018;41(8):1979–93.

    Article  Google Scholar 

  9. Zhang H, Cisse M, Dauphin YN, Lopez-Paz D. Mixup: Beyond empirical risk minimization. ICLR. 2017.

  10. Verma V, Kawaguchi K, Lamb A, Kannala J, Solin A, Bengio Y, Lopez-Paz D. Interpolation consistency training for semi-supervised learning. Neural Netw. 2022;145:90–106.

    Article  Google Scholar 

  11. Li X, Yu L, Chen H, Fu C-W, Xing L, Heng P-A. Transformation-consistent self-ensembling model for semisupervised medical image segmentation. IEEE Trans Neural Netw Learn Syst. 2020;32(2):523–34.

    Article  Google Scholar 

  12. Fang K, Li WJ. Dmnet: difference minimization network for semi-supervised segmentation in medical images. In: International Conference on Medical Image Computing and Computer-Assisted Intervention; 2020. pp. 532–541. Springer.

  13. Zheng X, Fu C, Xie H, Chen J, Wang X, Sham C-W. Uncertainty-aware deep co-training for semi-supervised medical image segmentation. Comput Biol Med. 2022;149:106051.

    Article  Google Scholar 

  14. Shi Y, Zhang J, Ling T, Lu J, Zheng Y, Yu Q, Qi L, Gao Y. Inconsistency-aware uncertainty estimation for semi-supervised medical image segmentation. IEEE Trans Med Imaging. 2021;41(3):608–20.

    Article  Google Scholar 

  15. Kervadec H, Dolz J, Granger É, Ben Ayed I. Curriculum semi-supervised segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention; 2019. pp. 568–576. Springer.

  16. Liu X, Hu G, Ma X, Kuang H. An enhanced neural network based on deep metric learning for skin lesion segmentation. In: 2019 Chinese Control And Decision Conference (CCDC); 2019. pp. 1633–1638. IEEE.

  17. Luther K, Seung HS. Learning metric graphs for neuron segmentation in electron microscopy images. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019); 2019. pp. 244–248. IEEE.

  18. Xu Z, Wang Y, Lu D, Yu L, Yan J, Luo J, Ma K, Zheng Y, Tong RKY. All-around real label supervision: Cyclic prototype consistency learning for semi-supervised medical image segmentation. IEEE J Biomed Health Inform. 2022.

  19. Xiao M, Kortylewski A, Wu R, Qiao S, Shen W, Yuille A. Tdmpnet: Prototype network with recurrent top-down modulation for robust object classification under partial occlusion. In: European Conference on Computer Vision; 2020. pp. 447–463. Springer.

  20. Xu W, Xian Y, Wang J, Schiele B, Akata Z. Attribute prototype network for zero-shot learning. Adv Neural Inf Process Syst. 2020;33:21969–80.

    Google Scholar 

  21. Liu Y, Zhang X, Zhang S, He X. Part-aware prototype network for few-shot semantic segmentation. In: European Conference on Computer Vision; 2020. pp. 142–158. Springer.

  22. Li Y, Gupta A. Beyond grids: Learning graph representations for visual recognition. Adv Neural Inf Process. 2018;31.

  23. Lu Y, Chen Y, Zhao D, Chen J. Graph-fcn for image semantic segmentation. In: International Symposium on Neural Networks; 2019. pp. 97–105. Springer.

  24. Zhang L, Li X, Arnab A, Yang K, Tong Y, Torr PH. Dual graph convolutional network for semantic segmentation. IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019.

  25. Wan J, Liu Y, Wei D, Bai X, Xu Y. Super-bpd: Super boundary-to-pixel direction for fast image segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2020 pp. 9253–9262.

  26. Suzuki T. Superpixel segmentation via convolutional neural networks with regularized information maximization. In: ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP); 2020. pp. 2573–2577. IEEE.

  27. Wang K, Liew JH, Zou Y, Zhou D, Feng J. Panet: Few-shot image semantic segmentation with prototype alignment. In: Proceedings of the IEEE/CVF International Conference on Computer Vision; 2019. pp. 9197–9206.

  28. Zhou J, Cui G, Hu S, Zhang Z, Yang C, Liu Z, Wang L, Li C, Sun M. Graph neural networks: A review of methods and applications. AI Open. 2020;1:57–81.

    Article  Google Scholar 

  29. Jaeger S, Karargyris A, Candemir S, Folio L, Siegelman J, Callaghan F, Xue Z, Palaniappan K, Singh RK, Antani S, et al. Automatic tuberculosis screening using chest radiographs. IEEE Trans Med Imaging. 2013;33(2):233–45.

    Article  Google Scholar 

  30. Shiraishi J, Katsuragawa S, Ikezoe J, Matsumoto T, Kobayashi T, Komatsu K-I, Matsui M, Fujita H, Kodera Y, Doi K. Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists’ detection of pulmonary nodules. Am J Roentgenol. 2000;174(1):71–4.

    Article  Google Scholar 

  31. Van Ginneken B, Stegmann MB, Loog M. Segmentation of anatomical structures in chest radiographs using supervised methods: a comparative study on a public database. Med Image Anal. 2006;10(1):19–40.

    Article  Google Scholar 

  32. Bosdelekidis V, Ioakeimidis NS. Lung field segmentation in chest x-rays: a deformation-tolerant procedure based on the approximation of rib cage seed points. Appl Sci. 2020;10(18):6264.

    Article  Google Scholar 

  33. Candemir S, Jaeger S, Palaniappan K, Musco JP, Singh RK, Xue Z, Karargyris A, Antani S, Thoma G, McDonald CJ. Lung segmentation in chest radiographs using anatomical atlases with nonrigid registration. IEEE Trans Med Imaging. 2013;33(2):577–90.

    Article  Google Scholar 

  34. Oliveira H, dos Santos J. Deep transfer learning for segmentation of anatomical structures in chest radiographs. In: 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI); 2018. pp. 204–211. IEEE.

  35. Souza JC, Diniz JOB, Ferreira JL, da Silva GLF, Silva AC, de Paiva AC. An automatic method for lung segmentation and reconstruction in chest x-ray using deep neural networks. Comput Methods Programs Biomed. 2019;177:285–96.

    Article  Google Scholar 

  36. Wang H, Gu H, Qin P, Wang J. U-shaped gan for semi-supervised learning and unsupervised domain adaptation in high resolution chest radiograph segmentation. Front Med. 2021;8.

  37. Scherer S, Schön R, Lienhart R. Pseudo-label noise suppression techniques for semi-supervised semantic segmentation. 2022. arXiv preprint arXiv:2210.10426.

  38. Yang L, Zhuo W, Qi L, Shi Y, Gao Y. St++: Make self-training work better for semi-supervised semantic segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2022. pp. 4268–4277.

  39. Xie H, Wang C, Zheng M, Dong M, You S, Fu C, Xu C. Boosting semi-supervised semantic segmentation with probabilistic representations. In: Proceedings of the AAAI Conference on Artificial Intelligence; 2023. vol. 37, pp. 2938–2946.

  40. Novikov AA, Lenis D, Major D, Hladůvka J, Wimmer M, Bühler K. Fully convolutional architectures for multiclass segmentation in chest radiographs. IEEE Trans Med Imaging. 2018;37(8):1865–76.

    Article  Google Scholar 

  41. Dai W, Dong N, Wang Z, Liang X, Zhang H, Xing EP. Scan: Structure correcting adversarial network for organ segmentation in chest x-rays. In: International Workshop on Deep Learning in Medical Image Analysis; 2018. pp. 263–273. Springer.

  42. Shah MP, Merchant S, Awate SP. Ms-net: mixed-supervision fully-convolutional networks for full-resolution segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention; 2018. pp. 379–387. Springer.

  43. Bortsova G, Dubost F, Hogeweg L, Katramados I, Bruijne MD. Semi-supervised medical image segmentation via learning consistency under transformations. In: International Conference on Medical Image Computing and Computer-Assisted Intervention; 2019. pp. 810–818. Springer.

Download references

Funding

This work was funded by the National Natural Science Foundation of China under Grant 51774219, Key R &D Projects in Hubei Province under grant 2020BAB098.

Author information

Authors and Affiliations

  1. College of Information Science and Engineering, Wuhan University of Science and Technology, Wuhan, 430081, Hubei, China

    Lu Xie, Weigang Li, Yongqiang Wang & Yuntao Zhao

  2. Engineering Research Center of Metallurgical Automation and Measurement Technology of Ministry of Education, Wuhan University of Science and Technology, Wuhan, 430081, Hubei, China

    Weigang Li

Authors
  1. Lu Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Weigang Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yongqiang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yuntao Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Xie Lu performed the conceptualization, data analysis and writing; Li Weigang performed the project administration and funding acquisition; Wang Yongqiang performed the writing (review & editing); Zhao Yuntao performed the supervision.

Corresponding author

Correspondence to Weigang Li.

Ethics declarations

Ethical Approval

This study is non-human subject research and is exempt from ethical approval by the corresponding author’s university.

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xie, L., Li, W., Wang, Y. et al. Prototype Consistency Learning for Medical Image Segmentation by Cross Pseudo Supervision. Cogn Comput 16, 215–228 (2024). https://doi.org/10.1007/s12559-023-10198-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12559-023-10198-5

Keywords

Search

Navigation