Hierarchical metric learning with intra-level and inter-level regularization | International Journal of Machine Learning and Cybernetics Skip to main content
Springer Nature Link
Log in

Hierarchical metric learning with intra-level and inter-level regularization

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Metric learning for hierarchical classification is a significant problem whose purpose is to learn more discriminative metrics by exploiting the dataset’s hierarchical structure and achieving higher accuracy rates for hierarchical classification. However, most of the existing hierarchical metric learning methods fail to consider the irrelevance between the metrics of sibling nodes in a hierarchical tree, which makes the metric of each node not well distinguish child nodes. This paper proposes a hierarchical metric learning model based on intra-level and inter-level regularization. The model mines the idiosyncrasies of sibling nodes and learns a more discriminative metric for each non-leaf node. At the same time, by exploiting the commonalities of parent-child nodes to control inter-level error propagation. Extensive experiments on five hierarchical datasets demonstrate that the proposed algorithm can perform better than the existing ones.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Esuli A, Fagni T, Sebastiani F (2008) Boosting multi-label hierarchical text categorization. Inform Retrieval 11(4):287–313

    Article  Google Scholar 

  2. Zheng Y, Fan JP, Zhang J, Gao XB (2017) Hierarchical learning of multi-task sparse metrics for large-scale image classification. Pattern Recognit 67:97–109

    Article  Google Scholar 

  3. Wang HX, Shen XT, Pan W (2011) Large margin hierarchical classification with mutually exclusive class membership. J Mach Learn Res 12:2721–2748

    MathSciNet  MATH  Google Scholar 

  4. Lv XM, Duan FJ (2018) Metric learning via feature weighting for scalable image retrieval. Pattern Recognition Letters, 109(JUL.15):97–102

  5. Martinel. N (2018) Accelerated low-rank sparse metric learning for person re-identification. Pattern Recognition Letters, 112(SEP.1):234–240

  6. Gundogdu B, Bianco MJ (2020) Collaborative similarity metric learning for face recognition in the wild. IET Image Process 14(9):1759–1768

    Article  Google Scholar 

  7. Lebanon G (2006) Metric learning for text documents. Pattern Anal Mach Intell 28(4):497–508

    Article  Google Scholar 

  8. Xing EP, Ng AY, Jordan MI, Russell (2002) SJ Distance metric learning with application to clustering with side-information. In Advances in Neural Information Processing Systems, pages 505–512

  9. Weinberger KQ, Saul LK (2009) Distance metric learning for large margin nearest neighbor classification. J Mach Learn Res 10(1):207–244

    MATH  Google Scholar 

  10. Cover TM, Hart PE (2003) Nearest neighbor pattern classification. IEEE Trans Inform Theory 13(1):21–27

    Article  Google Scholar 

  11. Davis JV, Kulis B, Jain P, Sra S, Dhillon IS (2007) Information-theoretic metric learning. In Int Conf Mach Learn 227:209–216

    Google Scholar 

  12. Chen S, Luo L, Yang J, Gong C, Li J, Huang H (2019) Curvilinear distance metric learning. In Advances in Neural Information Processing Systems, pages 4225–4234

  13. Chen QN, Sun SL (2010) Hierarchical large margin nearest neighbor classification. In International Conference on Pattern Recognition, pages 906–909

  14. Lei H, Mei KZ, Xin JM, Dong PX, Fan JP (2016) Hierarchical learning of large-margin metrics for large-scale image classification. Neurocomputing, 208(oct.5):46–58

  15. Goel A, Banerjee B, Pizurica A (2018) Hierarchical metric learning for optical remote sensing scene categorization. IEEE Geoscience and Remote Sensing Letters, pages 1–5

  16. Zheng Y, Fan JP, Zhang J, Gao XB (2020) Exploiting related and unrelated tasks for hierarchical metric learning and image classification. IEEE Trans. Image Process 29:883–896

    Article  MathSciNet  Google Scholar 

  17. Miller GA (1995) Wordnet: a lexical database for English. Commun Acm 38(11):39–41

    Article  Google Scholar 

  18. Li LJ, Wang C, Lim Y, Blei DM, Li FF (2010) Building and using a semantivisual image hierarchy. In Computer Vision and Pattern Recognition, pages 3336–3343

  19. Bengio S, Weston J, Grangier D (2010) Label embedding trees for large multi-class tasks. In Advances in Neural Information Processing Systems, pages 163–171

  20. Liu BY, Sadeghi F, Tappen MF, Shamir O, Liu C (2013) Probabilistic label trees for efficient large scale image classification. In Computer Vision and Pattern Recognition

  21. Fan JP, Zhou N, Peng JY, Gao L (2015) Hierarchical learning of tree classifiers for large-scale plant species identification. IEEE Trans Image Process 24(11):4172–4184

    Article  MathSciNet  Google Scholar 

  22. Gretton A, Bousquet O, Smola AJ, Schölkopf B (2005) Measuring statistical dependence with hilbert-schmidt norms. In Algorithmic Learning Theory 3734:63–77

    Article  MathSciNet  Google Scholar 

  23. Parameswaran S, Weinberger KQ (2010) Large margin multi-task metric learning. In Proceedings of Advances in Neural Information Processing Systems, pages 1867–1875

  24. Ding CHQ, Dubchak I (2001) Multi-class protein fold recognition using support vector machines and neural networks. Bioinform 17(4):349–358

    Article  Google Scholar 

  25. Wei LY, Liao MH, Gao X, Zou Q (2015) An improved protein structural classes prediction method by incorporating both sequence and structure information. IEEE Trans Nanobioscience 14(4):339–349

    Article  Google Scholar 

  26. Dimitrovski I, Kocev D, Loskovska S, Dzeroski S (2011) Hierarchical annotation of medical images. Pattern Recognit 44(10–11):2436–2449

    Article  Google Scholar 

  27. Everingham M, Gool LV, Williams CKI, Winn JM, Zisserman A (2010) The pascal visual object classes (VOC) challenge. Int J Comput Vis 88(2):303–338

    Article  Google Scholar 

  28. Lampert CH, Nickisch H, Harmeling S (2009) Learning to detect unseen object classes by between-class attribute transfer. In Computer Vision and Pattern Recognition, pages 951–958

Download references

Acknowledgements

This work is supported by the National Key Research and Development Program of China (No.2019YFE0118200), the National Natural Science Foundation of China (Nos.61976184, 61772323), and the 1331 Engineering Project of Shanxi Province, China.

Author information

Authors and Affiliations

  1. Key Laboratory of Computational Intelligence and Chinese Information Processing of Ministry of Education, School of Computer and Information Technology, Shanxi University, Taiyuan, 030006, Shanxi, China

    Lin Li, Ting Li, Wei Wei, Xinyao Guo & Jiye Liang

Authors
  1. Lin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ting Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wei Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xinyao Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jiye Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei Wei.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, L., Li, T., Wei, W. et al. Hierarchical metric learning with intra-level and inter-level regularization. Int. J. Mach. Learn. & Cyber. 13, 4033–4042 (2022). https://doi.org/10.1007/s13042-022-01664-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-022-01664-x

Keywords

Search

Navigation