Partial Domain Adaptation by Progressive Sample Learning of Shared Classes | Neural Processing Letters Skip to main content

Advertisement

Springer Nature Link
Log in

Partial Domain Adaptation by Progressive Sample Learning of Shared Classes

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Traditional domain adaptation (DA) research generally assume that the source and target domains have the same label set. However, in many real-world applications, there exists a more general and practical situation where target label set is just a subset of source label set, which is formulated as partial domain adaptation (PDA) problem. Compared with DA, PDA is more vulnerable to negative transfer due to the mismatch of label sets. In this paper, we propose a novel PDA method based on Progressive sample Learning of Shared Classes (PLSC), which contains two main parts: shared classes identification and progressive target sample learning. The shared classes identification component aims to exclude source-private classes and merely allow source samples within shared classes to participate in the progress of knowledge transfer. To achieve this goal, following the separation and alignment assumptions in DA, we minimize the sum of the distances from both source and target samples to their corresponding source class centers, and then design an adaptive threshold to determine the shared classes. Furthermore, considering the misleading of target samples that deviate from the source class centers, we propose to progressively include target samples for subspace learning by introducing self-paced learning mechanism. Extensive experiments verify the superiority of our method against the existing counterparts.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Notes

  1. https://www.csie.ntu.edu.tw/~cjlin/liblinear/.

  2. http://imageclef.org/2014/adaptation .

  3. https://github.com/hellowangqian/domainadaptation-capls.

  4. https://github.com/jindongwang/transferlearning/tree/master/code/feature_extractor/for_image_data.

  5. https://github.com/LeiTian-qj/CMMS/tree/master/data/Visda2017.

References

  1. Pan S, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359

    Article  Google Scholar 

  2. Long M, Wang J, Ding G, Pan SJ, Yu PS (2013) Adaptation regularization: a general framework for transfer learning. IEEE Trans Knowl Data Eng 26(5):1076–1089

    Article  Google Scholar 

  3. Wang J, Li X, Du J (2019) Label space embedding of manifold alignment for domain adaption. Neural Process Lett 49:375–391

    Article  Google Scholar 

  4. Tian L, Tang Y, Hu L, Ren Z, Zhang W (2019) Domain adaptation by class centroid matching and local manifold self-learning. IEEE Trans Image Process 29:9703–9718

    Article  MathSciNet  MATH  Google Scholar 

  5. Long M, Wang J, Ding G, Sun J, Yu PS (2013) Transfer feature learning with joint distribution adaptation. In: IEEE international conference on computer vision (ICCV), pp 2200–2207

  6. Zhang C, Tang Y, Zhang Z, Li D, Yang X, Zhang W (2020) Improving domain-adaptive person re-identification by dual-alignment learning with camera-aware image generation. IEEE Trans Circuits Syst Video Technol 31(11):4334–4346

    Article  Google Scholar 

  7. Bai Z, Wang Z, Wang J, Hu D, Ding E (2021) Unsupervised multi-source domain adaptation for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 12914–12923

  8. Cao Z, Long M, Wang J, Jordan M (2018) Partial transfer learning with selective adversarial networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2724–2732

  9. Deng J, Dong W, Socher R, Li LJ, Li K, Li F-F (2009) Imagenet: a large-scale hierarchical image database. In: Proceedings of computer vision and pattern recognition (CVPR), pp 248–255

  10. Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Dollar P, Zitnick CL (2014) Microsoft coco: common objects in context. In: Proceedings of European conference on computer vision (ECCV), pp 740–755

  11. Zhang J, Ding Z, Li W, Ogunbona P (2018) Importance weighted adversarial nets for partial domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 8156–8164

  12. Kim Y, Hong S (2021) Adaptive graph adversarial networks for partial domain adaptation. IEEE Trans Circuits Syst Video Technol 32:172–182

    Article  Google Scholar 

  13. Li S, Liu C, Lin Q, Wen Q, Su L, Huang G, Ding Z (2021) Deep residual correction network for partial domain adaptation. IEEE Trans Pattern Anal Mach Intell 43(7):2329–2344

    Article  Google Scholar 

  14. Cao Z, You K, Long M, Wang J, Yang Q (2019) Learning to transfer examples for partial domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2985–2994

  15. Shi Y, Sha F (2012) Information-theoretical learning of discriminative clusters for unsupervised domain adaptation. In: Proceedings of the 29th international conference on international conference on machine learning, pp 1275–1282

  16. Long M, Wang J, Ding G, Sun J, Yu PS (2014) Transfer joint matching for unsupervised domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 1410–1417

  17. Sugiyama M, Krauledat M, Muller KR (2007) Covariate shift adaptation by importance weighted cross validation. J Mach Learn Res 1010(8):985–1005

    MATH  Google Scholar 

  18. Li S, Song S, Huang G, Ding Z, Wu C (2018) Domain invariant and class discriminative feature learning for visual domain adaptation. IEEE Trans Image Process 27(9):4260–4276

    Article  MathSciNet  Google Scholar 

  19. Wang J, Feng W, Chen Y, Yu H, Huang M, Yu PS (2018) Visual domain adaptation with manifold embedded distribution alignment. In: Proceedings of ACM international conference on multimedia, pp 402–410

  20. Cao Z, Ma L, Long M, Wang J (2018) Partial adversarial domain adaptation. In: Proceedings of the European conference on computer vision (ECCV), pp 135–150

  21. Wang Q, Breckon T P (2021) Source class selection with label propagation for partial domain adaptation. In: IEEE international conference on image processing (ICIP), pp 769–773

  22. Wu K, Wu M, Yang J, Chen Z, Li Z, Li X (2021) Deep reinforcement learning boosted partial domain adaptation. In: Proceedings of the thirtieth international joint conference on artificial intelligence, pp 3192–3199

  23. Li L, Wang Z, He H (2020) Dual alignment for partial domain adaptation. IEEE Trans Cybern 51(7):3404–3416

    Article  Google Scholar 

  24. Kumar MP, Packer B, Daphne K (2010) Self-paced learning for latent variable models. In: Advances in neural information processing systems, pp 1–9

  25. Jiang L, Meng D, Yu S, Lan Z, Shan S, Hauptmann AG (2014) Self-paced learning with diversity. In: Advances in neural information processing systems, vol 27, pp 2078–2086

  26. Supancic JS, Ramanan D (2013) Self-paced learning for long-term tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2379–2386

  27. Jiang L, Meng D, Zhao Q, Shan S, Hauptmann AG (2015) Self-paced curriculum learning. In: AAAI conference on artificial intelligence

  28. Ren Y, Zhao P, Sheng Y, Yao D, Xu Z (2017) Robust softmax regression for multi-class classification with self-paced learning. In: International joint conference on artificial intelligence

  29. Meng D, Zhao Q, Jiang L (2017) A theoretical understanding of self-paced learning. Inf Sci 414:319–328

    Article  MATH  Google Scholar 

  30. Shu J, Xie Q, Yi L, Zhao Q, Zhou S, Xu Z, Meng D (2019) Meta-weight-net: learning an explicit mapping for sample weighting. In: Advances in neural information processing systems, pp 1919–1930

  31. Li Y, Ma C, Tao Y, Hu Z, Su Z, Liu M (2021) A robust cost-sensitive feature selection via self-paced learning regularization. Neural Process Lett 1–18

  32. Zheng W, Zhu X, Wen G, Zhu Y, Yu H, Gan J (2020) Unsupervised feature selection by self-paced learning regularization. Pattern Recognit Lett 132:4–11

    Article  Google Scholar 

  33. Tang Y, Xie Y, Yang X, Niu J, Zhang W (2021) Tensor multielastic kernel self-paced learning for time series clustering. IEEE Trans Knowl Data Eng 33(3):1223–1237

    Google Scholar 

  34. Chen R, Tang Y, Tian L, Zhang C, Zhang W (2021) Deep convolutional self-paced clustering. Appl Intell 52:4858–4872

    Article  Google Scholar 

  35. Huang W, Liang C, Yu Y, Wang Z, Ruan W, Hu R (2018) Self-paced multi-task learning. In: Proceedings of the thirty-second AAAI conference on artificial intelligence, pp 2273–2280

  36. Zhou S, Wang J, Meng D, Xin X, Li Y, Gong Y, Zheng N (2018) Deep self-paced learning for person re-identification. Pattern Recognit 76:739–751

    Article  Google Scholar 

  37. Pan SJ, Tsang IW, Kwok JT, Yang Q (2011) Domain adaptation via transfer component analysis. IEEE Trans Neural Netw 22(2):199–210

    Article  Google Scholar 

  38. Liang J, He R, Sun Z, Tan T (2019) Aggregating randomized clustering promoting invariant projections for domain adaptation. IEEE Trans Pattern Anal Mach Intell 41(5):1027–1042

    Article  Google Scholar 

  39. Saenko K, Kulis B, Fritz M, Darrell T (2010) Adapting visual category models to new fomains. In: Proceedings of the European conference on computer vision (ECCV), pp 213–226

  40. Venkateswara H, Eusebio J, Chakraborty S, Panchanathan S (2017) Deep hashing network for unsupervised domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 5018–2027

  41. Peng X, Usman B, Kaushik N, Hoffman J, Wang D, Saenko K (2017) Visda: the visual domain adaptation challenge. arXiv preprint arXiv:1710.06924

  42. Wang Q, Breckon TP (2020) Unsupervised domain adaptation via structured prediction based selective pseudo-labeling. In: The thirty-fourth AAAI conference on artificial intelligence (AAAI), pp 6243–6250

  43. He K, Zhang X, Ren S, Sun J (2017) Deep residual learning for image 1084 recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 770–778

  44. Griffin G, Holub A, Perona P (2007) Caltech-256 object category dataset

  45. Luo Y, Ren C, Dai D, Yan H (2022) Unsupervised domain adaptation via discriminative manifold propagation. IEEE Trans Pattern Anal Mach Intell 44:1653–1669

    Article  Google Scholar 

  46. Chen Z, Chen C, Cheng Z, Jiang B, Fang K, Jin X (2020) Selective transfer with reinforced transfer network for partial domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 12706–12714

Download references

Acknowledgements

The authors are thankful for the financial support by the the Key-Area Research and Development Program of Guangdong Province 2019B010153002 and the National Natural Science Foundation of China 62106266, U1936206, 61961160707 and 61976212.

Author information

Authors and Affiliations

  1. Institute of Automation, Chinese Academy of Sciences, Beijing, China

    Lei Tian, Yongqiang Tang & Wensheng Zhang

  2. School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China

    Lei Tian & Wensheng Zhang

Authors
  1. Lei Tian
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Yongqiang Tang
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Wensheng Zhang
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Yongqiang Tang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tian, L., Tang, Y. & Zhang, W. Partial Domain Adaptation by Progressive Sample Learning of Shared Classes. Neural Process Lett 55, 2001–2021 (2023). https://doi.org/10.1007/s11063-022-10828-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-022-10828-3

Keywords