Metric learning with adversarial hard negative samples for tag recommendation | The Journal of Supercomputing Skip to main content

Advertisement

Springer Nature Link
Log in

Metric learning with adversarial hard negative samples for tag recommendation

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Tag recommendation can suggest a collection of tags to users and effectively describe the characteristics of resources or users’ preferences, thereby enhancing the accuracy of information retrieval. In the field of recommendation, metric learning models are employed to measure distances among different categories. However, classifiers are susceptible to noise interference, and it is difficult to mine hard negative samples that lie close to the decision boundary in the training set. Resulting in the hard negative samples is incorrectly recommended to users. In this paper, we propose an Adversarial Tag Hard Negative samples framework to synthesize hard negative samples from observed training data, enhancing the diversity of data. We learn the distribution of the raw training data and the features that come from the hard negative samples. Specifically, we utilize the original metric learning model to preserve the effect of learning on normal samples. We also design an adversarial metric learning model, improving the model’s ability to adapt to unseen samples and potentially complex contexts, especially preventing the model from misclassifying a specific type of data in a classification. Finally, we conduct extensive experiments on the hetrec2011-MovieLens-2k and hetrec2011-LastFm-2k datasets, as well as an effective ablation experiment to quantify the contributions of adversarial components. The results demonstrate that the proposed method outperforms existing approaches in Top-N tag recommendation. Compared to the most competitive baselines, our method shows improvements of 2.1%, 8.3%, 10.9% and 5.3%, 5.7%, 7% in terms of F1@3, F1@5, F1@10 and NDCG@3, NDCG@5, NDCG@10 evaluation metrics on hetrec2011-MovieLens-2k dataset, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Gao C, Zheng Y, Li N, Li Y, Qin Y, Piao J, Quan Y, Chang J, Jin D, He X, Li Y (2023) A survey of graph neural networks for recommender systems: challenges, methods, and directions. ACM Trans Recomm Syst 1(1):511. https://doi.org/10.1145/3568022

    Article  Google Scholar 

  2. Ko H, Lee S, Park Y, Choi A (2022) A survey of recommendation systems: recommendation models, techniques, and application fields. Electronics 11(1):141. https://doi.org/10.3390/electronics11010141

    Article  Google Scholar 

  3. Yi J, Ren X, Chen Z (2023) Multi-auxiliary augmented collaborative variational auto-encoder for tag recommendation. ACM Trans Inf Syst 41(4):1–25. https://doi.org/10.1145/3578932

    Article  Google Scholar 

  4. Jafari Sadr M, Mirtaheri SL, Greco S, Borna K (2023) Popular tag recommendation by neural network in social media. Comput Intell Neurosci 2023:4300408. https://doi.org/10.1155/2023/4300408

    Article  Google Scholar 

  5. Kolda TG, Bader BW (2009) Tensor decompositions and applications. SIAM Rev 51(3):455–500. https://doi.org/10.1137/07070111X

    Article  MathSciNet  Google Scholar 

  6. Wang M, Hong D, Han Z, Li J, Yao J, Gao L, Zhang B, Chanussot J (2023) Tensor decompositions for hyperspectral data processing in remote sensing: a comprehensive review. IEEE Geosci Remote Sens Mag 11(1):26–72. https://doi.org/10.1109/MGRS.2022.3227063

    Article  Google Scholar 

  7. Rendle S, Balby Marinho L, Nanopoulos A, Schmidt-Thieme L (2009) Learning optimal ranking with tensor factorization for tag recommendation. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD ’09, pp 727–736. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/1557019.1557100

  8. Symeonidis P, Nanopoulos A, Manolopoulos Y (2008) Tag recommendations based on tensor dimensionality reduction. In: Proceedings of the 2008 ACM Conference on Recommender Systems. RecSys ’08, pp 43–50. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/1454008.1454017

  9. Cai Y, Zhang M, Luo D, Ding C, Chakravarthy S (2011) Low-order tensor decompositions for social tagging recommendation. In: Proceedings of the Fourth ACM International Conference on Web Search and Data Mining. WSDM ’11, pp 695–704. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/1935826.1935920

  10. Fang X, Pan R, Cao G, He X, Dai W (2015) Personalized tag recommendation through nonlinear tensor factorization using gaussian kernel. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 29(1). https://doi.org/10.1609/aaai.v29i1.9214

  11. Rendle S, Schmidt-Thieme L (2010) Pairwise interaction tensor factorization for personalized tag recommendation. In: Proceedings of the Third ACM International Conference on Web Search and Data Mining. WSDM ’10, pp 81–90. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/1718487.1718498

  12. Yu Y, Chen X, Zhang L, Gao R, Gao H (2022) Neural graph for personalized tag recommendation. IEEE Intell Syst 37(1):51–59. https://doi.org/10.1109/MIS.2020.3040046

    Article  Google Scholar 

  13. Chen B, Guo W, Tang R, Xin X, Ding Y, He X, Wang D (2020) Tgcn: Tag graph convolutional network for tag-aware recommendation. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management. CIKM ’20, pp 155–164. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3340531.3411927

  14. Huang R, Han C, Cui L (2021) Tag-aware attentional graph neural networks for personalized tag recommendation. In: 2021 International Joint Conference on Neural Networks (IJCNN), pp 1–8. https://doi.org/10.1109/IJCNN52387.2021.9533380

  15. Zuo Y, Liu S, Zhou Y, Liu H (2023) Tral: a tag-aware recommendation algorithm based on attention learning. Appl Sci 13(2):814. https://doi.org/10.3390/app13020814

    Article  Google Scholar 

  16. Quintanilla E, Rawat Y, Sakryukin A, Shah M, Kankanhalli M (2021) Adversarial learning for personalized tag recommendation. IEEE Trans Multimed 23:1083–1094. https://doi.org/10.1109/TMM.2020.2992941

    Article  Google Scholar 

  17. Gao M, Zhang J, Yu J, Li J, Wen J, Xiong Q (2021) Recommender systems based on generative adversarial networks: a problem-driven perspective. Inf Sci 546:1166–1185. https://doi.org/10.1016/j.ins.2020.09.013

    Article  MathSciNet  Google Scholar 

  18. Chen H, Li J (2019) Adversarial tensor factorization for context-aware recommendation. In: Proceedings of the 13th ACM Conference on Recommender Systems. RecSys ’19, pp 363–367. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3298689.3346987

  19. Jagan ND, Deepak G, Santhanavijayan A (2023) MPTR: a metadata-driven prospective tag recommendation model based on integrative classification. In: Tiwari S, Trivedi MC, Kolhe ML, Singh BK (eds) Advances in data and information sciences. Springer, Singapore, pp 291–301. https://doi.org/10.1007/978-981-19-5292-0_27

    Chapter  Google Scholar 

  20. Wang Q, Wu W, Zhao Y, Zhuang Y, Wang Y (2021) Combining label-wise attention and adversarial training for tag prediction of web services. In: 2021 IEEE International Conference on Web Services (ICWS), pp 358–363. https://doi.org/10.1109/ICWS53863.2021.00054

  21. Park J, Lee Y-C, Kim S-W (2022) Effective and efficient negative sampling in metric learning based recommendation. Inf Sci 605:351–365. https://doi.org/10.1016/j.ins.2022.05.039

    Article  Google Scholar 

  22. Tay Y, Anh Tuan L, Hui SC (2018) Latent relational metric learning via memory-based attention for collaborative ranking. In: Proceedings of the 2018 World Wide Web Conference. WWW ’18, pp 729–739. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE. https://doi.org/10.1145/3178876.3186154

  23. Park C, Kim D, Xie X, Yu H (2018) Collaborative translational metric learning. In: 2018 IEEE International Conference on Data Mining (ICDM), pp 367–376. https://doi.org/10.1109/ICDM.2018.00052

  24. Liu Z, Wang X, Ma Y, Yang X (2022) Relational metric learning with high-order neighborhood interactions for social recommendation. Knowl Inf Syst 64(6):1525–1547. https://doi.org/10.1007/s10115-022-01680-x

    Article  Google Scholar 

  25. Tran V-A, Salha-Galvan G, Hennequin R, Moussallam M (2021) Hierarchical latent relation modeling for collaborative metric learning. In: Proceedings of the 15th ACM Conference on Recommender Systems. RecSys ’21, pp 302–309. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3460231.3474230

  26. Jeong J, Choi J, Cho H, Chung S (2022) Fpadametric: false-positive-aware adaptive metric learning for session-based recommendation. Proc AAAI Conf Artif Intell 36(4):4039–4047. https://doi.org/10.1609/aaai.v36i4.20321

    Article  Google Scholar 

  27. Li M, Zhang S, Zhu F, Qian W, Zang L, Han J, Hu S (2020) Symmetric metric learning with adaptive margin for recommendation. Proc AAAI Conf Artif Intell 34(04):4634–4641. https://doi.org/10.1609/aaai.v34i04.5894

    Article  Google Scholar 

  28. Ma C, Ma L, Zhang Y, Tang R, Liu X, Coates M (2020) Probabilistic metric learning with adaptive margin for top-k recommendation. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. KDD ’20, pp 1036–1044. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3394486.3403147

  29. Zhang T, Zhao P, Liu Y, Xu J, Fang J, Zhao L, Sheng VS, Cui Z (2019) Adacml: adaptive collaborative metric learning for recommendation. In: Li G, Yang J, Gama J, Natwichai J, Tong Y (eds) Database systems for advanced applications. Springer, Cham, pp 301–316. https://doi.org/10.1007/978-3-030-18579-4_18

    Chapter  Google Scholar 

  30. Yang Z, Qin J, Lin C, Chen Y, Huang R, Qin Y (2023) Ganrec: a negative sampling model with generative adversarial network for recommendation. Expert Syst Appl 214:119155. https://doi.org/10.1016/j.eswa.2022.119155

    Article  Google Scholar 

  31. Chen CC, Lai P-L, Chen C-Y (2022) Coldgan: an effective cold-start recommendation system for new users based on generative adversarial networks. Appl Intell 53(7):8302–8317. https://doi.org/10.1007/s10489-022-04005-1

    Article  Google Scholar 

  32. Zhao J, Li H, Qu L, Zhang Q, Sun Q, Huo H, Gong M (2022) DCFGAN: an adversarial deep reinforcement learning framework with improved negative sampling for session-based recommender systems. Inf Sci 596:222–235. https://doi.org/10.1016/j.ins.2022.02.045

    Article  Google Scholar 

  33. Bharadhwaj H, Park H, Lim BY (2018) Recgan: Recurrent generative adversarial networks for recommendation systems. In: Proceedings of the 12th ACM Conference on Recommender Systems. RecSys ’18, pp 372–376. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3240323.3240383

  34. Zhang C, Li J, Wu J, Liu D, Chang J, Gao R (2022) Deep recommendation with adversarial training. IEEE Trans Emerg Top Comput 10(4):1966–1978. https://doi.org/10.1109/TETC.2022.3141422

    Article  Google Scholar 

  35. Huang J, Cao Q, Xie R, Zhang S, Xia F, Shen H, Cheng X (2023) Adversarial learning data augmentation for graph contrastive learning in recommendation. In: Wang X, Sapino ML, Han W-S, El Abbadi A, Dobbie G, Feng Z, Shao Y, Yin H (eds) Database systems for advanced applications. Springer, Cham, pp 373–388. https://doi.org/10.1007/978-3-031-30672-3_25

    Chapter  Google Scholar 

  36. He X, He Z, Du X, Chua T-S (2018) Adversarial personalized ranking for recommendation. In: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. SIGIR ’18, pp 355–364. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3209978.3209981

  37. Yuan F, Yao L, Benatallah B (2019) Adversarial collaborative neural network for robust recommendation. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. SIGIR’19, pp 1065–1068. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3331184.3331321

  38. Yuan J, Jin Y, Liu W, Wang X (2019) Attention-based neural tag recommendation. In: Li G, Yang J, Gama J, Natwichai J, Tong Y (eds) Database systems for advanced applications. Springer, Cham, pp 350–365. https://doi.org/10.1007/978-3-030-18579-4_21

    Chapter  Google Scholar 

  39. Feng J, Wang K, Miao Q, Xi Y, Xia Z (2023) Personalized recommendation with hybrid feedback by refining implicit data. Expert Syst Appl 232:120855. https://doi.org/10.1016/j.eswa.2023.120855

    Article  Google Scholar 

  40. Xia Z, Feng X, Peng J, Wu J, Fan J (2015) A regularized optimization framework for tag completion and image retrieval. Neurocomputing 147:500–508. https://doi.org/10.1016/j.neucom.2014.06.028

    Article  Google Scholar 

  41. Fei Z, Wang J, Huang B, Xiang X (2023) Pairwise metric learning with angular margin for tag recommendation. IEEE Access 11:27020–27033. https://doi.org/10.1109/ACCESS.2023.3246090

    Article  Google Scholar 

  42. Feng K, Liu T, Zhang H, Meng Z, Miao Z (2023) Tnod: Transformer network with object detection for tag recommendation. In: Proceedings of the 2023 ACM International Conference on Multimedia Retrieval. ICMR ’23, pp 617–621. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3591106.3592246

  43. Xu C, Zhang Y, Chen H, Dong L, Wang W (2023) A fairness-aware graph contrastive learning recommender framework for social tagging systems. Inf Sci 640:119064. https://doi.org/10.1016/j.ins.2023.119064

    Article  Google Scholar 

  44. Jeong D, Oh S, Park E (2022) Demohash: hashtag recommendation based on user demographic information. Expert Syst Appl 210:118375. https://doi.org/10.1016/j.eswa.2022.118375

    Article  Google Scholar 

  45. Li L, Wang P, Zheng X, Xie Q, Tao X, Velásquez JD (2023) Dual-interactive fusion for code-mixed deep representation learning in tag recommendation. Inf Fus 99:101862. https://doi.org/10.1016/j.inffus.2023.101862

    Article  Google Scholar 

  46. Hsieh C-K, Yang L, Cui Y, Lin T-Y, Belongie S, Estrin D (2017) Collaborative metric learning. In: Proceedings of the 26th International Conference on World Wide Web. WWW ’17, pp 193–201. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE. https://doi.org/10.1145/3038912.3052639

  47. Zhou X, Liu D, Lian J, Xie X (2019) Collaborative metric learning with memory network for multi-relational recommender systems. In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence. https://doi.org/10.24963/ijcai.2019/619

  48. Wang X, Liu Z, Wang N, Fan W (2020) Relational metric learning with dual graph attention networks for social recommendation. In: Lauw HW, Wong RC-W, Ntoulas A, Lim E-P, Ng S-K, Pan SJ (eds) Advances in knowledge discovery and data mining. Springer, Cham, pp 104–117. https://doi.org/10.1007/978-3-030-47426-3_9

    Chapter  Google Scholar 

  49. Zhao P, Wu T, Zhao S, Liu H (2021) Robust transfer learning based on geometric mean metric learning. Knowl-Based Syst 227:107227. https://doi.org/10.1016/j.knosys.2021.107227

    Article  Google Scholar 

  50. Li P, Tuzhilin A (2023) Dual metric learning for effective and efficient cross-domain recommendations. IEEE Trans Knowl Data Eng 35(1):321–334. https://doi.org/10.1109/TKDE.2021.3074395

    Article  Google Scholar 

  51. Huang Z, Xu X, Ni J, Zhu H, Wang C (2019) Multimodal representation learning for recommendation in internet of things. IEEE Internet Things J 6(6):10675–10685. https://doi.org/10.1109/JIOT.2019.2940709

    Article  Google Scholar 

  52. Song X, Qin J, Ren Q, Zheng J (2023) IGAN: a collaborative filtering model based on improved generative adversarial networks for recommendation. Eng Appl Artif Intell 124:106569. https://doi.org/10.1016/j.engappai.2023.106569

    Article  Google Scholar 

  53. Chen H, Wang Z, Huang F, Huang X, Xu Y, Lin Y, He P, Li Z (2022) Generative adversarial framework for cold-start item recommendation. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. SIGIR ’22, pp 2565–2571. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3477495.3531897

  54. Li G, Zhuo J, Li C, Hua J, Yuan T, Niu Z, Ji D, Wu R, Zhang H (2021) Multi-modal visual adversarial Bayesian personalized ranking model for recommendation. Inf Sci 572:378–403. https://doi.org/10.1016/j.ins.2021.05.022

    Article  MathSciNet  Google Scholar 

  55. Chen H, Zhou K, Lai K-H, Hu X, Wang F, Yang H (2022) Adversarial graph perturbations for recommendations at scale. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. SIGIR ’22, pp 1854–1858. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3477495.3531763

  56. Li Z, Qiao P, Zhang Y, Bian K (2019) Adversarial learning of transitive semantic features for cross-domain recommendation. In: 2019 IEEE Global Communications Conference (GLOBECOM), pp 1–6. https://doi.org/10.1109/GLOBECOM38437.2019.9013898

  57. Sun Z, Dong W, Li H, Huang Z (2023) Adversarial reinforcement learning for dynamic treatment regimes. J Biomed Inform 137:104244. https://doi.org/10.1016/j.jbi.2022.104244

    Article  Google Scholar 

  58. Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37. https://doi.org/10.1109/MC.2009.263

    Article  Google Scholar 

  59. Madry A, Makelov A, Schmidt L, Tsipras D, Vladu A (2018) Towards deep learning models resistant to adversarial attacks. In: 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. https://doi.org/10.48550/arXiv.1706.06083

Download references

Acknowledgements

This work was supported in part by the Key Research and Development Program of Zhejiang Province under Grant 2024C01071, in part by the Natural Science Foundation of Zhejiang Province under Grant LQ15F030006, and in part by the Research Project of Zhejiang Provincial Department of Education under Grant Y202249418.

Author information

Authors and Affiliations

  1. School of Automation and electrical Engineering, Zhejiang University of Science and Technology, Hangzhou, 310023, Zhejiang, China

    Jinglong Wang, Kai Xin & Zhengshun Fei

  2. Zhejiang Hanchine AI Tech. Co., Ltd., Hangzhou, 311100, Zhejiang, China

    Gui Chen

Authors
  1. Jinglong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gui Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kai Xin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhengshun Fei
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JW contributed to conceptualization, methodology, formal analysis, writing—original draft, and visualization. GC was involved in methodology, formal analysis, algorithm testing, and data support. KX provided software and was involved in validation and data curation. ZF contributed to supervision, project administration, methodology, and writing—review and editing. All authors reviewed the manuscript.

Corresponding author

Correspondence to Zhengshun Fei.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not involve any experiments or studies conducted on human participants or animals by the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, J., Chen, G., Xin, K. et al. Metric learning with adversarial hard negative samples for tag recommendation. J Supercomput 80, 21475–21507 (2024). https://doi.org/10.1007/s11227-024-06274-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-024-06274-8

Keywords

Search

Navigation