{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,1]],"date-time":"2024-09-01T05:08:58Z","timestamp":1725167338765},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,4,24]],"date-time":"2023-04-24T00:00:00Z","timestamp":1682294400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,24]],"date-time":"2023-04-24T00:00:00Z","timestamp":1682294400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["1976032"],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Data Sci. Eng."],"published-print":{"date-parts":[[2023,6]]},"abstract":"Abstract<\/jats:title>Hierarchical Text Classification (HTC) is a formidable task which involves classifying textual descriptions into a taxonomic hierarchy. Existing methods, however, have difficulty in adequately modeling the hierarchical label structures, because they tend to focus on employing graph embedding methods to encode the hierarchical structure while disregarding the fact that the HTC labels are rooted in a tree structure. This is significant because, unlike a graph, the tree structure inherently has a directive that ordains information flow from one node to another\u2014a critical factor when applying graph embedding to the HTC task. But in the graph structure, message-passing is undirected, which will lead to the imbalance of message transmission between nodes when applied to HTC. To this end, we propose a unidirectional message-passing multi-label generation model for HTC, referred to as UMP-MG. Instead of viewing HTC as a classification problem as previous methods have done, this novel approach conceptualizes it as a sequence generation task, introducing prior hierarchical information during the decoding process. This further enables the blocking of information flow in one direction to ensure that the graph embedding method is better suited for the HTC task and thus resulted in the enhanced tree structure representation. Results obtained through experimentation on both the public WOS dataset and an E-commerce user intent classification dataset demonstrate that our proposed model can achieve superlative results.<\/jats:p>","DOI":"10.1007\/s41019-023-00210-1","type":"journal-article","created":{"date-parts":[[2023,4,24]],"date-time":"2023-04-24T16:02:47Z","timestamp":1682352167000},"page":"112-123","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["UMP-MG: A Uni-directed Message-Passing Multi-label Generation Model for Hierarchical Text Classification"],"prefix":"10.1007","volume":"8","author":[{"ORCID":"http:\/\/orcid.org\/0000-0001-9512-7036","authenticated-orcid":false,"given":"Bo","family":"Ning","sequence":"first","affiliation":[]},{"given":"Deji","family":"Zhao","sequence":"additional","affiliation":[]},{"given":"Xinjian","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Chao","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Shuangyong","family":"Song","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,4,24]]},"reference":[{"key":"210_CR1","doi-asserted-by":"crossref","unstructured":"Huang W, Chen E, Liu Q, Chen Y, Huang Z, Liu Y, Zhao Z, Zhang D, Wang S (2019)Hierarchical multi-label text classification: an attention-based recurrent network approach. In: Proceedings of the 28th ACM international conference on information and knowledge management pp 1051\u20131060","DOI":"10.1145\/3357384.3357885"},{"key":"210_CR2","doi-asserted-by":"crossref","unstructured":"Shimura K, Li J, Fukumoto F (2018) Hft-cnn: Learning hierarchical category structure for multi-label short text categorization. In: Proceedings of the 2018 conference on empirical methods in natural language processing. pp 811\u2013816","DOI":"10.18653\/v1\/D18-1093"},{"key":"210_CR3","doi-asserted-by":"crossref","unstructured":"Wehrmann J, Cerri R, Barros R (2018) Hierarchical multi-label classification networks. In: International conference on machine learning , PMLR, pp 5075\u20135084","DOI":"10.1145\/3019612.3019664"},{"key":"210_CR4","doi-asserted-by":"crossref","unstructured":"Banerjee S, Akkaya C, Perez-Sorrosal F, Tsioutsiouliklis K (2019) Hierarchical transfer learning for multi-label text classification. In: Proceedings of the 57th annual meeting of the association for computational linguistics. pp 6295\u20136300","DOI":"10.18653\/v1\/P19-1633"},{"key":"210_CR5","doi-asserted-by":"crossref","unstructured":"Zhou J, Ma C, Long D, Xu G, Ding N, Zhang H, Xie P, Liu G (2020) Hierarchy-aware global model for hierarchical text classification. In: Proceedings of the 58th annual meeting of the association for computational linguistics. pp 1106\u20131117","DOI":"10.18653\/v1\/2020.acl-main.104"},{"key":"210_CR6","doi-asserted-by":"crossref","unstructured":"Wu J, Xiong W, Wang WY (2019) Learning to learn and predict: a meta-learning approach for multi-label classification. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP)","DOI":"10.18653\/v1\/D19-1444"},{"key":"210_CR7","doi-asserted-by":"crossref","unstructured":"Zhang Y, Qi P, Manning CD (2018) Graph convolution over pruned dependency trees improves relation extraction. In: Proceedings of the 2018 conference on empirical methods in natural language processing. pp 2205\u20132215","DOI":"10.18653\/v1\/D18-1244"},{"key":"210_CR8","unstructured":"Sutskever I, Vinyals O, Le QV (2014) Sequence to sequence learning with neural networks. Adv Neural Inform Process Syst 27"},{"key":"210_CR9","doi-asserted-by":"crossref","unstructured":"Rojas KR, Bustamante G, Oncevay A, Cabezudo MAS (2020) Efficient strategies for hierarchical text classification: external knowledge and auxiliary tasks. In: Proceedings of the 58th annual meeting of the association for computational linguistics. pp 2252\u20132257","DOI":"10.18653\/v1\/2020.acl-main.205"},{"key":"210_CR10","unstructured":"Cesa-Bianchi N, Gentile C, Tironi A, Zaniboni L (2004) Incremental algorithms for hierarchical classification. Adv Neural Inform Process Syst 17"},{"key":"210_CR11","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1016\/j.eswa.2019.04.020","volume":"130","author":"MM Miro\u0144czuk","year":"2019","unstructured":"Miro\u0144czuk MM, Protasiewicz J, Pedrycz W (2019) Empirical evaluation of feature projection algorithms for multi-view text classification. Expert Syst Appl 130:97\u2013112","journal-title":"Expert Syst Appl"},{"key":"210_CR12","unstructured":"Lin Z, Feng M, Santos CND, Yu M, Xiang B, Zhou B, Bengio Y (2017) A structured self-attentive sentence embedding. arXiv preprint arXiv:1703.03130"},{"key":"210_CR13","doi-asserted-by":"crossref","unstructured":"Fall CJ, T\u00f6rcsv\u00e1ri A, Benzineb K, Karetka G (2003) Automated categorization in the international patent classification. In: Acm Sigir Forum. vol. 37, pp 10\u201325. ACM New York, NY, USA","DOI":"10.1145\/945546.945547"},{"key":"210_CR14","doi-asserted-by":"crossref","unstructured":"Borges HB, Nievola JC (2012) Multi-label hierarchical classification using a competitive neural network for protein function prediction. In: The 2012 international joint conference on neural networks (IJCNN). IEEE, pp 1\u20138","DOI":"10.1109\/ICNC.2012.6234573"},{"issue":"4","key":"210_CR15","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1007\/s41019-021-00168-y","volume":"6","author":"H Abburi","year":"2021","unstructured":"Abburi H, Parikh P, Chhaya N, Varma V (2021) Fine-grained multi-label sexism classification using a semi-supervised multi-level neural approach. Data Sci Eng 6(4):359\u2013379","journal-title":"Data Sci Eng"},{"issue":"1","key":"210_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12859-016-1232-1","volume":"17","author":"R Cerri","year":"2016","unstructured":"Cerri R, Barros RC, de Carvalho PLF, Andr\u00e9 C, Jin Y (2016) Reduction strategies for hierarchical multi-label classification in protein function prediction. BMC Bioinform 17(1):1\u201324","journal-title":"BMC Bioinform"},{"key":"210_CR17","doi-asserted-by":"crossref","unstructured":"Mao Y, Tian J, Han J, Ren X (2020) Hierarchical text classification with reinforced label assignment. In: 2019 conference on empirical methods in natural language processing and 9th international joint conference on natural language processing. EMNLP-IJCNLP 2019, Association for Computational Linguistics, pp 445\u2013455","DOI":"10.18653\/v1\/D19-1042"},{"issue":"6","key":"210_CR18","doi-asserted-by":"publisher","first-page":"2505","DOI":"10.1109\/TKDE.2019.2959991","volume":"33","author":"H Peng","year":"2019","unstructured":"Peng H, Li J, Wang S, Wang L, Gong Q, Yang R, Li B, Philip SY, He L (2019) Hierarchical taxonomy-aware and attentional graph capsule rcnns for large-scale multi-label text classification. IEEE Trans Knowl Data Eng 33(6):2505\u20132519","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"210_CR19","doi-asserted-by":"crossref","unstructured":"Chen B, Huang X, Xiao L, Cai Z, Jing L (2020) Hyperbolic interaction model for hierarchical multi-label classification. In: Proceedings of the AAAI conference on artificial intelligence. vol. 34, pp 7496\u20137503","DOI":"10.1609\/aaai.v34i05.6247"},{"key":"210_CR20","doi-asserted-by":"publisher","first-page":"115922","DOI":"10.1016\/j.eswa.2021.115922","volume":"187","author":"X Zhang","year":"2022","unstructured":"Zhang X, Xu J, Soh C, Chen L (2022) La-hcn: label-based attention for hierarchical multi-label text classification neural network. Expert Syst Appl 187:115922","journal-title":"Expert Syst Appl"},{"key":"210_CR21","doi-asserted-by":"crossref","unstructured":"Deng Z, Peng H, He D, Li J, Philip SY (2021) HTCinfomax: A global model for hierarchical text classification via information maximization pp 3259\u20133265","DOI":"10.18653\/v1\/2021.naacl-main.260"},{"key":"210_CR22","doi-asserted-by":"publisher","first-page":"106876","DOI":"10.1016\/j.knosys.2021.106876","volume":"218","author":"B Wang","year":"2021","unstructured":"Wang B, Hu X, Li P, Philip SY (2021) Cognitive structure learning model for hierarchical multi-label text classification. Knowl-Based Syst 218:106876","journal-title":"Knowl-Based Syst"},{"key":"210_CR23","doi-asserted-by":"crossref","unstructured":"Chen W, Yue L, Li B, Wang C, Sheng QZ (2019) Damtrnn: a delta attention-based multi-task RNN for intention recognition. In: International conference on advanced data mining and applications. Springer, pp 373\u2013388","DOI":"10.1007\/978-3-030-35231-8_27"},{"issue":"3","key":"210_CR24","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1007\/s41019-021-00159-z","volume":"6","author":"G Du","year":"2021","unstructured":"Du G, Zhou L, Yang Y, L\u00fc K, Wang L (2021) Deep multiple auto-encoder-based multi-view clustering. Data Sci Eng 6(3):323\u2013338","journal-title":"Data Sci Eng"},{"key":"210_CR25","doi-asserted-by":"crossref","unstructured":"Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing. pp 1556\u20131566","DOI":"10.3115\/v1\/P15-1150"},{"key":"210_CR26","doi-asserted-by":"crossref","unstructured":"Chen Z, Wang X, Wang C, Li J (2022) Explainable link prediction in knowledge hypergraphs. In: Proceedings of the 31st ACM international conference on information & knowledge management. pp 262\u2013271","DOI":"10.1145\/3511808.3557316"},{"key":"210_CR27","doi-asserted-by":"crossref","unstructured":"Ning B, Zhao D, Liu X, Li G (2022) Eags: An extracting auxiliary knowledge graph model in multi-turn dialogue generation. World Wide Web. 1\u201322","DOI":"10.1007\/s11280-022-01100-8"},{"key":"210_CR28","unstructured":"Veli\u010dkovi\u0107 P, Cucurull G, Casanova A, Romero A, Lio P, Bengio Y (2017) Graph attention networks. arXiv preprint arXiv:1710.10903"},{"key":"210_CR29","doi-asserted-by":"crossref","unstructured":"Li Z, Liu X, Wang X, Liu P, Shen Y (2022) Transo: a knowledge-driven representation learning method with ontology information constraints. World Wide Web. 1\u201323","DOI":"10.1007\/s11280-022-01016-3"},{"key":"210_CR30","doi-asserted-by":"publisher","first-page":"106618","DOI":"10.1016\/j.knosys.2020.106618","volume":"212","author":"Z Li","year":"2021","unstructured":"Li Z, Wang X, Li J, Zhang Q (2021) Deep attributed network representation learning of complex coupling and interaction. Knowl-Based Syst 212:106618","journal-title":"Knowl-Based Syst"},{"key":"210_CR31","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A.N, Kaiser, \u0141, Polosukhin I (2017) Attention is all you need. Adv Neural Inform Process Syst 30"},{"key":"210_CR32","doi-asserted-by":"crossref","unstructured":"Gopal S, Yang Y (2013) Recursive regularization for large-scale classification with hierarchical and graphical dependencies. In: Proceedings of the 19th ACM SIGKDD international conference on knowledge discovery and data mining. pp 257\u2013265","DOI":"10.1145\/2487575.2487644"},{"key":"210_CR33","doi-asserted-by":"publisher","unstructured":"Kim Y (2014) In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), Association for Computational Linguistics, Doha, Qatar , pp 1746\u20131751 https:\/\/doi.org\/10.3115\/v1\/D14-1181. https:\/\/aclanthology.org\/D14-1181","DOI":"10.3115\/v1\/D14-1181"},{"key":"210_CR34","unstructured":"Devlin J, Chang M.-W, Lee K, Toutanova K (2018) Bert: Pre-training of deep bidirectional transformers for language understanding"}],"container-title":["Data Science and Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41019-023-00210-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s41019-023-00210-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41019-023-00210-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,15]],"date-time":"2023-05-15T14:44:34Z","timestamp":1684161874000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s41019-023-00210-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,24]]},"references-count":34,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["210"],"URL":"https:\/\/doi.org\/10.1007\/s41019-023-00210-1","relation":{},"ISSN":["2364-1185","2364-1541"],"issn-type":[{"value":"2364-1185","type":"print"},{"value":"2364-1541","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,24]]},"assertion":[{"value":"15 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 February 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 March 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 April 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"All authors have read and agreed to the published version of the manuscript.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"This article does not contain any studies involving human participants and\/or animals by any of the authors.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval and Consent to participate"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Human and animal participants"}}]}}