{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,9]],"date-time":"2024-10-09T04:26:17Z","timestamp":1728447977356},"reference-count":97,"publisher":"Association for Computing Machinery (ACM)","issue":"4","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Web"],"published-print":{"date-parts":[[2024,11,30]]},"abstract":"\n Graph neural networks (GNNs) have gained significant attention for their impressive results on different graph-based tasks. The essential mechanism of GNNs is the message-passing framework, whereby node representations are aggregated from local neighborhoods. Recently, Transformer-based GNNs have been introduced to learn the long-range dependencies, enhancing performance. However, their quadratic computational complexity, due to the attention computation, has constrained their applicability on large-scale graphs. To address this issue, we propose MGIGNN (\n M<\/jats:bold>\n emorized\n G<\/jats:bold>\n lobal\n I<\/jats:bold>\n nformation\n G<\/jats:bold>\n raph\n N<\/jats:bold>\n eural\n N<\/jats:bold>\n etwork), an innovative approach that leverages memorized global information to enhance existing GNNs in both transductive and inductive scenarios. Specifically, MGIGNN captures long-range dependencies by identifying and incorporating global similar nodes, which are defined as nodes exhibiting similar features, structural patterns and label information within a graph. To alleviate the computational overhead associated with computing embeddings for all nodes, we introduce an external memory module to facilitate the retrieval of embeddings and optimize performance on large graphs. To enhance the memory-efficiency, MGIGNN selectively retrieves global similar nodes from a small set of candidate nodes. These candidate nodes are selected from the training nodes based on a sparse node selection distribution with a Dirichlet prior. This selecting approach not only reduces the memory size required but also ensures efficient utilization of computational resources. Through comprehensive experiments conducted on ten widely-used and real-world datasets, including seven homogeneous datasets and three heterogeneous datasets, we demonstrate that our\u00a0MGIGNN can generally improve the performance of existing GNNs on node classification tasks under both inductive and transductive settings.\n <\/jats:p>","DOI":"10.1145\/3689430","type":"journal-article","created":{"date-parts":[[2024,8,28]],"date-time":"2024-08-28T10:26:31Z","timestamp":1724840791000},"page":"1-34","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Enhancing Graph Neural Networks via Memorized Global Information"],"prefix":"10.1145","volume":"18","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-3751-9127","authenticated-orcid":false,"given":"Ruihong","family":"Zeng","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Sun Yat-Sen University, Guangzhou, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-6886-5882","authenticated-orcid":false,"given":"Jinyuan","family":"Fang","sequence":"additional","affiliation":[{"name":"Sun Yat-Sen University, Guangzhou, China"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-7326-2883","authenticated-orcid":false,"given":"Siwei","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Machine Learning, Mohamed bin Zayed University of Artificial Intelligence, Masdar City, United Arab Emirates"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-5374-0318","authenticated-orcid":false,"given":"Zaiqiao","family":"Meng","sequence":"additional","affiliation":[{"name":"University of Glasgow, Glasgow, United Kingdom of Great Britain and Northern Ireland"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-1625-2168","authenticated-orcid":false,"given":"Shangsong","family":"Liang","sequence":"additional","affiliation":[{"name":"Schoo of Data and Computer Science, Sun Yat-Sen University, Guangzhou, China"}]}],"member":"320","published-online":{"date-parts":[[2024,10,8]]},"reference":[{"key":"e_1_3_3_2_2","unstructured":"Uri Alon and Eran Yahav. 2020. On the bottleneck of graph neural networks and its practical implications. In International Conference on Learning Representations."},{"key":"e_1_3_3_3_2","first-page":"43","volume-title":"Structural, Syntactic, and Statistical Pattern Recognition: Joint IAPR International Workshops, S+ SSPR 2022, Montreal, QC, Canada, August 26\u201327, 2022, Proceedings","author":"Bicciato Alessandro","year":"2023","unstructured":"Alessandro Bicciato, Luca Cosmo, Giorgia Minello, Luca Rossi, and Andrea Torsello. 2023. Classifying me softly: A novel graph neural network based on features soft-alignment. In Structural, Syntactic, and Statistical Pattern Recognition: Joint IAPR International Workshops, S+ SSPR 2022, Montreal, QC, Canada, August 26\u201327, 2022, Proceedings. Springer, 43\u201353."},{"key":"e_1_3_3_4_2","first-page":"2528","volume-title":"International Conference on Machine Learning","author":"Black Mitchell","year":"2023","unstructured":"Mitchell Black, Zhengchao Wan, Amir Nayyeri, and Yusu Wang. 2023. Understanding oversquashing in gnns through the lens of effective resistance. In International Conference on Machine Learning. PMLR, 2528\u20132547."},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i5.16514"},{"volume-title":"International Conference on Learning Representations","year":"2018","author":"Bojchevski Aleksandar","key":"e_1_3_3_6_2","unstructured":"Aleksandar Bojchevski and Stephan G\u00fcnnemann. 2018. Deep Gaussian embedding of graphs: Unsupervised inductive learning via ranking. In International Conference on Learning Representations."},{"key":"e_1_3_3_7_2","first-page":"1144","volume-title":"International Conference on Machine Learning","author":"Brockschmidt Marc","year":"2020","unstructured":"Marc Brockschmidt. 2020. Gnn-film: Graph neural networks with feature-wise linear modulation. In International Conference on Machine Learning. PMLR, 1144\u20131152."},{"volume-title":"International Conference on Learning Representations","year":"2021","author":"Brody Shaked","key":"e_1_3_3_8_2","unstructured":"Shaked Brody, Uri Alon, and Eran Yahav. 2021. How attentive are graph attention networks? In International Conference on Learning Representations."},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3485447.3512176"},{"key":"e_1_3_3_10_2","first-page":"3469","volume-title":"International Conference on Machine Learning","author":"Chen Dexiong","year":"2022","unstructured":"Dexiong Chen, Leslie O\u2019Bray, and Karsten Borgwardt. 2022. Structure-aware transformer for graph representation learning. In International Conference on Machine Learning. PMLR, 3469\u20133489."},{"volume-title":"The Eleventh International Conference on Learning Representations","year":"2022","author":"Chen Jinsong","key":"e_1_3_3_11_2","unstructured":"Jinsong Chen, Kaiyuan Gao, Gaichao Li, and Kun He. 2022. NAGphormer: A tokenized graph transformer for node classification in large graphs. In The Eleventh International Conference on Learning Representations."},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.5555\/3524938.3525099"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330925"},{"volume-title":"International Conference on Learning Representations","year":"2016","author":"Clevert Djork-Arn\u00e9","key":"e_1_3_3_14_2","unstructured":"Djork-Arn\u00e9 Clevert, Thomas Unterthiner, and Sepp Hochreiter. 2016. Fast and accurate deep network learning by exponential linear units (elus). In International Conference on Learning Representations."},{"key":"e_1_3_3_15_2","first-page":"22326","article-title":"Long range graph benchmark","volume":"35","author":"Dwivedi Vijay Prakash","year":"2022","unstructured":"Vijay Prakash Dwivedi, Ladislav Ramp\u00e1\u0161ek, Michael Galkin, Ali Parviz, Guy Wolf, Anh Tuan Luu, and Dominique Beaini. 2022. Long range graph benchmark. Advances in Neural Information Processing Systems 35 (2022), 22326\u201322340.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1083-6101.2007.00367.x"},{"issue":"3","key":"e_1_3_3_17_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3478284","article-title":"Hyperspherical variational co-embedding for attributed networks","volume":"40","author":"Fang Jinyuan","year":"2021","unstructured":"Jinyuan Fang, Shangsong Liang, Zaiqiao Meng, and Maarten De Rijke. 2021. Hyperspherical variational co-embedding for attributed networks. ACM Transactions on Information Systems (TOIS) 40, 3 (2021), 1\u201336.","journal-title":"ACM Transactions on Information Systems (TOIS)"},{"key":"e_1_3_3_18_2","unstructured":"Jinyuan Fang Qiang Zhang Zaiqiao Meng and Shangsong Liang. 2021. Structure-aware random fourier kernel for graphs. In Advances in Neural Information Processing Systems. 17681\u201317694."},{"key":"e_1_3_3_19_2","unstructured":"Matthias Fey. 2019. Just jump: Dynamic neighborhood aggregation in graph neural networks. In International Conference on Learning Representations."},{"volume-title":"ICLR 2019 (RLGM Workshop)","year":"2019","author":"Fey Matthias","key":"e_1_3_3_20_2","unstructured":"Matthias Fey and Jan Eric Lenssen. 2019. Fast graph representation learning with PyTorch geometric. In ICLR 2019 (RLGM Workshop)."},{"key":"e_1_3_3_21_2","first-page":"3294","volume-title":"International Conference on Machine Learning","author":"Fey Matthias","year":"2021","unstructured":"Matthias Fey, Jan E. Lenssen, Frank Weichert, and Jure Leskovec. 2021. Gnnautoscale: Scalable and expressive graph neural networks via historical embeddings. In International Conference on Machine Learning. 3294\u20133304."},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380297"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2021.3062794"},{"key":"e_1_3_3_24_2","unstructured":"Jing Gao Feng Liang Wei Fan Yizhou Sun and Jiawei Han. 2009. Graph-based consensus maximization among multiple supervised and unsupervised models. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_3_25_2","unstructured":"Will Hamilton Zhitao Ying and Jure Leskovec. 2017. Inductive representation learning on large graphs. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_3_26_2","first-page":"4094","volume-title":"International Conference on Machine Learning","author":"Hasanzadeh Arman","year":"2020","unstructured":"Arman Hasanzadeh, Ehsan Hajiramezanali, Shahin Boluki, Mingyuan Zhou, Nick Duffield, Krishna Narayanan, and Xiaoning Qian. 2020. Bayesian graph neural networks with adaptive connection sampling. In International Conference on Machine Learning. PMLR, 4094\u20134104."},{"key":"e_1_3_3_27_2","unstructured":"Junxian He Taylor Berg-Kirkpatrick and Graham Neubig. 2020. Learning sparse prototypes for text generation. In Advances in Neural Information Processing Systems. 14724\u201314735."},{"key":"e_1_3_3_28_2","first-page":"12724","volume-title":"International Conference on Machine Learning","author":"He Xiaoxin","year":"2023","unstructured":"Xiaoxin He, Bryan Hooi, Thomas Laurent, Adam Perold, Yann LeCun, and Xavier Bresson. 2023. A generalization of vit\/mlp-mixer to graphs. In International Conference on Machine Learning. PMLR, 12724\u201312745."},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3478322"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3343031.3350966"},{"key":"e_1_3_3_31_2","unstructured":"Weihua Hu Matthias Fey Marinka Zitnik Yuxiao Dong Hongyu Ren Bowen Liu Michele Catasta and Jure Leskovec. 2020. Open graph benchmark: Datasets for machine learning on graphs. In Advances in Neural Information Processing Systems. 22118\u201322133."},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380027"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3580516"},{"key":"e_1_3_3_34_2","first-page":"570","volume-title":"Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2010, Barcelona, Spain, September 20\u201324, 2010, Proceedings, Part I 21","author":"Ji Ming","year":"2010","unstructured":"Ming Ji, Yizhou Sun, Marina Danilevsky, Jiawei Han, and Jing Gao. 2010. Graph regularized transductive classification on heterogeneous information networks. In Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2010, Barcelona, Spain, September 20\u201324, 2010, Proceedings, Part I 21. Springer, 570\u2013586."},{"key":"e_1_3_3_35_2","doi-asserted-by":"crossref","unstructured":"Weiwei Jiang and Jiayun Luo. 2022. Graph neural network for traffic forecasting: A survey. In Expert Systems with Applications Elsevier 117921.","DOI":"10.1016\/j.eswa.2022.117921"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3449914"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.3390\/math9080830"},{"key":"e_1_3_3_38_2","unstructured":"Urvashi Khandelwal Omer Levy Dan Jurafsky Luke Zettlemoyer and Mike Lewis. 2019. Generalization through memorization: Nearest neighbor language models. In International Conference on Learning Representations."},{"volume-title":"International Conference on Learning Representations","year":"2015","author":"Kingma Diederik P.","key":"e_1_3_3_39_2","unstructured":"Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In International Conference on Learning Representations."},{"volume-title":"International Conference on Learning Representations","year":"2017","author":"Kipf Thomas N.","key":"e_1_3_3_40_2","unstructured":"Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In International Conference on Learning Representations."},{"key":"e_1_3_3_41_2","doi-asserted-by":"crossref","unstructured":"Katelyn A. Kirchner Daniel R. Cassar Edgar D. Zanotto Madoka Ono Seong H. Kim Karan Doss Mikkel L. B\u00f8dker Morten M. Smedskjaer Shinji Kohara Longwen Tang and others. 2022. Beyond the average: Spatial and temporal fluctuations in oxide glass-forming systems. Chemical Reviews 123 4 (2022) 1774\u20131840.","DOI":"10.1021\/acs.chemrev.1c00974"},{"key":"e_1_3_3_42_2","unstructured":"Devin Kreuzer Dominique Beaini Will Hamilton Vincent L\u00e9tourneau and Prudencio Tossou. 2021. Rethinking graph transformers with spectral attention. In Advances in Neural Information Processing Systems. 21618\u201321629."},{"issue":"1","key":"e_1_3_3_43_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3532611","article-title":"Dynamic graph convolutional recurrent network for traffic prediction: Benchmark and solution","volume":"17","author":"Li Fuxian","year":"2023","unstructured":"Fuxian Li, Jie Feng, Huan Yan, Guangyin Jin, Fan Yang, Funing Sun, Depeng Jin, and Yong Li. 2023. Dynamic graph convolutional recurrent network for traffic prediction: Benchmark and solution. ACM Transactions on Knowledge Discovery from Data 17, 1 (2023), 1\u201321.","journal-title":"ACM Transactions on Knowledge Discovery from Data"},{"key":"e_1_3_3_44_2","unstructured":"Guohao Li Chenxin Xiong Ali Thabet and Bernard Ghanem. 2020. Deepergcn: All you need to train deeper gcns. arXiv preprint arXiv:2006.07739 (2020)."},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11604"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3495162"},{"issue":"3","key":"e_1_3_3_47_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3576921","article-title":"Preference-aware graph attention networks for cross-domain recommendations with collaborative knowledge graph","volume":"41","author":"Li Yakun","year":"2023","unstructured":"Yakun Li, Lei Hou, and Juanzi Li. 2023. Preference-aware graph attention networks for cross-domain recommendations with collaborative knowledge graph. ACM Transactions on Information Systems 41, 3 (2023), 1\u201326.","journal-title":"ACM Transactions on Information Systems"},{"key":"e_1_3_3_48_2","doi-asserted-by":"crossref","unstructured":"Nan Lin. 2017. Building a network theory of social capital. In Social Capital Routledge 3\u201328.","DOI":"10.4324\/9781315129457-1"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403076"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3568953"},{"key":"e_1_3_3_51_2","first-page":"7180","volume-title":"International Conference on Machine Learning","author":"Lukovnikov Denis","year":"2021","unstructured":"Denis Lukovnikov and Asja Fischer. 2021. Improving breadth-wise backpropagation in graph neural networks helps learning long-range dependencies. In International Conference on Machine Learning. PMLR, 7180\u20137191."},{"key":"e_1_3_3_52_2","first-page":"11038","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"36","author":"Luo Man","year":"2022","unstructured":"Man Luo, Arindam Mitra, Tejas Gokhale, and Chitta Baral. 2022. Improving biomedical information retrieval with neural retrievers. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 11038\u201311046."},{"volume-title":"ICML 2022 Workshop on Knowledge Retrieval and Language Models","year":"2022","author":"Luo Man","key":"e_1_3_3_53_2","unstructured":"Man Luo, Mihir Parmar, Jayasurya Sevalur Mahendran, Sahit Jain, Samarth Rawal, and Chitta Baral. 2022. SCONER: Scoring negative candidates \\(\\backslash\\) \\(\\backslash\\) Before training neural re-ranker for question answering. In ICML 2022 Workshop on Knowledge Retrieval and Language Models."},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.5555\/3104322.3104425"},{"key":"e_1_3_3_55_2","unstructured":"Adam Paszke Sam Gross Soumith Chintala Gregory Chanan Edward Yang Zachary DeVito Zeming Lin Alban Desmaison Luca Antiga and Adam Lerer. 2017. Automatic differentiation in pytorch. In NIPS 2017 Workshop on Autodiff."},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i3.16345"},{"key":"e_1_3_3_57_2","first-page":"5241","volume-title":"International Conference on Machine Learning","author":"Qu Meng","year":"2019","unstructured":"Meng Qu, Yoshua Bengio, and Jian Tang. 2019. Gmnn: Graph Markov neural networks. In International Conference on Machine Learning. 5241\u20135250."},{"volume-title":"International Conference on Learning Representations","year":"2021","author":"Qu Meng","key":"e_1_3_3_58_2","unstructured":"Meng Qu, Huiyu Cai, and Jian Tang. 2021. Neural structured prediction for inductive node classification. In International Conference on Learning Representations."},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00266"},{"key":"e_1_3_3_60_2","unstructured":"Ladislav Ramp\u00e1\u0161ek Michael Galkin Vijay Prakash Dwivedi Anh Tuan Luu Guy Wolf and Dominique Beaini. 2022. Recipe for a general powerful scalable graph transformer. In Advances in Neural Information Processing Systems. 14501\u201314515."},{"issue":"1","key":"e_1_3_3_61_2","doi-asserted-by":"crossref","first-page":"btac759","DOI":"10.1093\/bioinformatics\/btac759","article-title":"DeepRank-GNN: A graph neural network framework to learn patterns in protein\u2013protein interfaces","volume":"39","author":"R\u00e9au Manon","year":"2023","unstructured":"Manon R\u00e9au, Nicolas Renaud, Li C. Xue, and Alexandre MJJ Bonvin. 2023. DeepRank-GNN: A graph neural network framework to learn patterns in protein\u2013protein interfaces. Bioinformatics 39, 1 (2023), btac759.","journal-title":"Bioinformatics"},{"key":"e_1_3_3_62_2","unstructured":"Yu Rong Wenbing Huang Tingyang Xu and Junzhou Huang. 2019. Dropedge: Towards deep graph convolutional networks on node classification. In International Conference on Learning Representations."},{"key":"e_1_3_3_63_2","unstructured":"T. Konstantin Rusch Michael M. Bronstein and Siddhartha Mishra. 2023. A survey on oversmoothing in graph neural networks. SAM Research Report 2023 (2023)."},{"key":"e_1_3_3_64_2","first-page":"18888","volume-title":"International Conference on Machine Learning","author":"Rusch T. Konstantin","year":"2022","unstructured":"T. Konstantin Rusch, Ben Chamberlain, James Rowbottom, Siddhartha Mishra, and Michael Bronstein. 2022. Graph-coupled oscillator networks. In International Conference on Machine Learning. PMLR, 18888\u201318909."},{"volume-title":"The Eleventh International Conference on Learning Representations","year":"2022","author":"Rusch T. Konstantin","key":"e_1_3_3_65_2","unstructured":"T. Konstantin Rusch, Benjamin Paul Chamberlain, Michael W. Mahoney, Michael M. Bronstein, and Siddhartha Mishra. 2022. Gradient gating for deep multi-rate learning on graphs. In The Eleventh International Conference on Learning Representations."},{"key":"e_1_3_3_66_2","doi-asserted-by":"crossref","unstructured":"Lei Sang Min Xu Shengsheng Qian Matt Martin Peter Li and Xindong Wu. 2020. Context-dependent propagating-based video recommendation in multimodal heterogeneous information networks. In IEEE Transactions on Multimedia. IEEE 2019\u20132032.","DOI":"10.1109\/TMM.2020.3007330"},{"key":"e_1_3_3_67_2","unstructured":"Jayaram Sethuraman. 1994. A constructive definition of Dirichlet priors. In Statistica Sinica JSTOR 639\u2013650."},{"key":"e_1_3_3_68_2","unstructured":"Oleksandr Shchur Maximilian Mumme Aleksandar Bojchevski and Stephan G\u00fcnnemann. 2018. Pitfalls of graph neural network evaluation. CoRR abs\/1811.05868 (2018)."},{"volume-title":"ICLR 2021 Workshop on Geometrical and Topological Representation Learning","year":"2021","author":"Strathmann Heiko","key":"e_1_3_3_69_2","unstructured":"Heiko Strathmann, Mohammadamin Barekatain, Charles Blundell, and Petar Veli\u010dkovi\u0107. 2021. Persistent message passing. In ICLR 2021 Workshop on Geometrical and Topological Representation Learning."},{"key":"e_1_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1402008"},{"volume-title":"International Conference on Learning Representations","year":"2021","author":"Topping Jake","key":"e_1_3_3_71_2","unstructured":"Jake Topping, Francesco Di Giovanni, Benjamin Paul Chamberlain, Xiaowen Dong, and Michael M. Bronstein. 2021. Understanding over-squashing and bottlenecks on graphs via curvature. In International Conference on Learning Representations."},{"volume-title":"International Conference on Learning Representations","year":"2018","author":"Veli\u010dkovi\u0107 Petar","key":"e_1_3_3_72_2","unstructured":"Petar Veli\u010dkovi\u0107, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Li\u00f2, and Yoshua Bengio. 2018. Graph attention networks. In International Conference on Learning Representations."},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330956"},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1162\/qss_a_00021"},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313562"},{"issue":"1","key":"e_1_3_3_76_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3577034","article-title":"Enhancing conversational recommendation systems with representation fusion","volume":"17","author":"Wang Yingxu","year":"2023","unstructured":"Yingxu Wang, Xiaoru Chen, Jinyuan Fang, Zaiqiao Meng, and Shangsong Liang. 2023. Enhancing conversational recommendation systems with representation fusion. ACM Transactions on the Web 17, 1 (2023), 1\u201334.","journal-title":"ACM Transactions on the Web"},{"volume-title":"The Eleventh International Conference on Learning Representations","year":"2022","author":"Wang Yuelin","key":"e_1_3_3_77_2","unstructured":"Yuelin Wang, Kai Yi, Xinliang Liu, Yu Guang Wang, and Shi Jin. 2022. ACMP: Allen-cahn message passing with attractive and repulsive forces for graph neural networks. In The Eleventh International Conference on Learning Representations."},{"key":"e_1_3_3_78_2","doi-asserted-by":"crossref","unstructured":"Lanning Wei Huan Zhao Zhiqiang He and Quanming Yao. 2023. Neural architecture search for GNN-based graph classification. ACM Transactions on Information Systems 42 1 (2023) 1\u201329.","DOI":"10.1145\/3584945"},{"key":"e_1_3_3_79_2","first-page":"6861","volume-title":"International Conference on Machine Learning","author":"Wu Felix","year":"2019","unstructured":"Felix Wu, Amauri Souza, Tianyi Zhang, Christopher Fifty, Tao Yu, and Kilian Weinberger. 2019. Simplifying graph convolutional networks. In International Conference on Machine Learning. 6861\u20136871."},{"key":"e_1_3_3_80_2","doi-asserted-by":"crossref","unstructured":"Lingfei Wu Yu Chen Kai Shen Xiaojie Guo Hanning Gao Shucheng Li Jian Pei Bo Long and others. 2023. Graph neural networks for natural language processing: A survey. In Foundations and Trends\u00ae in Machine Learning Now Publishers Inc. 119\u2013328.","DOI":"10.1561\/2200000096"},{"key":"e_1_3_3_81_2","first-page":"27387","article-title":"Nodeformer: A scalable graph structure learning transformer for node classification","volume":"35","author":"Wu Qitian","year":"2022","unstructured":"Qitian Wu, Wentao Zhao, Zenan Li, David P. Wipf, and Junchi Yan. 2022. Nodeformer: A scalable graph structure learning transformer for node classification. Advances in Neural Information Processing Systems 35 (2022), 27387\u201327401.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_82_2","doi-asserted-by":"crossref","unstructured":"Shiwen Wu Fei Sun Wentao Zhang Xu Xie and Bin Cui. 2022. Graph neural networks in recommender systems: A survey. In ACM Computing Surveys ACM New York NY 1\u201337.","DOI":"10.1145\/3535101"},{"key":"e_1_3_3_83_2","first-page":"13266","article-title":"Representing long-range context for graph neural networks with global attention","volume":"34","author":"Wu Zhanghao","year":"2021","unstructured":"Zhanghao Wu, Paras Jain, Matthew Wright, Azalia Mirhoseini, Joseph E Gonzalez, and Ion Stoica. 2021. Representing long-range context for graph neural networks with global attention. Advances in Neural Information Processing Systems 34 (2021), 13266\u201313279.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_84_2","first-page":"10432","volume-title":"International Conference on Machine Learning","author":"Xhonneux Louis-Pascal","year":"2020","unstructured":"Louis-Pascal Xhonneux, Meng Qu, and Jian Tang. 2020. Continuous graph neural networks. In International Conference on Machine Learning. 10432\u201310441."},{"volume-title":"International Conference on Learning Representations","year":"2018","author":"Xu Keyulu","key":"e_1_3_3_85_2","unstructured":"Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2018. How powerful are graph neural networks? In International Conference on Learning Representations."},{"key":"e_1_3_3_86_2","first-page":"5453","volume-title":"International Conference on Machine Learning","author":"Xu Keyulu","year":"2018","unstructured":"Keyulu Xu, Chengtao Li, Yonglong Tian, Tomohiro Sonobe, Ken-ichi Kawarabayashi, and Stefanie Jegelka. 2018. Representation learning on graphs with jumping knowledge networks. In International Conference on Machine Learning. 5453\u20135462."},{"key":"e_1_3_3_87_2","unstructured":"Mingqi Yang Renjian Wang Yanming Shen Heng Qi and Baocai Yin. 2022. Breaking the expression bottleneck of graph neural networks. IEEE Transactions on Knowledge and Data Engineering 35 6 (2022) 5652\u20135664."},{"key":"e_1_3_3_88_2","first-page":"40","volume-title":"International Conference on Machine Learning","author":"Yang Zhilin","year":"2016","unstructured":"Zhilin Yang, William Cohen, and Ruslan Salakhudinov. 2016. Revisiting semi-supervised learning with graph embeddings. In International Conference on Machine Learning. 40\u201348."},{"key":"e_1_3_3_89_2","unstructured":"Chengxuan Ying Tianle Cai Shengjie Luo Shuxin Zheng Guolin Ke Di He Yanming Shen and Tie-Yan Liu. 2021. Do transformers really perform badly for graph representation? In Advances in Neural Information Processing Systems. 28877\u201328888."},{"key":"e_1_3_3_90_2","first-page":"25684","volume-title":"International Conference on Machine Learning","author":"Yu Haiyang","year":"2022","unstructured":"Haiyang Yu, Limei Wang, Bokun Wang, Meng Liu, Tianbao Yang, and Shuiwang Ji. 2022. GraphFM: Improving large-scale GNN training via feature momentum. In International Conference on Machine Learning. 25684\u201325701."},{"key":"e_1_3_3_91_2","unstructured":"Hanqing Zeng Muhan Zhang Yinglong Xia Ajitesh Srivastava Andrey Malevich Rajgopal Kannan Viktor Prasanna Long Jin and Ren Chen. 2021. Decoupling the depth and scope of graph neural networks. Advances in Neural Information Processing Systems 34 (2021) 19665\u201319679."},{"key":"e_1_3_3_92_2","unstructured":"Ningyu Zhang Xin Xie Xiang Chen Shumin Deng Chuanqi Tan Fei Huang Xu Cheng and Huajun Chen. 2022. Reasoning through memorization: Nearest neighbor knowledge graph embeddings. arXiv:2201.05575. Retrieved from https:\/\/arxiv.org\/abs\/2201.05575"},{"key":"e_1_3_3_93_2","unstructured":"Wentao Zhang Zeang Sheng Yuezihan Jiang Yikuan Xia Jun Gao Zhi Yang and Bin Cui. 2021. Evaluating deep graph neural networks. arXiv preprint arXiv:2108.00955 (2021)."},{"key":"e_1_3_3_94_2","doi-asserted-by":"crossref","unstructured":"Wayne Xin Zhao Jing Liu Ruiyang Ren and Ji-Rong Wen. 2024. Dense text retrieval based on pretrained language models: A survey. ACM Transactions on Information Systems 42 4 (2024) 1\u201360.","DOI":"10.1145\/3637870"},{"key":"e_1_3_3_95_2","unstructured":"Kaixiong Zhou Xiao Huang Daochen Zha Rui Chen Li Li Soo-Hyun Choi and Xia Hu. 2021. Dirichlet energy constrained learning for deep graph neural networks. In Advances in Neural Information Processing Systems. 21834\u201321846."},{"volume-title":"International Conference on Learning Representations","year":"2020","author":"Zhu Hao","key":"e_1_3_3_96_2","unstructured":"Hao Zhu and Piotr Koniusz. 2020. Simple spectral graph convolution. In International Conference on Learning Representations."},{"key":"e_1_3_3_97_2","doi-asserted-by":"crossref","unstructured":"Haorui Zhu Fei Xiong Hongshu Chen Xi Xiong and Liang Wang. 2024. Incorporating a triple graph neural network with multiple implicit feedback for social recommendation. ACM Transactions on the Web 18 2 (2024) 1\u201326.","DOI":"10.1145\/3580517"},{"key":"e_1_3_3_98_2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btx252"}],"container-title":["ACM Transactions on the Web"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3689430","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,8]],"date-time":"2024-10-08T15:43:59Z","timestamp":1728402239000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3689430"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,8]]},"references-count":97,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,11,30]]}},"alternative-id":["10.1145\/3689430"],"URL":"https:\/\/doi.org\/10.1145\/3689430","relation":{},"ISSN":["1559-1131","1559-114X"],"issn-type":[{"type":"print","value":"1559-1131"},{"type":"electronic","value":"1559-114X"}],"subject":[],"published":{"date-parts":[[2024,10,8]]},"assertion":[{"value":"2023-11-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-07-16","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-10-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}