Abstract
This paper describes an approach to the use of citation links to improve the scientific paper classification performance. In this approach, we develop two refinement functions, a linear label refinement (LLR) and a probabilistic label refinement (PLR), to model the citation link structures of the scientific papers for refining the class labels of the documents obtained by the content-based Naive Bayes classification method. The approach with the two new refinement models is examined and compared with the content-based Naive Bayes method on a standard paper classification data set with increasing training set sizes. The results suggest that both refinement models can significantly improve the system performance over the content-based method for all the training set sizes and that PLR is better than LLR when the training examples are sufficient.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Lewis, D.D.: Naive (bayes) at forty: The independence assumption in information retrieval. In: Proceedings of the 10th European Conference on Machine Learning, Chemnitz, DE, pp. 4–15. Springer, Heidelberg (1998)
Yang, Y.: Expert network: effective and efficient learning from human decisions in text categorisation and retrieval. In: Proceedings of the 17th ACM International Conference on Research and Development in Information Retrieval, Dublin, IE, pp. 13–22. Springer, Heidelberg (1994)
Lewis, D.D., Ringuette, M.: A comparison of two learning algorithms for text categorization. In: Proceedings of the 3rd Annual Symposium on Document Analysis and Information Retrieval, Las Vegas, US, pp. 81–93 (1994)
Joachims, T.: Text categorization with support vector machines: learning with many relevant features. In: Proceedings of the 10th European Conference on Machine Learning, pp. 137–142. Springer, Heidelberg (1998)
Nigam, K., Lafferty, J., McCallum, A.: Using Maximum Entropy for Text Classification. In: IJCAI 1999, Workshop on Machine Learning for Information Filtering, pp. 61–67 (1999)
Ruiz, M.E., Srinivasan, P.: Hierarchical neural networks for text categorization. In: Proceedings of the 22nd ACM International Conference on Research and Development in Information Retrieval, pp. 281–282. ACM Press, New York (1999)
Brin, S., Page, L.: The anatomy of a Large-scale Hypertextual Web search Engine. Computer Networks and ISDN Systems 30(1–7), 107–117 (1998)
Chakrabarti, S., Dom, B.E., Indyk, P.: Enhanced hypertext categorization using hyperlinks. In: Proceedings of the ACM International Conference on Management of Data, pp. 307–318. ACM Press, New York (1998)
Oh, H.J., Myaeng, S.H., Lee, M.H.: A practical hypertext categorization method using links and incrementally available class information. In: Proceedings of the ACM International Conference on Research and Development in Information Retrieval, pp. 264–271. ACM Press, New York (2000)
Getoor, L., Segal, E., Taskar, B., Koller, D.: Probabilistic Models of Text and Link Structure for Hypertext Classification. In: IJCAI Workshop on Text Learning: Beyond Supervision (2001)
Lu, Q., Getoor, L.: Link-based classification using labeled and unlabeled data. In: ICML Workshop on the Continuum from Labeled to Unlabeled Data in Machine Learning and Data Mining, Washington DC (2003)
Lu, Q., Getoor, L.: Link-based text classification. In: IJCAI Workshop on Text Mining and Link Analysis. Acapulco, MX (2003)
Lu, Q., Getoor, L.: Link-based classification. In: International Conference on Machine Learning, Washington, DC (2003)
Taskar, B., Segal, E., Koller, D.: Probabilistic Classification and Clustering in Relational Data. In: Proceeding of the 17th International Joint Conference on Artificial Intelligence, pp. 870–878 (2001)
Craven, M., Slattery, S.: Relational Learning with Statistical Predicate Invention: Better Models for Hypertext. Mach. Learn. 43(1-2), 97–119 (2001)
Quinlan, J.R.: Learning logical definitions from relations. Mach. Learn. 5(3), 239–266 (1990)
Cao, M.D., Gao, X.: Combining contents and citations for scientific document classification. In: Proceedings of 18th Australian Joint Conference on Artificial Intelligence, pp. 143–152. Springer, Heidelberg (2005)
Lewis, D.D.: Naive (Bayes) at forty: The independence assumption in information retrieval. In: Proceedings of the 10th European Conference on Machine Learning, pp. 4–15. Springer, Heidelberg (1998)
Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Network of Plausible Inference. Morgan Kaufmann publishers, San Francisco (1988)
Ghahramani, Z.: Graphical Models: Parameter Learning. In: Handbook of Brain Theory and Neural Networks, 2nd edn., pp. 486–490. MIT Press, Cambridge (2003)
Jordan, M.I., Weiss, Y.: Graphical Models: Probabilistic Inference. In: Handbook of Brain Theory and Neural Networks, 2nd edn., pp. 490–496. MIT Press, Cambridge (2003)
Yedidia, J.S., Freeman, W.T., Weiss, Y.: Understanding Belief Propagation and its Generalizations. Technical Report TR-2001-22, Mitsubishi Electric Research Laboratories, Inc. (2002)
Cowell, R.: Introduction in Inference in Bayesian Networks, pp. 9–26. MIT Press, Cambridge (1999)
Russell, S., Novig, P.: Artificial Intelligence: A Modern Approach, 2nd edn. Prentice-Hall, Englewood Cliffs (2005)
MacKay, D.J.C.: Introduction to Monte Carlo Methods. In: Learning in graphical models, pp. 175–204. MIT Press, Cambridge (1999)
McCallum, A.K., Nigam, K., Rennie, J., Seymore, K.: Automating the Construction of Internet Portals with Machine Learning. Information Retrieval 3(2), 127–163 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, M., Gao, X., Cao, M.D., Ma, Y. (2006). Modelling Citation Networks for Improving Scientific Paper Classification Performance. In: Yang, Q., Webb, G. (eds) PRICAI 2006: Trends in Artificial Intelligence. PRICAI 2006. Lecture Notes in Computer Science(), vol 4099. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-36668-3_45
Download citation
DOI: https://doi.org/10.1007/978-3-540-36668-3_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-36667-6
Online ISBN: 978-3-540-36668-3
eBook Packages: Computer ScienceComputer Science (R0)