Abstract
Restricted Boltzmann Machine (RBM) is a two layer undirected graph model that capable to represent complex distributions. Recent research has shown RBM-based approach has comparable performance with or even better performance than previous models on many collaborative filtering (CF) tasks. However, the intractable inference makes the training of RBM sophisticated, which prevents it from practical application. We present a novel feedforward neural framework for collaborative filtering called NACF, which is extended from the Neural Autoregressive Distribution Estimator (NADE). Because of the autoregressive feed-forward architecture, NACF can be trained with efficient stochastic gradient descent, instead of slow and hard-to-tune truncated Gibbs sampling for RBM. By introducing linear visible units and dual reversed ordering, NACF show faster convergence and better results than Probabilistic Matrix Factorization (PMF) and corresponding RBM models on MovieLens dataset. Besides, by combining NACF results, the rating prediction of efficientsignificantly improved, showing NACF is an effective and efficient model for collaborative filtering.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Billsus, D., Pazzani, M.J.: Learning collaborative information filters. In: ICML, vol. 98, pp. 46–54 (1998)
Georgiev, K., Nakov, P.: A non-IID framework for collaborative filtering with restricted Boltzmann machines. In: Proceedings of the 30th International Conference on Machine Learning (ICML 2013), pp. 1148–1156 (2013)
Goldberg, K., Roeder, T., Gupta, D., Perkins, C.: Eigentaste: a constant time collaborative filtering algorithm. Inf. Retr. 4(2), 133–151 (2001)
Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313, 504–507 (2006)
Hinton, G.: A practical guide to training restricted Boltzmann machines. Momentum 9(1), 926 (2010)
Kim, D., Yum, B.J.: Collaborative filtering based on iterative principal component analysis. Expert Syst. Appl. 28(4), 823–830 (2005)
Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 42(8), 30–37 (2009)
Larochelle, H., Murray, I.: The neural autoregressive distribution estimator. J. Mach. Learn. Res. 15, 29–37 (2011)
Salakhutdinov, R., Mnih, A.: Probabilistic matrix factorization. In: NIPS, vol. 1, no. 1, pp. 2–1 (2007)
Salakhutdinov, R., Mnih, A., Hinton, G.: Restricted Boltzmann machines for collaborative filtering. In: Proceedings of the 24th International Conference on Machine Learning, pp. 791–798. ACM (2007)
Sarwar, B., Karypis, G., Konstan, J., Riedl, J.: Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th International Conference on World Wide Web, pp. 285–295. ACM (2001)
Uria, B., Murray, I., Larochelle, H.: A deep and tractable density estimator. arXiv preprint arXiv:1310.1757 (2013)
Acknowledgements
This work is supported by China NSFC under Grant 61672309 and National Fundamental Research Special Program funded by China MOST under Grant 2017FY201407.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Ouyang, Z., Sun, C., Li, C. (2017). A Neural Autoregressive Framework for Collaborative Filtering. In: Cong, F., Leung, A., Wei, Q. (eds) Advances in Neural Networks - ISNN 2017. ISNN 2017. Lecture Notes in Computer Science(), vol 10262. Springer, Cham. https://doi.org/10.1007/978-3-319-59081-3_33
Download citation
DOI: https://doi.org/10.1007/978-3-319-59081-3_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-59080-6
Online ISBN: 978-3-319-59081-3
eBook Packages: Computer ScienceComputer Science (R0)