Abstract
Transfer learning is one of the most important directions in current machine learning research. In this paper, we propose a new learning framework called Multi-source part-based Transfer Learning (Ms-pbTL), which is one kind of parameter transfer with multiple related source tasks. Dissimilar to many traditional works, we consider how to transfer information from one task to another in the form of integrating transferred information between parts. We regard all the complex tasks as a collection of several constituent parts respectively. It means that transfer learning between two complex tasks can be accomplished by sub-transfer learning between their parts. Then, after completing the above information transfer between the source and target tasks, we integrate the models of all the parts in the target task into a whole. Experiments on some real data sets with support vector machines (SVMs) validate the effectiveness of our proposed learning frameworks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Caruana, R.: Multitask Learning. Machine Learning 28, 41–75 (1997)
Dai, W., Yang, Q., Xue, G.R., Yu, Y.: Boosting for transfer learning. In: Proceedings of the 24th International Conference on Machine Learning, pp. 193–200 (2007)
Evgeniou, T., Pontil, M.: Regularized multi-task learning. In: Proceedings of the 10th International Conference on Knowledge Discovery and Data Mining, pp. 109–117 (2004)
Xu, Z., Sun, S.: An algorithm on multi-view adaboost. In: Proceedings of the 17th International Conference on Neural Information Processing, pp. 355–362 (2010)
Zhang, Q., Sun, S.: Multiple-view multiple-learner active learning. Pattern Recognition 43(9), 3113–3119 (2010)
Thrun, S., Pratt, L.: Learning to Learn. Kluwer Academic Publishers (1997)
Thrun, S.: Explanation-Based Neural Network Learning: A Lifelong Learning Approach. Kluwer Academic Publishers, Boston (1996)
Cao, B., Liu, N.N., Yang, Q.: Transfer learning for collective link prediction in multiple heterogenous domains. In: Proceedings of the 27th International Conference on Machine Learning, pp. 159–166 (2010)
Rohrbach, M., Stark, M., Szarvas, G., Gurevych, I., Schiele, B.: What helps where and why? Semantic relatedness for knowledge transfer. In: Proceedings of the 23rd Computer Society Conference on Computer Vision and Pattern Recognition, pp. 910–917 (2010)
Wu, P., Dietterich, T.G.: Improving SVM accuracy by training on auxiliary data sources. In: Proceedings of the 21st International Conference on Machine Learning, pp. 871–878 (2010)
Davis, J., Domingos, P.: Deep transfer via second-order Markov logic. In: Proceedings of the 26th International Conference on Machine Learning, pp. 217–224 (2009)
Ross, D.A., Zemel, R.S.: Learning parts-based representations of data. Journal of Machine Learning Research 7, 2369–2397 (2006)
Bar-Hillel, A., Hertz, T., Weinshall, D.: Object class recognition by boosting a part-based model. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Recognition, pp. 702–709 (2005)
Perkins, D.N., Salomon, G.: Transfer of learning. The Journal of International Encyclopedia of Education 11, 6452–6457 (1992)
Crammer, K., Kearns, M., Wortman, J.: Learning from multiple sources. Journal of Machine Learning Research 9, 1757–1774 (2008)
Luo, P., Zhuang, F., Xiong, Y., He, Q.: Transfer learning from multiple source domains via consensus regularization. In: Proceedings of the 17th ACM Conference on Information and Knowledge Management, pp. 103–112 (2008)
Xu, Z., Sun, S.: Part-based transfer learning. In: Proceedings of the 8th Internaional Symposium on Neural Networks, pp. 434–441 (2011)
Lima, N.H.C., Neto, A.D.D., Melo, J.D.: Creating an ensemble of diverse support vector machines using Adaboost. In: Proceedings of the International Joint Conference on Neural Networks, pp. 2342–2346 (2009)
Shawe-Taylor, J., Sun, S.: A review of optimization methodologies in support vector machines. Neurocomputing 74(17), 3609–3618 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sun, S., Xu, Z., Yang, M. (2013). Transfer Learning with Part-Based Ensembles. In: Zhou, ZH., Roli, F., Kittler, J. (eds) Multiple Classifier Systems. MCS 2013. Lecture Notes in Computer Science, vol 7872. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38067-9_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-38067-9_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38066-2
Online ISBN: 978-3-642-38067-9
eBook Packages: Computer ScienceComputer Science (R0)