Abstract
Incremental Attribute Learning (IAL) is a feasible approach for solving high-dimensional pattern recognition problems. It gradually trains features one by one. Previous research indicated that supervised machine learning with input attribute ordering can improve classification results. Moreover, input space partitioning can also effectively reduce the interference among features. This study proposed IAL based on Grouped Feature Ordering, which fused feature partitioning with feature ordering. The experimental results show that this approach is not only applicable for pattern classification improvement, but also efficient to reduce interference among features.
Article PDF
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
H. Liu, E. R. Dougherty, J. G. Dy, K. Torkkola, E. Tuv, H. Peng, C. Ding, F. Long, M. Berens, L. Parsons, Z. Zhao, L. Yu, and G. Forman, ‘Evolving Feature Selection’, Intelligent Systems, IEEE, 20 (2005), 64–76.
S.M. Weiss, and N. Indurkhya, Predictive Data Mining: A Practical GuideMorgan Kaufmann, 1998).
S. U. Guan, and F. M. Zhu, ‘An Incremental Approach to Genetic-Algorithms-Based Classification’, IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics, 35 (2005), 227–39.
F. M. Zhu, and S. U. Guan, ‘Ordered Incremental Training with Genetic Algorithms’, International Journal of Intelligent Systems, 19 (2004), 1239–56.
S. U. Guan, and S.C. Li, ‘Incremental Learning with Respect to New Incoming Input Attributes’, Neural Processing Letters, 14 (2001), 241–60.
S. U. Guan and J. Liu, ‘Incremental Neural Network Training with an Increasing Input Dimension’, Journal of Intelligent Systems, 13 (2004), 45–69.
X. Liu, G. Zhang, Y. Zhan, and E. Zhu, ‘An Incremental Feature Learning Algorithm Based on Least Square Support Vector Machine’, in 2nd International Frontiers in Algorithmics Workshop, FAW 2008, June 19, 2008 -June 21, 2008 (Changsha, China: Springer Verlag, 2008), pp. 330–38.
W. Bai, S. Cheng, E. M. Tadjouddine, and S. U. Guan, ‘Incremental Attribute Based Particle Swarm Optimization’, in 2012 8th International Conference on Natural Computation, ICNC 2012, May 29, 2012 - May 31, 2012 (Chongqing, China: IEEE Computer Society, 2012), pp. 669–74.
S. Chao, and F. Wong, ‘An Incremental Decision Tree Learning Methodology Regarding Attributes in Medical Data Mining’, in 2009 International Conference on Machine Learning and Cybernetics, July 12, 2009 - July 15, 2009 (Baoding, China: IEEE Computer Society, 2009), pp. 1694–99.
J. H. Ang, S. U. Guan, K. C. Tan, and A. Al Mamun, ‘Interference-Less Neural Network Training’, Neurocomputing, 71 (2008), 3509–24.
S. U. Guan, and J. Liu, ‘Incremental Ordered Neural Network Training’, Journal of Intelligent Systems, 12 (2002), 137–72.
S. U. Guan, and J. Liu, ‘Feature Selection for Modular Networks Based on Incremental Training’, Journal of Intelligent Systems, 14 (2005), 353–83.
S. U. Guan, J. Liu, and Y. Qi, ‘An incremental approach to contribution-based feature selection’, Journal of Intelligent Systems, 13(2004), 15–44.
S. U. Guan, and J. H. Ang, ‘Incremental Training Based on Input Space Partitioning and Ordered Attribute Presentation with Backward Elimination’, Journal of Intelligent Systems, 14 (2005), 321–51.
S. Guo, S. U. Guan, W. Li, et al, ‘Input Space Partitioning for Neural Network Learning’, International Journal of Applied Evolutionary Computation (IJAEC), 4(2013), 56–66.
S. U. Guan, S.C. Li, ‘Parallel growing and training of neural networks using output parallelism’, IEEE Trans Neural Netw, 13(2002), 542–550.
S. U. Guan, P. Li, ‘Incremental learning in terms of output attributes’, Journal of Intelligent Systems, 13(2002), 95–122.
S. U. Guan, C. Bao, T. Neo, ‘Reduced pattern training based on task decomposition using pattern distributor’, IEEE Trans Neural Netw, 18(2007), 1738–1749.
C. Bao, T. Neo, S. U. Guan, ‘Reduced pattern training in pattern distributor networks’, J Res Pract Inf Technol, 39(2007), 273–286.
R.K. Agrawal, R. Bala ,’Incremental Bayesian classification for multivariate normal distribution data’, Pattern Recognition Letters, 29(2008):1873–1876.
T. Wang, S. U. Guan, and F. Liu, ‘Feature Discriminability for Pattern Classification Based on Neural Incremental Attribute Learning’, in Foundations of Intelligent Systems: Proceedings of the Sixth International Conference on Intelligent Systems and Knowledge Engineering, Shanghai, China, Dec 2011 (ISKE2011) (Tiergartenstrasse 17, Heidelberg, D-69121, Germany: Springer Verlag, 2011), pp. 275–80.
T. Wang, S. U. Guan, and F. Liu, ‘Correlation-Based Feature Ordering for Classification Based on Neural Incremental Attribute Learning’, International Journal of Machine Learning and Computing, 2 (2012), 807–11.
T. Wang, S. U. Guan, and F. Liu, ‘Entropic Feature Discrimination Ability for Pattern Classification Based on Neural Ial’, in 9th International Symposium on Neural Networks, ISNN 2012, July 11, 2012 - July 14, 2012 (Shenyang, China: Springer Verlag, 2012), pp. 30–37.
T. Wang, S. U. Guan, T. O. Ting, K. L. Man, and F. Liu, ‘Evolving Linear Discriminant in a Continuously Growing Dimensional Space for Incremental Attribute Learning’, in 9th IFIP International Conference on Network and Parallel Computing, NPC 2012, September 6, 2012 - September 8, 2012 (Gwangju, Korea, Republic of: Springer Verlag, 2012), pp. 482–91.
T. Wang, and Y. Q. Wang, ‘Pattern Classification with Ordered Features Using Mrmr and Neural Networks’, in 2010 International Conference on Information, Networking and Automation, ICINA 2010, October 17, 2010 - October 19, 2010 (Kunming, China: IEEE Computer Society, 2010), pp. V2128–V31.
T. Wang, and S. U. Guan, ‘Feature Ordering for Neural Incremental Attribute Learning Based on Fisher’s Linear Discriminant’, in Intelligent Human-Machine Systems and Cybernetics (IHMSC), 2013 5th International Conference on, 2013), pp. 507–10.
H. Peng, F. Long, and C. Ding, ‘Feature Selection Based on Mutual Information: Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy’, IEEE Transactions on Pattern Analysis and Machine Intelligence, 27 (2005), 1226–38.
N. Japkowicz,and M. Shah, Evaluating Learning Algorithms: A Classification Perspective, Cambridge University Press, (2011).
L. Prechelt, ‘PROBEN1: A set of neural network benchmark problems and benchmarking rules’, Technical Report 21/94, Department of Informatics,University of Karlsruhe, Germany,(1994).
M. Riedmiller, and H. Braun, A direct adaptive method for faster backpropagation learning: the RPROP algorithm’, in Proceedings of the IEEE International Conference on Neural Networks, (1993), 586–591.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/), which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Liu, F., Wang, T., Guan, SU. et al. Neural Incremental Attribute Learning in Groups. Int J Comput Intell Syst 8, 490–501 (2015). https://doi.org/10.1080/18756891.2015.1023587
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1080/18756891.2015.1023587