Abstract
Labelled data are not only time consuming but often expensive and difficult to procure as it involves skilful inputs by humans to tag and annotate. Contrary to this unlabelled data is comparatively easier to procure but fewer methods exist to optimally use them. Semi-Supervised Learning overcomes this problem and assists to build better classifiers by using unlabelled data along with sufficient labelled data and may actually yield higher accuracy with considerably less human input effort. But if the labelled data set is inadequate in size then the Semi-Supervised techniques are also stuck. We propose a novel framework where the small labelled dataset is appropriately augmented using the intelligent learning mechanisms of artificial immune systems to train the proposed model. The model retrains with the unlabelled data to fortify the learning mechanism. We show that the generative deep framework utilizing artificial immune system principles provides a highly competitive approach for learning in the semi-supervised environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bhalla, V., Chaudhury, S.: Artificial immune hybrid photo album classifier. In: Proceedings of International Conference on Computer Vision and Image Processing CVIP 2016, vol. 1 (2016)
Bhalla, V., Chaudhury, S., Jain, A.: A novel hybrid cnn-ais visual pattern recognition engine, pp. 215–224. Springer International Publishing, Cham (2015)
Culp, M., Michailidis, G.: An iterative algorithm for extending learners to a semi-supervised setting. J. Comput. Graph. Stat. 17(3), 545–571 (2008)
De Castro, L.N., Von Zuben, F.J.: Learning and optimization using the clonal selection principle. IEEE Trans. Evol. Comput. 6(3), 239–251 (2002)
Fergus, R., Weiss, Y., Torralba, A.: Semi-supervised learning in gigantic image collections. In: Bengio, Y., Schuurmans, D., Lafferty, J.D., Williams, C.K.I., Culotta, A. (eds.) Advances in Neural Information Processing Systems 22, Curran Associates, Inc., pp. 522–530 (2009)
Glorot, X., Bordes, A., Bengio, Y.: Domain adaptation for large-scale sentiment classification: a deep learning approach. In: Getoor, L., Scheffer, T. (eds.) ICML, Omnipress, pp. 513–520 (2011)
Jiao, L.C., Shang, F., Wang, F., Liu, Y.: Fast semi-supervised clustering with enhanced spectral embedding. Pattern Recogn. 45(12), 4358–4369 (2012)
Kingma, D.P., Mohamed, S., Rezende, D.J., Welling, M.: Semi-supervised learning with deep generative models. In: Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.D., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems 27, Curran Associates, Inc., pp. 3581–3589 (2014)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp. 1097–1105 (2012)
Lee, C.H., Liu, C.L., Hsaio, W.H., Gou, F.S.: Semi-supervised linear discriminant clustering. IEEE Trans. Cybern. 44(7), 9891000 (July 2014)
Liu, T., Rosenberg, C., Rowley, H.A.: Clustering billions of images with large scale nearest neighbor search (2007)
Maeireizo, B., Litman, D., Hwa, R.: Co-training for predicting emotions with spoken dialogue data. In: Proceedings of the ACL 2004 on Interactive Poster and Demonstration Sessions (Stroudsburg, PA, USA), ACLdemo ’04, Association for Computational Linguistics (2004)
Ororbia II, A.G., Reitter, D., Wu, J., Lee Giles, C.: Online learning of deep hybrid architectures for semi-supervised categorization. In: Machine Learning and Knowledge Discovery in Databases—European Conference, ECML PKDD, Porto, Portugal, September 7–11, 2015. Proceedings, Part I, 2015, pp. 516–532 (2015)
Pitelis, N., Russell, C., Agapito,L.: Semi-supervised Learning Using an Unsupervised Atlas, pp. 565–580. Springer, Berlin, Heidelberg (2014)
Riloff, E., Wiebe, J., Wilson, T.: Learning subjective nouns using extraction pattern bootstrapping. In: Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003, vol. 4 (Stroudsburg, PA, USA), CONLL ’03, Association for Computational Linguistics, pp. 25–32 (2003)
Rosenberg, C., Hebert, M., Schneiderman, H.: Semi-supervised self-training of object detection models. In: WACV/MOTION, pp. 29–36. IEEE Computer Society (2005)
Tuzel, O., Anand, S., Mittal, S., Meer, P.: Semi-supervised kernel mean shift clustering. IEEE Trans. Pattern Anal. Mach. Intell. 36(6), 1201–1215 (June 2014)
Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P.-A.: Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11, 3371–3408 (2010)
Wang, D., Gao, X., Wang, X.: Semi-supervised nonnegative matrix factorization via constraint propagation. IEEE Trans. Cybern. 46(1), 233–244 (2016)
Xiong, S., Azimi, J., Fern, X.Z.: Active learning of constraints for semi-supervised clustering. IEEE Trans. Knowl. Data Eng. 26(1), 43–54 (2013)
Zeng, H., Cheung, Y.-M.: Semi-supervised maximum margin clustering with pairwise constraints. IEEE Trans. Knowl. Data Eng. 24(5), 926–939 (2012)
Zhang, J., Tian, G., Mu, Y., Fan, W.: Supervised deep learning with auxiliary networks. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (New York, NY, USA), KDD ’14, pp. 353–361. ACM (2014)
Zheng, L., Li, T.: Semi-supervised hierarchical clustering. In: Proceedings of the IEEE 11th International Conference on Data Mining, p. 982991 (2011)
Zhu, X.: Semi-supervised learning literature survey. Technical Report 1530, Computer Sciences, University of Wisconsin-Madison (2005)
Zhu, X., Goldberg, A.B., Brachman, R., Dietterich, T.: Introduction to Semi-supervised Learning. Morgan and Claypool Publishers (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Bhalla, V., Chaudhury, S. (2020). Integrated Semi-Supervised Model for Learning and Classification. In: Chaudhuri, B., Nakagawa, M., Khanna, P., Kumar, S. (eds) Proceedings of 3rd International Conference on Computer Vision and Image Processing. Advances in Intelligent Systems and Computing, vol 1022. Springer, Singapore. https://doi.org/10.1007/978-981-32-9088-4_16
Download citation
DOI: https://doi.org/10.1007/978-981-32-9088-4_16
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-32-9087-7
Online ISBN: 978-981-32-9088-4
eBook Packages: EngineeringEngineering (R0)