Abstract
Facial expression recognition is a challenging problem in computer vision as changes in the background and location of the same person may also lead to difficulties in the recognition. In order to improve the poor effect of facial expression recognition algorithms due to it’s easy to be affected by illumination and posture in real life environment, a facial expression recognition algorithm based on CLBP and convolutional neural network is proposed. The algorithm uses HOG feature and Adaboost algorithm to cut out images with face and eyes, extracts CLBP fusion feature images, constructs a seven-layer convolutional neural network model with two convolutional and pooling layers, two full connection layers and one Softmax classification layer to recognize six expressions of anger, aversion, fear, happiness, sadness and surprise. Four sets of comparative experiments are designed on the public data set CK+, a recognition rate of 98.60% is achieved, better than the existing mainstream methods.
This research has been financially supported by grants from the Hebei Provincial Education Department Youth Fund (No. QN2018095)
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ekman, P., Friesen, W.V.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)
Xie, X., Yuan, T., Zhou, X., Cheng, X.: Research on trust model in container-based cloud service. CMC: Comput. Mater. Continua 56(2), 273–283 (2018)
Wang, B., et al.: Research on hybrid model of garlic short-term price forecasting based on Big Data. CMC: Comput. Mater. Continua 57(2), 283–296 (2018)
Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)
Praseeda Lekshmi, V., Sasikumar, M.: Analysis of facial expression using Gabor and SVM. Int. J. Recent Trends Eng. 1(2), 47–50 (2009)
Choi, S.E., Lee, Y.J., Lee, S.J., Park, K.R., Kim, J.: Age estimation using a hierarchical classifier based on global and local facial features. Pattern Recognit. 44(6), 1262–1281 (2011)
Krahenbuhl, P., Doersch, C., Donahue, J., Darrell, T.: Data-dependent initializations of convolutional neural networks. In: International Conference on Computer Vision, pp. 1–12, November 2015. http://arxiv.org/abs/1511.06856
LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition, vol. 86, no. 11, pp. 2278–2324 (1998)
Dahmane, M., Meunier, J.: Emotion recognition using dynamic grid-based HoG features. In: IEEE International Conference on Automatic Face & Gesture Recognition and Workshops, pp. 884–888. IEEE (2011)
Yang, J., Zhang, D.D., Frangi, A.F., et al.: Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 26(1), 131–137 (2004)
Wang, X., Han, T.X., Yan, S.: An HOG-LBP human detector with partial occlusion handling. In: IEEE, International Conference on Computer Vision, pp. 32–39. IEEE (2009)
Shan, C., Gong, S., Mcowan, P.W.: Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis. Comput. 27(6), 803–816 (2009)
Lucey, P., Cohn, J.F., Kanade, T., et al.: The extended Cohn-Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression. In: Computer Vision and Pattern Recognition Workshops, pp. 94–101. IEEE (2010)
Georgescu, M.I., Ionescu, R.T., Popescu, M.: Local learning with deep and handcrafted features for facial expression recognition (2018)
Kahou, S.E., Michalski, V., Konda, K., et al.: Recurrent neural networks for emotion recognition in video. In: ACM International Conference on Multimodal Interaction, pp. 467–474. ACM (2015)
Levi, G., Hassner, T.: Emotion recognition in the wild via convolutional neural networks and mapped binary patterns. In: ACM on International Conference on Multimodal Interaction, pp. 503–510. ACM (2015)
Zhu, J., Zou, H., Rosset, S., et al.: Multi-class AdaBoost. Stat. Interface 2(3), 349–360 (2006)
Guo, Z., Zhang, L., Zhang, D.: A completed modeling of local binary pattern operator for texture classification. IEEE Trans. Image Process. 19(16), 1657–1663 (2010)
Simard, P., LeCun, Y., et al.: Efficient pattern recognition using a new transformation distance. In: Advances in Neural Information Processing Systems, pp. 50–58. DBLP (1992)
Zhang, J., Lin, W., Dong, Y., et al.: A double-layer interpolation method for implementation of BEM analysis of problems in potential theory. Appl. Math. Model. 51, 250–269 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Yu, P., Nie, Y., Cao, N., Higgs, R. (2019). Facial Expression Recognition Based on Complete Local Binary Pattern and Convolutional Neural Network. In: Sun, X., Pan, Z., Bertino, E. (eds) Artificial Intelligence and Security. ICAIS 2019. Lecture Notes in Computer Science(), vol 11632. Springer, Cham. https://doi.org/10.1007/978-3-030-24274-9_51
Download citation
DOI: https://doi.org/10.1007/978-3-030-24274-9_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-24273-2
Online ISBN: 978-3-030-24274-9
eBook Packages: Computer ScienceComputer Science (R0)