Facial Expression Recognition Using Improved Local Binary Pattern and Min-Max Similarity with Nearest Neighbor Algorithm | SpringerLink
Skip to main content

Facial Expression Recognition Using Improved Local Binary Pattern and Min-Max Similarity with Nearest Neighbor Algorithm

  • Conference paper
  • First Online:
Smart Innovations in Communication and Computational Sciences

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1168))

  • 695 Accesses

Abstract

In human-to-human interaction, important role is played by facial expression recognition (FER). Various modes of understanding and expressions out of verbal world are allowed by this. In many applications, it is a challenging task to analyze human facial expression automatically. For better human machine interaction, robust facial expression recognition (FER) system is proposed in this work. In this work, improved local binary patterns (ILBPs) and min-max similarity with nearest neighbor (MMSNN) algorithm are proposed for efficient training and recognition. Initially, the face detection is performed using Haar classifier method. From images, useful information is extracted by applying improved local binary pattern (ILBP) method. Finally, min-max similarity with nearest neighbor (MMSNN) algorithm is applied to train various expressions of face. Traditional methods are used to make a performance comparison of proposed MMSNN method. Mean recognition rate is achieved by proposed method, which shows its ability in comparison with existing methods. With respect to accuracy, f-measure, recall, and precision, better results are produced by the proposed MMSNN method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 17159
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 21449
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Samantaray, R.K., Panda, S., Pradhan, D.: Application of digital image processing and analysis in healthcare based on medical palmistry. IJCA Spec. Issue Intell. Syst. Data Process., 56–59 (2011)

    Google Scholar 

  2. Zilu, Y., Jingwen, L., Youwei, Z.: Facial expression recognition based on two dimensional feature extraction. In: ICSP2008, Beijing, pp. 1440–1444, May 2008

    Google Scholar 

  3. Yu, Z., Zhang, C.: Image based static facial expression recognition with multiple deep network learning. In: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction. ACM (2015)

    Google Scholar 

  4. Zilu, Y., Xieyan, F.: Combining LBP and AdaBoost for facial expression. In: Proceedings of the 9th International Conference on Signal Processing (2008)

    Google Scholar 

  5. Wang, X., Liu, X., Lu, L., Shen, Z.: A new facial expression recognition method based on geometric alignment and LBP features. In: 2014 IEEE 17th International Conference on Computational Science and Engineering, pp. 1734–1737, Dec 2014

    Google Scholar 

  6. Azcarate, A., et al.: Automatic facial emotion recognition. Universiteit van Amsterdam, 1–6 (2005)

    Google Scholar 

  7. Kumari, J., Rajesh, R., Kumar, A.: Fusion of features for the effective facial expression recognition. In: 2016 International Conference on Communication and Signal Processing (ICCSP), Melmaruvathur, pp. 0457–0461 (2016)

    Google Scholar 

  8. Ekweariri, A.N., Yurtkan, K.: Facial expression recognition using enhanced local binary patterns. In: 2017 9th International Conference on Computational Intelligence and Communication Networks (CICN). IEEE (2017)

    Google Scholar 

  9. Fernandes, J.d.A., Matos, L.N., Aragão, M.G.d.S.: Geometrical approaches for facial expression recognition using support vector machines. In: 2016 29th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Sao Paulo, Brazil, pp. 347–354 (2016)

    Google Scholar 

  10. Krestinskaya, O., James, A.P.: Facial emotion recognition using Min-Max similarity classifier. In: 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI). IEEE (2017)

    Google Scholar 

  11. Wilson, P.I., Fernandez, J.: Facial feature detection using Haar classifiers. J. Comput. Sci. Coll. 21(4), 127–133 (2006)

    Google Scholar 

  12. Levi, G., Hassner, T.: Emotion recognition in the wild via convolutional neural networks and mapped binary patterns. In: Proceedings of the 2015 ACM International, pp. 503–510 (2015)

    Google Scholar 

  13. Singh, S., Kaur, A., dir, T.: A face recognition technique using local binary pattern method. IJARCCE 4, 165–168 (2015)

    Google Scholar 

  14. López, L.S.: Local binary patterns applied to face detection and recognition. Mach. Learn. (2010)

    Google Scholar 

  15. Qamar, A.M., et al.: Similarity learning for nearest neighbor classification. In: 2008 Eighth IEEE International Conference on Data Mining. IEEE (2008)

    Google Scholar 

  16. Lucey, P., Cohn, J.F., Kanade, T., et al.: The extended Cohn–Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog. Workshops 36(1), 94–101 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Neeraj Varshney .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mohan, N., Varshney, N. (2021). Facial Expression Recognition Using Improved Local Binary Pattern and Min-Max Similarity with Nearest Neighbor Algorithm. In: Tiwari, S., Trivedi, M., Mishra, K., Misra, A., Kumar, K., Suryani, E. (eds) Smart Innovations in Communication and Computational Sciences. Advances in Intelligent Systems and Computing, vol 1168. Springer, Singapore. https://doi.org/10.1007/978-981-15-5345-5_28

Download citation

Publish with us

Policies and ethics