A Comparative Study on Using Zernike Velocity Moments and Hidden Markov Models for Hand Gesture Recognition | SpringerLink
Skip to main content
Springer Nature Link
Log in

A Comparative Study on Using Zernike Velocity Moments and Hidden Markov Models for Hand Gesture Recognition

  • Conference paper
Articulated Motion and Deformable Objects (AMDO 2008)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 5098))

Included in the following conference series:

Abstract

Hand-gesture recognition presents a challenging problem for computer vision due to the articulated structure of the human hand and the complexity of the environments in which it is typically applied. Solving such a problem requires a robust tracking mechanism which in turn depends on an effective feature descriptor and classifier. Moment invariants, as discriminative feature descriptors, have been used for shape representation for many years. Zernike moments have been particularly attractive for their scale, translation and rotation invariance. More recently, Zernike moments have been extended to a spatio-temporal descriptor, known as the Zernike velocity moment, through combining with the displacement vector of the centre of mass of the target object between video frames. This descriptor has hitherto been demonstrated successfully in human gait analysis. In this paper, we introduce and evaluate the application of Zernike velocity moments in hand-gesture recognition, and compare with a bank of hidden Markov models with Zernike moments as observations. We demonstrate good performance for both approaches, with a substantial increase in performance for the latter method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Wu, Y., Huang, T.S.: Human Hand Modeling, Analysis and Animation in the Context of HCI. In: IEEE International Conference Image Processing, Kobe, Japan (1999)

    Google Scholar 

  2. Yuan, Q., Sclaroff, S., Athitsos, V.: Automatic 2D Hand Tracking in Video Sequences. In: IEEE Workshop on Applications of Computer Vision (2005)

    Google Scholar 

  3. Park, H., Kim, E., Jang, S., Kim, H.: An HMM Based Gesture Recognition for Perceptual User Interface. In: Advances in Multimedia Information Processing, pp. 1027–1034 (2004)

    Google Scholar 

  4. Carbini, S., Viallet, J.E., Bernier, O.: Pointing Gesture Visual Recognition for Large Display. In: International Conference of Pattern Recognition. IEEE Computer Society Press, Los Alamitos (2004)

    Google Scholar 

  5. Sepehri, A., Yacoob, Y., Davis, L.S.: Parametric Hand Tracking for Recognition of Virtual Drawings. In: Proceeding of the fourth IEEE International Conference on Computer Vision Systems. IEEE Computer Society Press, Los Alamitos (2006)

    Google Scholar 

  6. Hu, M.: Visual Pattern Recognition by Moment Invariants. IEEE Transactions On Information Theory 8, 179–187 (1962)

    Google Scholar 

  7. Shutler, J.D., Nixon, M.S.: Zernike velocity moments for sequence-based description of moving features. Image and Vision Computing 24, 343–356 (2006)

    Article  Google Scholar 

  8. Heap, A.: Learning deformable shapes models for object tracking. In: Computing School Leeds, University of Leeds (1998)

    Google Scholar 

  9. Athitsos, V., Sclaroff, S.: An Appearance-based Framework for 3D Hand Shape Classification and Camera Viewpoint Estimation. In: Fifth IEEE International Conference Proceedings on Automatic Face and Gesture Recognition, vol. 1, IEEE Computer Society Press, Los Alamitos (2002)

    Google Scholar 

  10. Sudderth, E.B., Mandel, M.I., Freeman, W.T., Willsky, A.S.: Visual Hand Tracking Using Nonparametric Belief Propagation. In: Conference on Computer Vision and Pattern Recognition Workshop. IEEE Computer Society Press, Los Alamitos (2004)

    Google Scholar 

  11. Ahn, S.C., Lee, T., Kim, I., Kwon, Y., Kim, H.: Large Display Interaction Using Video Avatar and Hand Gesture Recognition. In: Campilho, A.C., Kamel, M. (eds.) ICIAR 2004. LNCS, vol. 3211, pp. 261–268. Springer, Heidelberg (2004)

    Google Scholar 

  12. Pham, Q., Gond, L., Begard, J., Allezard, N., Sayd, P.: Real-Time Posture Analysis in a Crowd using Thermal Imaging. In: IEEE Conference on Computer Vision and Pattern Recognition CVPR 2007. IEEE Computer Society Press, Los Alamitos (2007)

    Google Scholar 

  13. Ng, C.W., Ranganath, S.: Gesture Recognition via Pose Classification. In: 15th International Conference on Pattern Recognition, vol. 3. IEEE Computer Society Press, Los Alamitos (2000)

    Google Scholar 

  14. Bailey, R., Srinath, M.: Orthogonal Moment Features for Use with Parametric and Non-Parametric Classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 18, 389–399 (1996)

    Article  Google Scholar 

  15. Hse, H., Newton, A.R.: Sketched Symbol Recognition using Zernike Moments. In: 17th International Conference on Pattern Recognition (ICPR 2004), vol. 1. IEEE Computer Society Press, Los Alamitos (2004)

    Chapter  Google Scholar 

  16. Shutler, J.D., Nixon, M.S.: Zernike velocity moments for the description and recognition of moving shapes. In: Proceeding of British Machine Vision Conference BMVC, Manchester, vol. 2 (2001)

    Google Scholar 

  17. Jones, M.J., Rehg, J.M.: Statistical Color Models with Application to Skin Detection. International Journal of Computer Vision, 81–96 (2002)

    Google Scholar 

  18. Bradski, G.R.: Computer Vision Face Tracking For Use in a Perceptual User Interface. Intel Technology Journal (1998)

    Google Scholar 

  19. François, A.R.J.: CAMSHIFT Tracker Design Experiments with Intel OpenCV and SAI. Institute for Robotics and Intelligent Systems IRIS-04-423 (2004)

    Google Scholar 

  20. Frank, E., Wang, Y., Inglis, S., Holmes, G., Witten, I.H.: Using Model Trees for Classification, Department of Computer Science. University of Waikato, Hamilton, New Zealand (1998)

    Google Scholar 

  21. University of Waikato, Weka 3: Data Mining Software in Java (Accessed April 2008), http://www.cs.waikato.ac.nz/~ml/weka/

  22. Murphy, K.: Hidden Markov Model (HMM) Toolbox for Matlab (Accessed April 2008), http://www.cs.ubc.ca/~murphyk/Software/HMM/hmm.html

  23. Rabiner, L.R.: A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. IEEE Transactions on Information Theory 77, 257–286 (1989)

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Vision Group, School of Computing, University of Leeds, 7.27 E.C. Stoner Building, School of Computing, University of Leeds, Leeds, LS2 9JT, UK

    Moaath Al-Rajab, David Hogg & Kia Ng

Authors
  1. Moaath Al-Rajab
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. David Hogg
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kia Ng
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Francisco J. Perales Robert B. Fisher

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Al-Rajab, M., Hogg, D., Ng, K. (2008). A Comparative Study on Using Zernike Velocity Moments and Hidden Markov Models for Hand Gesture Recognition. In: Perales, F.J., Fisher, R.B. (eds) Articulated Motion and Deformable Objects. AMDO 2008. Lecture Notes in Computer Science, vol 5098. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-70517-8_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-70517-8_31

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-70516-1

  • Online ISBN: 978-3-540-70517-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics