Extraction Algorithm of Key Actions in Continuous and Complex Sign Language
Computer Science

Computer Science ›› 2018, Vol. 45 ›› Issue (11A): 189-193.

• Pattem Recognition & Image Processing • Previous Articles     Next Articles

Extraction Algorithm of Key Actions in Continuous and Complex Sign Language

XU Xin-xin1, HUANG Yuan-yuan1, HU Zuo-jin2   

  1. Institute of Computer Science and Technology,Nanjing University of Aeronautics & Astronautics,Nanjing 210016,China1
    Institute of Math and Information Science,Nanjing Normal University of Special Education,Nanjing 210038,China2
  • Online:2019-02-26 Published:2019-02-26

PDF (PC)

1165

Abstract: An algorithm of extracting key actions in sign language was brought out in this paper.In the continuous and complex sign language,the number of key actions is small and the state is relatively stable.Thus using the key actions to construct the data model of the sign language will reduce the unstable factors and improve the accuracy.In this paper,an adaptive classification algorithm was proposed,which extracts the key actions step by step according to the time order and the irrelevance among the key actions.Experiments show that the algorithm can be used for the non-specific population.Moreover,the algorithm can extract all the key actions from both the single vocabulary and the continuous sentence.Key actions can be regarded as primitives of sign language,and thus sign language can be looked upon as different combinations of those primitives as well.Therefore,as for the continuous and complex sign language,the extraction of key actions has important significance not only for the data model construction,but also for its recognition.

Key words: Continuous and complex sign language, Key actions, Motion-control device, Sign language recognition

CLC Number: 

  • TP391.41
[1]KAUR H,RANI J.A review:Study of various techniques of Hand gesture recognition[C]∥IEEE International Conference on Power Electronics,Intelligent Control and Energy Systems.IEEE,2017:1-5.
[2]HAN Y.A Low-Cost Visual Motion Data Glove as an Input De-vice to Interpret Human Hand Gestures[J].IEEE Transactions on Consumer Electronics,2010,56(2):501-509.
[3]OZ C,MING C L.American Sign Language word recognition with a sensory glove using artificial neural networks[J].Engineering Applications of Artificial Intelligence,2011,24(7):1204-1213.
[4]TUNTAKURN A,THONGVIGITMANEE S S,SA-ING V,et al.Natural interactive 3D medical image viewer based on finger and arm gestures[C]∥Biomedical Engineering International Conference.IEEE,2013:1-5.
[5]HUSSAIN I,TALUKDAR A K,SARMA K K.Hand gesture recognition system with real-time palm tracking[C]∥India Conference.IEEE,2015:1-6.
[6]李长龙.基于Kinect深度图像的手势识别研究[D].成都:西华大学,2014.
[7]HEO G,LEE D W,SHIN H C,et al.Hand segmentation and fingertip detection for interfacing of stereo vision-based smart glasses[C]∥IEEE International Conference on Consumer Electronics.IEEE,2015:585-586.
[8]ZHAO F,LIU Z,YUXIANG L.Gesture recognition based on Kinect skeleton information[J].China Sciencepaper,2015(20).
[9]BISWAS K K,BASU S K.Gesture recognition using Microsoft Kinect?[C]∥International Conference on Automation,Robo-tics and Applications.IEEE,2012:100-103.
[10]ARICI T,CELEBI S,AYDIN A S,TEMIZ T T,et al.Robust gesture recognition using feature pre-processing and weighted dynamic time warping[J].Multimedia Tools & Applications,2014,72(3):3045-3062.
[11]STARNER T,PENTL A.Visual Recognition of American Sign Language Using Hidden Markov Models[C]∥Proc.IEEE International Workshop on Automatic Face & Gesture Recognition.1995:189-194.
[12]LI S,OKUDA M,TAKAHASHI S.Embedded Key-Frame Extraction for CG Animation by Frame Decimation[C]∥IEEE International Conference on Multimedia and Expo.IEEE,2005:1404-1407.
[13]李姝蓉,黄元元,胡作进,等.非特定人群动态手语视频中的关键帧检测算法[J].小型微型计算机系统,2015,36(7):1597-1601.
[14]梁文乐,黄元元,胡作进.基于二级匹配策略的实时动态手语识别[J].计算机科学,2017,44(7):299-303.
[15]中国残疾人联合会教育就业部,中国聋人协会.中国手语[M].华夏出版社,2003.
[16]石曼曼.面向非特定人群的动态手语语句识别系统研究与实现[D].南京:南京航空航天大学,2017.
[1] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[2] GUO Dan, TANG Shen-geng, HONG Ri-chang, WANG Meng. Review of Sign Language Recognition, Translation and Generation [J]. Computer Science, 2021, 48(3): 60-70.
[3] RAN Meng-yuan, LIU Li, LI Yan-de, WANG Shan-shan. Deaf Sign Language Recognition Based on Inertial Sensor Fusion Control Algorithm [J]. Computer Science, 2021, 48(2): 231-237.
[4] LI Chen, HUANG Yuan-yuan, HU Zuo-jin. Continuous Sign Language Sentence Recognition Based on Double Transfer Probability of Key Actions [J]. Computer Science, 2019, 46(11A): 299-302.
[5] JIANG Xian-wei, ZHANG Miao-xian, ZHU Zhao-song. Recognition of Chinese Finger Sign Language Based on Gray Level Co-occurrence Matrix and Fine Gaussian Support Vector Machine [J]. Computer Science, 2019, 46(11A): 303-308.
[6] GUO Xin-peng, HUANG Yuan-yuan and HU Zuo-jin. Research on Continuous Sign Language Sentence Recognition Algorithm Based on Key Frame [J]. Computer Science, 2017, 44(Z11): 178-183.
[7] LIANG Wen-le, HUANG Yuan-yuan and HU Zuo-jin. Real-time Dynamic Sign Language Recognition Based on Hierarchical Matching Strategy [J]. Computer Science, 2017, 44(7): 299-303.
[8] YANG Quan and PENG Jin-ye. Chinese Sign Language Recognition Research Using SIFT-BoW and Depth Image Information [J]. Computer Science, 2014, 41(2): 302-307.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.