Classification of Activities of Daily Living Based on Grasp Dynamics Obtained from a Leap Motion Controller - PubMed Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Oct 28;22(21):8273.
doi: 10.3390/s22218273.

Classification of Activities of Daily Living Based on Grasp Dynamics Obtained from a Leap Motion Controller

Affiliations

Classification of Activities of Daily Living Based on Grasp Dynamics Obtained from a Leap Motion Controller

Hajar Sharif et al. Sensors (Basel). .

Abstract

Stroke is one of the leading causes of mortality and disability worldwide. Several evaluation methods have been used to assess the effects of stroke on the performance of activities of daily living (ADL). However, these methods are qualitative. A first step toward developing a quantitative evaluation method is to classify different ADL tasks based on the hand grasp. In this paper, a dataset is presented that includes data collected by a leap motion controller on the hand grasps of healthy adults performing eight common ADL tasks. Then, a set of features with time and frequency domains is combined with two well-known classifiers, i.e., the support vector machine and convolutional neural network, to classify the tasks, and a classification accuracy of over 99% is achieved.

Keywords: Leap Motion Controller; activities of daily living; hand grasps classification.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflict of interest.

Figures

Figure 2
Figure 2
Leap Motion Controller connected to a computer that runs the Leap Motion Visualizer software showing the hands on top of the LMC camera [51].
Figure 3
Figure 3
Experimental setup (a) and hand model in the global coordinate system (b).
Figure 4
Figure 4
LMC’s interaction zone [53].
Figure 1
Figure 1
Stroke timeline [3].
Figure 5
Figure 5
ADL tasks [54].
Figure 6
Figure 6
Hand joints and palm center [55].
Figure 7
Figure 7
Hand coordinate system [56].
Figure 8
Figure 8
Leap Motion Controller frame of reference [57].
Figure 9
Figure 9
Proposed CNN architecture [54].
Figure 10
Figure 10
Confusion matrices for sample combinations of features and classifiers. All values were obtained through 5-fold cross validation and are presented as percentages (%).

Similar articles

Cited by

References

    1. Cramer S.C., Nelles G., Benson R.R., Kaplan J.D., Parker R.A., Kwong K.K., Kennedy D.N., Finklestein S.P., Rosen B.R. A functional MRI study of subjects recovered from hemiparetic stroke. Stroke. 1997;28:2518–2527. doi: 10.1161/01.STR.28.12.2518. - DOI - PubMed
    1. Hatem S.M., Saussez G., Della Faille M., Prist V., Zhang X., Dispa D., Bleyenheuft Y. Rehabilitation of motor function after stroke: A multiple systematic review focused on techniques to stimulate upper extremity recovery. Front. Hum. Neurosci. 2016;10:442. doi: 10.3389/fnhum.2016.00442. - DOI - PMC - PubMed
    1. Langhorne P., Bernhardt J., Kwakkel G. Stroke rehabilitation. Lancet. 2011;377:1693–1702. doi: 10.1016/S0140-6736(11)60325-5. - DOI - PubMed
    1. [(accessed on 12 July 2017)]. Available online: http://www.strokeassociation.org/STROKEORG/AboutStroke/Impact-of-Stroke-....
    1. Duruoz M.T. Hand Function. Springer; Berlin/Heidelberg, Germany: 2016. - DOI