{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,2]],"date-time":"2024-08-02T21:09:57Z","timestamp":1722632997482},"reference-count":59,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,12,19]],"date-time":"2019-12-19T00:00:00Z","timestamp":1576713600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"EC SENSIBLE","award":["734331"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"With increased demand for tele-rehabilitation, many autonomous home-based rehabilitation systems have appeared recently. Many of these systems, however, suffer from lack of patient acceptance and engagement or fail to provide satisfactory accuracy; both are needed for appropriate diagnostics. This paper first provides a detailed discussion of current sensor-based home-based rehabilitation systems with respect to four recently established criteria for wide acceptance and long engagement. A methodological procedure is then proposed for the evaluation of accuracy of portable sensing home-based rehabilitation systems, in line with medically-approved tests and recommendations. For experiments, we deploy an in-house low-cost sensing system meeting the four criteria of acceptance to demonstrate the effectiveness of the proposed evaluation methodology. We observe that the deployed sensor system has limitations in sensing fast movement. Indicators of enhanced motivation and engagement are recorded through the questionnaire responses with more than 83 % of the respondents supporting the system\u2019s motivation and engagement enhancement. The evaluation results demonstrate that the deployed system is fit for purpose with statistically significant ( \u03f1 c > 0.99 , R 2 > 0.94 , I C C > 0.96 ) and unbiased correlation to the golden standard.<\/jats:p>","DOI":"10.3390\/s20010026","type":"journal-article","created":{"date-parts":[[2019,12,23]],"date-time":"2019-12-23T08:15:01Z","timestamp":1577088901000},"page":"26","source":"Crossref","is-referenced-by-count":8,"title":["Evaluation of Home-Based Rehabilitation Sensing Systems with Respect to Standardised Clinical Tests"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-3433-3757","authenticated-orcid":false,"given":"Ioannis","family":"Vourganas","sequence":"first","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XQ, UK"}]},{"given":"Vladimir","family":"Stankovic","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XQ, UK"}]},{"given":"Lina","family":"Stankovic","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XQ, UK"}]},{"given":"Anna Lito","family":"Michala","sequence":"additional","affiliation":[{"name":"School of Computing Science, University of Glasgow, Glasgow G12 8QQ, UK"}]}],"member":"1968","published-online":{"date-parts":[[2019,12,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e13732","DOI":"10.2196\/13732","article-title":"Factors that contribute to the use of stroke self-rehabilitation technologies: A review","volume":"4","author":"Vourganas","year":"2019","journal-title":"JMIR Biomed. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Orthopaedic Surgeons Panel on Falls Prevention (2001). Guideline for the prevention of falls in older persons. J. Am. Geriatr. Soc., 49, 664\u2013672.","DOI":"10.1046\/j.1532-5415.2001.49115.x"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1109\/RBME.2015.2390646","article-title":"Toward automating clinical assessments: A survey of the timed up and go","volume":"8","author":"Sprint","year":"2015","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1186\/1743-0003-11-83","article-title":"Timed Up & Go as a measure for longitudinal change in mobility after stroke\u2014Postural Stroke Study in Gothenburg (POSTGOT)","volume":"11","author":"Persson","year":"2014","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Dubois, A., Bihl, T., and Bresciani, J.P. (2018). Automating the timed up and go test using a depth camera. Sensors, 18.","DOI":"10.3390\/s18010014"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kitsunezaki, N., Adachi, E., Masuda, T., and Mizusawa, J.I. (2013, January 4\u20135). KINECT applications for the physical rehabilitation. Proceedings of the 2013 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Gatineau, QC, Canada.","DOI":"10.1109\/MeMeA.2013.6549755"},{"key":"ref_7","unstructured":"ScienceDirect (2019, September 17). Human Error. Available online: https:\/\/www.sciencedirect.com\/topics\/engineering\/human-error."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.hkpj.2015.11.001","article-title":"A validation study of a smartphone application for functional mobility assessment of the elderly","volume":"35","author":"Chan","year":"2016","journal-title":"Hong Kong Physiother. J."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Van Lummel, R.C., Walgaard, S., Maier, A.B., Ainsworth, E., Beek, P.J., and van Die\u00ebn, J.H. (2016). The Instrumented Sit-to-Stand Test (iSTS) has greater clinical relevance than the manually recorded sit-to-stand test in older adults. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0157968"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"e6","DOI":"10.2196\/rehab.4102","article-title":"Mobile functional reach test in people who suffer stroke: a pilot study","volume":"2","year":"2015","journal-title":"JMIR Rehabil. Assist. Technol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"559","DOI":"10.2522\/ptj.20070205","article-title":"Usefulness of the Berg Balance Scale in stroke rehabilitation: A systematic review","volume":"88","author":"Blum","year":"2008","journal-title":"Phys. Ther."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1620\/tjem.233.79","article-title":"Validity of the performance-oriented mobility assessment in predicting fall of stroke survivors: a retrospective cohort study","volume":"233","author":"An","year":"2014","journal-title":"Tohoku J. Exp. Med."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1638","DOI":"10.2522\/ptj.20150621","article-title":"Responsiveness of the Balance Evaluation Systems Test (BESTest) in people with subacute stroke","volume":"96","author":"Chinsongkram","year":"2016","journal-title":"Phys. Ther."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1589\/jpts.28.741","article-title":"The sensitivity and specificity of the Falls Efficacy Scale and the Activities-specific Balance Confidence Scale for hemiplegic stroke patients","volume":"30","author":"Park","year":"2018","journal-title":"J. Phys. Ther. Sci."},{"key":"ref_15","first-page":"846418","article-title":"Normative data for the balance error scoring system in adults","volume":"2013","author":"Iverson","year":"2013","journal-title":"Rehabil. Res. Pract."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/j.apmr.2009.10.030","article-title":"5-repetition sit-to-stand test in subjects with chronic stroke: Reliability and validity","volume":"91","author":"Mong","year":"2010","journal-title":"Arch. Phys. Med. Rehabil."},{"key":"ref_17","unstructured":"NHS (2019, September 17). Are You at Risk of a Fall? The Timed Get Up and Go Test. Available online: https:\/\/www.nhs.uk\/Video\/Pages\/timed-get-up-and-go-test.aspx."},{"key":"ref_18","unstructured":"ScienceDirect (2019, September 16). Timed Up and Go Test. Available online: https:\/\/www.sciencedirect.com\/topics\/medicine-and-dentistry\/timed-up-and-go-test."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ibrahim, A., Singh, D.K.A., and Shahar, S. (2017). \u2018Timed Up and Go\u2019test: Age, gender and cognitive impairment stratified normative values of older adults. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0185641"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"27","DOI":"10.5935\/0103-507X.20190006","article-title":"The Five Times Sit-to-Stand Test: safety and reliability with older intensive care unit patients at discharge","volume":"31","author":"Melo","year":"2019","journal-title":"Rev. Bras. Ter. Intensiva"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1097\/01.ASW.0000442876.94332.26","article-title":"A comparative study of the five-times-sit-to-stand and timed-up-and-go tests as measures of functional mobility in persons with and without injection-related venous ulcers","volume":"27","author":"Pieper","year":"2014","journal-title":"Adv. Skin Wound Care"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1109\/TNSRE.2007.891400","article-title":"Technical feasibility of teleassessments for rehabilitation","volume":"15","author":"Durfee","year":"2007","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Skrba, Z., O\u2019Mullane, B., Greene, B.R., Scanaill, C.N., Fan, C.W., Quigley, A., and Nixon, P. (2009, January 3\u20136). Objective real-time assessment of walking and turning in elderly adults. Proceedings of the 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN, USA.","DOI":"10.1109\/IEMBS.2009.5333934"},{"key":"ref_24","unstructured":"Wang, F., Skubic, M., Abbott, C., and Keller, J.M. (September, January 30). Quantitative analysis of 180 degree turns for fall risk assessment using video sensors. Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lohmann, O., Luhmann, T., and Hein, A. (2012, January 4\u20137). Skeleton timed up and go. Proceedings of the 2012 IEEE International Conference on Bioinformatics and Biomedicine, Philadelphia, PA, USA.","DOI":"10.1109\/BIBM.2012.6392610"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kanai, A., Kiyama, S., Goto, H., Tomita, H., Tanaka, A., Kunimi, M., Okada, T., and Nakai, T. (2016). Use of the sit-to-stand task to evaluate motor function of older adults using telemetry. BMC Geriatr., 16.","DOI":"10.1186\/s12877-016-0294-2"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1159\/000381804","article-title":"Kinect-based five-times-sit-to- stand test for clinical and in-home assessment of fall risk in older people","volume":"62","author":"Ejupi","year":"2016","journal-title":"Gerontology"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hellmers, S., Fudickar, S., Lau, S., Elgert, L., Diekmann, R., Bauer, J.M., and Hein, A. (2019). Measurement of the Chair Rise Performance of Older People Based on Force Plates and IMUs. Sensors, 19.","DOI":"10.3390\/s19061370"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1109\/TNSRE.2010.2047606","article-title":"iTUG, a sensitive and reliable measure of mobility","volume":"18","author":"Salarian","year":"2010","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2918","DOI":"10.1109\/TBME.2010.2083659","article-title":"Quantitative falls risk assessment using the timed up and go test","volume":"57","author":"Greene","year":"2010","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1109\/MEMB.2008.919494","article-title":"Quantitative evaluation of movement using the timed up-and-go test","volume":"27","author":"Higashi","year":"2008","journal-title":"IEEE Eng. Med. Biol. Mag."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1016\/j.rehab.2008.10.004","article-title":"The value of instrumental gait analysis in elderly healthy, MCI or Alzheimer\u2019s disease subjects and a comparison with other clinical tests used in single and dual-task conditions","volume":"52","author":"Gillain","year":"2009","journal-title":"Ann. Phys. Rehabil. Med."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hellmers, S., Izadpanah, B., Dasenbrock, L., Diekmann, R., Bauer, J., Hein, A., and Fudickar, S. (2018). Towards an Automated Unsupervised Mobility Assessment for Older People Based on Inertial TUG Measurements. Sensors, 18.","DOI":"10.3390\/s18103310"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"534","DOI":"10.1109\/TBME.2009.2033038","article-title":"Longitudinal falls-risk estimation using triaxial accelerometry","volume":"57","author":"Narayanan","year":"2009","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/j.gaitpost.2013.07.122","article-title":"Sensitivity of sensor-based sit-to-stand peak power to the effects of training leg strength, leg power and balance in older adults","volume":"39","author":"Regterschot","year":"2014","journal-title":"Gait Posture"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1186\/1743-0003-10-86","article-title":"An evaluation of the 30-s chair stand test in older adults: Frailty detection based on kinematic parameters from a single inertial unit","volume":"10","author":"Millor","year":"2013","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2053","DOI":"10.1088\/0967-3334\/35\/10\/2053","article-title":"Classification of frailty and falls history using a combination of sensor-based mobility assessments","volume":"35","author":"Greene","year":"2014","journal-title":"Physiol. Meas."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1093\/gerona\/62.6.636","article-title":"Coordination of strength exertion during the chair-rise movement in very old people","volume":"62","author":"Lindemann","year":"2007","journal-title":"J. Gerontol. Ser. A Biol. Sci. Med. Sci."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1186\/1743-0003-9-75","article-title":"Sit-stand and stand-sit transitions in older adults and patients with Parkinson\u2019s disease: Event detection based on motion sensors versus force plates","volume":"9","author":"Zijlstra","year":"2012","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Tacconi, C., Mellone, S., and Chiari, L. (2011, January 23\u201326). Smartphone-based applications for investigating falls and mobility. Proceedings of the 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops, Dublin, Ireland.","DOI":"10.4108\/icst.pervasivehealth.2011.246060"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Palmerini, L., Mellone, S., Rocchi, L., and Chiari, L. (September, January 30). Dimensionality reduction for the quantitative evaluation of a smartphone-based Timed Up and Go test. Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA.","DOI":"10.1109\/IEMBS.2011.6091814"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1007\/s00391-012-0404-5","article-title":"Smartphone-based solutions for fall detection and prevention: The FARSEEING approach","volume":"45","author":"Mellone","year":"2012","journal-title":"Z. Gerontol. Geriatr."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.1007\/s00779-012-0559-5","article-title":"Elderly frailty detection by using accelerometer-enabled smartphones and clinical information records","volume":"17","author":"Fontecha","year":"2013","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Milosevic, M., Jovanov, E., and Milenkovi\u0107, A. (2013, January 6\u20139). Quantifying Timed-Up-and-Go test: A smartphone implementation. Proceedings of the 2013 IEEE International Conference on Body Sensor Networks, Cambridge, MA, USA.","DOI":"10.1109\/BSN.2013.6575478"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Berrada, D., Romero, M., Abowd, G., Blount, M., and Davis, J. (2007, January 11). Automatic administration of the get up and go test. Proceedings of the 1st ACM SIGMOBILE International Workshop On Systems and Networking Support for Healthcare and Assisted Living Environments, San Juan, Puerto Rico.","DOI":"10.1145\/1248054.1248075"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Austin, D., Hayes, T.L., Kaye, J., Mattek, N., and Pavel, M. (September, January 30). Unobtrusive monitoring of the longitudinal evolution of in-home gait velocity data with applications to elder care. Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA.","DOI":"10.1109\/IEMBS.2011.6091603"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"813","DOI":"10.1109\/TBME.2009.2036732","article-title":"Unobtrusive and ubiquitous in-home monitoring: A methodology for continuous assessment of gait velocity in elders","volume":"57","author":"Hagler","year":"2009","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Frenken, T., Vester, B., Brell, M., and Hein, A. (2011, January 23\u201326). aTUG: Fully-automated timed up and go assessment using ambient sensor technologies. Proceedings of the 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops, Dublin, Ireland.","DOI":"10.4108\/icst.pervasivehealth.2011.245985"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Uddin, M., Khaksar, W., and Torresen, J. (2018). Ambient sensors for elderly care and independent living: A survey. Sensors, 18.","DOI":"10.3390\/s18072027"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Arcelus, A., Goubran, R., Sveistrup, H., Bilodeau, M., and Knoefel, F. (May, January 30). Context-aware smart home monitoring through pressure measurement sequences. Proceedings of the 2010 IEEE International Workshop on Medical Measurements and Applications, Ottawa, ON, Canada.","DOI":"10.1109\/MEMEA.2010.5480223"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"2470","DOI":"10.1109\/JPROC.2013.2262913","article-title":"A survey on ambient intelligence in healthcare","volume":"101","author":"Acampora","year":"2013","journal-title":"Proc. IEEE"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"M780","DOI":"10.1093\/gerona\/56.12.M780","article-title":"Height and body weight in elderly adults: A 21-year population study on secular trends and related factors in 70-year-olds","volume":"56","author":"Dey","year":"2001","journal-title":"J. Gerontol. Ser. A Biol. Sci. Med. Sci."},{"key":"ref_53","unstructured":"Lab, S.R.A. (2019, November 25). Timed Up and Go. Available online: https:\/\/www.sralab.org\/rehabilitation-measures\/timed-and-go."},{"key":"ref_54","unstructured":"Lab, S.R.A. (2019, November 25). Five Times Sit to Stand. Available online: https:\/\/www.sralab.org\/rehabilitation-measures\/five-times-sit-stand-test."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"16","DOI":"10.2202\/1557-4679.1107","article-title":"Statistical models for assessing agreement in method comparison studies with replicate measurements","volume":"4","author":"Carstensen","year":"2008","journal-title":"Int. J. Biostat."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1023\/A:1009982611386","article-title":"A meta-analysis of studies using bias and precision statistics to compare cardiac output measurement techniques","volume":"15","author":"Critchley","year":"1999","journal-title":"J. Clin. Monit. Comput."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.cmpb.2012.09.002","article-title":"Estimation of the concordance correlation coefficient for repeated measures using SAS and R","volume":"109","author":"Carrasco","year":"2013","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1037\/0033-2909.86.2.420","article-title":"Intraclass correlations: Uses in assessing rater reliability","volume":"86","author":"Shrout","year":"1979","journal-title":"Psychol. Bull."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"36","DOI":"10.4103\/jpcs.jpcs_11_17","article-title":"Decoding the Bland\u2014Altman plot: Basic review","volume":"3","author":"Kalra","year":"2017","journal-title":"J. Pract. Cardiovasc. Sci."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/1\/26\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,23]],"date-time":"2024-06-23T00:32:49Z","timestamp":1719102769000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/1\/26"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,19]]},"references-count":59,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,1]]}},"alternative-id":["s20010026"],"URL":"https:\/\/doi.org\/10.3390\/s20010026","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,19]]}}}