Abstract
Common approaches in the cross-domain sensor-based human activity recognition are based on the homogeneous domain adaptation which relies on the assumption that the training and testing data are of homogeneous feature space. In reality, such an assumption does not always hold. For example, although two devices may share common sensors, it is possible that each of them has its own specific sensors. In this case, the homogeneous domain adaptation approaches cannot be used directly. Although heterogeneous domain adaptation approaches have been proposed to handle such feature space heterogeneity, most of them require some label information in the target domain, which is often difficult to obtain. As a compromise, the hybrid domain adaptation has been recently proposed to address feature space heterogeneity. Instead of using the target domain label information, it exploits the common features between domains as additional information, so the adaptation can be performed in an unsupervised manner. However, it still neglects the possibility of the common features between domains having different distribution, which may lead to the negative transfer of the domain-specific features. In this work, we introduce a domain-invariant latent representation of the common features to enhance the specific feature transfer in the hybrid domain adaptation approach. The latent representation learning and the domain-specific feature transfer are performed jointly using an autoencoder-based framework. The experimental result shows that the performance improves when the common features are furthermore aligned in the latent space. It is also shown that, in overall, our model outperforms existing approaches, yielding up to 9.48% accuracy improvement.
Similar content being viewed by others
References
Li W, Xu Y, Tan B, Piechocki RJ (2017) Passive wireless sensing for unsupervised human activity recognition in healthcare. In: 2017 13th International on wireless communications and mobile computing conference (IWCMC), pp 1528–1533. IEEE
Braunagel C, Kasneci E, Stolzmann W, Rosenstiel W (2015) Driver-activity recognition in the context of conditionally autonomous driving. In: 2015 IEEE 18th international conference on intelligent transportation systems (ITSC), pp 1652–1657. IEEE
Attal F, Mohammed S, Dedabrishvili M, Chamroukhi F, Oukhellou L, Amirat Y (2015) Physical human activity recognition using wearable sensors. Sensors 15(12):31314–31338
Wang J, Chen Y, Hu L, Peng X, Philip SY (2018) Stratified transfer learning for cross-domain activity recognition. In: 2018 IEEE international conference on pervasive computing and communications(PerCom), pp 1–10. IEEE
Shi X, Liu Q, Fan W, Philip SY, Zhu R (2010) Transfer learning on heterogenous feature spaces via spectral transformation. In: 2010 IEEE 10th international conference on data mining (ICDM), pp 1049–1054. IEEE
Kulis B, Saenko K, Darrell T (2011) What you saw is not what you get: domain adaptation using asymmetric kernel transforms. In: 2011 IEEE conference on computer vision and pattern recognition (CVPR), pp 1785–1792. IEEE
Wang C, Mahadevan S (2011) Heterogeneous domain adaptation using manifold alignment. In: IJCAI proceedings-international joint conference on artificial intelligence, vol 22, p 1541
Wei P, Ke Y, Goh CK (2018) A general domain specific feature transfer framework for hybrid domain adaptation. IEEE Trans Knowl Data Eng 31:1440–1451
Lara OD, Labrador MA et al (2013) A survey on human activity recognition using wearable sensors. IEEE Commun Surv Tutor 15(3):1192–1209
Ponce H, Martínez-Villaseñor M, Miralles-Pechuán L (2016) A novel wearable sensor-based human activity recognition approach using artificial hydrocarbon networks. Sensors 16(7):1033
Wannenburg J, Malekian R (2017) Physical activity recognition from smartphone accelerometer data for user context awareness sensing. IEEE Trans Syst Man Cybern Syst 47(12):3142–3149
Jahn A, Kroll D, Lau SL, David K (2017) An activity history based approach for recognizing the mode of transportation. In: 2017 IEEE conference on open systems (ICOS), pp 21–25. IEEE
Aramendi AA, Weakley A, Goenaga AA, Schmitter-Edgecombe M, Cook DJ (2018) Automatic assessment of functional health decline in older adults based on smart home data. J Biomed Inform 81:119–130
Gong B, Shi Y, Sha F, Grauman K (2012) Geodesic flow kernel for unsupervised domain adaptation. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR), pp 2066–2073. IEEE
Fernando B, Habrard A, Sebban M, Tuytelaars T (2013) Unsupervised visual domain adaptation using subspace alignment. In: Proceedings of the IEEE international conference on computer vision, pp 2960–2967
Long M, Wang J, Jiaguang S, Philip SY (2015) Domain invariant transfer kernel learning. IEEE Trans Knowl Data Eng 27(6):1519–1532
Zhang J, Li W, Ogunbona P (2017) Joint geometrical and statistical alignment for visual domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1859–1867
Blitzer J, McDonald R, Pereira F (2006) Domain adaptation with structural correspondence learning. In: Proceedings of the 2006 conference on empirical methods in natural language processing, pp 120–128. Association for Computational Linguistics
Glorot X, Bordes A, Bengio Y (2011) Domain adaptation for large-scale sentiment classification: a deep learning approach. In: Proceedings of the 28th international conference on machine learning (ICML-11), pp 513–520
Pan J, Hu X, Li P, Li H, He W, Zhang Y, Lin Y (2016) Domain adaptation via multi-layer transfer learning. Neurocomputing 190:10–24
Wu F, Huang Y (2016) Sentiment domain adaptation with multiple sources. In: Proceedings of the 54th annual meeting of the association for computational linguistics (Volume 1: Long Papers), vol 1, pp 301–310
Kullback S (1987) Letter to the editor: The Kullback–Leibler distance
Zhuang F, Cheng X, Luo P, Pan SJ, He Q (2018) Supervised representation learning with double encoding-layer autoencoder for transfer learning. ACM Trans Intell Syst Technol (TIST) 9(2):16
Chavarriaga R, Sagha H, Calatroni A, Digumarti ST, Tröster G, Millán JDR, Roggen D (2013) The opportunity challenge: a benchmark database for on-body sensor-based activity recognition. Pattern Recognit Lett 34(15):2033–2042
Barshan B, Yüksek MC (2014) Recognizing daily and sports activities in two open source machine learning environments using body-worn sensor units. Comput J 57(11):1649–1667
Hu L, Chen Y, Wang J, Hu C, Jiang X (2018) Okrelm: online kernelized and regularized extreme learning machine for wearable-based activity recognition. Int J Mach Learn Cybern 9(9):1577–1590
Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. [arXiv:1412.6980]
Chang C-C, Lin C-J (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol (TIST) 2(3):27
Pan SJ, Tsang IW, Kwok JT, Yang Q (2011) Domain adaptation via transfer component analysis. IEEE Trans Neural Netw 22(2):199–210
Acknowledgements
This work was supported by Hankuk University of Foreign Studies Research Fund, and the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2018R1D1A1B07047241).
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Prabono, A.G., Yahya, B.N. & Lee, SL. Hybrid domain adaptation for sensor-based human activity recognition in a heterogeneous setup with feature commonalities. Pattern Anal Applic 24, 1501–1511 (2021). https://doi.org/10.1007/s10044-021-00995-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10044-021-00995-9