Land Vehicle Control Using Continuous Gesture Recognition on Smartwatches | SpringerLink
Skip to main content

Land Vehicle Control Using Continuous Gesture Recognition on Smartwatches

  • Conference paper
  • First Online:
HCI in Mobility, Transport, and Automotive Systems (HCII 2024)

Abstract

This work introduces a method for interaction between wearable devices and ground vehicles, utilizing continuous gesture recognition on a smartwatch to control an Arduino-based vehicle. Two interaction techniques were developed and compared: in the first, the vehicle moves while the user touches the screen; in the second, a double-tap initiates or stops the vehicle. Experiments included the application of SUS and NASA TLX questionnaires to assess usability and aspects such as mental load and satisfaction. Results indicate a significant user preference for the second technique, supported by SUS scores. Additionally, NASA TLX analysis reveals positive perceptions in dimensions of mental, physical, temporal load, performance, effort, and frustration. The distribution of preferences highlights that seven users favored technique two, two opted for technique one, and one did not express a preference. This study contributes to the development of intuitive and effective interactions between wearable devices and ground vehicles, exploring the potential of continuous gesture recognition.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 13727
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 8293
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Bangor, A., Kortum, P., Miller, J.: Determining what individual SUS scores mean: adding an adjective rating scale. J. Usability Stud. 4(3), 114–123 (2009). ISSN 1931-3357

    Google Scholar 

  2. Brooke, J.: SUS: a ‘quick and dirty’ usability scale. In: Usability Evaluation in Industry, 1st edn., pp. 189–194. Taylor and Francis, London (1996)

    Google Scholar 

  3. Brooke, J.: SUS: a retrospective. J. Usability Stud. 8(2), 29–40 (2013). ISSN 1931-3357

    Google Scholar 

  4. Butt, S.U., et al.: The simple design and control of unmanned ground vehicle via Arduino and Android application: design and control of unmanned ground vehicle. Sci. Proc. Ser. 2(1), 28–33 (2020)

    Google Scholar 

  5. Cieplik, J., Brinkestam, K.B.: Using hand gestures to control electric vehicles (2021)

    Google Scholar 

  6. Dourish, P.: Where the Action is: The Foundations of Embodied Interaction. MIT Press, Cambridge (2001)

    Google Scholar 

  7. Gomes, R.C., et al.: Construindo veículo teleoperado com arduino para auxilio no ensino de sistemas embarcados e robotica móvel (2012)

    Google Scholar 

  8. Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload, vol. 52. Advances in Psychology, North-Holland, pp. 139–183 (1988). https://doi.org/10.1016/S0166-4115(08)62386-9, https://www.sciencedirect.com/science/article/pii/S0166411508623869

  9. Horbylon Nascimento, T., Soares, F.: Home appliance control using smartwatches with continuous gesture recognition. In: Streitz, N., Konomi, S. (eds.) Distributed, Ambient and Pervasive Interactions, HCII 2021. LNCS, vol. 12782, pp. 122–134. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-77015-0_9, ISBN: 978-3-030-77015-0

  10. Nascimento, T.H., et al.: Interaction with smartwatches using gesture recognition: a systematic literature review. In: 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC), pp. 1661–1666 (2020). https://doi.org/10.1109/COMPSAC48688.2020.00-17

  11. Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, CHI 1997, pp. 234–241, New York, NY, USA. Association for Computing Machinery (1997). https://doi.org/10.1145/258549.258715, ISBN 0897918029

  12. Kristensson, P.O., Denby, L.C.: Continuous recognition and visualization of pen strokes and touch-screen gestures. In: EUROGRAPHICS Symposium on Sketch-Based Interfaces and Modeling (2011)

    Google Scholar 

  13. Mishra, A., Stanislaus, R.J.: Smart watch supported system for health care monitoring. arXiv preprint arXiv:2304.07789 (2023)

  14. Moazen, D., Sajjadi, S.A., Nahapetian, A.: AirDraw: leveraging smart watch motion sensors for mobile human computer interactions. In: 2016 13th IEEE Annual Consumer Communications & Networking Conference (CCNC), pp. 442–446 (2016). https://doi.org/10.1109/CCNC.2016.7444820

  15. Nascimento, T.H., et al.: Method for text input with google cardboard: an approach using smartwatches and continuous gesture recognition. In: 2017 19th Symposium on Virtual and Augmented Reality (SVR), pp. 223–226, November 2017. https://doi.org/10.1109/SVR.2017.36

  16. Nascimento, T.H., et al.: Netflix control method using smartwatches and continuous gesture recognition. In: 2019 IEEE Canadian Conference of Electrical and Computer Engineering (CCECE), pp. 1–4 (2019)

    Google Scholar 

  17. Nascimento, T.H., et al.: Interaction with platform games using smartwatches and continuous gesture recognition: a case study. In: 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC) (2018)

    Google Scholar 

  18. Nascimento, T.H., Soares, F.: WatchControl: a control for interactive movie using continuous gesture recognition in smartwatches. J. Inf. Process. 28, 643–649 (2020)

    Google Scholar 

  19. Nascimento, T.H., et al.: MazeVR: immersion and interaction using google cardboard and continuous gesture recognition on smartwatches. In: Proceedings of the 28th International ACM Conference on 3D Web Technology, Web3D 2023, San Sebastian, Spain. Association for Computing Machinery (2023). https://doi.org/10.1145/3611314.3615912

  20. Patil, V.P., et al.: Design and development of bluetooth control car based on Arduino UNO (2022)

    Google Scholar 

  21. Rawf, K.M.H., Abdulrahman, A.O.: Microcontroller-based Kurdish understandable and readable digital smart clock. Sci. J. Univ. Zakho 10(1), 1–4 (2022)

    Article  Google Scholar 

  22. Schirmer, A.S., et al.: Protótipo de veículo terrestre autônomo utilizando Arduino e módulo GPS. In: Revista Contemporânea 3(6), 6377–6387 (2023)

    Google Scholar 

  23. Tombeng, M.T., Najoan, R., Karel, N.: Smart car: digital controlling system using android smartwatch voice recognition. In: 2018 6th International Conference on Cyber and IT Service Management (CITSM), pp. 1–5. IEEE (2018)

    Google Scholar 

  24. Weiser, M.: The computer for the 21st century. Sci. Am. 265(3), 94–105 (1991). ISSN 00368733, 19467087. http://www.jstor.org/stable/24938718

  25. Wolf, A.S., et al.: Veículo terrestre não tripulado controlado via rede WI-FI. In: Revista Destaques Acadêmicos, vol. 7(4) (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Thamer Horbylon Nascimento or Fabrizzio Soares .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nascimento, T.H. et al. (2024). Land Vehicle Control Using Continuous Gesture Recognition on Smartwatches. In: Krömker, H. (eds) HCI in Mobility, Transport, and Automotive Systems. HCII 2024. Lecture Notes in Computer Science, vol 14733. Springer, Cham. https://doi.org/10.1007/978-3-031-60480-5_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-60480-5_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-60479-9

  • Online ISBN: 978-3-031-60480-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics