Feasibility Study on Parameter Adjustment for a Humanoid Using LLM Tailoring Physical Care | SpringerLink
Skip to main content
Springer Nature Link
Log in

Feasibility Study on Parameter Adjustment for a Humanoid Using LLM Tailoring Physical Care

  • Conference paper
  • First Online:
Social Robotics (ICSR 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14453 ))

Included in the following conference series:

  • 972 Accesses

Abstract

The increasing demand for care of the elderly, coupled with the shortage of caregivers, necessitates the introduction of robotic assistants capable of performing care tasks both intelligently and safely. Central to these tasks, especially those involving tactile interaction, is the ability to make human-in-the-loop adjustments based on individual preferences. In this study, our primary goal was to design and evaluate a system that captures user preferences prior to initiating a tactile care task. Our focus was on range-of-motion training exercises, emphasizing communication that demonstrates motion using the LLM approach. The system combines physical demonstrations with verbal explanations, ensuring adaptability to individual preferences before initiating range-of-motion training. Using the humanoid robot Dry-AIREC, augmented with the linguistic capabilities of ChatGPT, our system was evaluated with 14 young participants. The results showed that the robot could perform the range-of-motion exercises with tactile interactions while simultaneously communicating with the participant. Thus, our proposed system emerges as a promising approach for range-of-motion exercises rooted in human-preference-centered human-robot interaction. Interestingly, although there wasn’t a significant shift in the overall positive subjective impressions when the tuning was performed using ChatGPT, there was an increase in the number of participants who gave the highest rating to the experience.

This work was supported by JST Moonshot R &D, Grant No. JPMJMS2031.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 8464
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 10581
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Chatgpt. https://chat.openai.com. Accessed 21 Aug 2023

  2. Cogniron project. https://www.cogniron.org/final/Home.php. Accessed 19 Aug 2023

  3. CompanionAble project. http://www.robots-and-androids.com/CompanionAble-Project.html. Accessed 19 Aug 2023

  4. Domeo project. http://www.aal-europe.eu/projects/domeo/. Accessed 19 Aug 2023

  5. Faster Whisper transcription with CTranslate2. https://github.com/guillaumekln/faster-whisper. Accessed 1 Aug 2023

  6. HERB project. https://robotsguide.com/robots/herb. Accessed 19 Aug 2023

  7. HUMANOID ROBOT - TOROBO. https://robotics.tokyo/products/torobo/. Accessed 15 Aug 2023

  8. Introducing Whisper. https://openai.com/research/whisper. Accessed 20 Aug 2023

  9. Introduction of text-to-speech engine of VOICEVOX (in Japanese). https://blog.hiroshiba.jp/. Accessed 21 Aug 2023

  10. Ksera project. https://ksera.ieis.tue.nl. Accessed 19 Aug 2023

  11. Mediapipe. https://developers.google.com/mediapipe. Accessed 1 Aug 2023

  12. SRS project. https://robotnik.eu/projects/srs-en/. Accessed 19 Aug 2023

  13. Barrett, E.e.a.: Evaluation of a companion robot for individuals with dementia: quantitative findings of the mario project in an Irish residential care setting. Gerontological Nursing 45(7), 36–45 (2019)

    Google Scholar 

  14. Bucker, A., Figueredo, L., Haddadin, S., Kapoor, A., Ma, S., Vemprala, S., Bonatti, R.: Latte: Language trajectory transformer. In: 2023 IEEE International Conference on Robotics and Automation (ICRA), pp. 7287–7294. IEEE (2023)

    Google Scholar 

  15. Cui, Y., Karamcheti, S., Palleti, R., Shivakumar, N., Liang, P., Sadigh, D.: No, to the right: online language corrections for robotic manipulation via shared autonomy. In: Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, pp. 93–101 (2023)

    Google Scholar 

  16. Jung, H., et al.: Towards extended virtual presence of the therapist in stroke rehabilitation. In: IEEE 13th International Conference on Rehabilitation Robotics (ICORR), pp. 580–586 (2013). 110.1109/ICORR.2013.6650345

    Google Scholar 

  17. Hans, M., Graf, B., Schraft, R.: Robotic home assistant care-o-bot: past-present-future. In: Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication, pp. 380–385 (2002). https://doi.org/10.1109/ROMAN.2002.1045652

  18. Huisman, C., Kort, H.: Two-year use of care robot zora in dutch nursing homes: an evaluation study. Healthcare 7(1), 31 (2019)

    Google Scholar 

  19. Iwata, H., Sugano, S.: Design of human symbiotic robot twendy-one. In: 2009 IEEE International Conference on Robotics and Automation, pp. 580–586 (2009). https://doi.org/10.1109/ROBOT.2009.5152702

  20. Jøranson, N., Pedersen, I., R.A.A.G.O.C.I.C.: Group activity with paro in nursing homes: systematic investigation of behaviors in participants. Int. Psychogeriatrics 28(8), 1345–54 (2016)

    Google Scholar 

  21. Kanamori, M., Suzuki, M., Oshiro, H., Tanaka, M., Inoguchi, T., Takasugi, H., Saito, Y., Yokoyama, T.: Pilot study on improvement of quality of life among elderly using a pet-type robot. In: Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No.03EX694), vol. 1, pp. 107–112 (2003). https://doi.org/10.1109/CIRA.2003.1222072

  22. Kanda, T., Hirano, T., Eaton, D., Ishiguro, H.: Interactive robots as social partners and peer tutors for children: a field trial. Hum.-Comput. Inter. 19(1–2), 61–84 (2004)

    Article  Google Scholar 

  23. Libin, A., Cohen-Mansfield, J.: Therapeutic robocat for nursing home residents with dementia: preliminary inquiry. Am. J. Alzheimer’s Disease Other Dementias 19(2), 111–116 (2004)

    Article  Google Scholar 

  24. Matsuyama, Y., Akiba, I., Fujie, S., Kobayashi, T.: Four-participant group conversation: a facilitation robot controlling engagement density as the fourth participant. Comput. Speech Lang. 33(1), 1–24 (2015)

    Article  Google Scholar 

  25. Miyake, T., Wang, Y., Yan, G., Sugano, S.: Skeleton recognition-based motion generation and user emotion evaluation with in-home rehabilitation assistive humanoid robot. In: 2022 IEEE-RAS 21st International Conference on Humanoid Robots (Humanoids), pp. 616–621. IEEE (2022)

    Google Scholar 

  26. Moro, C., Nejat, G., Mihailidis, A.: Learning and personalizing socially assistive robot behaviors to aid with activities of daily living. ACM Trans. Hum.-Robot Inter. (THRI) 7(2), 1–25 (2018)

    Article  Google Scholar 

  27. Mukai, T., Hirano, S., Nakashima, H., Kato, Y., Sakaida, Y., Guo, S., Hosoe, S.: Development of a nursing-care assistant robot riba that can lift a human in its arms. In: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5996–6001 (2010). https://doi.org/10.1109/IROS.2010.5651735

  28. Odashima, T., et al.: A soft human-interactive robot ri-man. In: 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1–1 (2006). https://doi.org/10.1109/IROS.2006.282203

  29. Ogata, T., Sugano, S., Tani, J.: Open-end human-robot interaction from the dynamical systems perspective: mutual adaptation and incremental learning. Adv. Robot. 19(6), 651–670 (2005)

    Article  Google Scholar 

  30. Ohishi, K., Miyazaki, M., Fujita, M.: Hybrid control of force and position without force sensor. In: Proceedings of the 1992 International Conference on Industrial Electronics, Control, Instrumentation, and Automation, vol 2, pp. 670–675 (1992). https://doi.org/10.1109/IECON.1992.254552

  31. P. Deegan, e.a.: Mobile manipulators for assisted living in residential settings. Robot. Auton. Syst. 24(2), 179–192 (2008)

    Google Scholar 

  32. Pantaleoni, M., Cesta, A., Umbrico, A., Orlandini, A.: Learning user habits to enhance robotic daily-living assistance. In: International Conference on Social Robotics, pp. 165–173. Springer (2022)

    Google Scholar 

  33. Pineau, J., Montemerlo, M., Pollack, M., Roy, N., Thrun, S.: Towards robotic assistants in nursing homes: challenges and results. Robot. Auton. Syst. 42(3), 271–281 (2003)

    Article  MATH  Google Scholar 

  34. Shrestha, M.C., et al.: Intent communication in navigation through the use of light and screen indicators. In: 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 523–524. IEEE (2016)

    Google Scholar 

  35. Sugano, S.: Design of humanoid robot for human-robot interaction - waseda robots: wendy and wamoeba. In: 2005 IEEE International Conference on Robotics and Biomimetics - ROBIO, pp. 16–19 (2005). https://doi.org/10.1109/ROBIO.2005.246393

  36. Wada, K., Shibata, T., Saito, T., Tanie, K.: Effects of robot assisted activity to elderly people who stay at a health service facility for the aged. In: Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453), vol. 3, pp. 2847–2852 (2003). https://doi.org/10.1109/IROS.2003.1249302

  37. Wake, N., Kanehira, A., Sasabuchi, K., Takamatsu, J., Ikeuchi, K.: Chatgpt empowered long-step robot control in various environments: a case application. arXiv p. 2304.03893, April 2023

    Google Scholar 

  38. Wako, N., Miyake, T., Sugano, S.: 2020 8th ieee ras/embs international conference for biomedical robotics and biomechatronics (biorob), pp. 30–35 (2020). https://doi.org/10.1109/BioRob49111.2020.9224304

  39. Wang, Y., et al.: Evaluation of series clutch actuators with a high torque-to-weight ratio for open-loop torque control and collision safety. IEEE Robot. Autom. Lett. 3(1), 297–304 (2017)

    Article  Google Scholar 

  40. Yang, P.C., et al.: Hatsuki: an anime character like robot figure platform with anime-style expressions and imitation learning based action generation. In: 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 384–391. IEEE (2020)

    Google Scholar 

  41. Yi, J.B., Yi, S.J.: Mobile manipulation for the hsr intelligent home service robot. In: 2019 16th International Conference on Ubiquitous Robots (UR), pp. 169–173 (2019). https://doi.org/10.1109/URAI.2019.8768782

  42. Šabanović, S., Bennett, C.C., Chang, W.L., Huber, L.: Paro robot affects diverse interaction modalities in group sensory therapy for older adults with dementia. In: 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR), pp. 1–6 (2013). https://doi.org/10.1109/ICORR.2013.6650427

Download references

Author information

Authors and Affiliations

  1. Waseda University, Tokyo, Japan

    Tamon Miyake, Yushi Wang, Pin-chu Yang & Shigeki Sugano

Authors
  1. Tamon Miyake
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yushi Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pin-chu Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shigeki Sugano
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tamon Miyake .

Editor information

Editors and Affiliations

  1. Qatar University, Doha, Qatar

    Abdulaziz Al Ali

  2. Qatar University, Doha, Qatar

    John-John Cabibihan

  3. Qatar University, Doha, Qatar

    Nader Meskin

  4. University of Naples Federico II, Napoli, Italy

    Silvia Rossi

  5. Qingdao University, Qingdao, China

    Wanyue Jiang

  6. The University of Alabama, Tuscaloosa, AL, USA

    Hongsheng He

  7. National University of Singapore, Queenstown, Singapore

    Shuzhi Sam Ge

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Miyake, T., Wang, Y., Yang, Pc., Sugano, S. (2024). Feasibility Study on Parameter Adjustment for a Humanoid Using LLM Tailoring Physical Care. In: Ali, A.A., et al. Social Robotics. ICSR 2023. Lecture Notes in Computer Science(), vol 14453 . Springer, Singapore. https://doi.org/10.1007/978-981-99-8715-3_20

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-8715-3_20

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-8714-6

  • Online ISBN: 978-981-99-8715-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation