Abstract
Existing food delivery robots are not fully autonomous and require human guidance for their movements. Although they can perform simple human-robot interaction (HRI) tasks, they cannot find waving customers or take orders. In this paper, we propose an autonomous robot system that performs waiter tasks, such as finding customers, taking orders, and serving food. The proposed method uses a human support robot with human and action recognition to identify waving customers. It estimates the chair position of the customer using semantic mapping. The robot moves toward the customer and takes orders through speech recognition. Finally, the robot takes the order to the kitchen and delivers it to the customer. The proposed method was implemented in an actual restaurant, and it received high customer evaluation. The experimental results are available at https://youtu.be/KOu9h3tjzDI.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
alpha: Vosk offline speech recognition (2022), https://alphacephei.com/vosk/
Brazil, G., Straub, J., Ravi, N., Johnson, J., Gkioxari, G.: Omni3D: a large benchmark and model for 3D object detection in the wild. arXiv:2207.10660 (2022)
Chen, Y., Dinkel, H., Wu, M., Yu, K.: Voice activity detection in the wild via weakly supervised sound event detection, pp. 3665–3669 (2020)
Deloitte: Forecasting for service robot market in 2022 (2022). https://mic-r.co.jp/mr/02360/
KEENON: catering robot T-2 (2022). https://www.keenonrobot.com/jp/index/Page/index/catid/5.html
KEENON: catering robot T-8 (2022). https://www.keenonrobot.com/jp/index/Page/index/catid/32.html
Labbé, M., Michaud, F.: Rtab-map as an open-source lidar and visual simultaneous localization and mapping library for large-scale and long-term online operation. J. Field Rob. 36(2), 416–446 (2019)
Ono, T., et al.: Solution of world robot challenge 2020 partner robot challenge (Real Space). Adv. Rob. 36(17), 1–18 (2022)
REEMAN: Autonomous food delivery robot waiter restaurant robot hotel robot service robot (2022). https://www.reemanrobot.com/delivery-robot/food-delivery-robot/autonomous-delivery-robot.html
REEMAN: Reeman homepage (2022). https://www.reemanrobot.com/
Robotics, P.: Bella bot (2022). https://www.pudurobotics.com/products/pudubot2
Robotics, P.: Pudo robotics homepage (2022). https://www.pudurobotics.com/
Robotics, P.: Pudo robotics homepage (2022). https://www.pudurobotics.com/products/holabot
ROS.org: Ros wiki (2022). https://wiki.ros.org/
Sainburg, T., Thielk, M., Gentner, T.Q.: Finding, visualizing, and quantifying latent structure across diverse animal vocal repertoires. PLoS Comput. Biol. 16, e1008228 (2020)
SoftBank: catering robot servi (2022). https://www.softbankrobotics.com/jp/product/servi/
Yamamoto, T., Terada, K., Ochiai, A., Saito, F., Asahara, Y., Murase, K.: Development of human support robot as the research platform of a domestic mobile manipulator. ROBOMECH J. 6(1), 1–15 (2019)
Acknowledgement
This work was supported by JSPS KAKENHI grant number 23H03468. This paper is based on results obtained from a project, JPNP16007, commissioned by the New Energy and Industrial Technology Development Organization (NEDO).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yano, Y., Isomoto, K., Ono, T., Tamukoh, H. (2024). Autonomous Waiter Robot System for Recognizing Customers, Taking Orders, and Serving Food. In: Buche, C., Rossi, A., Simões, M., Visser, U. (eds) RoboCup 2023: Robot World Cup XXVI. RoboCup 2023. Lecture Notes in Computer Science(), vol 14140. Springer, Cham. https://doi.org/10.1007/978-3-031-55015-7_21
Download citation
DOI: https://doi.org/10.1007/978-3-031-55015-7_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-55014-0
Online ISBN: 978-3-031-55015-7
eBook Packages: Computer ScienceComputer Science (R0)