Abstract
In the context of the fourth industrial revolution, the integration of human operators in emergent cyber-physical systems assumes a crucial relevance. In this context, humans and machines can not be considered in an isolated manner but instead regarded as a collaborative and symbiotic team. Methodologies based on the use of intelligent assistants that guide human operators during the execution of their operations, taking advantage of user friendly interfaces, artificial intelligence (AI) and virtual reality (VR) technologies, become an interesting approach to industrial systems. This is particularly helpful in the execution of customised and/or complex assembly and maintenance operations. This paper presents the development of an intelligent personal assistant that empowers operators to perform faster and more cost-effectively their assembly operations. The developed approach considers ICT technologies, and particularly machine vision and image processing, to guide operators during the execution of their tasks, and particularly to verify the correctness of performed operations, contributing to increase productivity and efficiency, mainly in the assembly of complex products.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abidi, M., Al-Ahmari, A., Ahmad, A., Ameen, W., Alkhalefah, H.: Assessment of virtual reality-based manufacturing assembly training system. Int. J. Adv. Manuf. Technol. 105, 3743–3759 (2019)
de Barcelos Silva, A., et al.: Intelligent personal assistants: a systematic literature review. Expert Syst. Appl. 147, 113193 (2020)
Fantini, P., et al.: Exploring the Integration of the human as a flexibility factor in cps enabled manufacturing environments: methodology and results. In: Proceedings of the 42nd Annual Conference of IEEE Industrial Electronics Society (IECON 2016), pp. 5711–5716 (2016)
Frigo, M.A., da Silva, E.C., Barbosa, G.F.: Augmented reality in aerospace manufacturing: a review. J. Ind. Intell. Inf. 4(2), 125–130 (2016)
Gilchrist, A.: Industry 4.0: The Industrial Internet of Things. Springer, Heidelberg (2016)
Hauswald, J., Laurenzano, M.A., Zhang, Y., et al.: Sirius: an open end-to-end voice and vision personal assistant and its implications for future warehouse scale computers. In: 20th International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 223–238 (2015)
Hoedt, S., Claeys, A., Landeghem, H.V., Cottyn, J.: The evaluation of an elementary virtual training system for manual assembly. Int. J. Prod. Res. 55(24), 7496–7508 (2017)
Krupitzer, C., et al.: A survey on human machine interaction in industry 4.0. CoRR abs/2002.01025 (2020)
Leitão, P., Colombo, A.W., Karnouskos, S.: Industrial automation based on cyber-physical systems technologies: prototype implementations and challenges. Comput. Ind. 81, 11–25 (2016)
Mantovani, G.: VR Learning: Potential and Challenges for the Use of 3D. Towards Cyberpsychology: Mind, Cognitions, and Society in the Internet Age, pp. 208–225 (2003)
Mohd Ali, N., Md Rashid, N.K.A., Mustafah, Y.M.: Performance comparison between RGB and HSV color segmentations for road signs detection. In: Advances in Manufacturing and Mechanical Engineering. Applied Mechanics and Materials, vol. 393, pp. 550–555. Trans Tech Publications Ltd (2013)
Morgado, M., Miguel, L.: Ergonomics in the industry 4.0: virtual and augmented reality. J. Ergon. 08 (2018)
Pierdicca, R., Frontoni, E., Pollini, R., Trani, M., Verdini, L.: The use of augmented reality glasses for the application in industry 4.0. In: Proceedings of the International Conference on Augmented Reality, Virtual Reality and Computer Graphics, pp. 389–401 (2017)
Romero, D., et al.: Towards an operator 4.0 typology: a human-centric perspective on the fourth industrial revolution technologies. In: Proceedings of the Int’l Conference on Computers and Industrial Engineering, pp. 1–11 (2016)
Webel, S., Bockholt, U., Engelke, T., Gavish, N., Olbrich, M., Preusche, C.: Augmented reality training for assembly and maintenance skills. Robot. Auton. Syst. 61(4), 398–403 (2013)
Zhu, Z., et al.: AR-mentor: augmented reality based mentoring system. In: Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2014), pp. 17–22 (2014)
Acknowledgments
This work has been supported by FCT- Fundação para a Ciência e Tecnologia within the Project Scope: UIDB/05757/2020.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Talacio, M., Funchal, G., Melo, V., Piardi, L., Vallim, M., Leitao, P. (2021). Machine Vision to Empower an Intelligent Personal Assistant for Assembly Tasks. In: Pereira, A.I., et al. Optimization, Learning Algorithms and Applications. OL2A 2021. Communications in Computer and Information Science, vol 1488. Springer, Cham. https://doi.org/10.1007/978-3-030-91885-9_33
Download citation
DOI: https://doi.org/10.1007/978-3-030-91885-9_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-91884-2
Online ISBN: 978-3-030-91885-9
eBook Packages: Computer ScienceComputer Science (R0)