Abstract
Cyber-physical system (CPS) can increase efficiency and lower costs in manufacturing operations. CPS and related technologies can help medical device manufacturers to meet the rising demands for quality and affordable healthcare products and services. In this paper, a novel architecture for CPS-based manufacturing workcell systems was proposed. Its contribution is to provide quality inspection and operator guidance in manual assembly systems, specifically for the production of hybrid medical devices. The proposed system involves the integration of enabling technologies including Machine Vision (MV), Internet-of-things (IoT) and Augmented Reality. The group illustrated and evaluated the implementation of two CPS prototypes based on the proposed architecture on the fabrication of a specific hybrid medical device, verifying their effectiveness as guidance tools for operators. The two prototypes, CPS-1 and CPS-2 differ in their MV subsystems by having non-deep learning and deep learning-based image processing methods respectively. Experimental results illustrate that, when exposed to various changing conditions, the Regional Convolutional Neural Network (R-CNN) of CPS-2, on average, has outperformed the non-deep learning image processing method of CPS-1 by 42.3% and 8.5%, in terms of accuracy and precision respectively. Hence, this presents evidence on the usefulness of R-CNN-based MV system to increase the flexibility and adaptability of the CPS in terms of object monitoring and reporting.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Alom MZ, Taha TM, Yakopcic C, Westberg S, Hasan M, Esesn BCV, Awwal AAS, Asari VK (2018) The history began from AlexNet: a comprehensive survey on deep learning approaches. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 1–39
Bordel B, Alcarria R, Robles T, Martín D (2017a) Cyber–physical systems: extending pervasive sensing from control theory to the Internet of Things. Pervasive Mob Comput 40:156–184. https://doi.org/10.1016/j.pmcj.2017.06.011
Bordel B, Alcarria R, Martin D, Robles T, Rivera DS (2017b) Self-configuration in humanized cyber-physical systems. J Ambient Intell Human Comput 8:485–496. https://doi.org/10.1007/s12652-016-0410-3
Brown A, Eatock J, Dixon D, Meenan BJ, Anderson J (2008) Quality and continuous improvement in medical device manufacturing. TQM J 20(6):541–555. https://doi.org/10.1108/17542730810909329
Bueno E, Bilgen B, Barabino G (2005) Wavy-walled bioreactor supports increased cell proliferation and matrix deposition in engineered cartilage constructs. Tissue Eng 11(11–12):1699–1709. https://doi.org/10.1089/ten.2005.11.1699
Chaudhari P, Agarwal H (2016) Progressive review towards deep learning techniques. Proceedings of the International Conference on Data Engineering and Communication Technology 468:151–158. https://doi.org/10.1007/978-981-10-1675-2\_17
Chua M, Chui CK (2015a) New attenuation predictive model for carbon-based nanocomposites. IEEE Trans Nanotechnol 14(2):363–371. https://doi.org/10.1109/TNANO.2015.2396536
Chua M, Chui CK (2015b) Probabilistic predictive modelling of carbon nanocomposites for medical implants design. J Mech Behav Biomed Mater 44C:164–172. https://doi.org/10.1016/j.jmbbm.2015.01.013
Chua M, Chui CK, Chng CB, Lau D (2013a) Carbon nanotube-based artificial tracheal prosthesis: carbon nanocomposite implants for patient-specific ENT care. IEEE Nanatechnol Mag 7(4):27–31. https://doi.org/10.1109/MNANO.2013.2289691
Chua M, Chui CK, Chng CB, Lau D (2013b) Experiments of carbon nanocomposite implants for patient specific ENT care. In: Proceedings of the 7th IEEE international conference on nano/molecular medicine and engineering (NANOMED), pp 72–76. https://doi.org/10.1109/NANOMED.2013.6766318
Chua M, Chui CK, Teo C, Lau D (2015a) Patient-specific carbon nanocomposite tracheal prosthesis. Int J Artif Organs 38(1):31–38. https://doi.org/10.5301/ijao.5000374
Chua M, Chui CK, Teo C (2015b) Computer aided design and experiment of a novel patient-specific carbon nanocomposite voice prosthesis. Comput Aided Des 59:108–118. https://doi.org/10.1016/j.cad.2014.09.002
Ciurana J (2014) Designing, prototyping and manufacturing medical devices: an overview. Int J Comput Integ Manuf 27(10):901–918. https://doi.org/10.1080/0951192X.2014.934292
Donahue J, Jia Y, Vinyals O, Hoffman J, Zhang N, Tzeng E, Darrell T (2014) DeCAF: a deep convolutional activation feature for generic visual recognition. In: Proceedings of the 31st international conference in machine learning (ICML), vol 32(1), pp 647–655
Ge J, Li M, Zhang Q, Yang CZ, Wooley PH, Chen X et al (2013) Silica aerogel improves the biocompatibility in a poly-e-caprolactone composite used as a tissue engineering scaffold. Int J Polym Sci 402859:1–7. https://doi.org/10.1155/2013/402859
Gkioxari G, Girshick R, Malik J (2015) Contextual action recognition with R*CNN. In: Proceedings of the IEEE international conference on computer vision, vol 1080–1088. https://doi.org/10.1109/iccv.2015.129
Golnabi H, Asadpour A (2007) Design and application of industrial machine vision systems. Robot CIM-INT Manuf 23(6):630–637. https://doi.org/10.1016/j.rcim.2007.02.005
He C, Zhang F, Cao L, Feng W, Qiu K, Zhang Y et al (2012) Rapid mineralization of porous gelatin scaffolds by electrodeposition for bone tissue engineering. J Mater Chem 22:2111–2119. https://doi.org/10.1039/C1JM14631A
Ho N, Chua M, Chui CK (2017a) Optimization of cell seeding in a 2D bio-scaffold system using computational models. Comput Biol Med 84:98–113. https://doi.org/10.1016/j.compbiomed.2017.03.013
Ho N, Ang W, Chui CK (2017b) Workcell for hybrid medical device fabrication. In: Proceedings of the 3rd CIRP conference on biomanufacturing, vol 65, pp 236–241. https://doi.org/10.1016/j.procir.2017.04.052
Ho N, Wong PM, Chua M, Chui CK (2018) Virtual reality training for assembly of hybrid medical devices. Multimed Tools Appl 77(23):30651–30682. https://doi.org/10.1007/s11042-018-6216-x
Ho N, Ngooi SD, Chui CK (2019) Optimization of workcell layout for hybrid medical device fabrication. J Manuf Syst 50:163–179. https://doi.org/10.1016/j.jmsy.2018.12.010
Hoque ME, Chuan YL, Pashby I (2011) Extrusion based rapid prototyping technique: an advanced platform for tissue engineering scaffold fabrication. Biopolymers 97(2):83–93. https://doi.org/10.1002/bip.21701
Kitagawa T, Yamaoka T, Iwase R, Murakami A (2006) Three-dimensional cell seeding and growth in radial-flow perfusion bioreactor for in vitro tissue reconstruction. Biotechnol Bioeng 93(5):947–954. https://doi.org/10.1002/bit.20797
Krawiec JT, Liao HT, Kwan LL, D’Amore A, Weinbaum JS, Rubin JP, Wagner WR, Vorp DA (2017) Evaluation of the stromal vascular fraction of adipose tissue as the basis for a stem cell-based tissue-engineered vascular graft. J Vasc Surg 66(3):883–890. https://doi.org/10.1016/j.jvs.2016.09.034
Kristiansen S, Goebel V, Øyri K, Plagemann T (2018) Event-based methodology for real-time data analysis in cyber physical systems. Adv Intell Syst Comput 661:184–195. https://doi.org/10.1007/978-3-319-67618-0_17
Lee I, Sokolsky O (2010) Medical cyber physical systems. In: Proceedings of the 47th design automation conference, vol 743–748. https://doi.org/10.1145/1837274.1837463
Lenz C, Grimm M, Roder T, Knoll A (2012) Fusing multiple Kinects to survey shared Human-Robot-Workspaces. Technical Report TUM-I1214, Technische Universität München, pp 1–6.
Liu XF, Shahriar MR, Sunny SMNA, Leu MC, Hu L (2017) Cyber-physical manufacturing cloud: architecture, virtualization, communication, and testbed. J Manuf Syst 43:352–364. https://doi.org/10.1016/j.jmsy.2017.04.004
Liu C, Vengayil H, Zhong RY, Xu X (2018) A systematic development method for cyber-physical machine tools. J Manuf Syst 48:13–24. https://doi.org/10.1016/j.jmsy.2018.02.001
Lu Y, Xu X (2018) Resource virtualization: a core technology for developing cyber-physical production systems. J Manuf Syst 47:128–140. https://doi.org/10.1016/j.jmsy.2018.05.003
Lucke L, Anderson D, Smith D (2009) Harnessing experience for efficient medical device product development. J Med Devices 3(2):027551–027561. https://doi.org/10.1115/1.3147388
Ma M, Lin W, Pan D, Lin Y, Wang P, Zhou Y, Liang X (2017) Data and decision intelligence for human-in-the-loop cyber-physical systems: reference model, recent progresses and challenges. J Signal Process Syst 90(4):1–12. https://doi.org/10.1007/s11265-017-1304-0
Mi HY, Jing X, Salick MR, Turng LS, Peng XF (2014) Fabrication of thermoplastic polyurethane tissue engineering scaffold by combining microcellular injection molding and particle leaching. J Mater Res 29(8):911–922. https://doi.org/10.1557/jmr.2014.67
Monostori L, Kádár B, Bauernhansl T, Kondoh S, Kumara S, Reinhart G, Sauer O, Schuh G, Sihn W, Ueda K (2016) Cyber-physical systems in manufacturing. CIRP Ann Manuf Technol 65(2):621–641. https://doi.org/10.1016/j.cirp.2016.06.005
Mora H, Gil D, Terol RM, Azorín J, Szymanski J (2017) An IoT-based computational framework for healthcare monitoring in mobile environments. Sensors 17(10):1–25. https://doi.org/10.3390/s17102302
Mourtzis D, Vlachou A, Zogopoulos V (2017) Cloud-based augmented reality remote maintenance through shop-floor monitoring: a product-service system approach. ASME. J Manuf Sci Eng 139(6):061011. https://doi.org/10.1115/1.4035721
Nerem RM, Sambanis A (2007) Tissue engineering: from biology to biological substitutes. Tissue Eng 1(1):3–13. https://doi.org/10.1089/ten.1995.1.3
Okamoto M, Matsumoto S, Sugiyama A, Kanie K, Watanabe M, Huang H, Ali M, Ito Y, Miura J, Hirose Y, Uto K, Ebara M, Kato R, Yamawaki-Ogata A, Narita Y, Kawabata S, Takahashi Y, Hayashi M (2020) Performance of a biodegradable composite with hydroxyapatite as a scaffold in pulp tissue repair. Polymers 12(937):1–14
Pirvu BC, Zamfirescu CB, Gorecky D (2016) Engineering insights from an anthropocentric cyber-physical system: a case study for an assembly station. Mechatronics 34:147–159. https://doi.org/10.1016/j.mechatronics.2015.08.010
Porter J, Berkhahn J, Zhang L (2015) A comparative analysis of read mapping and indel calling pipelines for next-generation sequencing data. In: Tran QN, Arabnia HR (eds) Emerging trends in computational biology, bioinformatics, and systems biology. Elsevier Inc, Waltham, pp 521–535. https://doi.org/10.1016/B978-0-12-802508-6.00029-6
Premkumar T, Geckeler KE (2012) Graphene–DNA hybrid materials: assembly, applications, and prospects. Prog Polym Sci 37(4):515–529. https://doi.org/10.1016/j.progpolymsci.2011.08.003
Rawat W, Wang Z (2017) Deep convolutional neural networks for image classification: a comprehensive review. Neural Comput 29(9):2352–2449. https://doi.org/10.1162/NECO_a_00990
Razavian AS, Azizpour H, Sullivan J, Carlsson S (2014) CNN features off-the-shelf: an astounding baseline for recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, vol 512–519. https://doi.org/10.1109/CVPRW.2014.131
Roy S, Sarkar D, De D (2020) Entropy-aware ambient IoT analytics on humanized music information fusion. J Ambient Intell Human Comput 11:151–171. https://doi.org/10.1007/s12652-019-01261-x
Sowe SK, Simmon E, Zettsu K, Vaulx FD, Bojanova I (2016) Cyber-physical-human systems: putting people in the loop. IT Prof 18(1):10–13. https://doi.org/10.1109/MITP.2016.14
Sturm LD, Williams CB, Camelio JA, White J, Parker R (2017) Cyber-physical vulnerabilities in additive manufacturing systems: a case study attack on the.STL file with human subjects. J Manuf Syst 44:154–164. https://doi.org/10.1016/j.jmsy.2017.05.007
USC Consulting Group (2016) Improving efficiency in medical device manufacturing. http://www.usccg.com/improve-efficiency-medical-device-manufacturing/. Accessed 5 January 2019
Vogel-Heuser B, Diedrich C, Pantförder D, Göhner P (2014) Coupling heterogeneous production systems by a multi-agent based cyber-physical production system. In: Proceedings of the 12th IEEE international conference on industrial informatics (INDIN), vol 713–719. https://doi.org/10.1109/INDIN.2014.6945601
Wang L, Törngren M, Onori M (2015) Current status and advancement of cyber-physical systems in manufacturing. J Manuf Syst 37:517–527. https://doi.org/10.1016/j.jmsy.2015.04.008
Weber B, Zeisberger SM, Hoerstrup SP (2011) Prenatally harvested cells for cardiovascular tissue engineering: Fabrication of autologous implants prior to birth. Placenta 32:S316-319. https://doi.org/10.1016/j.placenta.2011.04.001
Weber B, Kehl D, Bleul U, Behr L, Sammut S, Frese L, Ksiazek A, Achermann J, Stranzinger G, Robert J, Sanders B, Sidler M, Brokopp CE, Proulx ST, Frauenfelder T, Schoenauer R, Emmert MY, Falk V, Hoerstrup SP (2016) In vitro fabrication of autologous living tissue-engineered vascular grafts based on prenatally harvested ovine amniotic fluid-derived stem cells. J Tissue Eng Regen Med 10:52–70. https://doi.org/10.1002/term.1781
Yang Z, Zhou Q, Lei L, Zheng K, Xiang W (2016) An IoT-cloud based wearable ECG monitoring system for smart healthcare. J Med Syst 40(12):1–11. https://doi.org/10.1007/s10916-016-0644-9
Yu S, Jia S, Xu C (2017) Convolutional neural networks for hyperspectral image classification. Neurocomputing 219:88–98. https://doi.org/10.1016/j.neucom.2016.09.010
Zhang Y, Qian C, Lv J, Liu Y (2017) Agent and cyber-physical system based self-organizing and self-adaptive intelligent shopfloor. IEEE Trans Ind Inform 13(2):737–747. https://doi.org/10.1109/TII.2016.2618892
Zhang H, Zhang G, Yan Q (2019) Digital twin-driven cyber-physical production system towards smart shop-floor. J Ambient Intell Human Comput 10:4439–4453. https://doi.org/10.1007/s12652-018-1125-4
Zhong RY, Wang L, Xu X (2017) An IoT-enabled real-time machine status monitoring approach for cloud manufacturing. In: Proceedings of the 50th CIRP conference on manufacturing systems, vol 63, pp 709–714. https://doi.org/10.1016/j.procir.2017.03.349
Acknowledgements
We acknowledge the valuable discussions with Mr. Chin-Beng Leng and his assistance in the development of the AR subsystem. We also would like to acknowledge Associate Professor, Dr. Thian Eng San for granting us the permission to utilize the Biomedical Materials Application and Technology (BIOMAT) Laboratory in National University of Singapore (NUS) to perform our initial experiments for this research project. We wish to acknowledge the contributions from Lee Yonggu for their assistance in the development of the CPSs. This project is supported in parts by a MOE FRC Tier 1 Grant from National University of Singapore (WBS: R-265-000-614-114).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ho, N., Wong, PM., Hoang, NS. et al. CPS-based manufacturing workcell for the production of hybrid medical devices. J Ambient Intell Human Comput 12, 10865–10879 (2021). https://doi.org/10.1007/s12652-020-02798-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-020-02798-y