{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,6]],"date-time":"2024-09-06T09:41:39Z","timestamp":1725615699596},"reference-count":78,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2022,6,29]],"date-time":"2022-06-29T00:00:00Z","timestamp":1656460800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"This is a review focused on advances and current limitations of computer vision (CV) and how CV can help us obtain to more autonomous actions in surgery. It is a follow-up article to one that we previously published in Sensors entitled, \u201cArtificial Intelligence Surgery: How Do We Get to Autonomous Actions in Surgery?\u201d As opposed to that article that also discussed issues of machine learning, deep learning and natural language processing, this review will delve deeper into the field of CV. Additionally, non-visual forms of data that can aid computerized robots in the performance of more autonomous actions, such as instrument priors and audio haptics, will also be highlighted. Furthermore, the current existential crisis for surgeons, endoscopists and interventional radiologists regarding more autonomy during procedures will be discussed. In summary, this paper will discuss how to harness the power of CV to keep doctors who do interventions in the loop.<\/jats:p>","DOI":"10.3390\/s22134918","type":"journal-article","created":{"date-parts":[[2022,6,30]],"date-time":"2022-06-30T02:43:28Z","timestamp":1656557008000},"page":"4918","source":"Crossref","is-referenced-by-count":27,"title":["The Advances in Computer Vision That Are Enabling More Autonomous Actions in Surgery: A Systematic Review of the Literature"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-7044-5318","authenticated-orcid":false,"given":"Andrew A.","family":"Gumbs","sequence":"first","affiliation":[{"name":"Departement de Chirurgie Digestive, Centre Hospitalier Intercommunal de, Poissy\/Saint-Germain-en-Laye, 78300 Poissy, France"},{"name":"Department of Surgery, University of Magdeburg, 39106 Magdeburg, Germany"}]},{"given":"Vincent","family":"Grasso","sequence":"additional","affiliation":[{"name":"Family Christian Health Center, 31 West 155th St., Harvey, IL 60426, USA"}]},{"given":"Nicolas","family":"Bourdel","sequence":"additional","affiliation":[{"name":"Gynecological Surgery Department, CHU Clermont Ferrand, 1, Place Lucie-Aubrac Clermont-Ferrand, 63100 Clermont-Ferrand, France"},{"name":"EnCoV, Institut Pascal, UMR6602 CNRS, UCA, Clermont-Ferrand University Hospital, 63000 Clermont-Ferrand, France"},{"name":"SurgAR-Surgical Augmented Reality, 63000 Clermont-Ferrand, France"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-6248-7086","authenticated-orcid":false,"given":"Roland","family":"Croner","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of Magdeburg, 39106 Magdeburg, Germany"}]},{"given":"Gaya","family":"Spolverato","sequence":"additional","affiliation":[{"name":"Department of Surgical, Oncological and Gastroenterological Sciences, University of Padova, 35122 Padova, Italy"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-7616-4226","authenticated-orcid":false,"given":"Isabella","family":"Frigerio","sequence":"additional","affiliation":[{"name":"Department of Hepato-Pancreato-Biliary Surgery, Pederzoli Hospital, 37019 Peschiera del Garda, Italy"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-0118-0483","authenticated-orcid":false,"given":"Alfredo","family":"Illanes","sequence":"additional","affiliation":[{"name":"INKA-Innovation Laboratory for Image Guided Therapy, Otto-von-Guericke University Magdeburg, 39120 Magdeburg, Germany"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-3162-4639","authenticated-orcid":false,"given":"Mohammad","family":"Abu Hilal","sequence":"additional","affiliation":[{"name":"Unit\u00e0 Chirurgia Epatobiliopancreatica, Robotica e Mininvasiva, Fondazione Poliambulanza Istituto Ospedaliero, Via Bissolati, 57, 25124 Brescia, Italy"}]},{"given":"Adrian","family":"Park","sequence":"additional","affiliation":[{"name":"Anne Arundel Medical Center, Johns Hopkins University, Annapolis, MD 21401, USA"}]},{"given":"Eyad","family":"Elyan","sequence":"additional","affiliation":[{"name":"School of Computing, Robert Gordon University, Aberdeen AB10 7JG, UK"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,29]]},"reference":[{"key":"ref_1","first-page":"1","article-title":"What is Artificial Intelligence Surgery?","volume":"1","author":"Gumbs","year":"2021","journal-title":"Artif. Intell. Surg."},{"key":"ref_2","first-page":"1","article-title":"Searching for a Better Definition of Robotic Surgery: Is It Really Different from Laparoscopy?","volume":"4","author":"Gumbs","year":"2020","journal-title":"Mini-Invasive Surg."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Gumbs, A.A., Frigerio, I., Spolverato, G., Croner, R., Illanes, A., Chouillard, E., and Elyan, E. (2021). Artificial Intelligence Surgery: How Do We Get to Autonomous Actions in Surgery?. Sensors, 21.","DOI":"10.3390\/s21165526"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1146\/annurev-control-062420-090543","article-title":"Autonomy in Surgical Robotics","volume":"4","author":"Attanasio","year":"2021","journal-title":"Annu. Rev. Control. Robot. Auton. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1240","DOI":"10.1016\/j.jacep.2017.05.005","article-title":"Catheter Ablation for Cardiac Arrhythmias: Utilization and In-Hospital Complications, 2000 to 2013","volume":"3","author":"Hosseini","year":"2017","journal-title":"JACC Clin. Electrophysiol."},{"key":"ref_6","first-page":"38","article-title":"Keeping surgeons in the loop: Are handheld robotics the best path towards more autonomous actions? (A comparison of complete vs. handheld robotic hepatectomy for colorectal liver metastases)","volume":"1","author":"Gumbs","year":"2021","journal-title":"Artif. Intell. Surg."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Try, P., Sch\u00f6llmann, S., W\u00f6hle, L., and Gebhard, M. (2021). Visual Sensor Fusion Based Autonomous Robotic System for Assistive Drinking. Sensors, 21.","DOI":"10.3390\/s21165419"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1002\/ags3.12513","article-title":"Artificial intelligence-based computer vision in surgery: Recent advances and future perspectives","volume":"6","author":"Kitaguchi","year":"2021","journal-title":"Ann. Gastroenterol. Surg."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1351","DOI":"10.12988\/ces.2017.711157","article-title":"Comparison between CNN and Haar Classifiers for Surgical Instrumentation Classifi-cation","volume":"10","author":"Murillo","year":"2017","journal-title":"Contemp. Eng. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4924","DOI":"10.1007\/s00464-019-07281-0","article-title":"Real-time automatic surgical phase recognition in laparoscopic sigmoidectomy using the convolutional neural network-based deep learning approach","volume":"34","author":"Kitaguchi","year":"2019","journal-title":"Surg. Endosc."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1114","DOI":"10.1109\/TMI.2017.2787657","article-title":"SV-RCNet: Workflow Recognition from Surgical Videos Using Recurrent Convolutional Network","volume":"37","author":"Jin","year":"2017","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1097\/SLA.0000000000003460","article-title":"Computer Vision Analysis of Intraoperative Video: Automated Recognition of Operative Steps in Laparoscopic Sleeve Gastrectomy","volume":"270","author":"Hashimoto","year":"2019","journal-title":"Ann. Surg."},{"key":"ref_13","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7\u201312). Faster R-CNN: Towards Real-time Object Detection with Region Proposal Networks. Proceedings of the 28th International Conference on Neural Information Processing Systems (NIPS 15), Montreal, QC, Canada."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1542","DOI":"10.1109\/TMI.2017.2665671","article-title":"Detection and Localization of Robotic Tools in Robot-Assisted Surgery Videos Using Deep Neural Networks for Region Proposal and Detection","volume":"36","author":"Sarikaya","year":"2017","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"101699","DOI":"10.1016\/j.media.2020.101699","article-title":"Surgical spectral imaging","volume":"63","author":"Clancy","year":"2020","journal-title":"Med Image Anal."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"080901","DOI":"10.1117\/1.JBO.21.8.080901","article-title":"Review of fluorescence guided surgery systems: Identification of key performance capabilities beyond indocyanine green imaging","volume":"21","author":"Dsouza","year":"2016","journal-title":"J. Biomed. Opt."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Studier-Fischer, A., Seidlitz, S., Sellner, J., Wiesenfarth, M., Ayala, L., Ozdemir, B., Odenthal, J., Kn\u00f6dler, S., Kowalewski, K.F., and Haney, C.M. (2021). Spectral organ fingerprints for intraoperative tissue classification with hyperspectral imaging. bioRxiv.","DOI":"10.1101\/2021.11.24.469943"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1164\/rccm.201211-2104OC","article-title":"Virtual Bronchoscopic Navigation Combined with Ultrathin Bronchoscopy. A Randomized Clinical Trial","volume":"188","author":"Asano","year":"2013","journal-title":"Am. J. Respir. Crit. Care Med."},{"key":"ref_21","first-page":"252","article-title":"Ultrathin Bronchoscopy with and without Virtual Bronchoscopic Navigation: Influence of Segmentation on Diagnostic Yield","volume":"97","author":"Morales","year":"2018","journal-title":"Respiration"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1007\/s11548-018-01910-0","article-title":"A dataset of laryngeal endoscopic images with comparative study on convolution neural network-based semantic segmentation","volume":"14","author":"Laves","year":"2019","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1177","DOI":"10.1007\/s11548-020-02151-w","article-title":"Detecting the occluding contours of the uterus to automatise augmented laparoscopy: Score, loss, dataset, evaluation and user study","volume":"15","author":"Calvet","year":"2020","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5377","DOI":"10.1007\/s00464-019-07330-8","article-title":"SurgAI: Deep learning for computerized laparoscopic image understanding in gynaecology","volume":"34","author":"Francois","year":"2020","journal-title":"Surg. Endosc."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2709","DOI":"10.1007\/s00464-019-07149-3","article-title":"Formalizing video documentation of the Critical View of Safety in laparoscopic cholecystectomy: A step towards artificial intelligence assistance to improve surgical safety","volume":"34","author":"Mascagni","year":"2019","journal-title":"Surg. Endosc."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"955","DOI":"10.1097\/SLA.0000000000004351","article-title":"Artificial Intelligence for Surgical Safety: Automatic Assessment of the Critical View of Safety in Laparoscopic Cholecystectomy Using Deep Learning","volume":"275","author":"Mascagni","year":"2022","journal-title":"Ann. Surg."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Chaurasia, A., and Culurciello, E. (2018, January 10\u201313). LinkNet: Exploiting encoder representations for efficient semantic segmentation. Proceedings of the 2017 IEEE Visual Communications and Image Processing (VCIP), St. Petersburg, FL, USA.","DOI":"10.1109\/VCIP.2017.8305148"},{"key":"ref_28","unstructured":"Iglovikov, V., and Shvets, A.A. (2018). TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Shvets, A.A., Rakhlin, A., Kalinin, A.A., and Iglovikov, V.I. (2018, January 17\u201320). Automatic Instrument Segmentation in Robot-Assisted Surgery using Deep Learning. Proceedings of the 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA), Orlando, FL, USA.","DOI":"10.1109\/ICMLA.2018.00100"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kamrul Hasan, S.M., and Linte, C.A. (2019, January 23\u201327). U-NetPlus: A Modified Encoder-Decoder U-Net Architecture for Semantic and Instance Seg-mentation of Surgical Instruments from Laparoscopic Images. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Berlin, Germany.","DOI":"10.1109\/EMBC.2019.8856791"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1227","DOI":"10.1007\/s11548-021-02404-2","article-title":"Mask then classify: Multi-instance segmentation for surgical instruments","volume":"16","author":"Kurmann","year":"2021","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1607","DOI":"10.1007\/s11548-021-02438-6","article-title":"Accurate instance segmentation of surgical instruments in robotic surgery: Model refinement and cross-dataset evaluation","volume":"16","author":"Kong","year":"2021","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Angeles-Ceron, J.C., Ochoa-Ruiz, G., Chang, L., and Ali, S. (2021). Real-time Instance Segmentation of Surgical Instruments using Attention and Multi-scale Feature Fusion. arXiv.","DOI":"10.1016\/j.media.2022.102569"},{"key":"ref_34","unstructured":"Alapatt, D., Mascagni, P., Vardazaryan, A., Garcia, A., Okamoto, N., Mutter, D., Marescaux, J., Costamagna, G., Dallemagne, B., and Padoy, N. (2021). Temporally Constrained Neural Networks (TCNN): A framework for semi-supervised video semantic segmentation. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Gao, J., and Tembine, H. (2017, January 6\u20138). Correlative Mean-Field Filter for Sequential and Spatial Data Processing. Proceedings of the IEEE International Conference on Computer as a Tool (EUROCON), Ohrid, Macedonia.","DOI":"10.1109\/EUROCON.2017.8011113"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Yeong, D., Velasco-Hernandez, G., Barry, J., and Walsh, J. (2021). Sensor and Sensor Fusion Technology in Autonomous Vehicles: A Review. Sensors, 21.","DOI":"10.20944\/preprints202102.0459.v1"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1192","DOI":"10.1007\/s00464-017-5791-7","article-title":"Augmented reality in a tumor resection model","volume":"32","author":"Chauvet","year":"2017","journal-title":"Surg. Endosc."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1177","DOI":"10.1016\/j.jmig.2019.04.003","article-title":"Use of Augmented Reality in Gynecologic Surgery to Visualize Adenomyomas","volume":"26","author":"Bourdel","year":"2019","journal-title":"J. Minim. Invasive Gynecol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1016\/j.jmig.2019.11.007","article-title":"Augmented Reality with Diffusion Tensor Imaging and Tractography during Laparoscopic Myomectomies","volume":"27","author":"Chauvet","year":"2019","journal-title":"J. Minim. Invasive Gynecol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1109\/TMI.2020.3027442","article-title":"Augmented Reality Guided Laparoscopic Surgery of the Uterus","volume":"40","author":"Collins","year":"2020","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1007\/s00464-016-4932-8","article-title":"Augmented reality in gynecologic surgery: Evaluation of potential benefits for myomectomy in an experimental uterine model","volume":"31","author":"Bourdel","year":"2016","journal-title":"Surg. Endosc."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1629","DOI":"10.1007\/s11548-018-1842-3","article-title":"Preoperative liver registration for augmented monocular laparoscopy using backward\u2013forward biomechanical simulation","volume":"13","author":"Koo","year":"2018","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1007\/s00464-017-5733-4","article-title":"Preliminary trial of augmented reality performed on a laparo-scopic left hepatectomy","volume":"32","author":"Phutane","year":"2018","journal-title":"Surg. Endosc."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/j.jviscsurg.2019.01.009","article-title":"Augmented reality guidance in laparoscopic hepatectomy with deformable semi-automatic computed tomography alignment (with video)","volume":"156","author":"Ozgur","year":"2019","journal-title":"J. Visc. Surg."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1712","DOI":"10.1007\/s10439-020-02479-z","article-title":"Combining Visual Cues with Interactions for 3D\u20132D Registration in Liver Laparoscopy","volume":"48","author":"Espinel","year":"2020","journal-title":"Ann. Biomed. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1007\/s00464-021-08798-z","article-title":"Augmented reality in laparoscopic liver resection evaluated on an ex-vivo animal model with pseudo-tumours","volume":"36","author":"Adballah","year":"2021","journal-title":"Surg. Endosc."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1008","DOI":"10.1007\/s10278-019-00272-6","article-title":"A Marker-Less Registration Approach for Mixed Reality\u2013Aided Maxillofacial Surgery: A Pilot Evaluation","volume":"32","author":"Pepe","year":"2019","journal-title":"J. Digit. Imaging"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1016\/j.cmpb.2009.06.009","article-title":"CYCLOPS: A mobile robotic platform for testing and validating image processing and autonomous navigation algorithms in support of artificial vision prostheses","volume":"96","author":"Fink","year":"2009","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"919","DOI":"10.1016\/j.acra.2004.05.014","article-title":"Automatic path searching for interactive navigation support within virtual medical 3-dimensional objects","volume":"11","author":"Noser","year":"2004","journal-title":"Acad. Radiol."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Athiniotis, S., Srivatsan, R.A., and Choset, H. (2019, January 23\u201326). Deep Q Reinforcement Learning for Autonomous Navigation of Surgical Snake Robot in Confined Spaces. Proceedings of the The Hamlyn Symposium on Medical Robotics, London, UK.","DOI":"10.31256\/HSMR2019.18"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1007\/s11548-015-1305-z","article-title":"Surgical robotics beyond enhanced dexterity in-strumentation: A survey of machine learning techniques and their role in intelligent and autonomous surgical actions","volume":"11","author":"Kassahun","year":"2016","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_52","first-page":"24","article-title":"Computer vision and machine learning for medical image analysis: Recent advances, challenges, and way forward","volume":"2","author":"Elyan","year":"2022","journal-title":"Artif. Intell. Surg."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11684-019-0733-5","article-title":"Application of artificial intelligence in surgery","volume":"14","author":"Zhou","year":"2020","journal-title":"Front. Med."},{"key":"ref_54","unstructured":"Dodge, S., and Karam, L. (August, January 31). A Study and Comparison of Human and Deep Learning Recognition Performance under Visual Distortions. Proceedings of the 26th International Conference on Computer Communication and Networks, Vancouver, BC, Canada."},{"key":"ref_55","first-page":"115","article-title":"Laparoscopic task recognition using Hidden Markov Models","volume":"111","author":"Dosis","year":"2005","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1109\/10.918597","article-title":"Markov modeling of minimally invasive surgery based on tool\/tissue interaction and force\/torque signatures for evaluating surgical skills","volume":"48","author":"Rosen","year":"2001","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1007\/s004640000230","article-title":"Skills evaluation in minimally invasive surgery using force\/torque signatures","volume":"14","author":"Richards","year":"2000","journal-title":"Surg. Endosc."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Lin, H.C., Shafran, I., Murphy, T.E., Okamura, A.M., Yuh, D.D., and Hager, G.D. (2005, January 26\u201329). Automatic Detection and Segmentation of Robot-Assisted Surgical Motions. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Palm Springs, CA, USA.","DOI":"10.1007\/11566465_99"},{"key":"ref_59","unstructured":"Reiley, C., Lin, H.C., Varadarajan, B., Vagvolgyi, B., Khudanpur, S., Yuh, D.D., and Hager, G.D. (2008, January 29). Automatic recognition of surgical motions using statistical modeling for capturing variability. Proceedings of the MMVR, Long Beach, CA, USA."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Varadarajan, B., Reiley, C., Lin, H., Khudanpur, S., and Hager, G. (2009, January 20\u201324). Data-Derived Models for Segmentation with Application to Surgical Assessment and Training. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, London, UK.","DOI":"10.1007\/978-3-642-04268-3_53"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1002\/rcs.408","article-title":"Evolution of autonomous and semi-autonomous robotic surgical systems: A review of the literature","volume":"7","author":"Moustris","year":"2011","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1111\/j.1749-4486.2008.01703.x","article-title":"An autonomous surgical robot for drilling a cochleostomy: Preliminary porcine trial","volume":"33","author":"Coulson","year":"2008","journal-title":"Clin. Otolaryngol."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Chow, D.L., Jackson, R.C., \u00c7avu\u015fo\u011flu, M.C., and Newman, W. (2014, January 18\u201322). A novel vision guided knot-tying method for autonomous robotic surgery. Proceedings of the 2014 IEEE International Conference on Automation Science and Engineering (CASE), New Taipei, Taiwan.","DOI":"10.1109\/CoASE.2014.6899373"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Ginesi, M., Meli, D., Roberti, A., Sansonetto, N., and Fiorini, P. (2020\u201324, January 24). Autonomous task planning and situation awareness in robotic surgery. Proceedings of the 2020 IEEE International Conference on Intelligent Robots and Systems, Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9341382"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"684","DOI":"10.1097\/SLA.0000000000004425","article-title":"Machine Learning for Surgical Phase Recognition: A Systematic Review","volume":"273","author":"Garrow","year":"2021","journal-title":"Ann. Surg."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1002\/rcs.238","article-title":"Trauma Pod: A semi-automated telerobotic surgical system","volume":"5","author":"Garcia","year":"2009","journal-title":"Int. J. Med Robot. Comput. Assist. Surg."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1016\/j.jamcollsurg.2006.11.010","article-title":"Evaluation of Resident Laparoscopic Performance Using Global Operative Assessment of Laparoscopic Skills","volume":"204","author":"Gumbs","year":"2007","journal-title":"J. Am. Coll. Surg."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"337ra64","DOI":"10.1126\/scitranslmed.aad9398","article-title":"Supervised autonomous robotic soft tissue surgery","volume":"8","author":"Shademan","year":"2016","journal-title":"Sci. Transl. Med."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JTEHM.2021.3056618","article-title":"Autonomous Robot for Removing Superficial Traumatic Blood","volume":"9","author":"Su","year":"2021","journal-title":"IEEE J. Transl. Eng. Health Med."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-021-94487-9","article-title":"A data-driven performance dashboard for surgical dissection","volume":"11","author":"Baghdadi","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1093\/milmed\/usaa253","article-title":"From the Dexterous Surgical Skill to the Battle-field-A Robotics Exploratory Study","volume":"186","author":"Gonzalez","year":"2021","journal-title":"Mil. Med."},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"3221","DOI":"10.1007\/s00464-021-08446-6","article-title":"Initial experience using a handheld fully articulating software-driven laparoscopic needle driver in TAPP inguinal hernia repair","volume":"35","author":"Needham","year":"2021","journal-title":"Surg. Endosc."},{"key":"ref_73","unstructured":"Marco, L., and Maria Farinella, G. (2018). Computer Vision and Machine Learning for Surgical Instrument Tracking: Focus: Random Forest-Based Microsurgical Tool Tracking. Computer Vision for Assistive Healthcare: A Volume in Computer Vision and Pattern Recognition, Elsevier. [1st ed.]."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-018-30641-0","article-title":"Novel clinical device tracking and tissue event characterization using proximally placed audio signal acquisition and processing","volume":"8","author":"Illanes","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"103370","DOI":"10.1016\/j.compbiomed.2019.103370","article-title":"Texture differentiation using audio signal analysis with robotic interventional instruments","volume":"112","author":"Chen","year":"2019","journal-title":"Comput. Biol. Med."},{"key":"ref_76","first-page":"1","article-title":"Surgical audio information as base for haptic feedback in ro-botic-assisted procedures","volume":"6","author":"Illanes","year":"2020","journal-title":"Curr. Dir. Biomed. Eng."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.compbiomed.2019.02.001","article-title":"Proximal detection of guide wire perforation using feature extraction from bispectral audio signal analysis combined with machine learning","volume":"107","author":"Mahmoodian","year":"2019","journal-title":"Comput. Biol. Med."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"55","DOI":"10.3389\/frobt.2019.00055","article-title":"Design and Integration of Electrical Bio-impedance Sensing in Surgical Robotic Tools for Tissue Identification and Display","volume":"6","author":"Cheng","year":"2019","journal-title":"Front. Robot. AI"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4918\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,1]],"date-time":"2024-08-01T06:31:23Z","timestamp":1722493883000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4918"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,29]]},"references-count":78,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["s22134918"],"URL":"https:\/\/doi.org\/10.3390\/s22134918","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,6,29]]}}}