{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,4,4]],"date-time":"2024-04-04T01:04:22Z","timestamp":1712192662728},"reference-count":65,"publisher":"IOP Publishing","issue":"2","license":[{"start":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T00:00:00Z","timestamp":1712102400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T00:00:00Z","timestamp":1712102400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"Proyectos de I+D+i del Ministerio de Ciencia, Innovacion y Universidades","award":["TASAR (Team of Advanced Search And Rescue Robots)"]},{"DOI":"10.13039\/501100003759","name":"Universidad Polit\u00e9cnica de Madrid","doi-asserted-by":"publisher","award":["\"Ayudas para contratos predoctorales para la reali"],"id":[{"id":"10.13039\/501100003759","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Programas de Actividades I+D en la Comunidad Madrid","award":["RoboCity2030-DIH-CM"]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2024,6,1]]},"abstract":"Abstract<\/jats:title>\n In recent years, legged quadruped robots have proved to be a valuable support to humans in dealing with search and rescue operations. These robots can move with great ability in complex terrains, unstructured environments or regions with many obstacles. This work employs the quadruped robot A1 Rescue Tasks UPM Robot (ARTU-R) by Unitree, equipped with an RGB-D camera and a lidar, to perform victim searches in post-disaster scenarios. Exploration is done not by following a pre-planned path (as common methods) but by prioritising the areas most likely to harbour victims. To accomplish that task, both indirect search and next best view techniques have been used. When ARTU-R gets inside an unstructured and unknown environment, it selects the next exploration point from a series of candidates. This operation is performed by comparing, for each candidate, the distance to reach it, the unexplored space around it and the probability of a victim being in its vicinity. This probability value is obtained using a Random Forest, which processes the information provided by a convolutional neural network. Unlike other AI techniques, random forests are not black box models; humans can understand their decision-making processes. The system, once integrated, achieves speeds comparable to other state-of-the-art algorithms in terms of exploration, but concerning victim detection, the tests show that the resulting smart exploration generates logical paths\u2014from a human point of view\u2014and that ARTU-R tends to move first to the regions where victims are present.<\/jats:p>","DOI":"10.1088\/2632-2153\/ad33df","type":"journal-article","created":{"date-parts":[[2024,3,14]],"date-time":"2024-03-14T22:23:01Z","timestamp":1710454981000},"page":"025004","update-policy":"http:\/\/dx.doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Active robotic search for victims using ensemble deep learning techniques"],"prefix":"10.1088","volume":"5","author":[{"ORCID":"http:\/\/orcid.org\/0000-0003-1429-8656","authenticated-orcid":true,"given":"Jorge F","family":"Garc\u00eda-Samart\u00edn","sequence":"first","affiliation":[]},{"ORCID":"http:\/\/orcid.org\/0000-0003-2824-6611","authenticated-orcid":true,"given":"Christyan","family":"Cruz Ulloa","sequence":"additional","affiliation":[]},{"ORCID":"http:\/\/orcid.org\/0000-0003-4893-2571","authenticated-orcid":false,"given":"Jaime","family":"del Cerro","sequence":"additional","affiliation":[]},{"ORCID":"http:\/\/orcid.org\/0000-0003-1691-3907","authenticated-orcid":false,"given":"Antonio","family":"Barrientos","sequence":"additional","affiliation":[]}],"member":"266","published-online":{"date-parts":[[2024,4,3]]},"reference":[{"key":"mlstad33dfbib1","author":"Institute for Economics & Peace","year":"2021"},{"key":"mlstad33dfbib2","first-page":"292","article-title":"Issues in intelligent robots for search and rescue","volume":"vol 4024","author":"Casper","year":"2000"},{"key":"mlstad33dfbib3","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1109\/TSMCC.2004.826267","article-title":"Human-robot interaction in rescue robotics","volume":"34","author":"Murphy","year":"2004","journal-title":"IEEE Trans. Syst. Man Cybern. C"},{"key":"mlstad33dfbib4","doi-asserted-by":"crossref","DOI":"10.21236\/ADA407901","article-title":"After action report to the unmanned ground vehicles \/ systems-joint program office: Center for the robotic assisted search and rescue (crasar) related efforts at the world trade center","author":"Blackburn","year":"2002"},{"key":"mlstad33dfbib5","author":"Murphy","year":"2014"},{"key":"mlstad33dfbib6","article-title":"The 2010 canterbury and 2011 christchurch new zealand earthquakes and the 2011 tohoku japan earthquake","author":"Eguchi","year":"2012"},{"key":"mlstad33dfbib7","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1109\/SSRR.2016.7784314","article-title":"Deployment of ground and aerial robots in earthquake-struck amatrice in italy (brief report)","author":"Kruijff","year":"2016"},{"key":"mlstad33dfbib8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/SSRR.2018.8468633","article-title":"Snake robot urban search after the 2017 mexico city earthquake 2018","author":"Whitman","year":"2018"},{"key":"mlstad33dfbib9","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1109\/ELECSYM.2016.7860982","article-title":"From concrete to abstract: multilayer neural networks for disaster victims detection","author":"Sulistijono","year":"2017"},{"key":"mlstad33dfbib10","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1109\/ICIAICT.2019.8784782","article-title":"Disaster Victims Detection System Using Convolutional Neural Network (CNN) Method","author":"Hartawan","year":"2019"},{"key":"mlstad33dfbib11","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1109\/ELECSYM.2018.8615503","article-title":"Implementation of victims detection framework on post disaster scenario","author":"Sulistijono","year":"2019"},{"key":"mlstad33dfbib12","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1109\/SSRR50563.2020.9292632","article-title":"Towards an autonomous UAV-based system to assist search and rescue operations in man overboard incidents","volume":"vol 2020","author":"Feraru","year":"2020"},{"key":"mlstad33dfbib13","doi-asserted-by":"publisher","first-page":"575","DOI":"10.1007\/978-3-030-95459-8_35","article-title":"Vision-based autonomous UAV navigation and landing for urban search and rescue","volume":"vol 20","author":"Mittal","year":"2022"},{"key":"mlstad33dfbib14","article-title":"Online 3D view planning for autonomous underwater exploration","author":"Vidal","year":"2019"},{"key":"mlstad33dfbib15","article-title":"Search and rescue robots\u2013current applications on land, sea, and air","author":"Walker","year":"2019"},{"key":"mlstad33dfbib16","doi-asserted-by":"publisher","first-page":"1460","DOI":"10.3390\/s19061460","article-title":"Two-Dimensional frontier-based viewpoint generation for exploring and mapping underwater environments","volume":"19","author":"Vidal","year":"2019","journal-title":"Sensors"},{"key":"mlstad33dfbib17","doi-asserted-by":"publisher","first-page":"1767","DOI":"10.3390\/e24121767","article-title":"Path planning research of a UAV base station searching for disaster victims\u2019 location information based on deep reinforcement learning","volume":"24","author":"Zhao","journal-title":"Entropy"},{"key":"mlstad33dfbib18","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1007\/s10846-020-01298-7","article-title":"Semantic active visual search system based on text information for large and unknown environments","volume":"101","author":"Mantelli","year":"2021","journal-title":"J. Intell. Robot. Syst., Theory Appl."},{"key":"mlstad33dfbib19","first-page":"723","article-title":"Fabrication and testing of the rescue quadruped robot for post-disaster search and rescue operations","author":"Li","year":"2023"},{"key":"mlstad33dfbib20","doi-asserted-by":"publisher","first-page":"1479","DOI":"10.1093\/jcde\/qwad061","article-title":"Mixed-reality for quadruped-robotic guidance in SAR tasks","volume":"10","author":"Cruz Ulloa","year":"2023","journal-title":"J. Comput. Des. Eng."},{"key":"mlstad33dfbib21","first-page":"13571","article-title":"Vision-assisted localization and terrain reconstruction with quadruped robots","author":"Zhang","year":"2022"},{"key":"mlstad33dfbib22","doi-asserted-by":"publisher","first-page":"1130","DOI":"10.1002\/rob.22175","article-title":"State estimation and traversability map construction method of a quadruped robot on soft uneven terrain","volume":"40","author":"Kang","year":"2023","journal-title":"J. Field Robot."},{"key":"mlstad33dfbib23","doi-asserted-by":"publisher","first-page":"7346","DOI":"10.3390\/s21217346","article-title":"Autonomous thermal vision robotic system for victims recognition in search and rescue missions","volume":"21","author":"Cruz Ulloa","year":"2021","journal-title":"Sensors"},{"key":"mlstad33dfbib24","author":"Lee","year":"2008"},{"key":"mlstad33dfbib25","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1006\/cviu.1998.0736","article-title":"Sensor planning for 3D object search","volume":"73","author":"Ye","year":"1996","journal-title":"Comput. Vis. Image Underst."},{"key":"mlstad33dfbib26","doi-asserted-by":"publisher","first-page":"2818","DOI":"10.1109\/ICRA.2011.5980495","article-title":"Search the real world: Active visual object search based on spatial relations","author":"Aydemir","year":"2011"},{"key":"mlstad33dfbib27","first-page":"1617","article-title":"Dora the explorer : a motivated robot","author":"Hawes","year":"2010"},{"key":"mlstad33dfbib28","doi-asserted-by":"publisher","first-page":"111","DOI":"10.3233\/978-1-60750-613-3-111","article-title":"Object search on a mobile robot using relational spatial information","author":"Aydemir","year":"2010"},{"key":"mlstad33dfbib29","doi-asserted-by":"publisher","first-page":"986","DOI":"10.1109\/TRO.2013.2256686","article-title":"Active visual object search in unknown environments using uncertain semantics","volume":"29","author":"Aydemir","year":"2013","journal-title":"IEEE Trans. Robot."},{"key":"mlstad33dfbib30","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1109\/ICRA.2014.6906604","article-title":"Using qualitative spatial relations for indirect object search","author":"Kunze","year":"2014"},{"key":"mlstad33dfbib31","doi-asserted-by":"publisher","first-page":"3515","DOI":"10.1109\/ICRA.2012.6224637","article-title":"Large-scale semantic mapping and reasoning with heterogeneous modalities","author":"Pronobis","year":"2012"},{"key":"mlstad33dfbib32","doi-asserted-by":"publisher","first-page":"144","DOI":"10.4995\/RIAI.2022.16113","article-title":"WGANVO: monocular visual odometry based on generative adversarial networks","volume":"19","author":"Cremona","year":"2021","journal-title":"Rev. Iberoamericana de Autom\u00e1tica e Inform\u00e1tica industrial"},{"key":"mlstad33dfbib33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/rs13214481","article-title":"Drone-based autonomous motion planning system for outdoor environments under object detection uncertainty","volume":"13","author":"Sandino","year":"2021","journal-title":"Remote Sens."},{"key":"mlstad33dfbib34","doi-asserted-by":"publisher","first-page":"5008","DOI":"10.1109\/IROS40897.2019.8967805","article-title":"Explore, Approach and Terminate: Evaluating Subtasks in Active Visual Object Search Based on Deep Reinforcement Learning","author":"Schmid","year":"2019"},{"key":"mlstad33dfbib35","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1007\/s10514-019-09882-z","article-title":"Attention-based active visual search for mobile robots","volume":"44","author":"Rasouli","year":"2019","journal-title":"Auton. Robots"},{"key":"mlstad33dfbib36","doi-asserted-by":"publisher","DOI":"10.1109\/AERO47225.2020.9172808","article-title":"Autonomous UAV navigation for active perception of targets in uncertain and cluttered environments","author":"Sandino","year":"2020"},{"key":"mlstad33dfbib37","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1016\/j.cie.2019.05.013","article-title":"A surrounding point set approach for path planning in unknown environments","volume":"133","author":"Han","year":"2019","journal-title":"Comput. Ind. Eng."},{"key":"mlstad33dfbib38","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1109\/CDS52072.2021.00058","article-title":"Active object searching on mobile robot using reinforcement learning","author":"Xu","year":"2021"},{"key":"mlstad33dfbib39","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1109\/ISCV.1995.477057","article-title":"Where to look next in 3d object search","author":"Ye","year":"1995"},{"key":"mlstad33dfbib40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TASE.2019.2894748","article-title":"Autonomous Robotic Exploration by Incremental Road Map Construction","volume":"16","author":"Wang","year":"2019","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"mlstad33dfbib41","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1016\/j.promfg.2020.01.364","article-title":"Optimal path planning for image based visual servoing","volume":"39","author":"Allen","year":"2019","journal-title":"Proc. Manuf."},{"key":"mlstad33dfbib42","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.114353","article-title":"A novel direct measure of exploration and exploitation based on attraction basins","volume":"167","author":"Jerebic","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"mlstad33dfbib43","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1016\/j.jvcir.2013.07.006","article-title":"A probabilistic framework for next best view estimation in a cluttered environment","volume":"25","author":"Potthast","year":"2014","journal-title":"J. Vis. Commun. Image Represent."},{"key":"mlstad33dfbib44","doi-asserted-by":"publisher","first-page":"1462","DOI":"10.1109\/ICRA.2016.7487281","article-title":"Receding horizon next-best-view planner for 3D exploration","volume":"vol 2016","author":"Bircher","year":"2016"},{"key":"mlstad33dfbib45","doi-asserted-by":"publisher","first-page":"1699","DOI":"10.1109\/LRA.2019.2897343","article-title":"Efficient autonomous exploration planning of large-scale 3-d environments","volume":"4","author":"Selin","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"mlstad33dfbib46","doi-asserted-by":"publisher","first-page":"2969","DOI":"10.1109\/LRA.2022.3146586","article-title":"A shadowcasting-based next-best-view planner for autonomous 3d exploration","volume":"7","author":"Batinovic","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"mlstad33dfbib47","doi-asserted-by":"publisher","first-page":"3779","DOI":"10.1109\/LRA.2022.3146558","article-title":"Online next-best-view planner for 3D-exploration and inspection with a mobile manipulator robot","volume":"7","author":"Naazare","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"mlstad33dfbib48","article-title":"TASAR\u2014Team of advanced search and rescue robot","author":"Barrientos","year":"2021"},{"key":"mlstad33dfbib49","first-page":"181","article-title":"Design and mixed-reality teleoperation of a quadruped-manipulator robot for sar tasks","author":"Cruz Ulloa","year":"2023"},{"key":"mlstad33dfbib50","doi-asserted-by":"crossref","DOI":"10.15607\/RSS.2021.XVII.011","article-title":"RMA: rapid motor adaptation for legged robots","author":"Kumar","year":"2021"},{"key":"mlstad33dfbib51","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.117857","article-title":"Morin M and Abi-Zeid I Supervised learning for maritime search operations: an artificial intelligence approach to search efficiency evaluation","volume":"206","author":"Laperri\u00e8re-Robillard","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"mlstad33dfbib52","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1080\/07370024.2004.9667342","article-title":"Beyond usability evaluation: analysis of human-robot interaction at a major robotics competition","volume":"19","author":"Yanco","year":"2004","journal-title":"Human-Comput. Interact."},{"key":"mlstad33dfbib53","doi-asserted-by":"publisher","first-page":"1311","DOI":"10.1002\/rob.21839","article-title":"Advances in real-world applications for legged robots","volume":"35","author":"Bellicoso","year":"2018","journal-title":"J. Field Robot."},{"key":"mlstad33dfbib54","doi-asserted-by":"publisher","first-page":"2518","DOI":"10.1109\/IROS45743.2020.9341361","article-title":"Autonomous spot: Long-range autonomous exploration of extreme environments with legged locomotion","author":"Bouman","year":"2020"},{"key":"mlstad33dfbib55","doi-asserted-by":"publisher","first-page":"2840","DOI":"10.1109\/LRA.2020.2972872","article-title":"Mine tunnel exploration using multiple quadrupedal robots","volume":"5","author":"Miller","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"mlstad33dfbib56","article-title":"Active robotic search for victims using ensemble deep learning techniques","author":"Garc\u00eda-Samart\u00edn","year":"2022"},{"key":"mlstad33dfbib57","article-title":"House rooms image dataset","author":"Reni","year":"2020"},{"key":"mlstad33dfbib58","article-title":"YOLOv5","author":"Jocher","year":"2020"},{"key":"mlstad33dfbib59","doi-asserted-by":"publisher","first-page":"1571","DOI":"10.1109\/CVPRW50498.2020.00203","article-title":"CSPNet: a new backbone that can enhance learning capability of CNN","volume":"vol 2020","author":"Wang","year":"2020"},{"key":"mlstad33dfbib60","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1016\/S1047-2797(01)00220-4","article-title":"Risk factors associated with moderate and serious injuries attributable to the 1994 northridge earthquake, los angeles, california","volume":"11","author":"Mahue-Giangreco","year":"2001","journal-title":"Ann. Epidemiol."},{"key":"mlstad33dfbib61","doi-asserted-by":"publisher","first-page":"1556","DOI":"10.3390\/ijerph14121556","article-title":"Investigating lushan earthquake victims\u2019 individual behavior response and rescue organization","volume":"14","author":"Kang","year":"2017","journal-title":"Int. J. Environ. Res. Public Health"},{"key":"mlstad33dfbib62","doi-asserted-by":"publisher","first-page":"568","DOI":"10.1007\/978-3-030-03098-8_43","article-title":"An agent-based approach to simulate post-earthquake indoor crowd evacuation","author":"Ni","year":"2018"},{"key":"mlstad33dfbib63","article-title":"Working from the same page: consistent messages for cdem","author":"Ministry of Civil Defence & Emergency","year":"2015"},{"key":"mlstad33dfbib64","doi-asserted-by":"publisher","first-page":"740","DOI":"10.1007\/978-3-319-10602-1_48","article-title":"Microsoft COCO: common objects in context","volume":"vol 8693","author":"Lin","year":"2014"},{"key":"mlstad33dfbib65","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1007\/s11370-021-00366-7","article-title":"Robust and adaptive door operation with a mobile robot","volume":"14","author":"Arduengo","year":"2021","journal-title":"Intell. Serv. Robot."}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad33df","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad33df\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad33df","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad33df\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad33df\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad33df\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad33df\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad33df\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T06:58:13Z","timestamp":1712127493000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad33df"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,3]]},"references-count":65,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,4,3]]},"published-print":{"date-parts":[[2024,6,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/ad33df","relation":{},"ISSN":["2632-2153"],"issn-type":[{"value":"2632-2153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,3]]},"assertion":[{"value":"Active robotic search for victims using ensemble deep learning techniques","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2024 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2023-05-09","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-03-14","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-04-03","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}