{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,15]],"date-time":"2024-10-15T22:10:23Z","timestamp":1729030223162},"reference-count":51,"publisher":"SAGE Publications","issue":"4-5","license":[{"start":{"date-parts":[[2024,5,16]],"date-time":"2024-05-16T00:00:00Z","timestamp":1715817600000},"content-version":"vor","delay-in-days":411,"URL":"http:\/\/www.sagepub.com\/licence-information-for-chorus"}],"funder":[{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N00014-17-1-2699"],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of Robotics Research"],"published-print":{"date-parts":[[2023,4]]},"abstract":" We present a framework for the automatic encoding and repair of high-level tasks. Given a set of skills a robot can perform, our approach first abstracts sensor data into symbols and then automatically encodes the robot\u2019s capabilities in Linear Temporal Logic (LTL). Using this encoding, a user can specify reactive high-level tasks, for which we can automatically synthesize a strategy that executes on the robot, if the task is feasible. If a task is not feasible given the robot\u2019s capabilities, we present two methods, one enumeration-based and one synthesis-based, for automatically suggesting additional skills for the robot or modifications to existing skills that would make the task feasible. We demonstrate our framework on a Baxter robot manipulating blocks on a table, a Baxter robot manipulating plates on a table, and a Kinova arm manipulating vials, with multiple sensor modalities, including raw images. <\/jats:p>","DOI":"10.1177\/02783649231167207","type":"journal-article","created":{"date-parts":[[2023,5,16]],"date-time":"2023-05-16T20:31:15Z","timestamp":1684269075000},"page":"263-288","update-policy":"http:\/\/dx.doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Automatic encoding and repair of reactive high-level tasks with learned abstract representations"],"prefix":"10.1177","volume":"42","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-4349-1888","authenticated-orcid":false,"given":"Adam","family":"Pacheck","sequence":"first","affiliation":[{"name":"Cornell University, Ithaca, NY, USA"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-4366-4125","authenticated-orcid":false,"given":"Steven","family":"James","sequence":"additional","affiliation":[{"name":"University of the Witwatersrand, Johannesburg, South Africa"}]},{"given":"George","family":"Konidaris","sequence":"additional","affiliation":[{"name":"Brown University, Providence, RI, USA"}]},{"given":"Hadas","family":"Kress-Gazit","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY, USA"}]}],"member":"179","published-online":{"date-parts":[[2023,5,16]]},"reference":[{"key":"bibr1-02783649231167207","unstructured":"Ahmetoglu A, Seker M, Sayin A, et al. (2020) DeepSym: deep symbol generation and rule learning from unsupervised continuous robot interaction for planning. ArXiv preprint arXiv:2012.02532."},{"key":"bibr2-02783649231167207","first-page":"26","volume-title":"Formal methods in computer-aided design","author":"Alur R","year":"2013"},{"key":"bibr3-02783649231167207","first-page":"526","volume-title":"IEEE\/RSJ international conference on intelligent robots and systems","author":"Ames B","year":"2018"},{"key":"bibr4-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1609\/icaps.v29i1.3525"},{"key":"bibr5-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.12077"},{"key":"bibr6-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcss.2011.08.007"},{"key":"bibr7-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-85361-9_14"},{"key":"bibr8-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994018"},{"key":"bibr9-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1177\/0278364918761570"},{"key":"bibr10-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1145\/2883817.2883832"},{"key":"bibr11-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-41540-6_18"},{"key":"bibr12-02783649231167207","first-page":"226","volume-title":"Proceedings of the second international conference on knowledge discovery and data mining, KDD\u201996","author":"Ester M","year":"1996"},{"key":"bibr13-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2011.5979895"},{"key":"bibr14-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(71)90010-5"},{"key":"bibr15-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2010.5650371"},{"key":"bibr16-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1613\/jair.1129"},{"key":"bibr17-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-control-091420-084139"},{"key":"bibr18-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1016\/B978-155860856-6\/50004-1"},{"key":"bibr19-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139583923"},{"key":"bibr20-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2018.2889191"},{"key":"bibr21-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2019.8794170"},{"key":"bibr22-02783649231167207","volume-title":"Nonparametric Statistical Methods","author":"Hollander M","year":"2014","edition":"3"},{"key":"bibr23-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(00)00026-5"},{"key":"bibr24-02783649231167207","first-page":"4682","volume-title":"International conference on machine learning","author":"James S","year":"2020"},{"key":"bibr25-02783649231167207","unstructured":"Jetchev N, Lang T, Toussaint M (2013) Learning grounded relational symbols from continuous data for abstract reasoning. In: Proceedings of the 2013 ICRA workshop on autonomous learning, Karlsruhe, Germany, 6\u201310 May 2013."},{"key":"bibr26-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1177\/0278364915587034"},{"key":"bibr27-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1613\/jair.5575"},{"key":"bibr28-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/FMCAD.2009.5351127"},{"key":"bibr29-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2009.2030225"},{"key":"bibr30-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-control-060117-104838"},{"key":"bibr31-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2011.2172150"},{"key":"bibr32-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2016.2544339"},{"key":"bibr33-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA48506.2021.9561895"},{"key":"bibr34-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/MEMCOD.2011.5970509"},{"key":"bibr35-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-14295-6_49"},{"key":"bibr36-02783649231167207","unstructured":"McDermott D, Ghallab M, Howe A, et al. (1998) Pddl\u2014the planning domain definition language. Yale Center for Computational Vision and Control, Technical report CVC TR98003\/DCS TR1165."},{"key":"bibr37-02783649231167207","unstructured":"Mugan J, Kuipers B (2009) Autonomously learning an action hierarchy using a learned qualitative state representation. In: Proceedings of the 21st international jont conference on artifical intelligence, Pasadena, CA, 11\u201317 July 2009, pp. 1175\u20131180."},{"key":"bibr38-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/TAMD.2011.2160943"},{"key":"bibr39-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2017.2783445"},{"key":"bibr40-02783649231167207","unstructured":"Pacheck A, Konidaris G, Kress-Gazit H (2019) Automatic encoding and repair of reactive high-level tasks with learned abstract representations. In: International symposium on robotics research, Hanoi, Vietnam, 6\u201310 October 2019."},{"key":"bibr41-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA40945.2020.9197223"},{"key":"bibr42-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177704472"},{"key":"bibr43-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/SFCS.1977.32"},{"key":"bibr44-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2012.2214558"},{"key":"bibr45-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177728190"},{"key":"bibr46-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2014.6906922"},{"key":"bibr47-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2015.7139553"},{"key":"bibr48-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/HUMANOIDS.2015.7363477"},{"key":"bibr49-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2016.7759617"},{"key":"bibr50-02783649231167207","doi-asserted-by":"publisher","DOI":"10.1145\/1755952.1755968"},{"key":"bibr51-02783649231167207","unstructured":"Yoon S, Fern A, Givan R (2007) Ff-replan: a baseline for probabilistic planning. In: Proceedings of the seventeenth international conference on automated planning and scheduling, ICAPS, Providence, RI, 22\u201326 September 2007, pp. 352\u2013359."}],"container-title":["The International Journal of Robotics Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649231167207","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/02783649231167207","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649231167207","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/02783649231167207","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,15]],"date-time":"2024-10-15T21:36:50Z","timestamp":1729028210000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/02783649231167207"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4]]},"references-count":51,"journal-issue":{"issue":"4-5","published-print":{"date-parts":[[2023,4]]}},"alternative-id":["10.1177\/02783649231167207"],"URL":"https:\/\/doi.org\/10.1177\/02783649231167207","relation":{},"ISSN":["0278-3649","1741-3176"],"issn-type":[{"type":"print","value":"0278-3649"},{"type":"electronic","value":"1741-3176"}],"subject":[],"published":{"date-parts":[[2023,4]]}}}