{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,19]],"date-time":"2024-09-19T16:25:25Z","timestamp":1726763125862},"reference-count":49,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2022,11,11]],"date-time":"2022-11-11T00:00:00Z","timestamp":1668124800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100013902","name":"ABB Corporate Research","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100013902","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100008982","name":"National Science Foundation of Sri Lanka","doi-asserted-by":"publisher","award":["2024561"],"id":[{"id":"10.13039\/501100008982","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Softw Pract Exp"],"published-print":{"date-parts":[[2023,3]]},"abstract":"Abstract<\/jats:title>Newly released robot programming tools have made it feasible for end\u2010users to program industrial robots by combining block\u2010based languages and lead\u2010through programming. To use these systems effectively, end\u2010users, who usually have limited or no programming experience, require training. To train users, tutoring systems are often used for block\u2010based programming\u2014some even for lead\u2010through programming\u2014but no tutorial system combines these two types of programming. We present CoBlox Interactive Tutorials (CITs), a novel tutoring approach that teaches how to use both the hardware and<\/jats:italic>\nsoftware components that comprise a typical end\u2010user robot programming environment. As users switch between the two programming styles, CITs provide them with extensive scaffolding, give users immediate feedback on missteps, and provide guidance on next steps. To evaluate CITs, we conducted a study with 79 industrial end\u2010users using a programming environment released by ABB Robotics that compares our approach to training with training videos, the most commonly used training in industry. This study, one of the largest to date on training professional end\u2010users, found that CIT\u2010trained users authored more correct programs in less time than video\u2010trained users. This shows that a tight integration of hardware and software concepts is crucial to training end\u2010users to program industrial robots.<\/jats:p>","DOI":"10.1002\/spe.3167","type":"journal-article","created":{"date-parts":[[2022,11,12]],"date-time":"2022-11-12T02:05:43Z","timestamp":1668218743000},"page":"729-747","update-policy":"http:\/\/dx.doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Training industrial end\u2010user programmers with interactive tutorials"],"prefix":"10.1002","volume":"53","author":[{"ORCID":"http:\/\/orcid.org\/0000-0001-5600-2978","authenticated-orcid":false,"given":"Nico","family":"Ritschel","sequence":"first","affiliation":[{"name":"Department of Computer Science University of British Columbia Vancouver British Columbia Canada"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-5816-8020","authenticated-orcid":false,"given":"Anand Ashok","family":"Sawant","sequence":"additional","affiliation":[{"name":"Department of Computer Science University of California, Davis Davis California USA"}]},{"given":"David","family":"Weintrop","sequence":"additional","affiliation":[{"name":"College of Education University of Maryland College Park Maryland USA"}]},{"given":"Reid","family":"Holmes","sequence":"additional","affiliation":[{"name":"Department of Computer Science University of British Columbia Vancouver British Columbia Canada"}]},{"given":"Alberto","family":"Bacchelli","sequence":"additional","affiliation":[{"name":"Department of Informatics University of Zurich Zurich Switzerland"}]},{"given":"Ronald","family":"Garcia","sequence":"additional","affiliation":[{"name":"Department of Computer Science University of British Columbia Vancouver British Columbia Canada"}]},{"given":"Chandrika","family":"K R","sequence":"additional","affiliation":[{"name":"ABB Corporate Research Bangalore Karnataka India"}]},{"given":"Avijit","family":"Mandal","sequence":"additional","affiliation":[{"name":"ABB Corporate Research Bangalore Karnataka India"}]},{"given":"Patrick","family":"Francis","sequence":"additional","affiliation":[{"name":"UserVoice Inc. Raleigh North Carolina USA"}]},{"given":"David C.","family":"Shepherd","sequence":"additional","affiliation":[{"name":"Department of Computer Science Virginia Commonwealth University Richmond Virginia USA"}]}],"member":"311","published-online":{"date-parts":[[2022,11,11]]},"reference":[{"key":"e_1_2_12_2_1","doi-asserted-by":"crossref","unstructured":"KockS VittorT MatthiasB et al.Robot concept for scalable flexible assembly automation: a technology study on a harmless dual\u2010armed robot. Proceedings of the International Symposium on Assembly and Manufacturing (ISAM);2011:1\u20105.","DOI":"10.1109\/ISAM.2011.5942358"},{"key":"e_1_2_12_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2015.2512741"},{"key":"e_1_2_12_4_1","first-page":"1","volume-title":"Proceedings of ISR and ROBOTIK","author":"Pan Z","year":"2010"},{"key":"e_1_2_12_5_1","first-page":"1","volume-title":"Proceedings of ARAA","author":"Biggs G","year":"2003"},{"key":"e_1_2_12_6_1","unstructured":"AjaykumarG SteeleM HuangCM.A survey on end\u2010user robot programming. arXiv preprint arXiv:210501757;2021."},{"key":"e_1_2_12_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2002.1045668"},{"key":"e_1_2_12_8_1","unstructured":"Lego Systems Inc.Lego mindstorms NXT\u2010G invention system;2008."},{"key":"e_1_2_12_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.3027255"},{"key":"e_1_2_12_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02481317"},{"key":"e_1_2_12_11_1","doi-asserted-by":"crossref","unstructured":"SefidgarYS WengT HarveyH ElliottS CakmakM.RobotIST: interactive situated tangible robot programming. Proceedings of the Symposium on Spatial User Interaction;2018:141\u2010149.","DOI":"10.1145\/3267782.3267921"},{"key":"e_1_2_12_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3332165.3347902"},{"key":"e_1_2_12_13_1","first-page":"366:1","volume-title":"Proceedings of SIGCHI","author":"Weintrop D","year":"2018"},{"key":"e_1_2_12_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753430"},{"key":"e_1_2_12_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025945"},{"key":"e_1_2_12_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/174809.174813"},{"key":"e_1_2_12_17_1","doi-asserted-by":"publisher","DOI":"10.4324\/9780203854501"},{"key":"e_1_2_12_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/24725854.2018.1493244"},{"key":"e_1_2_12_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753552"},{"key":"e_1_2_12_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1294211.1294248"},{"key":"e_1_2_12_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055047"},{"key":"e_1_2_12_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557407"},{"issue":"4","key":"e_1_2_12_23_1","first-page":"1","article-title":"Heyteddy: conversational test\u2010driven development for physical computing","volume":"3","author":"Kim Y","year":"2019","journal-title":"Proc UBICOMP"},{"key":"e_1_2_12_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242591"},{"key":"e_1_2_12_25_1","volume-title":"Paradox of the Active User","author":"Carroll JM","year":"1987"},{"key":"e_1_2_12_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518803"},{"key":"e_1_2_12_27_1","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X013006004"},{"key":"e_1_2_12_28_1","volume-title":"User Modeling","author":"Corbett A","year":"2001"},{"key":"e_1_2_12_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/00461520.2011.611369"},{"key":"e_1_2_12_30_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.228.4698.456"},{"key":"e_1_2_12_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3017680.3017728"},{"key":"e_1_2_12_32_1","doi-asserted-by":"publisher","DOI":"10.1177\/1076217517722578"},{"key":"e_1_2_12_33_1","volume-title":"LabVIEW Tutorial: Getting Started with LabVIEW Programming Basics","author":"NI Learning Center","year":"2022"},{"key":"e_1_2_12_34_1","doi-asserted-by":"crossref","unstructured":"KnabeK.Apple guide: a case study in user\u2010aided design of online help. Proceedings of the Conference Companion on Human Factors in Computing Systems;1995:286\u2010287.","DOI":"10.1145\/223355.223677"},{"key":"e_1_2_12_35_1","unstructured":"Code Inc.Hour of code. CoDesign; 2020.http:\/\/code.org\/learn."},{"key":"e_1_2_12_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1592761.1592779"},{"issue":"5","key":"e_1_2_12_37_1","first-page":"107","article-title":"Alice: a 3\u2010D tool for introductory programming concepts","volume":"15","author":"Cooper S","year":"2000","journal-title":"J Comput Sci Coll"},{"key":"e_1_2_12_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1095034.1095067"},{"key":"e_1_2_12_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047245"},{"key":"e_1_2_12_40_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-psych-010416-044022"},{"key":"e_1_2_12_41_1","volume-title":"RoboBlockly","author":"Barobo Inc","year":"2020"},{"key":"e_1_2_12_42_1","doi-asserted-by":"crossref","unstructured":"LiW GrossmanT FitzmauriceG.GamiCAD: a gamified tutorial system for first time autocad users. Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology;2012:103\u2010112.","DOI":"10.1145\/2380116.2380131"},{"key":"e_1_2_12_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3332165.3347920"},{"key":"e_1_2_12_44_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-psych-010416-044022"},{"key":"e_1_2_12_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2014.06.003"},{"issue":"194","key":"e_1_2_12_46_1","first-page":"4","article-title":"SUS\u2010A quick and dirty usability scale","volume":"189","author":"Brooke J","year":"1996","journal-title":"Usab Eval Ind"},{"issue":"6","key":"e_1_2_12_47_1","first-page":"574","article-title":"An empirical evaluation of the system usability scale","volume":"24","author":"Bangor A","year":"2008","journal-title":"J HCI"},{"key":"e_1_2_12_48_1","doi-asserted-by":"crossref","unstructured":"LewisJR SauroJ.The factor structure of the system usability scale. Proceedings of the International Conference on Human Centered Design;2009:94\u2010103.","DOI":"10.1007\/978-3-642-02806-9_12"},{"issue":"3","key":"e_1_2_12_49_1","first-page":"114","article-title":"Determining what individual SUS scores mean: adding an adjective rating scale","volume":"4","author":"Bangor A","year":"2009","journal-title":"J Usab Stud"},{"key":"e_1_2_12_50_1","doi-asserted-by":"crossref","unstructured":"WeintropD ShepherdDC FrancisP FranklinD.Blockly goes to work: block\u2010based programming for industrial robots. Proceedings of Blocks and Beyond Workshop (B&B);2017:29\u201036.","DOI":"10.1109\/BLOCKS.2017.8120406"}],"container-title":["Software: Practice and Experience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/spe.3167","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/spe.3167","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/spe.3167","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,19]],"date-time":"2023-08-19T11:48:15Z","timestamp":1692445695000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/spe.3167"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,11]]},"references-count":49,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,3]]}},"alternative-id":["10.1002\/spe.3167"],"URL":"https:\/\/doi.org\/10.1002\/spe.3167","archive":["Portico"],"relation":{},"ISSN":["0038-0644","1097-024X"],"issn-type":[{"value":"0038-0644","type":"print"},{"value":"1097-024X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,11]]},"assertion":[{"value":"2022-01-21","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-10-17","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-11-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}