{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,12,20]],"date-time":"2024-12-20T00:10:23Z","timestamp":1734653423445,"version":"3.32.0"},"reference-count":98,"publisher":"Association for Computing Machinery (ACM)","issue":"4","funder":[{"name":"Waterloo AI Institute"},{"name":"NSSFC","award":["22CG184"]},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"crossref","award":["2020-03966"],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2024,11,21]]},"abstract":"Children with autism spectrum disorder (ASD) have social-emotional deficits that lead to difficulties in recognizing emotions as well as understanding and responding to social interactions. This study presents EMooly, a tablet game that actively involves caregivers and leverages augmented reality (AR) and generative AI (GenAI) to enhance social-emotional learning for autistic children. Through a year of collaborative effort with five domain experts, we developed EMooly that engages children through personalized social stories, interactive and fun activities, and enhanced caregiver participation, focusing on emotion understanding and facial expression recognition. Compared with a baseline, a controlled study with 24 autistic children and their caregivers showed EMooly significantly improved children's emotion recognition skills and its novel features were preferred and appreciated. EMooly demonstrates the potential of AI and AR in enhancing social-emotional development for autistic children via prompt personalizing and engagement, and highlights the importance of caregiver involvement for optimal learning outcomes.<\/jats:p>","DOI":"10.1145\/3699738","type":"journal-article","created":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T17:23:32Z","timestamp":1732209812000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["EMooly: Supporting Autistic Children in Collaborative Social-Emotional Learning with Caregiver Participation through Interactive AI-infused and AR Activities"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-7730-8552","authenticated-orcid":false,"given":"Yue","family":"Lyu","sequence":"first","affiliation":[{"name":"University of Waterloo, Waterloo, ON, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-3513-6587","authenticated-orcid":false,"given":"Di","family":"Liu","sequence":"additional","affiliation":[{"name":"Southern University of Science and Technology, Shenzhen, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7705-2031","authenticated-orcid":false,"given":"Pengcheng","family":"An","sequence":"additional","affiliation":[{"name":"Southern University of Science and Technology, Shenzhen, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8037-6301","authenticated-orcid":false,"given":"Xin","family":"Tong","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology (Guangzhou), China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-0373-8241","authenticated-orcid":false,"given":"Huan","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, ON, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9642-9666","authenticated-orcid":false,"given":"Keiko","family":"Katsuragawa","sequence":"additional","affiliation":[{"name":"National Research Council, Waterloo, ON, Canada and University of Waterloo, Waterloo, ON, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5008-4319","authenticated-orcid":false,"given":"Jian","family":"Zhao","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, ON, Canada"}]}],"member":"320","published-online":{"date-parts":[[2024,11,21]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_2_2_1_1","DOI":"10.7196\/SAJCH.7942"},{"doi-asserted-by":"publisher","key":"e_1_2_2_2_1","DOI":"10.3390\/ijerph110807767"},{"doi-asserted-by":"publisher","key":"e_1_2_2_3_1","DOI":"10.1145\/3234695.3236351"},{"doi-asserted-by":"publisher","key":"e_1_2_2_4_1","DOI":"10.1176\/appi.books.9780890425596"},{"volume-title":"Using social stories to increase emotion recognition and labeling in school-age children with autism","author":"Bader Rachel","unstructured":"Rachel Bader. 2006. Using social stories to increase emotion recognition and labeling in school-age children with autism. Alliant International University, San Diego.","key":"e_1_2_2_5_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_6_1","DOI":"10.15585\/mmwr.ss6706a1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_7_1","DOI":"10.1111\/1469-7610.00715"},{"doi-asserted-by":"publisher","key":"e_1_2_2_8_1","DOI":"10.1145\/2593968.2593976"},{"doi-asserted-by":"publisher","key":"e_1_2_2_9_1","DOI":"10.1023\/A:1016378718278"},{"doi-asserted-by":"publisher","unstructured":"Audr\u00e9e Jeanne Beaudoin Guillaume S\u00e9bire and M\u00e9lanie Couture. 2019. Parent-mediated intervention tends to improve parent-child engagement and behavioral outcomes of toddlers with ASD-positive screening: A randomized crossover trial. Research in Autism Spectrum Disorders 66 (Oct. 2019) 101416. https:\/\/doi.org\/10.1016\/j.rasd.2019.101416","key":"e_1_2_2_10_1","DOI":"10.1016\/j.rasd.2019.101416"},{"doi-asserted-by":"publisher","key":"e_1_2_2_11_1","DOI":"10.1109\/ICACCS57279.2023.10112868"},{"doi-asserted-by":"publisher","key":"e_1_2_2_12_1","DOI":"10.1007\/s12559-014-9276-x"},{"doi-asserted-by":"publisher","key":"e_1_2_2_13_1","DOI":"10.1145\/3173574.3173778"},{"doi-asserted-by":"publisher","key":"e_1_2_2_14_1","DOI":"10.1145\/2751564"},{"doi-asserted-by":"publisher","key":"e_1_2_2_15_1","DOI":"10.1145\/3351995.3352037"},{"doi-asserted-by":"publisher","key":"e_1_2_2_16_1","DOI":"10.1145\/3329189.3329237"},{"key":"e_1_2_2_17_1","volume-title":"Arnaud Szmalec, and Lieven De Marez.","author":"Castellar Elena N\u00fa\u00f1ez","year":"2014","unstructured":"Elena N\u00fa\u00f1ez Castellar, Jan Van Looy, Arnaud Szmalec, and Lieven De Marez. 2014. Improving arithmetic skills through gameplay: Assessment of the effectiveness of an educational game in terms of cognitive and affective learning outcomes. Information sciences 264 (2014), 19--31."},{"doi-asserted-by":"publisher","key":"e_1_2_2_18_1","DOI":"10.3991\/ijet.v15i14.12509"},{"doi-asserted-by":"publisher","unstructured":"Chien-Hsu Chen I-Jui Lee and Ling-Yi Lin. 2016. Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions. Computers in Human Behavior 55 (Feb. 2016) 477--485. https:\/\/doi.org\/10.1016\/j.chb.2015.09.033","key":"e_1_2_2_19_1","DOI":"10.1016\/j.chb.2015.09.033"},{"doi-asserted-by":"publisher","key":"e_1_2_2_20_1","DOI":"10.1145\/3544548.3581341"},{"doi-asserted-by":"publisher","key":"e_1_2_2_21_1","DOI":"10.1080\/19411243.2023.2168824"},{"doi-asserted-by":"publisher","key":"e_1_2_2_22_1","DOI":"10.1145\/3351995.3352041"},{"key":"e_1_2_2_23_1","volume-title":"Renato AC Ferreira, and Raquel O Prates","author":"de Carvalho Ana Paula","year":"2023","unstructured":"Ana Paula de Carvalho, Camila S Braz, Sibele M dos Santos, Renato AC Ferreira, and Raquel O Prates. 2023. Serious games for children with autism spectrum disorder: A systematic literature review. International Journal of Human-Computer Interaction (2023), 1--28."},{"doi-asserted-by":"publisher","key":"e_1_2_2_24_1","DOI":"10.1007\/978-3-642-33885-4_79"},{"doi-asserted-by":"crossref","unstructured":"Michele D Dickey. 2006. Game design narrative for learning: Appropriating adventure game design narrative devices and techniques for the design of interactive learning environments. Educational technology research and development 54 (2006) 245--263.","key":"e_1_2_2_25_1","DOI":"10.1007\/s11423-006-8806-y"},{"key":"e_1_2_2_26_1","volume-title":"Gal Meiri, Idan Menashe, and Dorit Shmueli.","author":"Dinstein Ilan","year":"2023","unstructured":"Ilan Dinstein, Shirley Solomon, Michael Zats, Ronit Shusel, Raphael Lottner, Bella Ben Gershon, Gal Meiri, Idan Menashe, and Dorit Shmueli. 2023. Two-fold increase in the prevalence of autism in Israel between 2017 and 2021. medRxiv (2023), 2023--04."},{"doi-asserted-by":"publisher","key":"e_1_2_2_27_1","DOI":"10.1016\/j.ijhcs.2023.103139"},{"doi-asserted-by":"publisher","key":"e_1_2_2_28_1","DOI":"10.21767\/2471-9854.100037"},{"doi-asserted-by":"publisher","key":"e_1_2_2_29_1","DOI":"10.1037\/t27734-000"},{"doi-asserted-by":"publisher","key":"e_1_2_2_30_1","DOI":"10.1080\/14753634.2011.609025"},{"doi-asserted-by":"publisher","key":"e_1_2_2_31_1","DOI":"10.1007\/s10209-021-00818-y"},{"doi-asserted-by":"publisher","key":"e_1_2_2_32_1","DOI":"10.1145\/2982142.2982143"},{"doi-asserted-by":"publisher","key":"e_1_2_2_33_1","DOI":"10.1177\/1362361318775538"},{"doi-asserted-by":"publisher","key":"e_1_2_2_34_1","DOI":"10.1007\/s10803-018-3737-0"},{"doi-asserted-by":"publisher","key":"e_1_2_2_35_1","DOI":"10.1007\/s10803-009-0862-9"},{"doi-asserted-by":"publisher","key":"e_1_2_2_36_1","DOI":"10.1080\/17470910600980986"},{"key":"e_1_2_2_37_1","volume-title":"Ghorban Hemati Alamdarloo, and Shahram Moradi","author":"Golzari Fatemeh","year":"2015","unstructured":"Fatemeh Golzari, Ghorban Hemati Alamdarloo, and Shahram Moradi. 2015. The Effect of a Social Stories Intervention on the Social Skills of Male Students With Autism Spectrum Disorder. SAGE Open 5 (1 10 2015), 4."},{"doi-asserted-by":"publisher","key":"e_1_2_2_38_1","DOI":"10.1177\/108835769300800101"},{"doi-asserted-by":"publisher","key":"e_1_2_2_39_1","DOI":"10.1145\/1328567.1328576"},{"doi-asserted-by":"publisher","key":"e_1_2_2_40_1","DOI":"10.1145\/3585088.3593867"},{"doi-asserted-by":"publisher","key":"e_1_2_2_41_1","DOI":"10.1007\/s40489-020-00219-6"},{"doi-asserted-by":"publisher","key":"e_1_2_2_42_1","DOI":"10.1145\/3505270.3558320"},{"doi-asserted-by":"publisher","key":"e_1_2_2_43_1","DOI":"10.1109\/ISCCSP.2012.6217849"},{"doi-asserted-by":"publisher","key":"e_1_2_2_44_1","DOI":"10.1145\/3491101.3519874"},{"doi-asserted-by":"publisher","key":"e_1_2_2_45_1","DOI":"10.1177\/0265659013510922"},{"key":"e_1_2_2_46_1","volume-title":"Lynn Kern Koegel, and Lauren I Brookman","author":"Koegel Robert L","year":"2003","unstructured":"Robert L Koegel, Lynn Kern Koegel, and Lauren I Brookman. 2003. Empirically supported pivotal response interventions for children with autism. Evidence-based psychotherapies for children and adolescents 341357 (2003), 341--357."},{"doi-asserted-by":"publisher","key":"e_1_2_2_47_1","DOI":"10.1007\/BF01495055"},{"doi-asserted-by":"publisher","key":"e_1_2_2_48_1","DOI":"10.1007\/s10803-009-0931-0"},{"doi-asserted-by":"publisher","key":"e_1_2_2_49_1","DOI":"10.1016\/0270-4684(81)90003-3"},{"doi-asserted-by":"publisher","key":"e_1_2_2_50_1","DOI":"10.1017\/S2045796022000178"},{"key":"e_1_2_2_51_1","volume-title":"He Goes to the Seahorse\"-Blending Generative AI into Multimaterial Storymaking for Family Expressive Arts Therapy. arXiv preprint arXiv:2402.06472","author":"Liu Di","year":"2024","unstructured":"Di Liu, Hanqing Zhou, and Pengcheng An. 2024. \"When He Feels Cold, He Goes to the Seahorse\"-Blending Generative AI into Multimaterial Storymaking for Family Expressive Arts Therapy. arXiv preprint arXiv:2402.06472 (2024)."},{"doi-asserted-by":"publisher","key":"e_1_2_2_52_1","DOI":"10.1145\/3170427.3188525"},{"doi-asserted-by":"publisher","key":"e_1_2_2_53_1","DOI":"10.1145\/3596251"},{"doi-asserted-by":"publisher","key":"e_1_2_2_54_1","DOI":"10.1145\/2370216.2370277"},{"doi-asserted-by":"publisher","key":"e_1_2_2_55_1","DOI":"10.1007\/s11042-018-6916-2"},{"doi-asserted-by":"publisher","key":"e_1_2_2_56_1","DOI":"10.1177\/1362361307086664"},{"doi-asserted-by":"crossref","unstructured":"Antonio Narzisi. 2020. Handle the autism spectrum condition during Coronavirus (COVID-19) stay at home period: Ten tips for helping parents and caregivers of young children. 207 pages.","key":"e_1_2_2_57_1","DOI":"10.3390\/brainsci10040207"},{"doi-asserted-by":"publisher","key":"e_1_2_2_58_1","DOI":"10.1145\/3544548.3580721"},{"key":"e_1_2_2_59_1","volume-title":"Amanda V Young, BSN Amanda V Young","author":"Nuske Heather J","year":"2023","unstructured":"Heather J Nuske, PhD Heather J Nuske, Amanda V Young, BSN Amanda V Young, Farzana Khan, MPH Farzana Khan, Emma H Palermo, BA Emma H Palermo, Bukola Ajanaku Bukola Ajanaku, PhD Melanie Pellecchia NCSP, et al. 2023. Systematic review: emotion dysregulation and challenging behavior interventions for children andadolescents with autism with graded key evidence-based strategy recommendations. (2023)."},{"unstructured":"World Health Organization. 2023. Autism. https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/autism-spectrum-disorders","key":"e_1_2_2_60_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_61_1","DOI":"10.1145\/2212776.2223813"},{"doi-asserted-by":"publisher","key":"e_1_2_2_62_1","DOI":"10.1023\/A:1016374617369"},{"doi-asserted-by":"publisher","key":"e_1_2_2_63_1","DOI":"10.1177\/1088357610378291"},{"doi-asserted-by":"publisher","key":"e_1_2_2_64_1","DOI":"10.1145\/3271484"},{"doi-asserted-by":"publisher","key":"e_1_2_2_65_1","DOI":"10.1177\/1088357615613516"},{"doi-asserted-by":"publisher","key":"e_1_2_2_66_1","DOI":"10.1080\/10409280903440612"},{"key":"e_1_2_2_67_1","volume-title":"Russell Lang, and Mark O'Reilly.","author":"Ramdoss Sathiyaprakash","year":"2012","unstructured":"Sathiyaprakash Ramdoss, Wendy Machalicek, Mandy Rispoli, Austin Mulloy, Russell Lang, and Mark O'Reilly. 2012. Computer-based interventions to improve social and emotional skills in individuals with autism spectrum disorders: A systematic review. Developmental neurorehabilitation 15, 2 (2012), 119--135."},{"doi-asserted-by":"publisher","key":"e_1_2_2_68_1","DOI":"10.1007\/s10803-009-0842-0"},{"doi-asserted-by":"publisher","key":"e_1_2_2_69_1","DOI":"10.1007\/s10803-006-0086-1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_70_1","DOI":"10.1109\/ROBOT.2010.5509327"},{"key":"e_1_2_2_71_1","volume-title":"Scharoun Benson","author":"Camila Rios P.","year":"2020","unstructured":"P. Camila Rios and Sara M. Scharoun Benson. 2020. Exploring Caregiver Perspectives of Social and Motor Skills in Children With Autism Spectrum Disorder and the Impact on Participation. Frontiers in Psychology 11 (2020). https:\/\/www.frontiersin.org\/journals\/psychology\/articles\/10.3389\/fpsyg.2020.01260"},{"volume-title":"Serious games: Mechanisms and effects","author":"Ritterfeld Ute","unstructured":"Ute Ritterfeld, Michael Cody, and Peter Vorderer. 2009. Serious games: Mechanisms and effects. Routledge, Oxfordshire, England, UK.","key":"e_1_2_2_72_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_73_1","DOI":"10.1007\/s10803-019-04014-z"},{"doi-asserted-by":"publisher","key":"e_1_2_2_74_1","DOI":"10.1007\/s10803-007-0465-2"},{"doi-asserted-by":"publisher","key":"e_1_2_2_75_1","DOI":"10.1145\/3308557.3308688"},{"doi-asserted-by":"publisher","key":"e_1_2_2_76_1","DOI":"10.1038\/s41598-022-25902-y"},{"doi-asserted-by":"publisher","key":"e_1_2_2_77_1","DOI":"10.1080\/03004430.2019.1649256"},{"doi-asserted-by":"publisher","key":"e_1_2_2_78_1","DOI":"10.1007\/s10803-017-3386-8"},{"doi-asserted-by":"publisher","key":"e_1_2_2_79_1","DOI":"10.1007\/s10803-007-0527-5"},{"doi-asserted-by":"publisher","key":"e_1_2_2_80_1","DOI":"10.1023\/A:1014884404276"},{"doi-asserted-by":"publisher","key":"e_1_2_2_81_1","DOI":"10.1145\/2744195"},{"doi-asserted-by":"publisher","key":"e_1_2_2_82_1","DOI":"10.1145\/2818048.2820007"},{"doi-asserted-by":"publisher","key":"e_1_2_2_83_1","DOI":"10.1080\/10447318.2018.1550180"},{"unstructured":"Tarja Susi Mikael Johannesson and Per Backlund. 2007. Serious games: An overview. (2007).","key":"e_1_2_2_84_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_85_1","DOI":"10.1111\/j.1469-7610.2010.02258.x"},{"key":"e_1_2_2_86_1","first-page":"1","article-title":"Accessing peer social interaction: Using authorable virtual peer technology as a component of a group social skills intervention program","volume":"6","author":"Tartaro Andrea","year":"2014","unstructured":"Andrea Tartaro, Justine Cassell, Corina Ratz, Jennifer Lira, and Valeria Nanclares-Nogu\u00e9s. 2014. Accessing peer social interaction: Using authorable virtual peer technology as a component of a group social skills intervention program. ACM Transactions on Accessible Computing (TACCESS) 6, 1 (2014), 1--29.","journal-title":"ACM Transactions on Accessible Computing (TACCESS)"},{"doi-asserted-by":"publisher","key":"e_1_2_2_87_1","DOI":"10.1145\/3491102.3502130"},{"doi-asserted-by":"publisher","key":"e_1_2_2_88_1","DOI":"10.1007\/s00787-019-01395-5"},{"doi-asserted-by":"publisher","key":"e_1_2_2_89_1","DOI":"10.1016\/j.ijcci.2020.100214"},{"doi-asserted-by":"publisher","key":"e_1_2_2_90_1","DOI":"10.1145\/2470654.2466437"},{"doi-asserted-by":"publisher","key":"e_1_2_2_91_1","DOI":"10.1016\/j.eswa.2023.120527"},{"doi-asserted-by":"publisher","key":"e_1_2_2_92_1","DOI":"10.1145\/3130977"},{"doi-asserted-by":"publisher","key":"e_1_2_2_93_1","DOI":"10.1007\/s10803-014-2333-1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_94_1","DOI":"10.1044\/0161-1461(2011"},{"doi-asserted-by":"publisher","key":"e_1_2_2_95_1","DOI":"10.1111\/j.1469-7610.2012.02593.x"},{"doi-asserted-by":"publisher","key":"e_1_2_2_96_1","DOI":"10.2307\/1510643"},{"unstructured":"Zhiheng Xi Wenxiang Chen Xin Guo Wei He Yiwen Ding Boyang Hong Ming Zhang Junzhe Wang Senjie Jin Enyu Zhou Rui Zheng Xiaoran Fan Xiao Wang Limao Xiong Yuhao Zhou Weiran Wang Changhao Jiang Yicheng Zou Xiangyang Liu Zhangyue Yin Shihan Dou Rongxiang Weng Wensen Cheng Qi Zhang Wenjuan Qin Yongyan Zheng Xipeng Qiu Xuanjing Huang and Tao Gui. 2023. The Rise and Potential of Large Language Model Based Agents: A Survey. arXiv:2309.07864 [cs.AI]","key":"e_1_2_2_97_1"},{"doi-asserted-by":"publisher","key":"e_1_2_2_98_1","DOI":"10.1109\/ICIEV.2014.6850841"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3699738","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,19]],"date-time":"2024-12-19T23:32:23Z","timestamp":1734651143000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3699738"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,21]]},"references-count":98,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,11,21]]}},"alternative-id":["10.1145\/3699738"],"URL":"https:\/\/doi.org\/10.1145\/3699738","relation":{},"ISSN":["2474-9567"],"issn-type":[{"type":"electronic","value":"2474-9567"}],"subject":[],"published":{"date-parts":[[2024,11,21]]},"assertion":[{"value":"2024-11-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}