{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T17:42:51Z","timestamp":1732038171212},"reference-count":101,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,2,10]],"date-time":"2019-02-10T00:00:00Z","timestamp":1549756800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["NRI:INT 1734100"],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"Social robots are emerging as an important intervention for a variety of vulnerable populations. However, engaging participants in the design of social robots in a way that is ethical, meaningful, and rigorous can be challenging. Many current methods in human\u2013robotic interaction rely on laboratory practices, often experimental, and many times involving deception which could erode trust in vulnerable populations. Therefore, in this paper, we share our human-centered design methodology informed by a participatory approach, drawing on three years of data from a project aimed to design and develop a social robot to improve the mental health of teens. We present three method cases from the project that describe creative and age appropriate methods to gather contextually valid data from a teen population. Specific techniques include design research, scenario and script writing, prototyping, and teens as operators and collaborative actors. In each case, we describe the method and its implementation and discuss the potential strengths and limitations. We conclude by situating these methods by presenting a set of recommended participatory research principles that may be appropriate for designing new technologies with vulnerable populations.<\/jats:p>","DOI":"10.3390\/mti3010008","type":"journal-article","created":{"date-parts":[[2019,2,12]],"date-time":"2019-02-12T08:18:20Z","timestamp":1549959500000},"page":"8","source":"Crossref","is-referenced-by-count":73,"title":["Participatory Research Principles in Human-Centered Design: Engaging Teens in the Co-Design of a Social Robot"],"prefix":"10.3390","volume":"3","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-0385-2562","authenticated-orcid":false,"given":"Elin A.","family":"Bj\u00f6rling","sequence":"first","affiliation":[{"name":"Department of Human Centered Design & Engineering, University of Washington, Seattle, WA 98195, USA"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-4203-1548","authenticated-orcid":false,"given":"Emma","family":"Rose","sequence":"additional","affiliation":[{"name":"School of Interdisciplinary Arts and Sciences, University of Washington Tacoma, Tacoma, WA 98402, USA"}]}],"member":"1968","published-online":{"date-parts":[[2019,2,10]]},"reference":[{"key":"ref_1","first-page":"2","article-title":"Robots in the Wild: A Time for More Robust Theories of Human-Robot Interaction","volume":"7","author":"Jung","year":"2018","journal-title":"ACM Trans. Hum.-Robot Interact. (THRI)"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lee, H.R., \u0160abanovi\u0107, S., Chang, W.L., Nagata, S., Piatt, J., Bennett, C., and Hakken, D. (2017, January 6\u20139). Steps toward participatory design of social robots: mutual learning with older adults with depression. Proceedings of the 2017 ACM\/IEEE International Conference on Human-Robot Interaction, Vienna, Austria.","DOI":"10.1145\/2909824.3020237"},{"key":"ref_3","unstructured":"(2018, December 13). Jibo Social Robot: Where Things Went Wrong. Available online: https:\/\/www.therobotreport.com\/jibo-social-robot-analyzing-what-went-wrong\/."},{"key":"ref_4","unstructured":"(2018, December 13). The Adorable Kuri Robot Has Been Canceled\u2014The Verge. Available online: https:\/\/www.theverge.com\/circuitbreaker\/2018\/7\/25\/17613240\/kuri-robot-pause-refund-mayfield-robotics."},{"key":"ref_5","unstructured":"(2018, December 13). Sony Halts Support for Aibo, Still One of the Best Robot Toys Ever\u2014IEEE Spectrum. Available online: https:\/\/spectrum.ieee.org\/automaton\/robotics\/home-robots\/sony-halts-support-for-aibo-still-one-of-the-best-robot-toys-ever."},{"key":"ref_6","unstructured":"American Psychological Association (2018, December 13). Stress in America 2013 Highlights: Are Teens Adopting Adults\u2019 Stress Habits. Available online: https:\/\/www.apa.org\/news\/press\/releases\/stress\/2013\/highlights.aspx."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"702","DOI":"10.1177\/2167702614545479","article-title":"Stress and the development of cognitive vulnerabilities to depression explain sex differences in depressive symptoms during adolescence","volume":"3","author":"Hamilton","year":"2015","journal-title":"Clin. Psychol. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1028","DOI":"10.3389\/fpsyg.2015.01028","article-title":"A multi-method exploratory study of stress, coping, and substance use among high school youth in private schools","volume":"6","author":"Leonard","year":"2015","journal-title":"Front. Psychol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.neuroscience.2012.10.048","article-title":"Stress and the developing adolescent brain","volume":"249","author":"Eiland","year":"2013","journal-title":"Neuroscience"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"16011","DOI":"10.1038\/npjscilearn.2016.11","article-title":"Learning and memory under stress: Implications for the classroom","volume":"1","author":"Vogel","year":"2016","journal-title":"NPJ Sci. Learn."},{"key":"ref_11","unstructured":"Snyder, H.R., Young, J.F., and Hankin, B.L. (2017). Chronic stress exposure and generation are related to the p-factor and externalizing specific psychopathology in youth. J. Clin. Child Adolesc. Psychol., 1\u201310."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1007\/s12310-010-9038-1","article-title":"Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation","volume":"2","author":"Langley","year":"2010","journal-title":"Sch. Ment. Health"},{"key":"ref_13","unstructured":"Feil-Seifer, D., and Mataric, M.J. (July, January 28). Defining socially assistive robotics. Rehabilitation Robotics, 2005. Proceedings of the IEEE Conference on 9th International (ICORR 2005), Chicago, IL, USA."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Breazeal, C. (September, January 30). Social robots for health applications. Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA.","DOI":"10.1109\/IEMBS.2011.6091328"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1038","DOI":"10.1007\/s10803-012-1645-2","article-title":"Social robots as embedded reinforcers of social behavior in children with autism","volume":"43","author":"Kim","year":"2013","journal-title":"J. Autism Dev. Disord."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Duckworth, D., Henkel, Z., Wuisan, S., Cogley, B., Collins, C., and Bethel, C.L. (2015, January 2\u20135). Therabot: The Initial Design of a Robotic Therapy Support System. Proceedings of the Tenth Annual ACM\/IEEE International Conference on Human-Robot Interaction Extended Abstracts, Portland, OR, USA.","DOI":"10.1145\/2701973.2701993"},{"key":"ref_17","unstructured":"Wada, K., Shibata, T., Saito, T., Sakamoto, K., and Tanie, K. (2005, January 18\u201322). Psychological and social effects of one year robot assisted activity on elderly people at a health service facility for the aged. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2005), Barcelona, Spain."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fernaeus, Y., H\u00e5kansson, M., Jacobsson, M., and Ljungblad, S. (2010, January 9\u201312). How do you play with a robotic toy animal?: A long-term study of pleo. Proceedings of the 9th International Conference on Interaction Design and Children, Barcelona, Spain.","DOI":"10.1145\/1810543.1810549"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s12369-008-0009-8","article-title":"Keepon","volume":"1","author":"Kozima","year":"2009","journal-title":"Int. J. Soc. Robot."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bj\u00f6rling, E.A., Rose, E., and Ren, R. (2018, January 5\u20138). Teen-Robot Interaction: A Pilot Study of Engagement with a Low-fidelity Prototype. Proceedings of the Companion of the 2018 ACM\/IEEE International Conference on Human-Robot Interaction, Chicago, IL, USA.","DOI":"10.1145\/3173386.3177068"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1207\/s15327051hci1901&2_4","article-title":"Interactive robots as social partners and peer tutors for children: A field trial","volume":"19","author":"Kanda","year":"2004","journal-title":"Hum.\u2013Comput. Interact."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"962","DOI":"10.1109\/TRO.2007.904904","article-title":"A two-month field trial in an elementary school for long-term human\u2014Robot interaction","volume":"23","author":"Kanda","year":"2007","journal-title":"IEEE Trans. Robot."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1007\/s10209-005-0116-3","article-title":"Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills?","volume":"4","author":"Robins","year":"2005","journal-title":"Univ. Access Inf. Soc."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/S0921-8890(02)00377-9","article-title":"Social and collaborative aspects of interaction with a service robot","volume":"42","author":"Green","year":"2003","journal-title":"Robot. Auton. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Collins, C., Duckworth, D., Henkel, Z., Wuisan, S., and Bethel, C.L. (2015, January 2\u20135). Therabot\u2122: A Robot Therapy Support System in Action. Proceedings of the Tenth Annual ACM\/IEEE International Conference on Human-Robot Interaction Extended Abstracts, Portland, OR, USA.","DOI":"10.1145\/2701973.2702695"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Sabelli, A.M., Kanda, T., and Hagita, N. (2011, January 6\u20139). A conversational robot in an elderly care center: An ethnographic study. Proceedings of the 2011 6th ACM\/IEEE International Conference on Human-Robot Interaction (HRI), Lausanne, Switzerland.","DOI":"10.1145\/1957656.1957669"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1109\/TRO.2007.906261","article-title":"Living with seal robots\u2014Its sociopsychological and physiological influences on the elderly at a care house","volume":"23","author":"Wada","year":"2007","journal-title":"IEEE Trans. Robot."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1561\/2300000052","article-title":"A survey of methods for safe human-robot interaction","volume":"5","author":"Lasota","year":"2017","journal-title":"Found. Trends Robot."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1177\/1557234X13502463","article-title":"Teleoperation and beyond for assistive humanoid robots","volume":"9","author":"Goodrich","year":"2013","journal-title":"Rev. Hum. Factors Ergon."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Bailly, G., and Elisei, F. (2018, January 14\u201315). Demonstrating and Learning Multimodal Socio-communicative Behaviors for HRI: Building Interactive Models from Immersive Teleoperation Data. Proceedings of the FAIM\/ISCA Workshop on Artificial Intelligence for Multimodal Human Robot Interaction, Stockholm, Sweden.","DOI":"10.21437\/AI-MHRI.2018-10"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1109\/THMS.2014.2371048","article-title":"Usability guidelines for the design of robot teleoperation: A taxonomy","volume":"45","author":"Adamides","year":"2015","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Rosen, P.H., Sommer, S., and Wischniwski, S. (2018). Evaluation of Human-Robot Interaction Quality: A Toolkit for Workplace Design. Congress of the International Ergonomics Association, Springer.","DOI":"10.1007\/978-3-319-96071-5_169"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"618","DOI":"10.1177\/0278364917690593","article-title":"Human-robot mutual adaptation in collaborative tasks: Models and experiments","volume":"36","author":"Nikolaidis","year":"2017","journal-title":"Int. J. Robot. Res."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.rcim.2015.12.007","article-title":"Collaborative manufacturing with physical human\u2013robot interaction","volume":"40","author":"Cherubini","year":"2016","journal-title":"Robot. Comput.-Integr. Manuf."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1177\/0278364914557874","article-title":"Robot navigation in dense human crowds: Statistical models and experimental studies of human\u2014Robot cooperation","volume":"34","author":"Trautman","year":"2015","journal-title":"Int. J. Robot. Res."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1007\/s10514-016-9572-2","article-title":"Autonomous human\u2013robot proxemics: Socially aware navigation based on interaction potential","volume":"41","author":"Mead","year":"2017","journal-title":"Auton. Robot."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Unhelkar, V.V., P\u00e9rez-D\u2019Arpino, C., Stirling, L., and Shah, J.A. (2015, January 26\u201330). Human-robot co-navigation using anticipatory indicators of human walking motion. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7140067"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Darling, K., Nandy, P., and Breazeal, C. (September, January 31). Empathic concern and the effect of stories in human-robot interaction. Proceedings of the 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Kobe, Japan.","DOI":"10.1109\/ROMAN.2015.7333675"},{"key":"ref_39","unstructured":"Cameron, D., Aitken, J., Collins, E., Boorman, L., Chua, A., Fernando, S., McAree, O., Martinez Hernandez, U., and Law, J. (October, January 28). Framing factors: The importance of context and the individual in understanding trust in human-robot interaction. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS) 2015, Hamburg, Germany."},{"key":"ref_40","unstructured":"Fung, P., Bertero, D., Wan, Y., Dey, A., Chan, R.H.Y., Siddique, F.B., Yang, Y., Wu, C.S., and Lin, R. (2016). Towards empathetic human-robot interactions. International Conference on Intelligent Text Processing and Computational Linguistics, Springer."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Salem, M., Lakatos, G., Amirabdollahian, F., and Dautenhahn, K. (2015, January 2\u20135). Would you trust a (faulty) robot?: Effects of error, task type and personality on human-robot cooperation and trust. Proceedings of the Tenth Annual ACM\/IEEE International Conference on Human-Robot Interaction, Portland, OR, USA.","DOI":"10.1145\/2696454.2696497"},{"key":"ref_42","unstructured":"Walker, T. (2018, December 20). Establishing Trust in Human-Robot Interaction The Significance of Social and Personal Distance. Available online: https:\/\/commons.erau.edu\/hfap\/hfap-2015\/posters\/37\/."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Kessler, T.T., Larios, C., Walker, T., Yerdon, V., and Hancock, P. (2017). A Comparison of Trust Measures in Human\u2013Robot Interaction Scenarios. Advances in Human Factors in Robots and Unmanned Systems, Springer.","DOI":"10.1007\/978-3-319-41959-6_29"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Lewis, M., Sycara, K., and Walker, P. (2018). The role of trust in human-robot interaction. Foundations of Trusted Autonomy, Springer.","DOI":"10.1007\/978-3-319-64816-3_8"},{"key":"ref_45","unstructured":"Wagner, A.R. (2009). The Role of Trust and Relationships in Human-Robot Social Interaction. [Ph.D. Thesis, Georgia Institute of Technology]."},{"key":"ref_46","unstructured":"Bonial, C., Marge, M., Foots, A., Gervits, F., Hayes, C.J., Henry, C., Hill, S.G., Leuski, A., Lukin, S.M., and Moolchandani, P. (2017). Laying Down the Yellow Brick Road: Development of a Wizard-of-Oz Interface for Collecting Human-Robot Dialogue. arXiv."},{"key":"ref_47","unstructured":"Hoffman, G. (2018, January 26\u201328). Openwoz: A runtime-configurable wizard-of-oz framework for human-robot interaction. Proceedings of the AAAI Spring Symposium on Enabling Computing Research in Socially Intelligent Human-Robot Interaction, Palo Alto, CA, USA."},{"key":"ref_48","unstructured":"Knox, W.B., Spaulding, S., and Breazeal, C. (2018, December 20). Learning from the Wizard: Programming Social Interaction through Teleoperated Demonstrations. Available online: https:\/\/pdfs.semanticscholar.org\/2f04\/4effc6b80c8da00fe5aaf1a9ddfaf86e9e16.pdf."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Mutlu, B., Yamaoka, F., Kanda, T., Ishiguro, H., and Hagita, N. (2009, January 9\u201313). Nonverbal leakage in robots: Communication of intentions through seemingly unintentional behavior. Proceedings of the 4th ACM\/IEEE international conference on Human Robot Interaction, La Jolla, CA, USA.","DOI":"10.1145\/1514095.1514110"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Riether, N., Hegel, F., Wrede, B., and Horstmann, G. (2012, January 5\u20138). Social facilitation with social robots?. Proceedings of the Seventh Annual ACM\/IEEE International Conference on Human-Robot Interaction, Boston, MA, USA.","DOI":"10.1145\/2157689.2157697"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.cognition.2018.12.005","article-title":"Gaze allocation in face-to-face communication is affected primarily by task structure and social context, not stimulus-driven factors","volume":"184","author":"Hessels","year":"2019","journal-title":"Cognition"},{"key":"ref_52","unstructured":"Riek, L., and Howard, D. (2014, January 12\u201314). A code of ethics for the human-robot interaction profession. Proceedings of the We Robot, Stanford, CA, USA."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Riek, L.D., Hartzog, W., Howard, D.A., Moon, A., and Calo, R. (2015, January 2\u20135). The Emerging Policy and Ethics of Human Robot Interaction. Proceedings of the Tenth Annual ACM\/IEEE International Conference on Human-Robot Interaction Extended Abstracts, Portland, OR, USA.","DOI":"10.1145\/2701973.2714393"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1007\/s12369-016-0368-5","article-title":"An ethical evaluation of human\u2013robot relationships","volume":"8","year":"2016","journal-title":"Int. J. Soc. Robot."},{"key":"ref_55","unstructured":"Westlund, J.K., Breazeal, C., and Story, A. (2018, December 20). Deception, Secrets, Children, and Robots: What\u2019s Acceptable. Available online: https:\/\/www.media.mit.edu\/publications\/deception-secrets-children-and-robots-what-s-acceptable\/."},{"key":"ref_56","unstructured":"Sabanovic, S., Michalowski, M.P., and Simmons, R. (2006, January 27\u201329). Robots in the wild: Observing human-robot social interaction outside the lab. Proceedings of the 9th IEEE International Workshop on Advanced Motion Control, Istanbul, Turkey."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1007\/s11370-007-0009-9","article-title":"Going into the wild in child\u2013robot interaction studies: Issues in social robotic development","volume":"1","author":"Salter","year":"2008","journal-title":"Intell. Serv. Robot."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Ros, R., Nalin, M., Wood, R., Baxter, P., Looije, R., Demiris, Y., Belpaeme, T., Giusti, A., and Pozzi, C. (2011, January 14\u201318). Child-robot interaction in the wild: Advice to the aspiring experimenter. Proceedings of the 13th International Conference on Multimodal Interfaces, Alicante, Spain.","DOI":"10.1145\/2070481.2070545"},{"key":"ref_59","unstructured":"Bohus, D., Saw, C.W., and Horvitz, E. (2014, January 5\u20139). Directions robot: In-the-wild experiences and lessons learned. Proceedings of the 2014 International Conference on Autonomous Agents and Multi-Agent Systems, Paris, France."},{"key":"ref_60","unstructured":"Jacobson, R.E. (2000). Human-Centered Design. Information Design, MIT Press. Chapter 10."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1177\/0047281616653494","article-title":"Design as advocacy: Using a human-centered approach to investigate the needs of vulnerable populations","volume":"46","author":"Rose","year":"2016","journal-title":"J. Tech. Writ. Commun."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1080\/15710882.2011.563314","article-title":"Tensions in human-centred design","volume":"7","author":"Steen","year":"2011","journal-title":"CoDesign"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1162\/074793601750357178","article-title":"Human dignity and human rights: Thoughts on the principles of human-centered design","volume":"17","author":"Buchanan","year":"2001","journal-title":"Des. Issues"},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1177\/0047281616653496","article-title":"Supporting human dignity and human rights: A call to adopt the first principle of human-centered design","volume":"46","author":"Walton","year":"2016","journal-title":"J. Tech. Writ. Commun."},{"key":"ref_65","unstructured":"Putnam, C., Rose, E., Johnson, E.J., and Kolko, B. (2009). Adapting user-centered design methods to design for diverse populations. Inf. Technol. Int. Dev., 5."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Bell, A., and Davis, K. (2016, January 21\u201324). Learning through Participatory Design: Designing Digital Badges for and with Teens. Proceedings of the 15th International Conference on Interaction Design and Children, Manchester, UK.","DOI":"10.1145\/2930674.2930705"},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Fitton, D., Bell, B.T., Little, L., Horton, M., Read, J.C., Rouse, M., and Toth, N. (2016). Working with teenagers in HCI research: A reflection on techniques used in the Taking on the Teenagers project. Perspectives on HCI Research with Teenagers, Springer.","DOI":"10.1007\/978-3-319-33450-9_10"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Fisher, K.E., Bishop, A.P., Magassa, L., and Fawcett, P. (2014, January 17\u201320). Action!: Codesigning interactive technology with immigrant teens. Proceedings of the 2014 Conference on Interaction Design And Children, Aarhus, Denmark.","DOI":"10.1145\/2593968.2610488"},{"key":"ref_69","unstructured":"Schuler, D., and Namioka, A. (1993). Participatory Design: Principles and Practices, CRC Press."},{"key":"ref_70","unstructured":"(2005). The Methodology of Participatory Design. Tech. Commun., 52, 163\u2013174."},{"key":"ref_71","unstructured":"Rodil, K., Rehm, M., and Krummheuer, A.L. (October, January 29). Co-designing Social Robots with Cognitively Impaired Citizens. Proceedings of the 10th Nordic Conference on Human-Computer Interaction (NordiCHI \u201918), Oslo, Norway."},{"key":"ref_72","unstructured":"DiSalvo, C., Nourbakhsh, I., Holstius, D., Akin, A., and Louw, M. (2008, January 1\u20134). The Neighborhood Networks project: A case study of critical engagement and creative expression through participatory design. Proceedings of the Tenth Anniversary Conference on Participatory Design 2008, Indiana University, Bloomington, Indiana."},{"key":"ref_73","unstructured":"Vavoula, G.N., Sharples, M., and Rudman, P.D. (2002, January 28\u201329). Developing the \u2018future technology workshop\u2019method. Proceedings of the International Workshop on Interaction Design and Children, Eindhoven, The Netherlands."},{"key":"ref_74","unstructured":"Quesenbery, W., and Brooks, K. (2010). Storytelling for User Experience: Crafting Stories for Better Design, Rosenfeld Media."},{"key":"ref_75","unstructured":"Buxton, B. (2010). Sketching User Experiences: Getting the Design Right and the Right Design, Morgan Kaufmann."},{"key":"ref_76","doi-asserted-by":"crossref","unstructured":"Moraveji, N., Li, J., Ding, J., O\u2019Kelley, P., and Woolf, S. (May2007, January 30). Comicboarding: Using comics as proxies for participatory design with children. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.","DOI":"10.1145\/1240624.1240832"},{"key":"ref_77","first-page":"606","article-title":"What Is Human Centred Design?","volume":"17","author":"Giacomin","year":"2014","journal-title":"Des. J."},{"key":"ref_78","unstructured":"Ackerman, E., and Guizzo, E. (2015). Darpa robotics challenge: Amazing moments, lessons learned, and what\u2019s next. IEEE Spectr., 3."},{"key":"ref_79","first-page":"S13","article-title":"Inspiring Future Generations in Stem Field through Robotics Competition: A College Student Mentoring Approach","volume":"140","author":"Kamen","year":"2018","journal-title":"Mech. Eng. Mag. Sel. Artic."},{"key":"ref_80","first-page":"1","article-title":"Fire-Fighting Robot Competitions and Learning Outcomes: A Quantitative Assessment","volume":"5","author":"Verner","year":"2000","journal-title":"Age"},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"187","DOI":"10.12973\/ejmste\/75239","article-title":"Using the TOSRA to Assess High School Students\u2019 Attitudes toward Science after Competing in the FIRST Robotics Competition: An Exploratory Study","volume":"6","author":"Welch","year":"2010","journal-title":"Eurasia J. Math. Sci. Technol. Educ."},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Rose, E.J., and Bj\u00f6rling, E.A. (2017, January 11\u201313). Designing for engagement: Using participatory design to develop a social robot to measure teen stress. Proceedings of the 35th ACM International Conference on the Design of Communication, Halifax, NS, Canada.","DOI":"10.1145\/3121113.3121212"},{"key":"ref_83","unstructured":"(2018). Human Centered Design Tutorials, Design Me."},{"key":"ref_84","doi-asserted-by":"crossref","unstructured":"Rose, E.J., Bj\u00f6rling, E.A., Kim, A., and Alvarez, N.Y. (2018, January 3\u20135). Usability Testing with Teens: Adapting Human-centered Design and UX Methods. Proceedings of the 36th ACM International Conference on the Design of Communication (SIGDOC \u201918), Milwaukee, WI, USA.","DOI":"10.1145\/3233756.3233955"},{"key":"ref_85","unstructured":"Krug, S. (2000). Don\u2019t Make Me Think!: A Common Sense Approach to Web Usability, Pearson."},{"key":"ref_86","unstructured":"Barnum, C.M. (2010). Usability Testing Essentials: Ready, Set... Test!, Elsevier."},{"key":"ref_87","doi-asserted-by":"crossref","unstructured":"Powers, A., Kiesler, S., Fussell, S., Fussell, S., and Torrey, C. (2007, January 9\u201311). Comparing a computer agent with a humanoid robot. Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction, Arlington, VA, USA.","DOI":"10.1145\/1228716.1228736"},{"key":"ref_88","doi-asserted-by":"crossref","unstructured":"Seo, S.H., Geiskkovitch, D., Nakane, M., King, C., and Young, J.E. (2015, January 2\u20135). Poor Thing! Would You Feel Sorry for a Simulated Robot?: A comparison of empathy toward a physical and a simulated robot. Proceedings of the Tenth Annual ACM\/IEEE International Conference on Human-Robot Interaction, Portland, OR, USA.","DOI":"10.1145\/2696454.2696471"},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Wainer, J., Feil-Seifer, D.J., Shell, D.A., and Mataric, M.J. (2006, January 6\u20138). The role of physical embodiment in human-robot interaction. Proceedings of the 15th IEEE International Symposium on Robot and Human Interactive Communication, Hatfield, UK.","DOI":"10.1109\/ROMAN.2006.314404"},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1177\/160940690400300102","article-title":"Exploring risky youth experiences: Popular theatre as a participatory, performative research method","volume":"3","author":"Conrad","year":"2004","journal-title":"Int. J. Qual. Methods"},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1080\/14681810802639905","article-title":"The effectiveness of participatory theatre with early adolescents in school-based sexuality education","volume":"9","author":"Ponzetti","year":"2009","journal-title":"Sex Educ."},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"996","DOI":"10.1016\/j.intcom.2006.05.003","article-title":"The use of theatre in requirements gathering and usability studies","volume":"18","author":"Newell","year":"2006","journal-title":"Interact. Comput."},{"key":"ref_93","first-page":"189","article-title":"Can a Teleoperated Android Represent Personal Presence?\u2014A Case Study with Children","volume":"50","author":"Nishio","year":"2018","journal-title":"Psychologia"},{"key":"ref_94","doi-asserted-by":"crossref","unstructured":"Ishiguro, H., and Dalla Libera, F. (2018). Geminoid Studies: Science and Technologies for Humanlike Teleoperated Androids, Springer.","DOI":"10.1007\/978-981-10-8702-8"},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Butler, D.J., Huang, J., Roesner, F., and Cakmak, M. (2015, January 2\u20135). The privacy-utility tradeoff for remotely teleoperated robots. Proceedings of the Tenth Annual ACM\/IEEE International Conference on Human-Robot Interaction, Portland, OR, USA.","DOI":"10.1145\/2696454.2696484"},{"key":"ref_96","doi-asserted-by":"crossref","unstructured":"Suguitan, M., and Hoffman, G. (2018, January 5\u20138). Blossom: A Tensile Social Robot Design with a Handcrafted Shell. Proceedings of the Companion of the 2018 ACM\/IEEE International Conference on Human-Robot Interaction, Chicago, IL, USA.","DOI":"10.1145\/3173386.3177019"},{"key":"ref_97","doi-asserted-by":"crossref","unstructured":"Nielsen, J., Clemmensen, T., and Yssing, C. (2002, January 19\u201323). Getting access to what goes on in people\u2019s heads?: Reflections on the think-aloud technique. Proceedings of the Second Nordic Conference on Human-Computer Interaction, Aarhus, Denmark.","DOI":"10.1145\/572020.572033"},{"key":"ref_98","unstructured":"Feng, Y., Preston, J.A., and Skelton, J. (August, January 30). Asymmetric game design and player location: An empirical study on mobile play experiences. Proceedings of the 2013 18th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES), Louisville, KY, USA."},{"key":"ref_99","doi-asserted-by":"crossref","unstructured":"Jagosh, J., Bush, P.L., Salsberg, J., Macaulay, A.C., Greenhalgh, T., Wong, G., Cargo, M., Green, L.W., Herbert, C.P., and Pluye, P. (2015). A realist evaluation of community-based participatory research: Partnership synergy, trust building and related ripple effects. BMC Public Health, 15.","DOI":"10.1186\/s12889-015-1949-1"},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"1398","DOI":"10.2105\/AJPH.2007.125757","article-title":"Building and maintaining trust in a community-based participatory research partnership","volume":"98","author":"Christopher","year":"2008","journal-title":"Am. J. Public Health"},{"key":"ref_101","unstructured":"Zawieska, K. (2015, January 2\u20135). Deception and manipulation in social robotics. Proceedings of the Workshop on the Emerging Policy and Ethic of Human-Robot Interaction at the 10th ACM\/IEEE International Conference on Human-Robot Interaction (HRI2015), Portland, OR, USA."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/3\/1\/8\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,16]],"date-time":"2024-06-16T15:26:45Z","timestamp":1718551605000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/3\/1\/8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,10]]},"references-count":101,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["mti3010008"],"URL":"https:\/\/doi.org\/10.3390\/mti3010008","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,2,10]]}}}