{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,2]],"date-time":"2024-08-02T14:34:00Z","timestamp":1722609240575},"reference-count":92,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2020,1,16]],"date-time":"2020-01-16T00:00:00Z","timestamp":1579132800000},"content-version":"vor","delay-in-days":365,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["1252276"],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2019,9,30]]},"abstract":"It is widely believed that there are educational benefits to making computer games, but there is no systematic review of research on this topic. This article describes a meta-synthesis of research on children designing and programming computer games that investigates the extent to which there is evidence of benefits for computer science learning and motivation. Over 400 articles were identified, and 68 articles met the inclusion criteria. A systematic analysis and synthesis across studies showed some evidence that computer game design and programming can lead to changes in programming knowledge, problem solving, and computer science attitudes and confidence. However, most of the evidence described engagement in computing-related practices and did not measure learning. The findings were mostly positive, although several studies noted more negative attitudes toward programming after making games. The results were similar across different pedagogical approaches, although social interaction may provide unique opportunities for computer science learning. The synthesis resulted in a list of design elements for studying computer game design and programming activities; these can be used to increase the availability of evidence about learning. The article concludes with the identification of gaps in the research and suggestions for additional research.<\/jats:p>","DOI":"10.1145\/3277565","type":"journal-article","created":{"date-parts":[[2019,1,16]],"date-time":"2019-01-16T13:13:32Z","timestamp":1547644412000},"page":"1-35","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":42,"title":["Does Computer Game Design and Programming Benefit Children? A Meta-Synthesis of Research"],"prefix":"10.1145","volume":"19","author":[{"given":"Jill","family":"Denner","sequence":"first","affiliation":[{"name":"Education, Training, Research (ETR), Scotts Valley, CA"}]},{"given":"Shannon","family":"Campe","sequence":"additional","affiliation":[{"name":"Education, Training, Research (ETR), Scotts Valley, CA"}]},{"given":"Linda","family":"Werner","sequence":"additional","affiliation":[{"name":"UC Santa Cruz, CA"}]}],"member":"320","published-online":{"date-parts":[[2019,1,16]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2011. An Operational Definition of Computational Thinking. Retrieved from http:\/\/www.iste.org\/docs\/ct-documents\/computational-thinking-operational-definition-flyer.pdf?sfvrsn=2. 2011. An Operational Definition of Computational Thinking. Retrieved from http:\/\/www.iste.org\/docs\/ct-documents\/computational-thinking-operational-definition-flyer.pdf?sfvrsn=2."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157136.2157319"},{"key":"e_1_2_1_3_1","unstructured":"Mete Akcaoglu. 2013. Cognitive and Motivational Impacts of Learning Game Design on Middle School Children. Michigan State University. Mete Akcaoglu. 2013. Cognitive and Motivational Impacts of Learning Game Design on Middle School Children. Michigan State University."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11423-014-9347-4"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1595496.1562913"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the Games, Learning, and Society Conference","volume":"3","author":"Anton Gabriella","year":"2013"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1822090.1822154"},{"key":"e_1_2_1_8_1","unstructured":"Ahmet Baytak. 2009. An investigation of the artifacts outcomes and processes of constructing computer games about environmental science in a fifth grade science classroom. Dissertation Pennsylvania State University. Ahmet Baytak. 2009. An investigation of the artifacts outcomes and processes of constructing computer games about environmental science in a fifth grade science classroom. Dissertation Pennsylvania State University."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 31st Annual Convention of the Association for Educational Communications and Technology","author":"Baytak Ahmet"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Quinn Burke and Yasmin B. Kafai. 2014. Decade of game making for learning: From tools to communities. Handbook of Digital Games (2014) 689--709. Quinn Burke and Yasmin B. Kafai. 2014. Decade of game making for learning: From tools to communities. Handbook of Digital Games (2014) 689--709.","DOI":"10.1002\/9781118796443.ch26"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2010.05.007"},{"key":"e_1_2_1_12_1","volume-title":"Beyond Programming: The Power of Making Games.","author":"Castaneda Lisa","year":"2015"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1547-5069.2003.00177.x"},{"key":"e_1_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Harris Cooper. 2017. Research synthesis and meta-analysis: A step-by-step approach. Sage Publications Los Angeles. Harris Cooper. 2017. Research synthesis and meta-analysis: A step-by-step approach. Sage Publications Los Angeles.","DOI":"10.4135\/9781071878644"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.3102\/0034654314540007"},{"key":"e_1_2_1_16_1","first-page":"26","article-title":"The girl game company: Engaging Latina girls in information technology","volume":"8","author":"Denner Jill","year":"2009","journal-title":"Afterschool Matters"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.2190\/12T6-41L2-6765-G3T2"},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Jill Denner Linda Werner Shannon Campe and Eloy Ortiz. 2014. Pair programming: Under what conditions is it advantageous for middle school students?Journal of Research on Technology in Education 46 3 (2014) 277--296. Jill Denner Linda Werner Shannon Campe and Eloy Ortiz. 2014. Pair programming: Under what conditions is it advantageous for middle school students?Journal of Research on Technology in Education 46 3 (2014) 277--296.","DOI":"10.1080\/15391523.2014.888272"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2011.08.006"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of 8th International Conference of Education, Research and Innovation (ICERI2015)","author":"Earp Jeffrey","year":"2015"},{"key":"e_1_2_1_21_1","first-page":"58","article-title":"Appreciative learning approach as a pedagogical strategy and computer game development as a technological tool in enhancing students\u2019 creativity","volume":"7","author":"Eow Yee Leng","year":"2011","journal-title":"Journal of the Research Center for Educational Technology"},{"key":"e_1_2_1_22_1","first-page":"40","article-title":"Fundamental computer science conceptual understandings for high school students using original computer game design","volume":"13","author":"Ernst Jeremy V.","year":"2012","journal-title":"Journal of STEM Education"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/bjet.12022"},{"key":"e_1_2_1_24_1","unstructured":"W. Foster M. S. El-Nasr and T. Maygoli. 2011. IT fluency through game development: A study of the utility of game workshops as an after school activity for middle and high schools. (2011). W. Foster M. S. El-Nasr and T. Maygoli. 2011. IT fluency through game development: A study of the utility of game workshops as an after school activity for middle and high schools. (2011)."},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 3rd Annual Conference of Computing and Information Technology, Education and Research in New Zealand (incorporating 24th Annual NACCQ).","author":"Fowler Allan","year":"2012"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2159365.2159398"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2159365.2159366"},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Elisabeth R. Gee and Kelly M. Tran. 2016. Video game making and modding. In Handbook of Research on the Societal Impact of Digital Media. IGI Global 238--267. Elisabeth R. Gee and Kelly M. Tran. 2016. Video game making and modding. In Handbook of Research on the Societal Impact of Digital Media. IGI Global 238--267.","DOI":"10.4018\/978-1-4666-8310-5.ch010"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2016039.2016049"},{"key":"e_1_2_1_30_1","doi-asserted-by":"crossref","unstructured":"Roxana Hadad. 2013. Using game design as a means to make computer science accessible to adolescents. In Cases on Digital Game-Based Learning: Methods Models and Strategies. IGI Global 279--300. Roxana Hadad. 2013. Using game design as a means to make computer science accessible to adolescents. In Cases on Digital Game-Based Learning: Methods Models and Strategies. IGI Global 279--300.","DOI":"10.4018\/978-1-4666-2848-9.ch015"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1177\/1555412008317312"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11423-013-9320-7"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvlc.2009.04.001"},{"key":"e_1_2_1_34_1","volume-title":"9th European Conference on Games Based Learning (ECGBL2015)","author":"Jenson Jennifer","year":"2015"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the International Conference on Computers and Advanced Technology for Education (IASTED","author":"Jill Denner","year":"2005"},{"key":"e_1_2_1_36_1","volume-title":"Half-real: Video Games between Real Rules and Fictional Worlds","author":"Juul Jesper","year":"2011"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1177\/1555412005281767"},{"key":"e_1_2_1_38_1","doi-asserted-by":"crossref","unstructured":"Yasmin B. Kafai. 2012. Minds in Play: Computer Game Design as a Context for Children\u2019s Learning. Routledge. Yasmin B. Kafai. 2012. Minds in Play: Computer Game Design as a Context for Children\u2019s Learning. Routledge.","DOI":"10.4324\/9780203052914"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1080\/00461520.2015.1124022"},{"key":"e_1_2_1_40_1","unstructured":"Yasmin B. Kafai and Quinn Burke. 2016. Connected Gaming: What Making Video Games Can Teach Us about Learning and Literacy. MIT Press. Yasmin B. Kafai and Quinn Burke. 2016. Connected Gaming: What Making Video Games Can Teach Us about Learning and Literacy. MIT Press."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2013.12.010"},{"key":"e_1_2_1_42_1","volume-title":"Build IT: Girls Building Information Technology Fluency through Design.","author":"Koch Melissa","year":"2009"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2538862.2538914"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1080\/00131881.2010.524752"},{"key":"e_1_2_1_45_1","volume-title":"National Educational Computing Conference. Citeseer.","author":"Mei-Chuen Lin Janet","year":"2005"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1177\/1468794111413367"},{"key":"e_1_2_1_47_1","unstructured":"C. K. Martin S. Walter and B. Barron. 2009. Looking at learning through student designed computer games: A rubric approach with novice programming projects. Unpublished article Stanford University (2009). C. K. Martin S. Walter and B. Barron. 2009. Looking at learning through student designed computer games: A rubric approach with novice programming projects. Unpublished article Stanford University (2009)."},{"key":"e_1_2_1_48_1","volume-title":"ASEE\/IEEE Frontiers in Education Conference.","author":"Maxim Bruce R."},{"key":"e_1_2_1_49_1","unstructured":"Laura Minnigerode and Catherine Malerba. 2012. Engineering self-efficacy in economically disadvantaged and English language learner middle school students learning game design. Unpublished paper Worldwideworkshop.com. Laura Minnigerode and Catherine Malerba. 2012. Engineering self-efficacy in economically disadvantaged and English language learner middle school students learning game design. Unpublished paper Worldwideworkshop.com."},{"key":"e_1_2_1_50_1","unstructured":"Laura Minnigerode. 2013. Quantitative data report and analysis school year 2011-2012. (2013). Laura Minnigerode. 2013. Quantitative data report and analysis school year 2011-2012. (2013)."},{"key":"e_1_2_1_51_1","volume-title":"Proceedings of the World Conference on Educational Multimedia, Hypermedia and Telecommunications. 282--293","author":"Cesar"},{"key":"e_1_2_1_52_1","unstructured":"Seymour Papert and Idit Harel. 1991. Situating constructionism. In Constructionism Idit Harel and Seymour Papert (Eds.). Ablex Publishing Company. Seymour Papert and Idit Harel. 1991. Situating constructionism. In Constructionism Idit Harel and Seymour Papert (Eds.). Ablex Publishing Company."},{"key":"e_1_2_1_53_1","unstructured":"Seymour Papert. 1993. The Children\u2019s Machine: Rethinking School in the Age of the Computer. ERIC. Seymour Papert. 1993. The Children\u2019s Machine: Rethinking School in the Age of the Computer. ERIC."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1080\/00393541.2013.11518915"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.2304\/elea.2010.7.1.90"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11422-014-9632-x"},{"key":"e_1_2_1_57_1","unstructured":"Catherine Pope Nicholas Mays and Jennie Popay. 2007. Synthesising Qualitative and Quantitative Health Evidence: A Guide to Methods: A Guide to Methods. McGraw-Hill Education (UK). Catherine Pope Nicholas Mays and Jennie Popay. 2007. Synthesising Qualitative and Quantitative Health Evidence: A Guide to Methods: A Guide to Methods. McGraw-Hill Education (UK)."},{"key":"e_1_2_1_58_1","doi-asserted-by":"crossref","unstructured":"Jill Denner Erica Marsh and Shannon Campe. 2016. Approaches to reviewing research in education. The BERA\/SAGE Handbook of Educational Research 143--164. Jill Denner Erica Marsh and Shannon Campe. 2016. Approaches to reviewing research in education. The BERA\/SAGE Handbook of Educational Research 143--164.","DOI":"10.4135\/9781473983953.n7"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1352322.1352242"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/1592761.1592779"},{"key":"e_1_2_1_61_1","unstructured":"Rebecca Reynolds and Ming Ming Chiu. 2012. Contribution of motivational orientations to student outcomes in a discovery-based program of game design learning. (2012). Rebecca Reynolds and Ming Ming Chiu. 2012. Contribution of motivational orientations to student outcomes in a discovery-based program of game design learning. (2012)."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1080\/17439884.2013.779585"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2013.774155"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.4018\/ijgbl.2013040107"},{"key":"e_1_2_1_65_1","doi-asserted-by":"crossref","unstructured":"Michael Saini and Aron Shlonsky. 2012. Systematic Synthesis of Qualitative Research. OUP USA. Michael Saini and Aron Shlonsky. 2012. Systematic Synthesis of Qualitative Research. OUP USA.","DOI":"10.1093\/acprof:oso\/9780195387216.001.0001"},{"key":"e_1_2_1_66_1","doi-asserted-by":"crossref","unstructured":"Margarete Sandelowski Julie Barroso and Corrine I. Voils. 2007. Using qualitative metasummary to synthesize qualitative and quantitative descriptive findings. Research in Nursing 8 Health 30 1 (2007) 99--111. Margarete Sandelowski Julie Barroso and Corrine I. Voils. 2007. Using qualitative metasummary to synthesize qualitative and quantitative descriptive findings. Research in Nursing 8 Health 30 1 (2007) 99--111.","DOI":"10.1002\/nur.20176"},{"key":"e_1_2_1_67_1","volume-title":"Proceedings of the DiGRA Conference.","author":"Sanford Kathy","year":"2007"},{"key":"e_1_2_1_68_1","volume-title":"Second Annual Microsoft Academic Days Conference on Game Development.","author":"El-Nasr Magy Seif","year":"2007"},{"key":"e_1_2_1_69_1","unstructured":"Richard Shavelson and Lisa Towne. 2002. Scientific research in education. Committee on scientific principles for education research. Center for Education. Division of Behavioral and Social Sciences and Education. National Research Council. National Academy Press Washington DC. Richard Shavelson and Lisa Towne. 2002. Scientific research in education. Committee on scientific principles for education research. Center for Education. Division of Behavioral and Social Sciences and Education. National Research Council. National Academy Press Washington DC."},{"key":"e_1_2_1_70_1","unstructured":"Kimberly Sheridan Kevin Clark and Erin Peters. 2009. How scientific inquiry emerges from game design. In Society for Information Technology 8 Teacher Education International Conference. Association for the Advancement of Computing in Education (AACE) 1555--1563. Kimberly Sheridan Kevin Clark and Erin Peters. 2009. How scientific inquiry emerges from game design. In Society for Information Technology 8 Teacher Education International Conference. Association for the Advancement of Computing in Education (AACE) 1555--1563."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/2282338.2282359"},{"key":"e_1_2_1_72_1","volume-title":"International Joint Conferences on Artificial Intelligences.","author":"James"},{"key":"e_1_2_1_73_1","doi-asserted-by":"crossref","unstructured":"Harsh Suri. 2013. Towards Methodologically Inclusive Research Syntheses: Expanding Possibilities. Routledge. Harsh Suri. 2013. Towards Methodologically Inclusive Research Syntheses: Expanding Possibilities. Routledge.","DOI":"10.4324\/9780203383193"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.3102\/0034654308326349"},{"key":"e_1_2_1_75_1","doi-asserted-by":"crossref","unstructured":"Andrea H. Tapia Magy Seif El-Nasr Ibrahim Yucel Joseph Zupko and Edgard Maldonado. 2007. Building virtual spaces. In Virtuality and Virtualization. Springer 317--334. Andrea H. Tapia Magy Seif El-Nasr Ibrahim Yucel Joseph Zupko and Edgard Maldonado. 2007. Building virtual spaces. In Virtuality and Virtualization. Springer 317--334.","DOI":"10.1007\/978-0-387-73025-7_22"},{"key":"e_1_2_1_76_1","doi-asserted-by":"crossref","unstructured":"Katie Salen Tekinbas Robert Torres Loretta Wolozin Rebecca Rufo-Tepper and Arana Shapiro. 2010. Quest to Learn: Developing the School for Digital Kids. MIT Press. Katie Salen Tekinbas Robert Torres Loretta Wolozin Rebecca Rufo-Tepper and Arana Shapiro. 2010. Quest to Learn: Developing the School for Digital Kids. MIT Press.","DOI":"10.7551\/mitpress\/8909.001.0001"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-8-45"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.2190\/EC.44.4.b"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/1868358.1868364"},{"key":"e_1_2_1_80_1","volume-title":"Proceedings of the Games, Learning, Society. 313--322","author":"Vattel Lucien","year":"2012"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/DIGITEL.2010.47"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICALT.2011.161"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157136.2157191"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157136.2157263"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/1536513.1536552"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157136.2157200"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2648.2005.03621.x"},{"key":"e_1_2_1_88_1","volume-title":"Proceedings of the 5th European Conference on Games Based Learning. 639--649","author":"Wilson Amanda","year":"2011"},{"key":"e_1_2_1_89_1","volume-title":"Proceedings of the 6th European Conference on Games-Based Learning (ECGBL). 4--5.","author":"Wilson Amanda","year":"2012"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/1118178.1118215"},{"key":"e_1_2_1_91_1","unstructured":"Zhen Wu Catherine Ashcraft Wendy DuBow etal 2012. Assessing girls\u2019 interest confidence and participation in computing activities: Results for Globaloria in West Virginia. Unpublished paper from http:\/\/www.ncwit.org. Zhen Wu Catherine Ashcraft Wendy DuBow et al. 2012. Assessing girls\u2019 interest confidence and participation in computing activities: Results for Globaloria in West Virginia. Unpublished paper from http:\/\/www.ncwit.org."},{"key":"e_1_2_1_92_1","doi-asserted-by":"crossref","unstructured":"Ya-Ting Carolyn Yang and Chao-Hsiang Chang. 2013. Empowering students through digital game authorship: Enhancing concentration critical thinking and academic achievement. Computers 8 Education 68 (2013) 334--344. Ya-Ting Carolyn Yang and Chao-Hsiang Chang. 2013. Empowering students through digital game authorship: Enhancing concentration critical thinking and academic achievement. Computers 8 Education 68 (2013) 334--344.","DOI":"10.1016\/j.compedu.2013.05.023"}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3277565","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3277565","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T07:53:18Z","timestamp":1672559598000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3277565"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,16]]},"references-count":92,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2019,9,30]]}},"alternative-id":["10.1145\/3277565"],"URL":"https:\/\/doi.org\/10.1145\/3277565","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,16]]},"assertion":[{"value":"2017-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-01-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}