{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,30]],"date-time":"2024-10-30T21:02:49Z","timestamp":1730322169504,"version":"3.28.0"},"publisher-location":"New York, NY, USA","reference-count":35,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,11,21]],"date-time":"2019-11-21T00:00:00Z","timestamp":1574294400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,11,21]]},"DOI":"10.1145\/3364510.3364528","type":"proceedings-article","created":{"date-parts":[[2019,12,9]],"date-time":"2019-12-09T08:35:33Z","timestamp":1575880533000},"page":"1-5","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Discovering Empirically-Based Best Practices in Computing Education Through Replication, Reproducibility, and Meta-Analysis Studies"],"prefix":"10.1145","author":[{"given":"Monica M.","family":"McGill","sequence":"first","affiliation":[{"name":"Knox College & csedresearch.org, Galesburg, IL, USA"}]}],"member":"320","published-online":{"date-parts":[[2019,11,21]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2999541.2999554"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2839509.2844601"},{"key":"e_1_3_2_1_3_1","unstructured":"American Psychological Association. 2010. Publication manual of the American Psychological Association (6th ed.). American Psychological Association: Washington DC USA. American Psychological Association. 2010. Publication manual of the American Psychological Association (6th ed.). American Psychological Association: Washington DC USA."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"crossref","unstructured":"Scott M Bartell. 2019. Understanding and Mitigating the Replication Crisis for Environmental Epidemiologists. Current environmental health reports 6 1 (2019) 8--15. Scott M Bartell. 2019. Understanding and Mitigating the Replication Crisis for Environmental Epidemiologists. Current environmental health reports 6 1 (2019) 8--15.","DOI":"10.1007\/s40572-019-0225-4"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-018-0399-z"},{"key":"e_1_3_2_1_6_1","unstructured":"Paulo Carvalho Bryan G Cook Joshua de Leeuw Emily Fyfe Hunter Gehlbach Robert Goldstone Matthew C Makel David Mellor Amanda Montoya Benjamin Motz etal 2019. Actions for Increasing the Credibility of Educational Research. https:\/\/edarxiv.org\/tv7rn\/. (2019). Accessed: 2019-08-02. Paulo Carvalho Bryan G Cook Joshua de Leeuw Emily Fyfe Hunter Gehlbach Robert Goldstone Matthew C Makel David Mellor Amanda Montoya Benjamin Motz et al. 2019. Actions for Increasing the Credibility of Educational Research. https:\/\/edarxiv.org\/tv7rn\/. (2019). Accessed: 2019-08-02."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Open Science Collaboration etal 2015. Estimating the reproducibility of psychological science. Science 349 6251 (2015) aac4716. Open Science Collaboration et al. 2015. Estimating the reproducibility of psychological science. Science 349 6251 (2015) aac4716.","DOI":"10.1126\/science.aac4716"},{"key":"e_1_3_2_1_8_1","unstructured":"Chris Drummond. 2009. Replicability is not reproducibility: nor is it good science. (2009). Chris Drummond. 2009. Replicability is not reproducibility: nor is it good science. (2009)."},{"volume-title":"Emerging Trends in Learning Analytics","author":"Fritz John","key":"e_1_3_2_1_9_1"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3345328"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Frank G Hillary and John D Medaglia. 2019. What the replication crisis means for intervention science. Frank G Hillary and John D Medaglia. 2019. What the replication crisis means for intervention science.","DOI":"10.1016\/j.ijpsycho.2019.05.006"},{"key":"e_1_3_2_1_12_1","first-page":"14","article-title":"The values and challenges of 'openness' in addressing the reproducibility crisis and regaining public trust in social sciences and humanities","volume":"45","author":"Ho MT","year":"2019","journal-title":"European Science Editing"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557004"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858796.2858798"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Robert Kosara and Steve Haroz. 2018. Skipping the Replication Crisis in Visualization: Threats to Study Validity and How to Address Them: Position Paper. In 2018 IEEE Evaluation and Beyond-Methodological Approaches for Visualization (BELIV). IEEE 102--107. Robert Kosara and Steve Haroz. 2018. Skipping the Replication Crisis in Visualization: Threats to Study Validity and How to Address Them: Position Paper. In 2018 IEEE Evaluation and Beyond-Methodological Approaches for Visualization (BELIV). IEEE 102--107.","DOI":"10.1109\/BELIV.2018.8634392"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40614-019-00193-3"},{"key":"e_1_3_2_1_17_1","unstructured":"Ljiljana B. Lazarevic and Iris Zezelj. 2018. How open science norms improve scientific practices. https:\/\/bit.ly\/2lUc0HO. Accessed: 2019-08-01. Ljiljana B. Lazarevic and Iris Zezelj. 2018. How open science norms improve scientific practices. https:\/\/bit.ly\/2lUc0HO. Accessed: 2019-08-01."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X14545513"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3291279.3339401"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jas.2018.07.003"},{"key":"e_1_3_2_1_21_1","unstructured":"National Science Foundation and Institute for Education Science. 2018. Companion Guidelines on Replication & Reproducibility in Education Research: A Supplement to the Common Guidelines for Education Research and Development. https:\/\/ies.ed.gov\/pdf\/CompanionGuidelinesReplicationReproducibility.pdf. Accessed: 2019-03-01. National Science Foundation and Institute for Education Science. 2018. Companion Guidelines on Replication & Reproducibility in Education Research: A Supplement to the Common Guidelines for Education Research and Development. https:\/\/ies.ed.gov\/pdf\/CompanionGuidelinesReplicationReproducibility.pdf. Accessed: 2019-03-01."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Gina Neff Anissa Tanweer Brittany Fiore-Gartland and Laura Osburn. 2017. Critique and contribute: A practice-based framework for improving critical data studies and data science. Big data 5 2 (2017) 85--97. Gina Neff Anissa Tanweer Brittany Fiore-Gartland and Laura Osburn. 2017. Critique and contribute: A practice-based framework for improving critical data studies and data science. Big data 5 2 (2017) 85--97.","DOI":"10.1089\/big.2016.0050"},{"volume-title":"Retrieved","year":"2019","author":"Institute of Education Sciences. [n. d.].","key":"e_1_3_2_1_23_1"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027385.3029445"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1596\/1813-9450-8835"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Craig Sale and Duane Mellor. 2018. A call for replication studies in Nutrition and Health. Craig Sale and Duane Mellor. 2018. A call for replication studies in Nutrition and Health.","DOI":"10.1177\/0260106018817675"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Alexandra Sarafoglou Suzanne Hoogeveen Dora Matzke and Eric-Jan Wagenmakers. 2019. Teaching Good Research Practices: Protocol of a Research Master Course. (2019). Alexandra Sarafoglou Suzanne Hoogeveen Dora Matzke and Eric-Jan Wagenmakers. 2019. Teaching Good Research Practices: Protocol of a Research Master Course. (2019).","DOI":"10.31234\/osf.io\/gvesh"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"crossref","unstructured":"P Schatz K Bogar and R J Elbin. 2019. Addressing the \"Replication Crisis\" in Sports Neuropsychology: Validation of the Two-Factor Theory of ImPACT. Archives of Clinical Neuropsychology 34 5 (07 2019) 758--758. P Schatz K Bogar and R J Elbin. 2019. Addressing the \"Replication Crisis\" in Sports Neuropsychology: Validation of the Two-Factor Theory of ImPACT. Archives of Clinical Neuropsychology 34 5 (07 2019) 758--758.","DOI":"10.1093\/arclin\/acz026.28"},{"key":"e_1_3_2_1_29_1","unstructured":"Anissa Tanweer. 2018. Data science of the social: How the practice is responding to ethical crisis and spreading across sectors. Ph.D. Dissertation. Anissa Tanweer. 2018. Data science of the social: How the practice is responding to ethical crisis and spreading across sectors. Ph.D. Dissertation."},{"key":"e_1_3_2_1_30_1","unstructured":"Olmo van den Akker. 2019. How do researchers interpret the results of multiple experiments? Open Science 2019 Trier Germany (2019). Olmo van den Akker. 2019. How do researchers interpret the results of multiple experiments? Open Science 2019 Trier Germany (2019)."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1177\/2515245918757427"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Tobias Wingen Jana Berkessel and Birte Englich. 2019. No Replication no Trust? How Low Replicability Influences Trust in Psychology. (2019). Tobias Wingen Jana Berkessel and Birte Englich. 2019. No Replication no Trust? How Low Replicability Influences Trust in Psychology. (2019).","DOI":"10.31219\/osf.io\/4ukq5"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infbeh.2019.101329"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Joanne Yaffe. 2019. From the Editor: Do We Have a Replication Crisis in Social Work Research? Joanne Yaffe. 2019. From the Editor: Do We Have a Replication Crisis in Social Work Research?","DOI":"10.1080\/10437797.2019.1594399"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.7557\/5.4525"}],"event":{"name":"Koli Calling '19: 19th Koli Calling International Conference on Computing Education Research","sponsor":["University of Helsinki","Univ. Eastern Finland University of Eastern Finland","The University of Adelaide, Australia","SIGCSE ACM Special Interest Group on Computer Science Education"],"location":"Koli Finland","acronym":"Koli Calling '19"},"container-title":["Proceedings of the 19th Koli Calling International Conference on Computing Education Research"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3364510.3364528","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,13]],"date-time":"2023-01-13T12:33:11Z","timestamp":1673613191000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3364510.3364528"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,21]]},"references-count":35,"alternative-id":["10.1145\/3364510.3364528","10.1145\/3364510"],"URL":"https:\/\/doi.org\/10.1145\/3364510.3364528","relation":{},"subject":[],"published":{"date-parts":[[2019,11,21]]},"assertion":[{"value":"2019-11-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}