{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T11:16:29Z","timestamp":1721387789012},"reference-count":62,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2022,12,29]],"date-time":"2022-12-29T00:00:00Z","timestamp":1672272000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,12,29]],"date-time":"2022-12-29T00:00:00Z","timestamp":1672272000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["MOST 108-2511-H-003-056-MY3"],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100020950","name":"National Science and Technology Council","doi-asserted-by":"publisher","award":["111-2410-H-003-168-MY3"],"id":[{"id":"10.13039\/501100020950","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Educ Inf Technol"],"published-print":{"date-parts":[[2023,7]]},"abstract":"Abstract<\/jats:title>There is a growing number of products for learning the interdisciplinary application of science, technology, engineering, art, and mathematics (STEAM) in K-12. However, there is no general assessment tool for those STEAM creations, so as to help parents or instructors to experience and evaluate the STEAM products created or sold by companies or proposed by academic institutes when they want to introduce one to their children or students. Therefore, this study developed and validated an assessment of STEAM Creation with formative constructs by utilizing the PLS-SEM technique. The four constructs taken into account based on the theoretical foundations were computational thinking (CT) levels, design thinking (DT) levels, STEAM interdisciplinary levels, and literacy-oriented (LO) levels. CT was operationalized as four indicators (i.e., problem decomposition, pattern recognition, abstraction, and algorithm steps), and DT was operationalized as another four indicators (i.e., analysis of design requirements, creative brainstorming, hands-on experience, and test and verification). Meanwhile, STEAM was operationalized with five indispensable indicators, where each indicator refers to one discipline. LO was operationalized with three indicators (i.e., cooperation and co-creation, problem solving, and daily application). There were 16 indicators in total. Therefore, the formative relationship was established and evaluated in this study. This paper assessed STEAM creations with a formative measurement model comprising four hypotheses indicating that CT has a significant direct effect on STEAM and LO, DT has a significant direct effect on STEAM while STEAM has a significant direct effect on LO. The results reveal that all four hypotheses were accepted and the paths in the model were confirmed. CT has a significant indirect effect on LO through STEAM, which was also deeply discussed.<\/jats:p>","DOI":"10.1007\/s10639-022-11412-x","type":"journal-article","created":{"date-parts":[[2022,12,29]],"date-time":"2022-12-29T06:02:42Z","timestamp":1672293762000},"page":"8855-8878","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["A validity and reliability study of the formative model for the indicators of STEAM education creations"],"prefix":"10.1007","volume":"28","author":[{"ORCID":"http:\/\/orcid.org\/0000-0001-6504-9540","authenticated-orcid":false,"given":"Ting-Chia","family":"Hsu","sequence":"first","affiliation":[]},{"given":"Yu-Shan","family":"Chang","sequence":"additional","affiliation":[]},{"given":"Mu-Sheng","family":"Chen","sequence":"additional","affiliation":[]},{"given":"I.-Fan","family":"Tsai","sequence":"additional","affiliation":[]},{"given":"Cheng-Yen","family":"Yu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,12,29]]},"reference":[{"issue":"5","key":"11412_CR1","doi-asserted-by":"publisher","first-page":"1669","DOI":"10.1016\/j.jbusres.2015.10.036","volume":"69","author":"M Ali","year":"2016","unstructured":"Ali, M., & Park, K. (2016). The mediating role of an innovative culture in the relationship between absorptive capacity and technical and non-technical innovation. Journal of Business Research, 69(5), 1669\u20131675. https:\/\/doi.org\/10.1016\/j.jbusres.2015.10.036","journal-title":"Journal of Business Research"},{"key":"11412_CR2","doi-asserted-by":"publisher","unstructured":"Araujo, A. L. S. O., Andrade, W. L., Guerrero, D. D. S., & Melo, M. R. A. (2019). How\u00a0many abilities can we measure in computational thinking? A study on Bebras challenge. In proceedings of the 50th ACM technical symposium on computer science education. 545\u2013551. https:\/\/doi.org\/10.1145\/3287324.3287405","DOI":"10.1145\/3287324.3287405"},{"issue":"1","key":"11412_CR3","first-page":"3","volume":"8","author":"P Askar","year":"2009","unstructured":"Askar, P., & Davenport, D. (2009). An investigation of factors related to self-efficacy for Java Programming among engineering students. Turkish Online Journal of Educational Technology, 8(1), 3.","journal-title":"Turkish Online Journal of Educational Technology"},{"key":"11412_CR4","doi-asserted-by":"publisher","unstructured":"Avc\u0131, C., & Deniz, M. N. (2022). Computational thinking: Early childhood teachers\u2019 and prospective teachers\u2019 preconceptions and self-efficacy. Education and Information Technologies, 1\u201325,. https:\/\/doi.org\/10.1007\/s10639-022-11078-5","DOI":"10.1007\/s10639-022-11078-5"},{"issue":"1","key":"11412_CR5","doi-asserted-by":"publisher","first-page":"1507306","DOI":"10.1080\/2331186X.2018.1507306","volume":"5","author":"K Bati","year":"2018","unstructured":"Bati, K., Yeti\u015fir, M. I., \u00c7ali\u015fkan, I., G\u00fcne\u015f, G., & G\u00fcl Sa\u00e7an, E. (2018). Teaching the concept of time: A steam-based program on computational thinking in science education. Cogent Education, 5(1), 1507306. https:\/\/doi.org\/10.1080\/2331186X.2018.1507306","journal-title":"Cogent Education"},{"issue":"1","key":"11412_CR6","doi-asserted-by":"publisher","first-page":"25","DOI":"10.2307\/41166415","volume":"50","author":"SL Beckman","year":"2007","unstructured":"Beckman, S. L., & Barry, M. (2007). Innovation as a learning process: Embedding design thinking. California Management Review, 50(1), 25\u201356. https:\/\/doi.org\/10.2307\/41166415","journal-title":"California Management Review"},{"issue":"2","key":"11412_CR7","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1080\/00043125.2012.11519167","volume":"65","author":"JW Bequette","year":"2012","unstructured":"Bequette, J. W., & Bequette, M. B. (2012). A place for art and design education in the STEM conversation. Art Education, 65(2), 40\u201347. https:\/\/doi.org\/10.1080\/00043125.2012.11519167","journal-title":"Art Education"},{"issue":"2","key":"11412_CR8","doi-asserted-by":"publisher","first-page":"65","DOI":"10.4018\/ijgbl.2011040105","volume":"1","author":"M Berland","year":"2011","unstructured":"Berland, M., & Lee, V. R. (2011). Collaborative strategic board games as a site for distributed computational thinking. International Journal of Game-Based Learning, 1(2), 65\u201381. https:\/\/doi.org\/10.4018\/ijgbl.2011040105","journal-title":"International Journal of Game-Based Learning"},{"issue":"2","key":"11412_CR9","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1037\/0033-2909.110.2.305","volume":"110","author":"K Bollen","year":"1991","unstructured":"Bollen, K., & Lennox, R. (1991). Conventional wisdom on measurement: A structural equation perspective. Psychological Bulletin, 110(2), 305\u2013314. https:\/\/doi.org\/10.1037\/0033-2909.110.2.305","journal-title":"Psychological Bulletin"},{"issue":"6","key":"11412_CR10","first-page":"84","volume":"86","author":"T Brown","year":"2008","unstructured":"Brown, T. (2008). Design thinking. Harvard Business Review, 86(6), 84. https:\/\/readings.design\/PDF\/Tim%20Brown,%20Design%20Thinking.pdf.","journal-title":"Harvard Business Review"},{"key":"11412_CR11","doi-asserted-by":"publisher","unstructured":"Buffum, P. S., Lobene, E. V., Frankosky, M. H., Boyer, K. E., Wiebe, E. N., & Lester, J. C. (2015). A practical guide to developing and validating computer science knowledge assessments with application to middle school. In\u00a0Proceedings of the 46th ACM technical symposium on computer science education. 622\u2013627. https:\/\/doi.org\/10.1145\/2676723.2677295","DOI":"10.1145\/2676723.2677295"},{"key":"11412_CR12","doi-asserted-by":"publisher","unstructured":"Charosky, G., Leveratto, L., Hassi, L., Papageorgiou, K., Ramos-Castro, J., & Brag\u00f3s, R. (2018). Challenge based education: an approach to innovation through multidisciplinary teams of students using Design Thinking. Paper presented at the 2018 XIII Technologies Applied to Electronics Teaching Conference (TAEE). https:\/\/doi.org\/10.1109\/TAEE.2018.8476051.","DOI":"10.1109\/TAEE.2018.8476051."},{"key":"11412_CR13","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1016\/j.compedu.2017.03.001","volume":"109","author":"G Chen","year":"2017","unstructured":"Chen, G., Shen, J., Barth-Cohen, L., Jiang, S., Huang, X., & Eltoukhy, M. (2017). Assessing elementary students\u2019 computational thinking in everyday reasoning and robotics programming. Computers & Education, 109, 162\u2013175. https:\/\/doi.org\/10.1016\/j.compedu.2017.03.001","journal-title":"Computers & Education"},{"key":"11412_CR14","doi-asserted-by":"publisher","unstructured":"Chen, L., Yoshimatsu, N., Goda, Y., Okubo, F., Taniguchi, Y., Oi, M., \u2026 & Yamada, M. (2019). Direction of collaborative problem solving-based STEM learning by learning analytics approach. Research and Practice in Technology Enhanced Learning, 14(1), 1\u201328. https:\/\/doi.org\/10.1186\/s41039-019-0119-y","DOI":"10.1186\/s41039-019-0119-y"},{"issue":"6","key":"11412_CR15","doi-asserted-by":"publisher","first-page":"513","DOI":"10.1080\/00220671.2021.1990002","volume":"114","author":"M Dubek","year":"2021","unstructured":"Dubek, M., DeLuca, C., & Rickey, N. (2021). Unlocking the potential of STEAM education: How exemplary teachers navigate assessment challenges. The Journal of Educational Research, 114(6), 513\u2013525. https:\/\/doi.org\/10.1080\/00220671.2021.1990002","journal-title":"The Journal of Educational Research"},{"issue":"1","key":"11412_CR16","doi-asserted-by":"publisher","first-page":"38","DOI":"10.3102\/0013189X12463051","volume":"42","author":"S Grover","year":"2013","unstructured":"Grover, S., & Pea, R. (2013). Computational thinking in K\u201312: A review of the state of the field. Educational Researcher, 42(1), 38\u201343. https:\/\/doi.org\/10.3102\/0013189X12463051","journal-title":"Educational Researcher"},{"issue":"1","key":"11412_CR17","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1007\/s10956-019-09796-6","volume":"29","author":"R Hadad","year":"2020","unstructured":"Hadad, R., Thomas, K., Kachovska, M., & Yin, Y. (2020). Practicing formative assessment for computational thinking in making environments. Journal of Science Education and Technology, 29(1), 162\u2013173. https:\/\/doi.org\/10.1007\/s10956-019-09796-6","journal-title":"Journal of Science Education and Technology"},{"issue":"2","key":"11412_CR18","doi-asserted-by":"publisher","first-page":"139","DOI":"10.2753\/MTP1069-6679190202","volume":"19","author":"JF Hair","year":"2011","unstructured":"Hair, J. F., Ringle, C. M., & Sarstedt, M. (2011). PLS-SEM: Indeed a silver bullet. Journal of Marketing Theory and Practice, 19(2), 139\u2013151. https:\/\/doi.org\/10.2753\/MTP1069-6679190202","journal-title":"Journal of Marketing Theory and Practice"},{"key":"11412_CR19","doi-asserted-by":"publisher","DOI":"10.1080\/1743727X.2015.1005806","volume-title":"A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM) [B]","author":"JF Hair","year":"2017","unstructured":"Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017). A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM) [B] (2nd ed.). Sage. https:\/\/doi.org\/10.1080\/1743727X.2015.1005806","edition":"2"},{"key":"11412_CR20","unstructured":"Hassi, L., Ramos-Castro, J., Leveratto, L., Kurikka, J. J., Charosky, G., Utriainen, T. M., . . . Nordberg, M. (2016). Mixing design, management and engineering students in challenge-based projects. Paper presented at the Proceedings of the 12th International CDIO Conference. http:\/\/www.cdio.org\/files\/document\/cdio2016\/121\/121_Paper_PDF.pdf"},{"issue":"1","key":"11412_CR21","doi-asserted-by":"publisher","first-page":"11","DOI":"10.5642\/steam.20170301.11","volume":"3","author":"D Henriksen","year":"2017","unstructured":"Henriksen, D. (2017). Creating STEAM with design thinking: Beyond STEM and arts integration. The STEAM Journal, 3(1), 11. https:\/\/doi.org\/10.5642\/steam.20170301.11","journal-title":"The STEAM Journal"},{"issue":"1","key":"11412_CR22","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1007\/s11747-014-0403-8","volume":"43","author":"J Henseler","year":"2015","unstructured":"Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115\u2013135. https:\/\/doi.org\/10.1007\/s11747-014-0403-8","journal-title":"Journal of the Academy of Marketing Science"},{"issue":"1","key":"11412_CR23","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1108\/IMDS-09-2015-0382","volume":"116","author":"J Henseler","year":"2016","unstructured":"Henseler, J., Hubona, G., & Ray, P. A. (2016). Using PLS path modeling in new technology research: Updated guidelines. Industrial Management & Data Systems, 116(1), 2\u201320. https:\/\/doi.org\/10.1108\/IMDS-09-2015-0382","journal-title":"Industrial Management & Data Systems"},{"issue":"1","key":"11412_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40594-017-0094-z","volume":"4","author":"D Herro","year":"2017","unstructured":"Herro, D., Quigley, C., Andrews, J., & Delacruz, G. (2017). Co-Measure: Developing an assessment for student collaboration in STEAM activities. International Journal of STEM Education, 4(1), 1\u201312. https:\/\/doi.org\/10.1186\/s40594-017-0094-z","journal-title":"International Journal of STEM Education"},{"key":"11412_CR25","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1016\/j.compedu.2018.07.004","volume":"126","author":"T-C Hsu","year":"2018","unstructured":"Hsu, T.-C., Chang, S.-C., & Hung, Y.-T. (2018). How to learn and how to teach computational thinking: Suggestions based on a review of the literature. Computers & Education, 126, 296\u2013310. https:\/\/doi.org\/10.1016\/j.compedu.2018.07.004","journal-title":"Computers & Education"},{"key":"11412_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/10705519909540118","volume":"6","author":"L Hu","year":"1999","unstructured":"Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1\u201355. https:\/\/doi.org\/10.1080\/10705519909540118","journal-title":"Structural Equation Modeling"},{"issue":"1","key":"11412_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40594-021-00294-z","volume":"8","author":"C Jackson","year":"2021","unstructured":"Jackson, C., Mohr-Schroeder, M. J., Bush, S. B., Maiorca, C., Roberts, T., Yost, C., & Fowler, A. (2021). Equity-Oriented Conceptual Framework for K-12 STEM literacy. International Journal of STEM Education, 8(1), 1\u201316. https:\/\/doi.org\/10.1186\/s40594-021-00294-z","journal-title":"International Journal of STEM Education"},{"issue":"1","key":"11412_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40594-021-00271-6","volume":"8","author":"R Kijima","year":"2021","unstructured":"Kijima, R., Yang-Yoshihara, M., & Maekawa, M. S. (2021). Using design thinking to cultivate the next generation of female STEAM thinkers. International Journal of STEM Education, 8(1), 1\u201315. https:\/\/doi.org\/10.1186\/s40594-021-00271-6","journal-title":"International Journal of STEM Education"},{"issue":"4","key":"11412_CR29","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1007\/s40692-016-0076-z","volume":"3","author":"SC Kong","year":"2016","unstructured":"Kong, S. C. (2016). A framework of curriculum design for computational thinking development in K-12 education. Journal of Computers in Education, 3(4), 377\u2013394. https:\/\/doi.org\/10.1007\/s40692-016-0076-z","journal-title":"Journal of Computers in Education"},{"key":"11412_CR30","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2020.103872","volume":"151","author":"SC Kong","year":"2020","unstructured":"Kong, S. C., Lai, M., & Sun, D. (2020). Teacher development in computational thinking: Design and learning outcomes of programming concepts, practices and pedagogy. Computers & Education, 151, 103872. https:\/\/doi.org\/10.1016\/j.compedu.2020.103872","journal-title":"Computers & Education"},{"key":"11412_CR31","doi-asserted-by":"publisher","first-page":"558","DOI":"10.1016\/j.chb.2017.01.005","volume":"72","author":"\u00d6 Korkmaz","year":"2017","unstructured":"Korkmaz, \u00d6., \u00c7akir, R., & \u00d6zden, M. Y. (2017). A validity and reliability study of the Computational Thinking Scales (CTS). Computers in Human Behavior, 72, 558\u2013569. https:\/\/doi.org\/10.1016\/j.chb.2017.01.005","journal-title":"Computers in Human Behavior"},{"issue":"1","key":"11412_CR32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40594-021-00321-z","volume":"9","author":"CJ Ku","year":"2022","unstructured":"Ku, C. J., Hsu, Y. S., Chang, M. C., & Lin, K. Y. (2022). A model for examining middle school students\u2019 STEM integration behavior in a national technology competition. International Journal of STEM Education, 9(1), 1\u201313. https:\/\/doi.org\/10.1186\/s40594-021-00321-z","journal-title":"International Journal of STEM Education"},{"key":"11412_CR33","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1016\/j.procs.2013.09.317","volume":"20","author":"MH Land","year":"2013","unstructured":"Land, M. H. (2013). Full STEAM ahead: The benefits of integrating the arts into STEM. Procedia Computer Science, 20, 547\u2013552. https:\/\/doi.org\/10.1016\/j.procs.2013.09.317","journal-title":"Procedia Computer Science"},{"key":"11412_CR34","doi-asserted-by":"publisher","unstructured":"Lee, S. G. (2015). The effect of the design based STEAM program utilizing smart device for interest in science and STEAM literacy. Journal of the Korean Society of Earth Science Education, 8(3), 240\u2013250. https:\/\/doi.org\/10.15523\/JKSESE.2015.8.3.240.","DOI":"10.15523\/JKSESE.2015.8.3.240."},{"key":"11412_CR35","unstructured":"Lenke, M., & Tenberge, C. (2022). Future Primary Teacher Education: Computational Thinking and STEAM. In D. Grill, J. Tuff, T. Kennedy, S. Pendergast & S. Jamil (Eds.),\u00a0PATT39 on the edge technology, innovation & education: Selected papers from Memorial University International Conference 2022\u00a0(pp. 429\u2013436). https:\/\/research.edgehill.ac.uk\/ws\/portalfiles\/portal\/50821651\/patt39_proceedings_june_17_2022.pdf#page=428"},{"key":"11412_CR36","doi-asserted-by":"publisher","unstructured":"Lestari, N., Ihwan, I., Mahfud, M., Ernawati, E., & Jannah, N. (2020). Training of literacy-oriented teaching material development in MTs Al Ikhlas Soe, East Nusa Tenggara. Journal of Community Service and Empowerment, 1(2), 73\u201379. https:\/\/doi.org\/10.22219\/jcse.v1i2.12312","DOI":"10.22219\/jcse.v1i2.12312"},{"key":"11412_CR37","doi-asserted-by":"publisher","unstructured":"Madden, M. E., Baxter, M., Beauchamp, H., Bouchard, K., Habermas, D., Huff, M., \u2026 & Plague, G. (2013). Rethinking STEM education: An interdisciplinary STEAM curriculum. Procedia Computer Science, 20, 541\u2013546. https:\/\/doi.org\/10.1016\/j.procs.2013.09.316","DOI":"10.1016\/j.procs.2013.09.316"},{"issue":"1","key":"11412_CR38","doi-asserted-by":"publisher","first-page":"34","DOI":"10.5642\/steam.201301.34","volume":"1","author":"J Maeda","year":"2013","unstructured":"Maeda, J. (2013). Stem+ art= steam. The STEAM Journal, 1(1), 34. https:\/\/doi.org\/10.5642\/steam.201301.34","journal-title":"The STEAM Journal"},{"issue":"4","key":"11412_CR39","doi-asserted-by":"publisher","first-page":"1805","DOI":"10.1007\/s11365-020-00687-6","volume":"17","author":"SC Manley","year":"2021","unstructured":"Manley, S. C., Hair, J. F., Williams, R. I., & McDowell, W. C. (2021). Essential new PLS-SEM analysis methods for your entrepreneurship analytical toolbox. International Entrepreneurship and Management Journal, 17(4), 1805\u20131825. https:\/\/doi.org\/10.1007\/s11365-020-00687-6","journal-title":"International Entrepreneurship and Management Journal"},{"key":"11412_CR40","doi-asserted-by":"publisher","unstructured":"Markic, S., Eilks, I., & Valanides, N. (2008). Developing a tool to evaluate differences in beliefs about science teaching and learning among freshman science student teachers from different science teaching domains: a case study. Eurasia Journal of Mathematics, Science and Technology Education, 4(2), 109\u2013120. https:\/\/doi.org\/10.12973\/ejmste\/75311","DOI":"10.12973\/ejmste\/75311"},{"key":"11412_CR41","unstructured":"McAuliffe, M. (2016). The potential benefits of divergent thinking and metacognitive skills in STEAM learning: A discussion paper. International Journal of Innovation, Creativity and Change, 2(3), 71\u201382. https:\/\/www.ijicc.net\/images\/Volume2issue22015\/McAuliffe_May_2016.pdf"},{"issue":"8","key":"11412_CR42","doi-asserted-by":"publisher","first-page":"1222","DOI":"10.1080\/02602938.2020.1729696","volume":"45","author":"H Meijer","year":"2020","unstructured":"Meijer, H., Hoekstra, R., Brouwer, J., & Strijbos, J. W. (2020). Unfolding collaborative learning assessment literacy: A reflection on current assessment methods in higher education. Assessment & Evaluation in Higher Education, 45(8), 1222\u20131240. https:\/\/doi.org\/10.1080\/02602938.2020.1729696","journal-title":"Assessment & Evaluation in Higher Education"},{"key":"11412_CR43","unstructured":"Ministry of Education. (2014). Curriculum Guidelines of 12-Year Basic Education: General Guidelines. Retrieved from https:\/\/cirn.moe.edu.tw\/Upload\/file\/32077\/83646.pdf. Accessed 19 Dec 2020."},{"issue":"3","key":"11412_CR44","doi-asserted-by":"publisher","first-page":"215824401986148","DOI":"10.1177\/2158244019861480","volume":"9","author":"B Moore","year":"2019","unstructured":"Moore, B., Boardman, A. G., Smith, C., & Ferrell, A. (2019). Enhancing collaborative group processes to promote academic literacy and content learning for diverse learners through video reflection. SAGE Open, 9(3), 2158244019861480. https:\/\/doi.org\/10.1177\/2158244019861480","journal-title":"SAGE Open"},{"key":"11412_CR45","volume-title":"Applied statistical models","author":"J Neter","year":"1990","unstructured":"Neter, J., Wasserman, W., & Kutner, M. H. (1990). Applied statistical models. Richard D Irwin Inc."},{"issue":"1","key":"11412_CR46","first-page":"48","volume":"20","author":"D Pusca","year":"2018","unstructured":"Pusca, D., & Northwood, D. O. (2018). Design thinking and its application to problem solving. Global Journal of Engineering Education, 20(1), 48\u201353. https:\/\/www.researchgate.net\/profile\/Derek-Northwood\/publication\/323277797_Design_thinking_and_its_application_to_problem_solving\/links\/5a9c029caca2721e3f32082a\/Design-thinking-and-its-application-to-problem-solving.pdf.","journal-title":"Global Journal of Engineering Education"},{"key":"11412_CR47","doi-asserted-by":"publisher","unstructured":"Rahmawati, L., Wilujeng, I., & Satriana, A. (2020). Application of STEM learning approach through simple technology to increase data literacy. In Journal of Physics: Conference Series (Vol. 1440, No. 1, p. 012047). IOP Publishing. https:\/\/doi.org\/10.1088\/1742-6596\/1440\/1\/012047","DOI":"10.1088\/1742-6596\/1440\/1\/012047"},{"issue":"4","key":"11412_CR48","first-page":"8","volume":"75","author":"EM Reeve","year":"2015","unstructured":"Reeve, E. M. (2015). STEM Thinking! Technology and Engineering Teacher, 75(4), 8\u201316.","journal-title":"Technology and Engineering Teacher"},{"key":"11412_CR49","unstructured":"Ringle, Christian M., Wende, Sven, & Becker, Jan-Michael. (2015). SmartPLS 3. B\u00f6nningstedt: SmartPLS. Retrieved from http:\/\/www.smartpls.com"},{"issue":"1","key":"11412_CR50","doi-asserted-by":"publisher","first-page":"3","DOI":"10.2307\/41410402","volume":"36","author":"CM Ringle","year":"2012","unstructured":"Ringle, C. M., Sarstedt, M., & Straub, D. W. (2012). Editor\u2019s Comments: A Critical Look at the Use of PLS-SEM in\" MIS Quarterly\". MIS Quarterly, 36(1), 3-14 41410402.","journal-title":"MIS Quarterly"},{"key":"11412_CR51","doi-asserted-by":"publisher","first-page":"678","DOI":"10.1016\/j.chb.2016.08.047","volume":"72","author":"M Rom\u00e1n-Gonz\u00e1lez","year":"2017","unstructured":"Rom\u00e1n-Gonz\u00e1lez, M., P\u00e9rez-Gonz\u00e1lez, J. C., & Jim\u00e9nez-Fern\u00e1ndez, C. (2017). Which cognitive abilities underlie computational thinking? Criterion validity of the Computational Thinking Test. Computers in Human Behavior, 72, 678\u2013691. https:\/\/doi.org\/10.1016\/j.chb.2016.08.047","journal-title":"Computers in Human Behavior"},{"key":"11412_CR52","volume-title":"The analytic process: Planning, priority setting, resources allocation","author":"TL Saaty","year":"1980","unstructured":"Saaty, T. L. (1980). The analytic process: Planning, priority setting, resources allocation. McGraw."},{"issue":"5","key":"11412_CR53","doi-asserted-by":"publisher","first-page":"18","DOI":"10.53761\/1.17.5.18","volume":"17","author":"CP Sarmiento","year":"2020","unstructured":"Sarmiento, C. P., Morales, M. P. E., Elipane, L. E., & Palomar, B. C. (2020). Assessment Practices in Philippine Higher STEAM Education. Journal of University Teaching and Learning Practice, 17(5), 18. https:\/\/ro.uow.edu.au\/jutlp\/vol17\/iss5\/18.","journal-title":"Journal of University Teaching and Learning Practice"},{"issue":"4","key":"11412_CR54","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1108\/EUM0000000006493","volume":"29","author":"A Smith Macklin","year":"2001","unstructured":"Smith Macklin, A. (2001). Integrating information literacy using problem-based learning. Reference Services Review, 29(4), 306\u2013314. https:\/\/doi.org\/10.1108\/EUM0000000006493","journal-title":"Reference Services Review"},{"issue":"1","key":"11412_CR55","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s40299-019-00494-w","volume":"29","author":"HJ So","year":"2020","unstructured":"So, H. J., Jong, M. S. Y., & Liu, C. C. (2020). Computational thinking education in the Asian Pacific region. The Asia-Pacific Education Researcher, 29(1), 1\u20138. https:\/\/doi.org\/10.1007\/s40299-019-00494-w","journal-title":"The Asia-Pacific Education Researcher"},{"key":"11412_CR56","doi-asserted-by":"publisher","unstructured":"Sung, J. (2022). Assessing young Korean children\u2019s computational thinking: A validation study of two measurements. Education and Information Technologies, 1\u201329,. https:\/\/doi.org\/10.1007\/s10639-022-11137-x","DOI":"10.1007\/s10639-022-11137-x"},{"key":"11412_CR57","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2019.103798","volume":"148","author":"X Tang","year":"2020","unstructured":"Tang, X., Yin, Y., Lin, Q., Hadad, R., & Zhai, X. (2020). Assessing computational thinking: A systematic review of empirical studies. Computers & Education, 148, 103798. https:\/\/doi.org\/10.1016\/j.compedu.2019.103798","journal-title":"Computers & Education"},{"key":"11412_CR58","doi-asserted-by":"publisher","unstructured":"Tsai, M. J., Chien, F. P., Wen-Yu Lee, S., Hsu, C. Y., & Liang, J. C. (2022). Development and validation of the computational thinking test for elementary school students (CTT-ES): Correlate CT competency with CT disposition. Journal of Educational Computing Research, 07356331211051043,. https:\/\/doi.org\/10.1177\/07356331211051043","DOI":"10.1177\/07356331211051043"},{"issue":"3","key":"11412_CR59","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1145\/1118178.1118215","volume":"49","author":"JM Wing","year":"2006","unstructured":"Wing, J. M. (2006). Computational thinking. Communications of the ACM, 49(3), 33\u201335. https:\/\/doi.org\/10.1145\/1118178.1118215","journal-title":"Communications of the ACM"},{"issue":"1881","key":"11412_CR60","doi-asserted-by":"publisher","first-page":"3717","DOI":"10.1098\/rsta.2008.0118","volume":"366","author":"JM Wing","year":"2008","unstructured":"Wing, J. M. (2008). Computational thinking and thinking about computing. Philosophical Transactions of the Royal Society a: Mathematical, Physical and Engineering Sciences, 366(1881), 3717\u20133725. https:\/\/doi.org\/10.1098\/rsta.2008.0118","journal-title":"Philosophical Transactions of the Royal Society a: Mathematical, Physical and Engineering Sciences"},{"issue":"1","key":"11412_CR61","doi-asserted-by":"publisher","first-page":"929","DOI":"10.1007\/s10639-018-9801-8","volume":"24","author":"M Ya\u011fc\u0131","year":"2019","unstructured":"Ya\u011fc\u0131, M. (2019). A valid and reliable tool for examining computational thinking skills. Education and Information Technologies, 24(1), 929\u2013951. https:\/\/doi.org\/10.1007\/s10639-018-9801-8","journal-title":"Education and Information Technologies"},{"issue":"2","key":"11412_CR62","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1007\/s10956-019-09794-8","volume":"29","author":"Y Yin","year":"2020","unstructured":"Yin, Y., Hadad, R., Tang, X., & Lin, Q. (2020). Improving and assessing computational thinking in maker activities: The integration with physics and engineering learning. Journal of Science Education and Technology, 29(2), 189\u2013214. https:\/\/doi.org\/10.1007\/s10956-019-09794-8","journal-title":"Journal of Science Education and Technology"}],"container-title":["Education and Information Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10639-022-11412-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10639-022-11412-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10639-022-11412-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,3]],"date-time":"2023-07-03T07:23:12Z","timestamp":1688368992000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10639-022-11412-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,29]]},"references-count":62,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["11412"],"URL":"https:\/\/doi.org\/10.1007\/s10639-022-11412-x","relation":{},"ISSN":["1360-2357","1573-7608"],"issn-type":[{"value":"1360-2357","type":"print"},{"value":"1573-7608","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,29]]},"assertion":[{"value":"13 June 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 October 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 December 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}