Abstract
Programming skill is one of the essential basic experience that each student in the field of computer science has to acquire. To potentially train all students such a skill, teachers should know every student understanding level during the practice of a programming for individually supporting. Conducting a test is a common method to classify the understanding level of the students. However, it would be a heavy burden for teachers and the student levels are known after the test. The purpose of our study is to classify the understanding level of programming during the practice. In this study, we focus on a block coding learning platform, and we propose a classification method by using mouse tracking heatmaps and machine learning techniques. As a first step of the study, we conduct a test with 18 participants. The results had shown that using mouse click heatmap image and decision tree algorithm was observed to classify students based on their programming logic understanding level through activity on a block coding learning platform. In our future work, we will increase the accuracy of classification and develop a model that can classify the understanding levels almost in real time of during programming practice.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Lauer, D.C.: Exploring Workplace Learning for Software Developers from the Perspectives of Software Developers and Managers of Software Developers. Drake University (2022)
Verma, A., et al.: An investigation of skill requirements in artificial intelligence and machine learning job advertisements. Ind. High. Educ. 36(1), 63–73 (2022)
João, et al.: A cross-analysis of block-based and visual programming apps with computer science student-teachers. Educ. Sci. 9(3), 181 (2019). https://doi.org/10.3390/educsci9030181
Carlos Begosso, L., et al.: An analysis of block-based programming environments for CS1. In: 2020 IEEE Frontiers in Education Conference (FIE), pp. 1–5 IEEE, Uppsala, Sweden (2020). https://doi.org/10.1109/FIE44824.2020.9273982
Zelle, J.M.: Python Programming: An Introduction to Computer Science. Franklin, Beedle & Associates Inc, Portland, Oregon (2017)
Çetinkaya, A., Baykan, Ö.K.: Prediction of middle school students’ programming talent using artificial neural networks. Eng. Sci. Technol., an Int. J. 23(6), 1301–1307 (2020). https://doi.org/10.1016/j.jestch.2020.07.005
Sagar, M., et al.: Performance prediction and behavioral analysis of student programming ability. In: 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp. 1039–1045 IEEE, Jaipur, India (2016). https://doi.org/10.1109/ICACCI.2016.7732181
Sivasakthi, M.: Classification and prediction based data mining algorithms to predict students’ introductory programming performance. In: 2017 International Conference on Inventive Computing and Informatics (ICICI), pp. 346–350 IEEE, Coimbatore (2017). https://doi.org/10.1109/ICICI.2017.8365371
Koonsanit, K., Tsunajima, T., Nishiuchi, N.: Evaluation of Strong and Weak Signifiers in a Web Interface Using Eye-Tracking Heatmaps and Machine Learning. In: Saeed, K. and Dvorský, J. (eds.) Computer Information Systems and Industrial Management. pp. 203–213. Springer International Publishing, Cham (2021). https://doi.org/10.1007/978-3-030-84340-3_16
Kirsh, I.: Using mouse movement heatmaps to visualize user attention to words. In: Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society, pp. 1–5 ACM, Tallinn Estonia (2020). https://doi.org/10.1145/3419249.3421250
Navalpakkam, V., Churchill, E.: Mouse tracking: measuring and predicting users’ experience of web-based content. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2963–2972 ACM, Austin Texas USA (2012). https://doi.org/10.1145/2207676.2208705
Scratch - Imagine, Program, Share. https://scratch.mit.edu/. Accessed 21 Mar 2023
Learn computer science. Change the world. https://code.org/. Accessed 21 Mar 2023
Coding For Kids, Kids Online Coding Classes & Games | Tynker. https://www.tynker.com. Accessed 21 Mar 2023
Blockly. https://developers.google.com/blockly. Accessed 21 Mar 2023
Principal component analysis for special types of data. In: Principal Component Analysis, pp. 338–372 Springer-Verlag, New York (2002). https://doi.org/10.1007/0-387-22440-8_13
Koonsanit, K., Hiruma, D., Nishiuchi, N.: Dimension reduction method by principal component analysis in the prediction of final user satisfaction. In: 2022 12th International Congress on Advanced Applied Informatics (IIAI-AAI), pp. 649–650. IEEE, Kanazawa, Japan (2022). https://doi.org/10.1109/IIAIAAI55812.2022.00128
Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press (2000).https://doi.org/10.1017/CBO9780511801389
Koonsanit, K., Nishiuchi, N.: Predicting final user satisfaction using momentary UX data and machine learning techniques. J. Theor. Appl. Electron. Commer. Res. 16, 3136–3156 (2021). https://doi.org/10.3390/jtaer16070171
Zhang, Z.: Introduction to machine learning: k-nearest neighbors. Ann. Transl. Med. 4(11), 218–218 (2016). https://doi.org/10.21037/atm.2016.03.37
Priyanka, N.A., Kumar, D.: Decision tree classifier: a detailed survey. IJIDS. 12(3), 246 (2020). https://doi.org/10.1504/IJIDS.2020.108141
Speiser, J.L., et al.: A comparison of random forest variable selection methods for classification prediction modeling. Expert Syst. Appl. 134, 93–101 (2019). https://doi.org/10.1016/j.eswa.2019.05.028
Webb, G.I., et al.: Leave-one-out cross-validation. In: Sammut, C., Webb, G.I. (eds.) Encyclopedia of Machine Learning, pp. 600–601 Springer US, Boston, MA (2011). https://doi.org/10.1007/978-0-387-30164-8_469
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Khaesawad, A., Yem, V., Nishiuchi, N. (2023). Classification of Programming Logic Understanding Level Using Mouse Tracking Heatmaps and Machine Learning Techniques. In: Saeed, K., Dvorský, J., Nishiuchi, N., Fukumoto, M. (eds) Computer Information Systems and Industrial Management. CISIM 2023. Lecture Notes in Computer Science, vol 14164. Springer, Cham. https://doi.org/10.1007/978-3-031-42823-4_34
Download citation
DOI: https://doi.org/10.1007/978-3-031-42823-4_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42822-7
Online ISBN: 978-3-031-42823-4
eBook Packages: Computer ScienceComputer Science (R0)