{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,30]],"date-time":"2024-08-30T21:48:02Z","timestamp":1725054482167},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"2","funder":[{"DOI":"10.13039\/501100004837","name":"Ministerio de Ciencia e Innovaci\u00f3n","doi-asserted-by":"publisher","award":["TIN2008-04103\/TSI"],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2009,6]]},"abstract":"This article reviews successful educational experiences in using program and algorithm visualizations (PAVs). First, we survey a total of 18 PAV systems that were subject to 33 evaluations. We found that half of the systems have only been tested for usability, and those were shallow inspections. The rest were evaluated with respect to their educational effectiveness. Script-based systems seem to be well suited for the viewing, responding, and changing engagement levels, while compiler-based systems do well for the construction and presenting engagement levels. Finally, we analyze additional PAV features of successful evaluations and hypothesize that they are relevant.<\/jats:p>","DOI":"10.1145\/1538234.1538236","type":"journal-article","created":{"date-parts":[[2009,12,1]],"date-time":"2009-12-01T14:35:04Z","timestamp":1259678104000},"page":"1-21","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":86,"title":["A Survey of Successful Evaluations of Program Visualization and Algorithm Animation Systems"],"prefix":"10.1145","volume":"9","author":[{"given":"Jaime","family":"Urquiza-Fuentes","sequence":"first","affiliation":[{"name":"Universidad Rey Juan Carlos"}]},{"given":"J. \u00c1ngel","family":"Vel\u00e1zquez-Iturbide","sequence":"additional","affiliation":[{"name":"Universidad Rey Juan Carlos"}]}],"member":"320","published-online":{"date-parts":[[2009,6]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcs.2007.01.043"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/611892.611959"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0360-1315(02)00076-3"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1133265.1133362"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcs.2007.01.040"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1140124.1140267"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/340368.340385"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1006\/jvlc.1999.0143"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1268784.1268869"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/218683.218689"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1227310.1227316"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/774833.774846"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the 3rd Program Visualization Workshop (PVW\u201904)","author":"Hamer J.","year":"2004","unstructured":"Hamer , J. 2004 . A lightweight visualizer for Java . In Proceedings of the 3rd Program Visualization Workshop (PVW\u201904) . 54--61. Hamer, J. 2004. A lightweight visualizer for Java. In Proceedings of the 3rd Program Visualization Workshop (PVW\u201904). 54--61."},{"key":"e_1_2_1_14_1","first-page":"1","article-title":"Helping learners visualize and comprehend algorithms","volume":"2","author":"Hansen S.","year":"2000","unstructured":"Hansen , S. , Narayanan , N. , and Schrimpsher , D. 2000 . Helping learners visualize and comprehend algorithms . Interactive Multimedia Electr. J. Comput.-Enhanc. Learn. 2 , 1 . http:\/\/imej.wfu.edu\/articles\/2000\/1\/02\/. Hansen, S., Narayanan, N., and Schrimpsher, D. 2000. Helping learners visualize and comprehend algorithms. Interactive Multimedia Electr. J. Comput.-Enhanc. Learn. 2, 1. http:\/\/imej.wfu.edu\/articles\/2000\/1\/02\/.","journal-title":"Interactive Multimedia Electr. J. Comput.-Enhanc. Learn."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/971300.971433"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/774833.774847"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0360-1315(02)00044-1"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2005.72"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2006.06.002"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1006\/jvlc.2002.0231"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1006\/jvlc.2002.0237"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148493.1148497"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0360-1315(97)00015-8"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.2000.0409"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvlc.2006.09.004"},{"key":"e_1_2_1_26_1","volume-title":"J., Stlnacke, K.","author":"Korhonen A.","year":"2004","unstructured":"Korhonen , A. , Malmi , L. , Silvasti , P. , Karavirta , V. , L\u00f6nnberg , J. , Nikander , J., Stlnacke, K. , and Ihantola, P. 2004 . Matrix - A framework for interactive software visualization. Tech. Rep. TKO-B 154\/04. Laboratory of Information Processing Science, Department of Computer Science and Engineering, Helsinki University of Technology , Helsinki, Finland. Korhonen, A., Malmi, L., Silvasti, P., Karavirta, V., L\u00f6nnberg, J., Nikander, J., Stlnacke, K., and Ihantola, P. 2004. Matrix - A framework for interactive software visualization. Tech. Rep. TKO-B 154\/04. Laboratory of Information Processing Science, Department of Computer Science and Engineering, Helsinki University of Technology, Helsinki, Finland."},{"key":"e_1_2_1_27_1","series-title":"Lecture Notes in Computer Science","volume-title":"Human-centered visualization environments","author":"Kulyk O.","unstructured":"Kulyk , O. , Kosara , R. , Urquiza-Fuentes , J. , and I., W. 2007. Human-centered visualization environments . Lecture Notes in Computer Science , vol. 4417 , Chapter Human-Centered Aspects. Springer-Verlag , 13--75. Kulyk, O., Kosara, R., Urquiza-Fuentes, J., and I., W. 2007. Human-centered visualization environments. Lecture Notes in Computer Science, vol. 4417, Chapter Human-Centered Aspects. Springer-Verlag, 13--75."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1047344.1047422"},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","first-page":"49","DOI":"10.15388\/infedu.2005.04","article-title":"Multi-perspective study of novice learners adopting the visual algorithm simulation exercise system TRAKLA2","volume":"4","author":"Laakso M.-J.","year":"2005","unstructured":"Laakso , M.-J. , Salakoski , T. , Grandell , L. , Qiu , X. , Korhonen , A. , and Malmi , L. 2005 . Multi-perspective study of novice learners adopting the visual algorithm simulation exercise system TRAKLA2 . Informatics Educ. 4 , 1, 49 -- 68 . Laakso, M.-J., Salakoski, T., Grandell, L., Qiu, X., Korhonen, A., and Malmi, L. 2005. Multi-perspective study of novice learners adopting the visual algorithm simulation exercise system TRAKLA2. Informatics Educ. 4, 1, 49--68.","journal-title":"Informatics Educ."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the IEEE Symposium on Visual Languages (VL\u201994)","author":"Lawrence A.","unstructured":"Lawrence , A. , Badre , A. , and Stasko , J . 1994. Empirically evaluating the use of animations to teach algorithms . In Proceedings of the IEEE Symposium on Visual Languages (VL\u201994) . 48--54. Lawrence, A., Badre, A., and Stasko, J. 1994. Empirically evaluating the use of animations to teach algorithms. In Proceedings of the IEEE Symposium on Visual Languages (VL\u201994). 48--54."},{"key":"e_1_2_1_32_1","doi-asserted-by":"crossref","first-page":"267","DOI":"10.15388\/infedu.2004.19","article-title":"Visual algorithm simulation exercise system with automatic assessment: TRAKLA2","volume":"3","author":"Malmi L.","year":"2004","unstructured":"Malmi , L. , Karavirta , V. , Korhonen , A. , Nikander , J. , Sepp\u00e4l\u00e4 , O. , and Silvasti , P. 2004 . Visual algorithm simulation exercise system with automatic assessment: TRAKLA2 . Informatics Educ. 3 , 2, 267 -- 288 . Malmi, L., Karavirta, V., Korhonen, A., Nikander, J., Sepp\u00e4l\u00e4, O., and Silvasti, P. 2004. Visual algorithm simulation exercise system with automatic assessment: TRAKLA2. Informatics Educ. 3, 2, 267--288.","journal-title":"Informatics Educ."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/989863.989928"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/971300.971328"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcs.2007.01.034"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2005.110"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/782941.782998"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcs.2007.01.035"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the Canadian Electrical and Computer Engineering Conference (CCECE\u201900)","author":"Norvell T.","unstructured":"Norvell , T. and Bruce-Lockhart , M . 2000. Taking the hood of the computer: Program animation with the Teaching Machine . In Proceedings of the Canadian Electrical and Computer Engineering Conference (CCECE\u201900) . 831--835. Norvell, T. and Bruce-Lockhart, M. 2000. Taking the hood of the computer: Program animation with the Teaching Machine. In Proceedings of the Canadian Electrical and Computer Engineering Conference (CCECE\u201900). 831--835."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273039.1273042"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/273133.274310"},{"key":"e_1_2_1_42_1","unstructured":"Price B. Baecker R. and Small I. 1998. An introduction to software visualization. In Software Visualization J. Stasko J. Domingue M. Brown and B. Price Eds. MIT Press Cambridge MA 3--27. Price B. Baecker R. and Small I. 1998. An introduction to software visualization. In Software Visualization J. Stasko J. Domingue M. Brown and B. Price Eds. MIT Press Cambridge MA 3--27."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcs.2007.01.036"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/544414.544446"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcs.2008.12.044"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/343048.343069"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/236452.236527"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/130956.130959"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/268084.268091"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI\u201993)","author":"Stasko J.","unstructured":"Stasko , J. , Badre , A. , and Lewis , C . 1993. Do algorithm animations assist learning? An empirical study and analysis . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI\u201993) . 61--66. Stasko, J., Badre, A., and Lewis, C. 1993. Do algorithm animations assist learning? An empirical study and analysis. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI\u201993). 61--66."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.entcs.2007.01.038"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2006.04.005"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1384271.1384332"},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the 5th Koli Calling Conference on Computer Science Education (KOLI\u201905)","author":"Virtanen A.","unstructured":"Virtanen , A. , Lahtinen , E. , and J\u00e4rvinen , H . -M. 2005. VIP, a visual interpreter for learning introductory programming with C++ . In Proceedings of the 5th Koli Calling Conference on Computer Science Education (KOLI\u201905) . 125--130. Virtanen, A., Lahtinen, E., and J\u00e4rvinen, H.-M. 2005. VIP, a visual interpreter for learning introductory programming with C++. In Proceedings of the 5th Koli Calling Conference on Computer Science Education (KOLI\u201905). 125--130."}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1538234.1538236","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,29]],"date-time":"2022-12-29T05:57:24Z","timestamp":1672293444000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1538234.1538236"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,6]]},"references-count":53,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2009,6]]}},"alternative-id":["10.1145\/1538234.1538236"],"URL":"https:\/\/doi.org\/10.1145\/1538234.1538236","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,6]]},"assertion":[{"value":"2008-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-06-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}