Abstract
In this paper, we present work on learning analytics that aims to support learners and teachers through dashboard applications, ranging from small mobile applications to learnscapes on large public displays. Dashboards typically capture and visualize traces of learning activities, in order to promote awareness, reflection, and sense-making, and to enable learners to define goals and track progress toward these goals. Based on an analysis of our own work and a broad range of similar learning dashboards, we identify HCI issues for this exciting research area.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Chatti MA, Agustiawan MR, Jarke M, Specht M (2012) Toward a personal learning environment framework. In: Design, implementation, and evaluation of virtual learning environments. IGI Global, 2012, pp 20–40. Web 14 Dec 2012. doi:10.4018/978-1-4666-1770-4.ch003
Duval E, Wiley D (2010) Guest editorial: open educational resources. IEEE Trans Learn Technol 3(2):83–84
Purpura S, Schwanda V, Williams K, Stubler W, Sengers P (2011) Fit4life: the design of a persuasive technology promoting healthy behavior and ideal weight. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI ‘11), ACM, New York, NY, pp 423–432
Duval E (2011) Attention please! Learning analytics for visualization and recommendation. In: Proceedings of LAK11, ACM, New York, pp 9–17
Pechenizkiy M et al (eds) (2011) Proceedings of EDM11: 4th international conference on educational data mining, 2011
Santos JL, Govaerts S, Verbert K, Duval E (2012) Goal-oriented visualizations of activity tracking: a case study with engineering students. In: Shum SB, Gasevic D, Ferguson R (eds) Proceedings of the 2nd international conference on learning analytics and knowledge (LAK ‘12). ACM, New York, NY, pp 143–152
Verbert K, Duval E, Klerkx J, Govaerts S, Santos JL (2013) Learning analytics dashboard applications. Am Behav Sci 57(10):1500–1509
Yu Y-C, You S-CD, Tsai D-R (2012) Social interaction feedback system for the smart classroom. In: Proceedings of the 2012 IEEE international conference on consumer electronics (ICCE), IEEE, pp 500–501
Pohl A, Bry F, Schwarz J, Gottstein M (2012) Sensing the classroom: improving awareness and self-awareness of students with backstage. In: Proceedings of the international conference on interactive and collaborative learning (ICL), Villach, Austria, 26–28 September 2012
Barr J, Gunawardena A (2012) Classroom salon: a tool for social collaboration. In: Proceedings of the 43rd ACM technical symposium on computer science education (SIGCSE ‘12), ACM, New York, NY, pp 197–202
Fagen W, Kamin S (2012) Developing device-independent applications for active and collaborative learning with the SLICE framework. In: Amiel T, Wilson B (eds) Proceedings of world conference on educational multimedia, hypermedia and telecommunications 2012, AACE, Chesapeake, VA, pp 1565–1572
Cuendet S, Bonnard Q, Kaplan F, Dillenbourg P (2011) Paper interface design for classroom orchestration. In: CHI ‘11 extended abstracts on human factors in computing systems (CHI EA ‘11), ACM, New York, NY, pp 1993–1998
Son LH (2012) Supporting reflection and classroom orchestration with tangible tabletops. PhD Thesis http://biblion.epfl.ch/EPFL/theses/2012/5313/5313_abs.pdf
Martinez Maldonado R, Kay J, Yacef K, Schwendimann B (2012) An interactive teacher’s dashboard for monitoring groups in a multi-tabletop learning environment. In: Cerri et al (eds) Proceedings of the 11th international conference on intelligent tutoring. Springer, Berlin, pp 482–492
Gutiérrez Rojas I, Crespo García RM, Delgado Kloos C (2011) Orchestration and feedback in lab sessions: improvements in quick feedback provision. In: Delgado Kloos C et al (eds) ECTEL 2011 towards ubiquitous learning 6th European conference of technology enhanced learning 2023 September 2011, Palermo Italy Proceedings LNCS 6964, vol 6964. Springer, Berlin, pp 424–429
Gutiérrez Rojas I, Crespo García RM (2012) Towards efficient provision of feedback supported by learning analytics. In: Proceedings of the 12th international conference on advanced learning technologies (ICALT), IEEE, pp 599–603
Morris MR, Piper AM, Cassanego T, Winograd T (2005) Supporting cooperative language learning: issues in interface design for an interactive table. Stanford University Technical Report, 2005
Arnold KE, Pistilli MD (2012) Course signals at Purdue: using learning analytics to increase student success. In: Shum SB, Gasevic D, Ferguson R (eds) Proceedings of the 2nd international conference on learning analytics and knowledge (LAK ‘12), ACM, NY, pp 267–270
Dollár A, Steif PS (2012) Web-based statics course with learning dashboard for instructors. In: Uskov V (ed) Proceedings of computers and advanced technology in education (CATE 2012), June 25–27, 2012, Napoli, Italy
Govaerts S, Verbert K, Duval E, Pardo A (2012) The student activity meter for awareness and self-reflection. In: The ACM SIGCHI conference on human factors in computing systems, Austin, TX, USA, 5–10 May 2012, CHI EA ‘12: proceedings of the 2012 ACM annual conference extended abstracts on human factors in computing systems extended abstracts, ACM, pp 869–884
Ali L, Hatala M, Gašević D, Jovanović J (2012) A qualitative evaluation of evolution of a learning analytics tool. Comput Educ 58(1):470–489
Podgorelec V, Kuhar S (2011) Taking advantage of education data: advanced data analysis and reporting in virtual learning environments. Electron Electr Eng 114(8):111–116
Leony D, Pardo A, de la Fuente Valentín L, Sánchez de Castro D, Delgado Kloos C (2012) GLASS: a learning analytics visualization tool. In Buckingham Shum S, Gasevic D, Ferguson R (eds) Proceedings of the 2nd international conference on learning analytics and knowledge LAK ‘12, ACM, New York, NY, pp 162–163
Scheuer O, Zinn C (2007) How did the e-learning session go? The student inspector. In: Luckin R et al. (eds) Proceedings of the 2007 conference on artificial intelligence in education: building technology rich learning contexts that work. IOS Press, Amsterdam, pp 487–494
Lafford BA (2004) Review of tell me more Spanish. J Lang Learn Technol 8(3):21–34
Kerly A, Ellis R, Bull S (2007) CALMsystem: a conversational agent for learner modelling. In: Ellis R et al. (eds) Applications and innovations in intelligent systems XV—proceedings of AI-2007, 27th SGAI international conference on innovative techniques and applications of artificial intelligence. Springer, pp 89–102
Chen GD, Chang CK, Wang CY (2008) Ubiquitous learning website: scaffold learners by mobile devices with information-aware techniques. Comput Educ 50(1):77–90
Kobsa E, Dimitrova V, Boyle R (2005) Using student and group models to support teachers in web-based distance education. In: Proceedings of the 10th international conference on user modeling. Edinburgh, UK, pp 124–133
Santos Odriozola J, Verbert K, Duval E (2012) Empowering students to reflect on their activity with StepUp!: two case studies with engineering students. In: Proceedings of ARTELL’12 2nd workshop on awareness and reflection, CEUR workshop proceedings, pp 73–86
Nakahara J, Hisamatsu S, Yaegashi K, Yamauchi Y (2005) iTree: does the mobile phone encourage learners to be more involved in collaborative learning? In: Proceedings of the 2005 conference on computer support for collaborative learning: learning 2005: the next 10 years! (CSCL ‘05). International Society of the Learning Sciences, pp 470–478
Dawson S, Bakharia A, Heathcote E (2010) SNAPP: realising the affordances of real- time SNA within networked learning environments. In: Dirckinck-Holmfeld L et al (eds), Proceedings of the 7th international conference on networked learning. University of Lancaster, Lancaster, pp 125–133
Silius K, Miilumaki T, Huhtamaki J, Tebest T, Merilainen J, Pohjolainen S (2010) Students’ Motivations for social media enhanced studying and learning. Knowl Manage E-Learn Int J (KM&EL) 2(1):51–67
France L, Heraud J-M, Marty J-C, Carron T, Heili J (2006) Monitoring virtual classroom: visualization techniques to observe student activities in an e-learning system. In: Proceedings of the sixth international conference on advanced learning technologies, IEEE, pp 716–720
Govaerts S, Verbert K, Dahrendorf D, Ullrich C, Schmidt M, Werkle M, Chatterjee A, Nussbaumer A, Renzel D, Scheffel M, Friedrich M, Santos Odriozola J, Duval E, Law E (2011) Towards responsive open learning environments: the ROLE interoperability framework. In: Proceedings of 6th European conference of technology enhanced learning, EC-TEL 2011, LNCS vol 6964. Springer, pp 125–138
Santos JL, Verbert K, Govaerts S, Duval E (2013) Addressing learner issues with StepUp!: an evaluation. In Suthers D, Verbert K, Duval E, Ochoa X (eds) Proceedings of the 2013 ACM international conference on learning analytics and knowledge (LAK’13), ACM, 10 p
Verbert K, Manouselis N, Ochoa X, Wolpers M, Drachsler H, Bosnic I, Duval E (2012) Context-aware recommender systems for learning: a survey and future challenges. IEEE Trans Learn Technol 5(4):318–335
Verpoorten D, Westera W, Specht M (2011) Reflection amplifiers in online courses: a classification framework. J Interact Learn Res 22(2):167–190
Leony D, Crespo RM, Perez-Sanagustin M, Parada GHA, de la Fuente Valentin L, Pardo A (2012). Coverage metrics for learning-event datasets based on client-side monitoring. In: Proceedings of the IEEE 12th international conference on advanced learning technologies (ICALT), 2012, IEEE, pp 652–653
Dillenbourg P, Zufferey G, Alavi H, Jermann P, Do-lenh S, Bonnard Q, Cuendet S et al. (2011) Classroom orchestration: the third circle of usability. In: CSCL2011 proceedings vol I. International Society of the Learning Sciences, Hong Kong, pp 510–517
Bakker J, Holenderski L, Kocielnik R, Pechenizkiy M, Sidorova N (2012) Stess@Work: from measuring stress to its understanding, prediction and handling with personalized coaching. In: Proceedings of the 2nd ACM SIGHIT international health informatics symposium (IHI ‘12), ACM, New York, NY, pp 673–678
Shum SB, Gasevic D, Ferguson R (eds) (2012) LAK12: proceedings of 2nd international conference on learning analytics and knowledge, ACM
Suthers D, Verbert K, Duval E, Ochoa X (eds) (2013) LAK13: proceedings of 3rd international conference on learning analytics and knowledge, ACM
Schaaff K, Müller L, Kirst M, Heuer S (2012) xAffect—a modular framework for online affect recognition and biofeedback applications. In: Proceedings of the 3rd international workshop on motivational and affective aspects of technology enhanced learning, September 2012
Leony D, Pardo A, Parada Gélvez H, Delgado Kloos C (2012) A widget to recommend learning resources based on the learner affective state. In: Proceedings of the 3rd international workshop on motivational and affective aspects of technology enhanced learning, September 2012
Harris S (2010) The place of virtual, pedagogic and physical space in the 21st century classroom
Bizer C (2009) The emerging web of linked data. IEEE Intell Syst 24(5):87–92
Siemens G, Gasevic D, Haythornthwaite C, Dawson S, Buckingham Shum S, Ferguson R, Duval E, Verbert K, Baker RSJD (2011) Open learning analytics: an integrated & modularized platform proposal to design, implement and evaluate an open platform to integrate heterogeneous learning analytics techniques. Retrieved online from http://solaresearch.org/OpenLearningAnalytics.pdf
Baillie C (2000) Motivation and attrition in engineering students. Geraldine Fitzgerald Eur J Eng Educ 25(2):145–155
Killen R (1994) Differences between students’ and lecturers’ perceptions of factors influencing students’ academic success at university. High Educ Res Dev 13:199
Zhou X, Jin Q (2011) Dynamical user networking and proling based on activity streams for enhanced social learning. Advances in web-based learning-ICWL, Springer, pp 219–225
Goligoski E (2012) Motivating the learner: mozillas open badges program. Access Knowl Course J 4(1):8
Domínguez A, Saenz-de-Navarrete J, de-Marcos L, Fernández-Sanz L, Pagés C, Martínez-Herráiz J-J (2013) Gamifying learning experiences: practical implications and outcomes, Comput Educ 63:380–392
Santos JL, Charleer S, Parra G, Klerkx J, Duval E, Verbert K (2013) Motivating students in an open learning environment through open badges. In: Proceedings of the eighth European conference on technology enhanced learning (ECTEL 2013), 14 p (to appear)
Jarvis J (2011) Public parts: how sharing in the digital age improves the way we work and live. Simon & Schuster, New York
Purpura S, Schwanda V, Williams K, Stubler W, Sengers P (2011) Fit4life: the design of a persuasive technology promoting healthy behavior and ideal weight. In: Proceedings of the 2011 annual conference on human factors in computing systems, ACM, pp 423–432
Verbert K, Manouselis N, Drachsler H, Duval E (2012) Dataset-driven research to support learning and knowledge analytics. Educ Technol Soc 15(3):133–148
Acknowledgments
We thank all evaluation participants for their most valuable feedback. The research leading to these results has received funding from the European Community Seventh Framework Programme (FP7/2007–2013) under Grant Agreement No. 231396 (ROLE). Katrien Verbert is a post-doctoral fellow of the Research Foundation—Flanders (FWO).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Verbert, K., Govaerts, S., Duval, E. et al. Learning dashboards: an overview and future research opportunities. Pers Ubiquit Comput 18, 1499–1514 (2014). https://doi.org/10.1007/s00779-013-0751-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00779-013-0751-2