Making the Invisible Visible: Real-Time Feedback for Embedded Computing Learning Activity Using Pedagogical Virtual Machine with Augmented Reality | SpringerLink
Skip to main content
Springer Nature Link
Log in

Making the Invisible Visible: Real-Time Feedback for Embedded Computing Learning Activity Using Pedagogical Virtual Machine with Augmented Reality

  • Conference paper
  • First Online:
Augmented Reality, Virtual Reality, and Computer Graphics (AVR 2017)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10324))

  • 4398 Accesses

Abstract

In today’s digital world, the use of diverse interconnected physical computer-based devices, typified by the Internet-of-Things, has increased, leaving their internal functionalities hidden from people. In education, these hidden computational processes leave learners with a vagueness that obscures how these physical devices function and communicate in order to produce the high-level behaviours and actions they observe. The current approach to revealing these hidden worlds involves the use of debugging tools, visualisation, simulation, or augmented-reality views. Even when such advanced technologies are utilised, they fail to construct a meaningful view of the hidden worlds that relate to the learning context, leaving learners with formidable challenges to understanding the operation of these deep technologies. Therefore, a pedagogical virtual machine (PVM) model was employed to evaluate the learning effectiveness of the proposed model. We presented the experimental evaluation of the PVM model with AR that concerned students learning to program a desk-based robot (which is used as an example of an embedded computer) and reveal the learning effectiveness of using PVM with AR compared to traditional engineering laboratory methods. Overall, the PVM with AR improved learning and teaching, as compared to traditional environments, and learners preferred the use of the PVM with AR system for doing similar activities.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 5719
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 7149
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Alrashidi, M., Callaghan, V., Gardner, M.: An object-oriented pedagogical model for mixed reality teaching and learning. In: 2014 International Conference on Intelligent Environments (IE), pp. 202–206 (2014)

    Google Scholar 

  2. Wu, H.-K., Lee, S.W.-Y., Chang, H.-Y., Liang, J.-C.: Current status, opportunities and challenges of augmented reality in education. Comput. Educ. 62, 41–49 (2013)

    Article  Google Scholar 

  3. Arvanitis, T.N., et al.: Human factors and qualitative pedagogical evaluation of a mobile augmented reality system for science education used by learners with physical disabilities. Pers. Ubiquit. Comput. 13(3), 243–250 (2007)

    Article  Google Scholar 

  4. Shelton, B.E.: Using augmented reality for teaching Earth-Sun relationships to undergraduate geography students. In: The First IEEE International Augmented Reality Toolkit Workshop, ART 2002 (2002)

    Google Scholar 

  5. Cooperstock, J.R.: The classroom of the future: enhancing education through augmented reality. In: Proceedings of HCI International 2001 Conference on Human-Computer Interaction, pp. 688–692 (2001)

    Google Scholar 

  6. Neumann, U., Majoros, A.: Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance. In: Proceedings of the Virtual Reality Annual International Symposium, Washington, DC, USA, p. 4 (1998)

    Google Scholar 

  7. Klopfer, E., Squire, K.: Environmental detectives—the development of an augmented reality platform for environmental simulations. Educ. Technol. Res. Dev. 56(2), 203–228 (2007)

    Article  Google Scholar 

  8. Dünser, A., Billinghurst, M.: Evaluating augmented reality systems. In: Furht, B. (ed.) Handbook of Augmented Reality, pp. 289–307. Springer, New York (2011)

    Chapter  Google Scholar 

  9. Dunleavy, M., Dede, C., Mitchell, R.: Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. J. Sci. Educ. Technol. 18(1), 7–22 (2009)

    Article  Google Scholar 

  10. Kotranza, A., Lind, D.S., Pugh, C.M., Lok, B.: Real-time in-situ visual feedback of task performance in mixed environments for learning joint psychomotor-cognitive tasks. In: 2009 8th IEEE International Symposium on Mixed and Augmented Reality, pp. 125–134 (2009)

    Google Scholar 

  11. Chen, Y.-C., Chi, H.-L., Hung, W.-H., Kang, S.-C.: Use of tangible and augmented reality models in engineering graphics courses. J. Prof. Issues Eng. Educ. Pract. 137(4), 267–276 (2011)

    Article  Google Scholar 

  12. Andujar, J.M., Mejias, A., Marquez, M.A.: Augmented reality for the improvement of remote laboratories: an augmented remote laboratory. IEEE Trans. Educ. 54(3), 492–500 (2011)

    Article  Google Scholar 

  13. Onime, C., Abiona, O.: 3D mobile augmented reality interface for laboratory experiments. Int. J. Commun. Netw. Syst. Sci. 9(4), 67 (2016)

    Google Scholar 

  14. Freund, E., Schluse, M., Rossmann, J.: State oriented modeling as enabling technology for projective virtual reality. In: Proceedings of 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 4, pp. 1842–1847 (2001)

    Google Scholar 

  15. Daily, M., Cho, Y., Martin, K., Payton, D.: World embedded interfaces for human-robot interaction. In: Proceedings of the 36th Annual Hawaii International Conference on System Sciences, p. 6–pp (2003)

    Google Scholar 

  16. Chen, I.Y.H., MacDonald, B., Wunsche, B.: Mixed reality simulation for mobile robots. In: 2009 IEEE International Conference on Robotics and Automation, pp. 232–237 (2009)

    Google Scholar 

  17. Collett, T.H.J., MacDonald, B.A.: An augmented reality debugging system for mobile robot software engineers. J. Softw. Eng. Robot. 1(1), 18–32 (2010)

    Google Scholar 

  18. Magnenat, S., Ben-Ari, M., Klinger, S., Sumner, R.W.: Enhancing robot programming with visual feedback and augmented reality. In: Proceedings of the 2015 ACM Conference on Innovation and Technology in Computer Science Education, New York, USA, pp. 153–158 (2015)

    Google Scholar 

  19. Lalonde, J., Bartley, C.P., Nourbakhsh, I.: Mobile robot programming in education. In: Proceedings 2006 IEEE International Conference on Robotics and Automation, ICRA 2006, pp. 345–350 (2006)

    Google Scholar 

  20. Callaghan, V.: Buzz-boarding; practical support for teaching computing, based on the internet-of-things. In: 1st Annual Conference on the Aiming for Excellence in STEM Learning and Teaching, Imperial College, London & The Royal Geographical Society, pp. 12–13 (2012)

    Google Scholar 

  21. Arkin, R.C.: Motor schema—based mobile robot navigation. Int. J. Robot. Res. 8(4), 92–112 (1989)

    Article  Google Scholar 

  22. Pfeifer, R., Scheier, C.: Understanding Intelligence. MIT Press, Cambridge (1999)

    Google Scholar 

  23. Wiedenbeck, S., Ramalingam, V.: Novice comprehension of small programs written in the procedural and object-oriented styles. Int. J. Hum.-Comput. Stud. 51(1), 71–87 (1999)

    Article  Google Scholar 

  24. Ahmadzadeh, M., Elliman, D., Higgins, C.: An analysis of patterns of debugging among novice computer science students. In: Proceedings of the 10th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education, New York, USA, pp. 84–88 (2005)

    Google Scholar 

  25. Li, X., Flatt, M.: Medic: metaprogramming and trace-oriented debugging. In: Proceedings of the Workshop on Future Programming, New York, USA, pp. 7–14 (2015)

    Google Scholar 

  26. Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Meshkati, P.A.H.N. (ed.) Advances in Psychology, vol. 52, pp. 139–183. North-Holland, Amsterdam (1988)

    Google Scholar 

  27. Medenica, Z., Kun, A.L., Paek, T., Palinko, O.: Augmented reality vs. street views: a driving simulator study comparing two emerging navigation aids. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 265–274 (2011)

    Google Scholar 

  28. Tang, A., Owen, C., Biocca, F., Mou, W.: Comparative effectiveness of augmented reality in object assembly. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New York, USA, pp. 73–80 (2003)

    Google Scholar 

  29. Tang, A., Owen, C., Biocca, F., Mou, W.: Experimental evaluation of augmented reality in object assembly task. In: Proceedings of the 1st International Symposium on Mixed and Augmented Reality, p. 265 (2002)

    Google Scholar 

  30. Radu, I.: Augmented reality in education: a meta-review and cross-media analysis. Pers. Ubiquit. Comput. 18(6), 1533–1543 (2014)

    Article  Google Scholar 

  31. Sayed, E., et al.: ARSC: augmented reality student card–an augmented reality solution for the education field. Comput. Educ. 56(4), 1045–1061 (2011)

    Article  MathSciNet  Google Scholar 

  32. Ibáñez, M.B., Di Serio, Á., Villarán, D., Delgado Kloos, C.: Experimenting with electromagnetism using augmented reality: impact on flow student experience and educational effectiveness. Comput. Educ. 71, 1–13 (2014)

    Article  Google Scholar 

  33. Squire, K.D., Jan, M.: Mad city mystery: developing scientific argumentation skills with a place-based augmented reality game on handheld computers. J. Sci. Educ. Technol. 16(1), 5–29 (2007)

    Article  Google Scholar 

  34. O’Shea, P.M., Dede, C., Cherian, M.: Research note: the results of formatively evaluating an augmented reality curriculum based on modified design principles. Int J Gaming Comput. Mediat. Simul. 3(2), 57–66 (2011)

    Article  Google Scholar 

  35. Cheng, K.-H., Tsai, C.-C.: Affordances of augmented reality in science learning: suggestions for future research. J. Sci. Educ. Technol. 22(4), 449–462 (2012)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Electronic Engineering, University of Essex, Colchester, UK

    Malek Alrashidi, Michael Gardner & Victor Callaghan

  2. Computer Science Department, Community College, University of Tabuk, Tabuk, Kingdom of Saudi Arabia

    Khalid Almohammadi

Authors
  1. Malek Alrashidi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Khalid Almohammadi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michael Gardner
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Victor Callaghan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Malek Alrashidi .

Editor information

Editors and Affiliations

  1. University of Salento, Lecce, Italy

    Lucio Tommaso De Paolis

  2. University of Paris-Sud, Orsay, France

    Patrick Bourdot

  3. University of Salento, Lecce, Italy

    Antonio Mongelli

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Alrashidi, M., Almohammadi, K., Gardner, M., Callaghan, V. (2017). Making the Invisible Visible: Real-Time Feedback for Embedded Computing Learning Activity Using Pedagogical Virtual Machine with Augmented Reality. In: De Paolis, L., Bourdot, P., Mongelli, A. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2017. Lecture Notes in Computer Science(), vol 10324. Springer, Cham. https://doi.org/10.1007/978-3-319-60922-5_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-60922-5_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-60921-8

  • Online ISBN: 978-3-319-60922-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics