Using WCAG 2.0 and Heuristic Evaluation to Evaluate Accessibility in Educational Web Based Pages | SpringerLink
Skip to main content
Springer Nature Link
Log in

Using WCAG 2.0 and Heuristic Evaluation to Evaluate Accessibility in Educational Web Based Pages

  • Conference paper
  • First Online:
Learning Technology for Education in Cloud (LTEC 2015)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 533))

Included in the following conference series:

Abstract

In this paper, we presented an innovative way for a quick and comprehensive evaluation of different online educational websites by following and combining the Web Content Accessibility Guidelines 2.0, the standard ISO/IEC 24751 and heuristic evaluation approach. Five presentative web pages of the Learning Management System eCampus were evaluated by 14 participants classified into two groups with one usability expert in each group. Questionnaires containing twenty-five accessibility questions (=success criteria) were distributed among participants. Each participant was asked to evaluate only up to four success criteria. When completed, usability experts reviewed results and transformed them into final recommendations for improvements. Results revealed that none of five reviewed web pages reached level A for accessibility by the standard Web Content Accessibility Guidelines 2.0. On average, all five web pages reached the score 14 out of 25 in “pass” success criteria. In “fail” success criteria the average score was 4.80. The way of evaluation used in this study suggests possible implications in practice due to its simplicity and quickness.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 5719
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 7149
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Batanero, C., Karhu, M., Holvikivi, J., Oton, S., Amado-Salvatierra, H.R.: A method to evaluate accessibility in e-learning education systems. In: Proceedings of the IEEE 14th International Conference on Advanced Learning Technologies (ICALT), Athens, Greece (2014). doi:10.1109/ICALT.2014.163

  2. ISO 9241-171:2008: Ergonomics of Human-System Interaction - Part 171 Guidance on Software Accessibility. International Standard Organization, Geneva (2008)

    Google Scholar 

  3. Bevan, N.: How you could benefit from using ISO standards. In: Proceedings of the Extended Abstracts of the 32nd Annual ACM Conference on Human Factors in Computing Systems. ACM, Toronto (2014)

    Google Scholar 

  4. European Parliament: Proposal for a directive of the European Parliament and of the Council on the accessibility of public sector bodies’ websites (COM(2012)0721 – C7-0394/2012 – 2012/0340(COD)) (2012)

    Google Scholar 

  5. ISO/IEC 24751-1:2008: Information Technology – Individualized Adaptability and Accessibility in E-learning, Education and Training - Part 1: Framework and Reference Model. International Standard Organization, Geneva (2008)

    Google Scholar 

  6. ISO/IEC 24751-2:2008: Information Technology – Individualized Adaptability and Accessibility in E-learning, Education and Training - Part 2: “Access for All” Personal Needs and Preferences for Digital. International Standard Organization, Geneva (2008)

    Google Scholar 

  7. ISO/IEC 24751-3:2008: Information Technology – Individualized Adaptability and Accessibility in E-learning, Education and Training - Part 3: “Access for All” Digital Resource Description. International Standard Organization, Geneva (2008)

    Google Scholar 

  8. ISO/IEC 40500:2012: Information Technology – W3C Web Content Accessibility Guidelines (WCAG) 2.0. International Standard Organization, Geneva (2012)

    Google Scholar 

  9. W3C: Web Content Accessibility Guidelines (WCAG) 2.0. http://www.w3.org/TR/WCAG20/. Accessed 20 December 2014

  10. Mayer, R.E.: Multimedia Learning. Cambridge University Press, New York (2001)

    Book  Google Scholar 

  11. Sweller, J.: Cognitive load during problem solving: effects on learning. Cogn. Sci. 12, 257–285 (1988)

    Article  Google Scholar 

  12. Sullins, J., Craig, S.D., Graesser, A.C.: The influence of modality on deep-reasoning questions. Int. J. Learn. Technol. 5(4), 378–387 (2010)

    Article  Google Scholar 

  13. Nielsen, J.: Finding usability problems through heuristic evaluation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM Press, New York (1992)

    Google Scholar 

  14. Nielsen, J., Landauer, T.: A mathematical model of the finding of usability problems. In: Proceedings of the ACM/IFIP INTERCHI 1993 Conference. ACM Press, New York (1993)

    Google Scholar 

  15. Nielsen, J.: Usability inspection methods. In: Conference Companion on Human Factors in Computing Systems, pp. 413–414. ACM (1994)

    Google Scholar 

  16. Holzinger, A.: Usability engineering methods for software developers. Commun. ACM 48(1), 71–74 (2005)

    Article  Google Scholar 

  17. Lapuh Bele, J., Hauptman, S., Kožuh, I., Debevc, M.: eCampus as a platform for ubiquitous learning. In: Proceedings of the IEEE Global Engineering Education Conference (EDUCON), Istanbul, Turkey (2014)

    Google Scholar 

  18. Gilbert, T.D., Machin, C.H.C.: Guidelines, icons and marketable skills: an accessibility evaluation of 100 web development company homepages. In: Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A 2012). ACM, New York (2012). doi:10.1145/2207016.2207024

  19. McGrath, L.: What are the Web Content Accessibility Guidelines 2.0? http://www.wuhcag.com/web-content-accessibility-guidelines/. Accessed 20 December 2014

  20. Michailidou, E., Mavrou, K., Zaphiris, P.: eInclusion @ cyprus universities: provision and web accessibility. In: CHI 2012 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2012), pp. 1637–1642. ACM, New York (2012). doi:10.1145/2212776.2223685

  21. WEBAIM: WEBAIM Checklist, WebAIM (Web Accessibility in Mind). http://webaim.org/standards/wcag/checklist. Accessed 20 December 2014

  22. Oud, J.: How well do Ontario library web sites meet new accessibility requirements? Partnership. Can. J. Libr. Inf. Pract. Res. 7(1), 1–17 (2012)

    MathSciNet  Google Scholar 

Download references

Acknowledgements

This work has been partially supported by the European Union through the Tempus Programme project ECESM – Enhancement of cyber educational system of Montenegro, No: 544088.

Author information

Authors and Affiliations

  1. Faculty of Electrical Engineering and Computer Science, University of Maribor, Smetanova ulica 17, SI-2000, Maribor, Slovenia

    Matjaž Debevc, Ines Kožuh, Simon Hauptman & Andrej Klembas

  2. B2, Tržaška 42, 1000, Ljubljana, Slovenia

    Julija Bele Lapuh

  3. Research Unit HCI-KDD, Institute for Medical Informatics, Medical University of Graz, Graz, Austria

    Andreas Holzinger

Authors
  1. Matjaž Debevc
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ines Kožuh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Simon Hauptman
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andrej Klembas
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Julija Bele Lapuh
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Andreas Holzinger
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Matjaž Debevc .

Editor information

Editors and Affiliations

  1. Staffordshire University, Stoke-on-Trent, United Kingdom

    Lorna Uden

  2. Universidad Tecnica Federico Santa Maria, Valparaiso, Chile

    Dario Liberona

  3. University of Maribor, Maribor, Slovenia

    Tatjana Welzer

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Debevc, M., Kožuh, I., Hauptman, S., Klembas, A., Lapuh, J.B., Holzinger, A. (2015). Using WCAG 2.0 and Heuristic Evaluation to Evaluate Accessibility in Educational Web Based Pages. In: Uden, L., Liberona, D., Welzer, T. (eds) Learning Technology for Education in Cloud. LTEC 2015. Communications in Computer and Information Science, vol 533. Springer, Cham. https://doi.org/10.1007/978-3-319-22629-3_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-22629-3_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-22628-6

  • Online ISBN: 978-3-319-22629-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation