Intelligent Evaluation of Short Responses for e-Learning Systems | SpringerLink
Skip to main content

Abstract

Evaluation of learners’ response is an important metric in determining learners’ satisfaction for any learning system. E-Learning systems currently use string matching or regular expression-based approaches in evaluating short answers. While these endorse the correctness of an answer, they are limited to handling predictable errors only. The nature of errors, however, may vary and it is important to intelligently judge the nature of the error to correctly gauge the state of learning of the learner. A better learning experience requires the system to also display benevolence, which is an innately human behavior characteristic, in evaluating the response. The current paper presents a k-variable fuzzy finite state automaton-based approach to implement an evaluation system for short answers. The proposed method attempts to emulate human behavior in the context of errors committed which may be knowledge based or inadvertent in nature. The technique is explained with sample scores from test conducted on a group of learners.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 22879
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 28599
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Corbet, A.T., Koedinger, K.R., Anderson, R., (1997) “Intelligent Tutoring Systems”, In Helander, M., Landauer, T.K., Prabhu, P., (Eds), Handbook of Human Computer Interaction, Second, Completely Revised Edition, Elsevier Science B.v. Chapter 37.

    Google Scholar 

  2. Allen, I., Seaman, J., (2008), “ Staying the course. Online education in the United States”, Needham, MA: The Sloan Consortium.

    Google Scholar 

  3. Martin, F., Parker, M., A.,(2011), “Measuring Success in a Synchronous Virtual Classroom”, In Sean B. Eom, S., B., Arbaugh, J., B., (eds.), Student Satisfaction and Learning Outcomes in E-Learning: An Introduction to Empirical Research, Information Science Reference, pp. 249–266.

    Google Scholar 

  4. Phipps, R., Merisotis, J. (2000). “Quality on the line: Benchmarks for success in Internet-based distance education.”, Institute for Higher Education Policy. Retrieved from http://www.eric.ed.gov/ERICDocs/data/ericdocs2sql/content_storage_01/0000019b/80/16/67/ba.pdf

  5. Gutierrez, I., Kloos, C., Crespo, R. (2010). “Assessing assessment formats: The current picture”, Proceedings of IEEE Education Engineering (EDUCON), 2010, 1233–1238. doi:10.1109/EDUCON.2010.5492384

  6. Bergin, J. (2000). “Fourteen Pedagogical Patterns”, Pace University. Downloaded from: https://csis.pace.edu/~bergin/PedPat1.3.html#fillintheblanks

  7. Leal, J.,P., Queiros, R., (2009). “CrimsonHex: A Service Oriented Repository of Specialized Learning Objects”, in Felipe, J., Cordeiro, J. (eds.), Proceedings of ICEIS 2009, LNBIP 24, 102–113.

    Google Scholar 

  8. Crisp, G. (2007). The e-Assessment Handbook. Continuum International Publishing Group, London.

    Google Scholar 

  9. Available at: http://en-us.help.blackboard.com/Learn/9.1_2014_04/Instructor/110_Tests_Surveys_Pools/100_Question_Types/Fill_in_Multiple_Blanks_Questions

  10. Chakraborty, U. K., Roy, S. (2011). “Fuzzy Automata Inspired Intelligent Assessment of Learning Achievement”. Proceedings of the Fifth Indian International Conference on Artificial Intelligence, pp. 1505–1518.

    Google Scholar 

  11. Khoussainov, B., Nerode, A., “Automata Theory and its Applications” (2010), First Indian Reprint, Springer International, Berlin.

    Google Scholar 

  12. Wen., Mo Zhi, Min., Wan, (2006) “Fuzzy Automata Induction using Construction Method”, Journal of Mathematics and Statistics, (2):2, pp.-395–400.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Udit kr. Chakraborty .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Science+Business Media Singapore

About this paper

Cite this paper

Chakraborty, U.k., Konar, D., Roy, S., Choudhury, S. (2017). Intelligent Evaluation of Short Responses for e-Learning Systems. In: Satapathy, S., Prasad, V., Rani, B., Udgata, S., Raju, K. (eds) Proceedings of the First International Conference on Computational Intelligence and Informatics . Advances in Intelligent Systems and Computing, vol 507. Springer, Singapore. https://doi.org/10.1007/978-981-10-2471-9_35

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-2471-9_35

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-2470-2

  • Online ISBN: 978-981-10-2471-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics