Abstract
We propose a fair peer assessment method for group work using a multi-agent trust network. Although group work is an effective educational method, accurately assessing individual students is not easy. Mutual evaluation is often used for such assessment, but often presents some potential problems such as irresponsible evaluations and collusion. Our method identifies and excludes such cheating and unfair ratings on the basis of trust networks that are often used to evaluate sellers in e-market places by using customers’ ratings. We assume a group-work course in a semester in which students mutually evaluate other group members a few (three to five) times. We introduce the iterative method for alternately generating trust networks using cluster-trust values, which represent similarity of evaluations in a cluster network. We experimentally show that our method can find the irresponsible students and collusive groups and considerably improve accuracy of final marks with only a few chances for mutual evaluations, and thereby, can provide useful information for assessments to instructors.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Allen, B., Crosky, A., Mcalpine, I., Hoffman, M., Munroe, P.: A blended approach to collaborative learning: can it make large group teaching more student-centred. In: Proceedings of the 23rd Annual ASCILITE Conference, pp. 33–41. University Press (2006)
Brutus, S., Donia, M.B.L.: Improving the Effectiveness of Students in Groups With a Centralized Peer Evaluation System. Academy of Management Learning and Education 9(4), 652–662 (2010). Academy of Management
Ettington, D.R., Camp, R.R.: Facilitating Transfer of Skills between Group Projects and Work Teams. Journal of Management Education 26(4), 356–379 (2002). Sage Publications
Fellenz, M.R.: Toward Fairness in Assessing Student Groupwork: A Protocol for Peer Evaluation of Individual Contributions. Journal of Management Education 30(4), 570–591 (2006). Sage Publications
Hall, D., Buzwell, S.: The problem of free-riding in group projects: Looking beyond social loafing as reason for non-contribution. Active Learning in Higher Education (2012)
Jiang, S., Zhang, J., Ong, Y.S.: An evolutionary model for constructing robust trust networks. In: Proceedings of the 2013 International Conference on Autonomous Agents and Multi-agent Systems. AAMAS 2013, pp. 813–820. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC (2013)
McCorkle, D.E., Reardon, J., Alexander, J.F., Kling, N.D., Harris, R.C., Iyer, R.V.: Undergraduate Marketing Students, Group Projects, and Teamwork: The Good, the Bad, and the Ugly? Journal of Marketing Education 21(2), 106–117 (1999). Sage Publications
North, A.C., Linley, P.A., Hargreaves, D.J.: Social Loafing in a Co-operative Classroom Task. Educational Psychology 20(3), 389–392 (2000). Taylor and Fancis
Sadler, P.M., Good, E.: The impact of peer-grading on student learning. Educational Assessment 11(1), 1–31 (2006). Taylor and Fancis
Shiba, Y., Sugawara, T.: Fair assessment of group work by mutual evaluation based on trust network. In: Proceedings of the 2014 IEEE Frontiers in Education Conference (FIE), pp. 1–7. IEEE Xplore (2014)
Topping, K.J.: Peer Assessment. Theory into Practice 48(1), 20–27 (2009). Taylor and Fancis
Zeng, J., Gao, M., Wen, J., Hirokawa, S.: A hybrid trust degree model in social network for recommender system. In: Proceedings of the 2014 IIAI 3rd International Conference on Advanced Applied Informatics (IIAIAAI), pp. 37–41. IEEE Xplore (2014)
Zhang, L., Jiang, S., Zhang, J., Ng, W.K.: Robustness of trust models and combinations for handling unfair ratings. In: Dimitrakos, T., Moona, R., Patel, D., McKnight, D.H. (eds.) IFIPTM 2012. IFIP AICT, vol. 374, pp. 36–51. Springer, Heidelberg (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Shiba, Y., Umegaki, H., Sugawara, T. (2015). Fair Assessment of Group Work by Mutual Evaluation with Irresponsible and Collusive Students Using Trust Networks. In: Chen, Q., Torroni, P., Villata, S., Hsu, J., Omicini, A. (eds) PRIMA 2015: Principles and Practice of Multi-Agent Systems. PRIMA 2015. Lecture Notes in Computer Science(), vol 9387. Springer, Cham. https://doi.org/10.1007/978-3-319-25524-8_35
Download citation
DOI: https://doi.org/10.1007/978-3-319-25524-8_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-25523-1
Online ISBN: 978-3-319-25524-8
eBook Packages: Computer ScienceComputer Science (R0)