Abstract
Generative AI (GenAI) is praised as a transformative force for education, with the potential to significantly alter teaching and learning. Despite its promise, debates persist regarding GenAI impacts, with critical voices highlighting the necessity for thorough ethical scrutiny. While traditional ethical evaluations of GenAI tend to focus on the opacity of AI decision-making, we argue that the true challenge for ethical evaluation extends beyond the models themselves, and to the socio-technical networks shaping GenAI development and training. To address this limitation, we present an evaluation method, called Ethical Network Evaluation for AI (ENEA), which combines Latour’s Actor-Network Theory—used to map network dynamics by tracing actors’ interests and values—with Brusseau’s AI Human Impact framework, which identifies ethical indicators for evaluating AI systems. By applying ENEA to GenAI “copilots” in education, we show how making Actor-Networks visible lets us unveil a great variety of dilemmas, guiding ethical auditing and stakeholder discussions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Of which a famous example is GitHub Copilot.
- 2.
See https://github.com/features/copilot (FAQs section, General question #4. (Accessed 2024/01/26).
- 3.
See https://openai.com/our-structure and the profiles of GitHub’s leadership at https://github.com/about/leadership (Accessed 2024/01/26).
- 4.
See https://docs.github.com/en/copilot/using-github-copilot/getting-started-with-github-copilot (Accessed 2024/01/26).
- 5.
See for example https://docs.github.com/en/copilot/github-copilot-in-the-cli/about-github-copilot-in-the-cli (Accessed 2024/01/26).
- 6.
Effectively summarised in the TESCREAL acronym: Transhumanism, Extropianism, Singularitarianism, Cosmism, Rationalism, Effective Altruism, and Longtermism.
References
Akrich, M.: The description of technical objects (1992)
Barana, A., Marchisio, M., Roman, F.: Fostering problem solving and critical thinking in mathematics through generative artificial intelligence. In: 20th International Conference on Cognition and Exploratory Learning in the Digital Age. PRT (2023)
Bardzell, J., Bardzell, S.: The user reconfigured: on subjectivities of information. In: Proceedings of the Fifth Decennial Aarhus Conference on Critical Alternatives. CA 2015, pp. 133–144. Aarhus University Press, Aarhus N, August 2015
Bowker, G.C., Star, S.L.: Sorting Things Out: Classification and Its Consequences. MIT Press, Cambridge (2000)
Brusseau, J.: AI human impact: toward a model for ethical investing in AI-intensive companies. J. Sustain. Financ. Invest. 13(2), 1030–1057 (2023)
Callon, M., Latour, B.: Don’t throw the baby out with the bath school! A reply to collins and yearley. In: Science as Practice and Culture, pp. 343–368. University of Chicago Press (1992). https://doi.org/10.7208/9780226668208-013
Dignum, V.: Responsible Artificial Intelligence: How to Develop and Use AI in a Responsible Way. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-30371-6
Ernst, N.A., Bavota, G.: AI-Driven development is here: should you worry? IEEE Softw. 39(2), 106–110 (2022)
Finnie-Ansley, J., Denny, P., Becker, B.A., Luxton-Reilly, A., Prather, J.: The robots are coming: exploring the implications of OpenAI codex on introductory programming. In: Proceedings of 24th Australasian Computing Education Conference. ACE 2022, pp. 10–19. Association for Computing Machinery, February 2022
Hickman, S.E., Baxter, G.C., Gilbert, F.J.: Adoption of artificial intelligence in breast imaging: evaluation, ethical constraints and limitations. Br. J. Cancer 125(1), 15–22 (2021)
Introna, L.D.: Ethics and the speaking of things. Theory Culture Soc. 26(4), 25–46 (2009)
Latour, B.: A Cautious Prometheus? A Few Steps Toward a Philosophy of Design, p. 2. Universal Publishers (2008). https://sciencespo.hal.science/hal-00972919
Latour, B.: Reassembling the Social: An Introduction to Actor-Network-Theory. OUP Oxford, September 2007
Law, J.: After ant: complexity, naming and topology 47, 1–14 (1999)
Metzinger, T.: Phenomenal transparency and cognitive self-reference 2(4), 353–39 (2003). https://doi.org/10.1023/B:PHEN.0000007366.42918.eb
Minow, M.: Equality vs equity 1, 167–193 (2021). https://doi.org/10.1162/ajle_a_00019
Raji, I.D., et al.: Closing the AI accountability gap: defining an end-to-end framework for internal algorithmic auditing. In: 2020 Conference on Fairness, Accountability, and Transparency. ACM, January 2020
Rydin, Y.: Actor-network theory and planning theory: a response to booelens. Plan. Theory 9(3), 265–268 (2010)
Selwyn, N.: On the Limits of Artificial Intelligence (AI) in Education 10, 3 (2024). https://doi.org/10.23865/ntpk.v10.6062
Star, S.L., Griesemer, J.R.: Institutional ecology, ‘translations’ and boundary objects: amateurs and professionals in Berkeley’s museum of vertebrate zoology, 1907–39. Soc. Stud. Sci. 19(3), 387–420 (1989)
Takerngsaksiri, W., Warusavitarne, C., Yaacoub, C., Hou, M.H.K., Tantithamthavorn, C.: Students’ perspective on AI code completion: benefits and challenges, October 2023
Yilmaz, R., Karaoglan Yilmaz, F.G.: The effect of generative artificial intelligence (AI)-based tool use on students’ computational thinking skills, programming self-efficacy and motivation. Comput. Educ. 4 (2023)
Acknowledgments
L.A. thanks Fabio Gasparini for the many insightful conversations and comments. F.B. was supported by Future AI Research (FAIR) PE01, SPOKE 8 on PERVASIVE AI funded by the National Recovery and Resilience Plan (NRRP).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
Disclosure of Interests
The authors have no competing interests to declare that are relevant to the content of this article.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Balzan, F., Munarini, M., Angeli, L. (2024). Who Pilots the Copilots?. In: Olney, A.M., Chounta, IA., Liu, Z., Santos, O.C., Bittencourt, I.I. (eds) Artificial Intelligence in Education. AIED 2024. Lecture Notes in Computer Science(), vol 14830. Springer, Cham. https://doi.org/10.1007/978-3-031-64299-9_42
Download citation
DOI: https://doi.org/10.1007/978-3-031-64299-9_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-64298-2
Online ISBN: 978-3-031-64299-9
eBook Packages: Computer ScienceComputer Science (R0)