{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,26]],"date-time":"2024-08-26T23:43:31Z","timestamp":1724715811526},"reference-count":80,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,3,28]],"date-time":"2022-03-28T00:00:00Z","timestamp":1648425600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,3,28]],"date-time":"2022-03-28T00:00:00Z","timestamp":1648425600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003246","name":"nederlandse organisatie voor wetenschappelijk onderzoek","doi-asserted-by":"publisher","award":["024.00 4.022"],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Auton Agent Multi-Agent Syst"],"published-print":{"date-parts":[[2022,4]]},"abstract":"Abstract<\/jats:title>The pursuit of values drives human behavior and promotes cooperation. Existing research is focused on general values (e.g., Schwartz) that transcend contexts. However, context-specific values are necessary to (1) understand human decisions, and (2) engineer intelligent agents that can elicit and align with human values. We propose Axies, a hybrid (human and AI) methodology to identify context-specific values. Axies simplifies the abstract task of value identification as a guided value annotation process involving human annotators. Axies exploits the growing availability of value-laden text corpora and Natural Language Processing to assist the annotators in systematically identifying context-specific values. We evaluate Axies in a user study involving 80 human subjects. In our study, six annotators generate value lists for two timely and important contexts:Covid<\/jats:sc>-19 measures and sustainableEnergy<\/jats:sc>. We employ two policy experts and 72 crowd workers to evaluate Axies value lists and compare them to a list of general (Schwartz) values. We find that Axies yields values that are (1) more context-specific than general values, (2) more suitable for value annotation than general values, and (3) independent of the people applying the methodology.<\/jats:p>","DOI":"10.1007\/s10458-022-09550-0","type":"journal-article","created":{"date-parts":[[2022,3,28]],"date-time":"2022-03-28T16:03:15Z","timestamp":1648483395000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["What values should an agent align with?"],"prefix":"10.1007","volume":"36","author":[{"given":"Enrico","family":"Liscio","sequence":"first","affiliation":[]},{"given":"Michiel","family":"van der Meer","sequence":"additional","affiliation":[]},{"given":"Luciano C.","family":"Siebert","sequence":"additional","affiliation":[]},{"given":"Catholijn M.","family":"Jonker","sequence":"additional","affiliation":[]},{"ORCID":"http:\/\/orcid.org\/0000-0002-1261-6908","authenticated-orcid":false,"given":"Pradeep K.","family":"Murukannaiah","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,3,28]]},"reference":[{"issue":"1","key":"9550_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.9707\/2307-0919.1116","volume":"2","author":"SH Schwartz","year":"2012","unstructured":"Schwartz, S. H. (2012). An overview of the Schwartz theory of basic values. Online Readings in Psychology and Culture, 2(1), 1\u201320.","journal-title":"Online Readings in Psychology and Culture"},{"key":"9550_CR2","unstructured":"Murukannaiah, P.\u00a0K., Ajmeri, N., Jonker, C.\u00a0J.\u00a0M., & Singh, M.\u00a0P. (2020) . New foundations of ethical multiagent systems. In Proceedings of the 19th international conference on autonomous agents and multiagent systems, AAMAS \u201920. Aukland, New Zealand, IFMAAMAS, (pp. 1706\u20131710)."},{"issue":"8","key":"9550_CR3","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/MC.2020.2996587","volume":"53","author":"Z Akata","year":"2020","unstructured":"Akata, Z., Balliet, D., de Rijke, M., Dignum, F., Dignum, V., Eiben, G., et al. (2020). A research agenda for hybrid intelligence: Augmenting human intellect with collaborative, adaptive, responsible, and explainable artificial intelligence. Computer, 53(8), 18\u201328.","journal-title":"Computer"},{"issue":"3","key":"9550_CR4","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1007\/s11023-020-09539-2","volume":"30","author":"I Gabriel","year":"2020","unstructured":"Gabriel, I. (2020). Artificial intelligence, values, and alignment. Minds and Machines, 30(3), 411\u2013437. https:\/\/doi.org\/10.1007\/s11023-020-09539-2.","journal-title":"Minds and Machines"},{"issue":"4","key":"9550_CR5","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1609\/aimag.v36i4.2577","volume":"36","author":"S Russell","year":"2015","unstructured":"Russell, S., Dewey, D., & Tegmark, M. (2015). Research priorities for robust and beneficial artificial intelligence. AI Magazine, 36(4), 105\u2013114.","journal-title":"AI Magazine"},{"key":"9550_CR6","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1007\/978-3-662-54033-6_5","volume-title":"The technological singularity: Managing the journey","author":"N Soares","year":"2017","unstructured":"Soares, N., & Fallenstein, B. (2017). Agent foundations for aligning machine intelligence with human interests: A technical research agenda. The technological singularity: Managing the journey (pp. 103\u2013125). Springer. https:\/\/doi.org\/10.1007\/978-3-662-54033-6_5."},{"key":"9550_CR7","doi-asserted-by":"publisher","unstructured":"Balakrishnan, A., Bouneffouf, D., Mattei, N., & Rossi, F. (2019) . Incorporating behavioral constraints in online ai systems. In Proceedings of the thirty-third AAAI conference on artificial intelligence , AAAI \u201919, Honolulu, Hawaii, USA, (pp. 3\u201311). AAAI Press. https:\/\/doi.org\/10.1609\/aaai.v33i01.33013.","DOI":"10.1609\/aaai.v33i01.33013"},{"key":"9550_CR8","unstructured":"Soares, N. (2014). The value learning problem. Technical report, Machine Intelligence Research Institute, Berkeley, California, USA."},{"key":"9550_CR9","unstructured":"Ajmeri, N., Guo, H., Murukannaiah, P.\u00a0K., & Singh, M.\u00a0P. (2020) . Elessar: Ethics in norm-aware agents. In Proceedings of the 19th international conference on autonomous agents and multiagent systems, AAMAS \u201920, Auckland, New Zealand, (pp. 16\u201324). IFAAMAS."},{"key":"9550_CR10","doi-asserted-by":"crossref","unstructured":"Conitzer, V., Sinnott-Armstrong, W., Borg, J.\u00a0S.,Deng, Y., & Kramer, M. (2017) . Moral decision making frameworks for artificial intelligence. In Proceedings of the thirty-first AAAI conference on artificial intelligence, AAAI \u201917, San Francisco, California, USA, (pp. 4831\u20134835). AAAI Press.","DOI":"10.1609\/aaai.v31i1.11140"},{"key":"9550_CR11","doi-asserted-by":"publisher","unstructured":"Cranefield, S., Winikoff, M., Dignum, V., & Dignum, F. (2017) . No pizza for you: Value-based plan selection in bdi agents. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI \u201917, Melbourne, Australia, (pp. 178\u2013184). International Joint Conferences on Artificial Intelligence Organization. https:\/\/doi.org\/10.24963\/ijcai.2017\/26.","DOI":"10.24963\/ijcai.2017\/26"},{"issue":"1","key":"9550_CR12","doi-asserted-by":"publisher","first-page":"9","DOI":"10.18564\/jasss.3929","volume":"22","author":"R Mercuur","year":"2019","unstructured":"Mercuur, R., Dignum, V., & Jonker, C. M. (2019). The value of values and norms in social simulation. Journal of Artificial Societies and Social Simulation, 22(1), 9. https:\/\/doi.org\/10.18564\/jasss.3929.","journal-title":"Journal of Artificial Societies and Social Simulation"},{"key":"9550_CR13","volume-title":"The nature of human values","author":"M Rokeach","year":"1973","unstructured":"Rokeach, M. (1973). The nature of human values. Free Press."},{"issue":"5","key":"9550_CR14","doi-asserted-by":"publisher","first-page":"1029","DOI":"10.1037\/a0015141","volume":"96","author":"J Graham","year":"2009","unstructured":"Graham, J., Haidt, J., & Nosek, B. A. (2009). Liberals and conservatives rely on different sets of moral foundations. Journal of Personality and Social Psychology, 96(5), 1029\u20131046. https:\/\/doi.org\/10.1037\/a0015141.","journal-title":"Journal of Personality and Social Psychology"},{"key":"9550_CR15","doi-asserted-by":"publisher","unstructured":"Friedman, B., Kahn, P.\u00a0H., & Borning, A. (2008) . Value sensitive design and information systems. In The handbook of information and computer ethics, (pp. 69\u2013101). Wiley. https:\/\/doi.org\/10.1002\/9780470281819.ch4.","DOI":"10.1002\/9780470281819.ch4"},{"key":"9550_CR16","doi-asserted-by":"crossref","unstructured":"Wilson, S.\u00a0R., Shen, Y., & Mihalcea, R. (2018) . Building and validating hierarchical lexicons with a case study on personal values. In Proceedings of the 10th international conference on social informatics, SocInfo \u201918, St. Petersburg, Russia, (pp. 455\u2013470). Springer.","DOI":"10.1007\/978-3-030-01129-1_28"},{"key":"9550_CR17","doi-asserted-by":"publisher","unstructured":"Le\u00a0Dantec, C.\u00a0A., Poole, E.\u00a0S., & Wyche, S.\u00a0P. (2009) . Values as lived experience. In Proceedings of the 27th international conference on Human factors in computing systems, CHI \u201909, New York, USA, (p. 1141). ACM Press. https:\/\/doi.org\/10.1145\/1518701.1518875.","DOI":"10.1145\/1518701.1518875"},{"issue":"4","key":"9550_CR18","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1007\/s10676-011-9282-6","volume":"14","author":"A Pommeranz","year":"2012","unstructured":"Pommeranz, A., Detweiler, C., Wiggers, P., & Jonker, C. M. (2012). Elicitation of situated values: Need for tools to help stakeholders and designers to reflect and communicate. Ethics and Information Technology, 14(4), 285\u2013303. https:\/\/doi.org\/10.1007\/s10676-011-9282-6.","journal-title":"Ethics and Information Technology"},{"issue":"2","key":"9550_CR19","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1007\/s11135-018-0784-8","volume":"53","author":"J de Wet","year":"2018","unstructured":"de Wet, J., Wetzelh\u00fctter, D., & Bacher, J. (2018). Revisiting the trans-situationality of values in Schwartz\u2019s Portrait Values Questionnaire. Quality and Quantity, 53(2), 685\u2013711. https:\/\/doi.org\/10.1007\/s11135-018-0784-8.","journal-title":"Quality and Quantity"},{"issue":"3","key":"9550_CR20","doi-asserted-by":"publisher","first-page":"477","DOI":"10.2307\/40041279","volume":"154","author":"DJ Solove","year":"2006","unstructured":"Solove, D. J. (2006). A taxonomy of privacy. University of Pennsylvania Law Review, 154(3), 477\u2013560.","journal-title":"University of Pennsylvania Law Review"},{"issue":"3","key":"9550_CR21","doi-asserted-by":"publisher","first-page":"906","DOI":"10.1016\/j.ssresearch.2012.12.009","volume":"42","author":"G Datler","year":"2013","unstructured":"Datler, G., Jagodzinski, W., & Schmidt, P. (2013). Two theories on the test bench: Internal and external validity of the theories of Ronald Inglehart and Shalom Schwartz. Social Science Research, 42(3), 906\u2013925. https:\/\/doi.org\/10.1016\/j.ssresearch.2012.12.009.","journal-title":"Social Science Research"},{"issue":"10","key":"9550_CR22","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1108\/03090569410075786","volume":"28","author":"WF van Raaij","year":"1994","unstructured":"van Raaij, W. F., & Verhallen, T. M. M. (1994). Domain-specific market segmentation. European Journal of Marketing, 28(10), 49\u201366.","journal-title":"European Journal of Marketing"},{"key":"9550_CR23","doi-asserted-by":"publisher","unstructured":"van\u00a0de Poel, I. (2013) . Translating values into design requirements. In Philosophy and engineering: Reflections on practice, principles and process (pp. 253\u2013266). Springer. https:\/\/doi.org\/10.1007\/978-94-007-7762-0_20","DOI":"10.1007\/978-94-007-7762-0_20"},{"key":"9550_CR24","unstructured":"Murukannaiah, P.\u00a0K., & Singh, M.\u00a0P. (2014) . Xipho: Extending tropos to engineer context-aware personal agents. In Proceedings of the 13th international conference on autonomous agents and multiagent systems, AAMAS \u201914, Paris, France, (pp. 309\u2013316). IFAAMAS."},{"key":"9550_CR25","unstructured":"Montes, N., & Sierra, C. (2021) . Value-Guided Synthesis of Parametric Normative Systems. In Proceedigs of the 20th international conference on autonomous agents and multiagent systems, AAMAS \u201921, (pp. 907\u2013915). IFAAMAS."},{"key":"9550_CR26","unstructured":"Serramia, M., Lopez-Sanchez, M., & Rodriguez-Aguilar, J.\u00a0A. (2020) . A qualitative approach to composing value-aligned norm systems. In Proceedings of the 19th international conference on autonomous agents and multiagent systems, AAMAS \u201920, Auckland, New Zealand, (pp. 1233\u20131241) IFAAMAS."},{"key":"9550_CR27","unstructured":"Tielman, M.\u00a0L., Jonker, C.\u00a0M., & Van Riemsdijk, M.\u00a0B. (2019) . Deriving norms from actions, values, and context. In Proceedings of the international joint conference on autonomous agents and multiagent systems, AAMAS \u201919, (pp. 2223\u20132225)"},{"key":"9550_CR28","doi-asserted-by":"publisher","unstructured":"Chhogyal, K., Nayak, A., Ghose, A., & Dam, H.\u00a0K. (2019) . A Value-based Trust Assessment Model for Multi-agent Systems. In International joint conference on artificial intelligence, IJCAI \u201919, (pp. 194\u2013200). https:\/\/doi.org\/10.24963\/ijcai.2019\/28.","DOI":"10.24963\/ijcai.2019\/28"},{"key":"9550_CR29","doi-asserted-by":"publisher","unstructured":"Mehrotra, S., Jonker, C.\u00a0M., & Tielman, M.\u00a0L. (2021) . More similar values, more trust?\u2014The effect of value similarity on trust in human-agent interaction. In Proceedings of the 2021 AAAI\/ACM conference on AI, ethics, and society, AIES \u201921, (pp. 1\u20137). Association for Computing Machinery, https:\/\/doi.org\/10.1145\/3461702.3462576.","DOI":"10.1145\/3461702.3462576"},{"key":"9550_CR30","doi-asserted-by":"publisher","unstructured":"Tubella, A.\u00a0A., Theodorou, A., Dignum, F., & Dignum, V. (2019) . Governance by glass-box: Implementing transparent moral bounds for AI behaviour. IJCAI International Joint Conference on Artificial Intelligence, August:5787\u20135793, https:\/\/doi.org\/10.24963\/ijcai.2019\/802.","DOI":"10.24963\/ijcai.2019\/802"},{"issue":"5","key":"9550_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0250614","volume":"16","author":"N Mouter","year":"2021","unstructured":"Mouter, N., Hernandez, J. I., & Itten, A. V. (2021). Public participation in crisis policymaking. How 30,000 Dutch citizens advised their government on relaxing COVID-19 lockdown measures. PLoS ONE, 16(5), 1\u201342. https:\/\/doi.org\/10.1371\/journal.pone.0250614.","journal-title":"PLoS ONE"},{"key":"9550_CR32","volume-title":"The discovery of grounded theory","author":"BG Glaser","year":"1967","unstructured":"Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory. Chicago, Illinois, USA: Aldine Publishing."},{"key":"9550_CR33","doi-asserted-by":"publisher","unstructured":"Basu, S., Banerjee, A., & Mooney, R.\u00a0J. (2004) . Active semi-supervision for pairwise constrained clustering. In Proceedings of the 2004 SIAM International Conference on Data Mining, SDM \u201904, Orlando, Florida, USA, (pp. 333\u2013344). Society for Industrial and Applied Mathematics. https:\/\/doi.org\/10.1137\/1.9781611972740.31.","DOI":"10.1137\/1.9781611972740.31"},{"key":"9550_CR34","unstructured":"Liscio, E., van der Meer, M., Siebert, L. C., Jonker, C. M., Mouter, N., & Murukannaiah, P. K. (2021). Axies: Identifying and evaluating context-specific values. In Proc. of the 20th international conference on autonomous agents and multiagent systems, AAMAS \u201921 (pp. 799\u2013808). Online, IFAAMAS."},{"key":"9550_CR35","unstructured":"Liscio, E., van der Meer, M., Siebert, L. C., Jonker, C. M., Mouter, N., & P. Murukannaiah. (2021). Axies: Identifying and evaluating context specific values\u2014supplemental material."},{"key":"9550_CR36","unstructured":"Liscio, E., van der Meer, M., Jonker, C. M., & Murukannaiah, P. K. (2021). A collaborative platform for identifying context-specific values. In Proc. of the 20th international conference on autonomous agents and multiagent systems, AAMAS '21 (pp. 1773\u20131775). IFAAMAS."},{"issue":"6","key":"9550_CR37","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1038\/s41562-018-0353-0","volume":"2","author":"M Mooijman","year":"2018","unstructured":"Mooijman, M., Hoover, J., Lin, Y., Ji, H., & Dehghani, M. (2018). Moralization in social networks and the emergence of violence during protests. Nature Human Behaviour, 2(6), 389\u2013396. https:\/\/doi.org\/10.1038\/s41562-018-0353-0.","journal-title":"Nature Human Behaviour"},{"issue":"10","key":"9550_CR38","doi-asserted-by":"publisher","first-page":"1992","DOI":"10.3390\/app9101992","volume":"9","author":"H Liu","year":"2019","unstructured":"Liu, H., Huang, Y., Wang, Z., Liu, K., Hu, X., & Wang, W. (2019). Personality or value: A comparative study of psychographic segmentation based on an online review enhanced recommender system. Applied Sciences, 9(10), 1992. https:\/\/doi.org\/10.3390\/app9101992.","journal-title":"Applied Sciences"},{"key":"9550_CR39","doi-asserted-by":"publisher","unstructured":"Lin, Y., Hoover, J., Portillo-Wightman, G., Park, C., Dehghani, M., & Ji, H. (2018) . Acquiring background knowledge to improve moral value prediction. In Proceedings of the 2018 IEEE\/ACM international conference on advances in social networks analysis and mining, ASONAM \u201918, (pp. 552\u2013559). IEEE. https:\/\/doi.org\/10.1109\/ASONAM.2018.8508244.","DOI":"10.1109\/ASONAM.2018.8508244"},{"issue":"1","key":"9550_CR40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1525\/collabra.129","volume":"4","author":"J Hoover","year":"2018","unstructured":"Hoover, J., Johnson, K., Boghrati, R., Graham, J., & Dehghani, M. (2018). Moral framing and charitable donation: Integrating exploratory social media analyses and confirmatory experimentation. Collabra: Psychology, 4(1), 1\u201318. https:\/\/doi.org\/10.1525\/collabra.129.","journal-title":"Collabra: Psychology"},{"issue":"1","key":"9550_CR41","doi-asserted-by":"publisher","first-page":"344","DOI":"10.3758\/s13428-017-0875-9","volume":"50","author":"J Garten","year":"2018","unstructured":"Garten, J., Hoover, J., Johnson, K. M., Boghrati, R., Iskiwitch, C., & Dehghani, M. (2018). Dictionaries and distributions: Combining expert knowledge and large scale textual data content analysis: Distributed dictionary representation. Behavior Research Methods, 50(1), 344\u2013361. https:\/\/doi.org\/10.3758\/s13428-017-0875-9.","journal-title":"Behavior Research Methods"},{"issue":"3","key":"9550_CR42","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2019.105184","volume":"191","author":"O Araque","year":"2020","unstructured":"Araque, O., Gatti, L., & Kalimeri, K. (2020). MoralStrength: Exploiting a moral lexicon and embedding similarity for moral foundations prediction. Knowledge-Based Systems, 191(3), 105184.","journal-title":"Knowledge-Based Systems"},{"key":"9550_CR43","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-020-01433-0","author":"FR Hopp","year":"2020","unstructured":"Hopp, F. R., Fisher, J. T., Cornell, D., Huskey, R., & Weber, R. (2020). The extended moral foundations dictionary (eMFD): Development and applications of a crowd-sourced approach to extracting moral intuitions from text. Behavior Research Methods. https:\/\/doi.org\/10.3758\/s13428-020-01433-0.","journal-title":"Behavior Research Methods"},{"issue":"5","key":"9550_CR44","doi-asserted-by":"publisher","first-page":"885","DOI":"10.1002\/per.2294","volume":"34","author":"V Ponizovskiy","year":"2020","unstructured":"Ponizovskiy, V., Ardag, M., Grigoryan, L., Boyd, R., Dobewall, H., & Holtz, P. (2020). Development and validation of the personal values dictionary: A theory-driven tool for investigating references to basic human values in text. European Journal of Personality, 34(5), 885\u2013902. https:\/\/doi.org\/10.1002\/per.2294.","journal-title":"European Journal of Personality"},{"key":"9550_CR45","doi-asserted-by":"crossref","unstructured":"Boyd, R.\u00a0L., Wilson, S.\u00a0R., Pennebaker, J.\u00a0W., Kosinski, M., Stillwell, D.\u00a0J., & Mihalcea, R. (2015) . Values in words: Using language to evaluate and understand personal values. In Proceedings of the 9th international conference on web and social media, ICWSM \u201915, Oxford, UK, (pp. 31\u201340). AAAI Press.","DOI":"10.1609\/icwsm.v9i1.14589"},{"key":"9550_CR46","doi-asserted-by":"crossref","unstructured":"Teernstra, L., van\u00a0der Putten, P., Noordegraaf-Eelens, L., & Verbeek, F. (2016) . The morality machine: Tracking moral values in tweets. In Advances in intelligent data analysis XV: 15th international symposium, IDA \u201916, Stockholm, Sweden, (pp. 26\u201337). Springer.","DOI":"10.1007\/978-3-319-46349-0_3"},{"key":"9550_CR47","unstructured":"Mosca, F., & Such, J.\u00a0M. (2021) . ELVIRA: An explainable agent for value and utility-driven multiuser privacy. In Proc. of the 20th international conference on autonomous agents and multiagent systems, AAMAS \u201921, (pp. 916\u2013924). IFAAMAS."},{"key":"9550_CR48","doi-asserted-by":"publisher","unstructured":"Nathan, L.\u00a0P., Klasnja, P.\u00a0V., & Friedman, B. (2007) . Value scenarios: A technique for envisioning systemic effects of new technologies. In CHI \u201907 extended abstracts on human factors in computing systems (pp. 2585\u20132590). https:\/\/doi.org\/10.1145\/1240866.1241046.","DOI":"10.1145\/1240866.1241046"},{"key":"9550_CR49","doi-asserted-by":"publisher","unstructured":"Miller, J.\u00a0K., Friedman, B., Jancke, G., & Gill, B. (2007) . Value tensions in design: The value sensitive design, development, and appropriation of a corporation\u2019s groupware system. In Proceedings of the international ACM conference on supporting group work, GROUP, (pp. 281\u2013290). https:\/\/doi.org\/10.1145\/1316624.1316668.","DOI":"10.1145\/1316624.1316668"},{"key":"9550_CR50","doi-asserted-by":"publisher","unstructured":"Friedman, B., & Hendry, D.\u00a0G. (2012) . The envisioning cards: A toolkit for catalyzing humanistic and technical imaginations. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 1145\u20131148). https:\/\/doi.org\/10.1145\/2207676.2208562.","DOI":"10.1145\/2207676.2208562"},{"issue":"2","key":"9550_CR51","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10458-021-09519-5","volume":"35","author":"M Serramia","year":"2021","unstructured":"Serramia, M., L\u00f3pez-S\u00e1nchez, M., Moretti, S., & Rodr\u00edguez-Aguilar, J. A. (2021). On the dominant set selection problem and its application to value alignment. Autonomous Agents and Multi-Agent Systems, 35(2), 1\u201338. https:\/\/doi.org\/10.1007\/s10458-021-09519-5.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"key":"9550_CR52","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-007-6970-0_15","volume-title":"Design for values in software development","author":"H Aldewereld","year":"2015","unstructured":"Aldewereld, H., Dignum, V., & Tan, Y.-H. (2015). Design for values in software development. Springer. https:\/\/doi.org\/10.1007\/978-94-007-6970-0_15."},{"key":"9550_CR53","doi-asserted-by":"publisher","unstructured":"Ferrario, M.\u00a0A., Simm, W., Forshaw, S., Gradinar, A., Smith, M.\u00a0T., & Smith, I. (2016) . Values-first SE: Research principles in practice. In Proceedings of the 38th international conference on software engineering (pp. 553\u2013562). https:\/\/doi.org\/10.1145\/2889160.2889219.","DOI":"10.1145\/2889160.2889219"},{"key":"9550_CR54","doi-asserted-by":"publisher","unstructured":"Mougouei, D., Perera, H., Hussain, W., Shams, R., & Whittle, J. (2018) . Operationalizing human values in software: A research roadmap. In ESEC\/FSE 2018\u2014Proceedings of the 2018 26th ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering (pp. 780\u2013784). https:\/\/doi.org\/10.1145\/3236024.3264843.","DOI":"10.1145\/3236024.3264843"},{"key":"9550_CR55","doi-asserted-by":"publisher","unstructured":"Perera, H., Mussbacher, G., Hussain, W., Ara Shams, R., Nurwidyantoro, A., & Whittle, J. (2020) Continual human value analysis in software development: A goal model based approach. In Proceedings of the IEEE international conference on requirements engineering (pp. 192\u2013203). https:\/\/doi.org\/10.1109\/RE48521.2020.00030.","DOI":"10.1109\/RE48521.2020.00030"},{"key":"9550_CR56","first-page":"2","volume":"1138","author":"C Detweiler","year":"2014","unstructured":"Detweiler, C., & Harbers, M. (2014). Value stories: Putting human values into requirements engineering. CEUR Workshop Proceedings, 1138, 2\u201311.","journal-title":"CEUR Workshop Proceedings"},{"issue":"4","key":"9550_CR57","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1007\/s00766-017-0273-y","volume":"23","author":"S Thew","year":"2018","unstructured":"Thew, S., & Sutcliffe, A. (2018). Value-based requirements engineering: Method and experience. Requirements Engineering, 23(4), 443\u2013464. https:\/\/doi.org\/10.1007\/s00766-017-0273-y.","journal-title":"Requirements Engineering"},{"key":"9550_CR58","doi-asserted-by":"publisher","unstructured":"Winter, E., Forshaw, S., & Ferrario, M.\u00a0A. (2018) . Measuring human values in software engineering. In Proceedings of the 12th ACM\/IEEE international symposium on empirical software engineering and measurement (pp. 10\u201313). https:\/\/doi.org\/10.1145\/3239235.3267427.","DOI":"10.1145\/3239235.3267427"},{"key":"9550_CR59","doi-asserted-by":"publisher","unstructured":"Perera, H., Hussain, W., Whittle, J., Nurwidyantoro, A., Mougouei, D., Shams, R.\u00a0A., & Oliver, G. (2015) . A study on the prevalence of human values in software engineering publications, 2015\u20132018. In Proceedings of the 42nd international conference on software engineering (pp. 409\u2013420). https:\/\/doi.org\/10.1145\/3377811.3380393.","DOI":"10.1145\/3377811.3380393"},{"key":"9550_CR60","volume-title":"Introduction to value theory","author":"N Rescher","year":"1969","unstructured":"Rescher, N. (1969). Introduction to value theory. Prentice-Hall."},{"key":"9550_CR61","doi-asserted-by":"publisher","unstructured":"Reimers, N., & Gurevych, I. Sentence-BERT: Sentence embeddings using siamese BERT-networks. In Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing, EMNLP-IJCNLP \u201919, Hong Kong, China, (pp. 3973\u20133983). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/d19-1410.","DOI":"10.18653\/v1\/d19-1410"},{"issue":"3","key":"9550_CR62","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1007\/978-1-4020-9688-4_3","volume":"6","author":"DJ Rosenkrantz","year":"1977","unstructured":"Rosenkrantz, D. J., Stearns, R. E., & Lewis, P. M., II. (1977). An analysis of several heuristics for the traveling salesman problem. SIAM Journal on Computing, 6(3), 563\u2013581. https:\/\/doi.org\/10.1007\/978-1-4020-9688-4_3.","journal-title":"SIAM Journal on Computing"},{"key":"9550_CR63","doi-asserted-by":"publisher","unstructured":"Mrk\u0161i\u0107, N., S\u00e9aghdha, D., Thomson, B., Ga\u0161i\u0107, M., Rojas-Barahona, L., Su, P.\u00a0H., Vandyke, D., Wen, T.\u00a0H., & Young, S. (2016) . Counter-fitting word vectors to linguistic constraints. In Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: Human language technologies, NAACL HLT \u201916, San Diego, California, USA, (pp. 142\u2013148). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/n16-1018.","DOI":"10.18653\/v1\/n16-1018"},{"issue":"4","key":"9550_CR64","doi-asserted-by":"publisher","first-page":"1893","DOI":"10.1007\/s11135-017-0574-8","volume":"52","author":"B Saunders","year":"2018","unstructured":"Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., et al. (2018). Saturation in qualitative research: Exploring its conceptualization and operationalization. Quality and Quantity, 52(4), 1893\u20131907. https:\/\/doi.org\/10.1007\/s11135-017-0574-8.","journal-title":"Quality and Quantity"},{"key":"9550_CR65","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fpsyg.2018.01643","volume":"9","author":"PH Hanel","year":"2018","unstructured":"Hanel, P. H., Litzellachner, L. F., & Maio, G. R. (2018). An empirical comparison of human value models. Frontiers in Psychology, 9, 1\u201314. https:\/\/doi.org\/10.3389\/fpsyg.2018.01643.","journal-title":"Frontiers in Psychology"},{"key":"9550_CR66","unstructured":"Spruit, S.\u00a0L., & Mouter, N. (2020) . 1376 residents of S\u00fadwest-Frysl\u00e2n about the future energy policy of their municipality: The results of a consultation, 2020. https:\/\/www.tudelft.nl\/en\/tpm\/pve\/case-studies\/energy-in-sudwest-fryslan\/."},{"key":"9550_CR67","doi-asserted-by":"publisher","unstructured":"Junczys-Dowmunt, M., Grundkiewicz, R., Dwojak, T., Hoang, H., Heafield, K., Neckermann, T., Seide, F., Germann, U., Aji, A.\u00a0F., Bogoychev, N., Martins, A.\u00a0F.\u00a0T., & Birch, A. (2018) . Marian: Fast neural machine translation in C++. In Proceedings of ACL 2018, system demonstrations, ACL \u201918, Melbourne, Australia (pp. 116\u2013121). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/P18-4020.","DOI":"10.18653\/v1\/P18-4020"},{"issue":"1","key":"9550_CR68","doi-asserted-by":"publisher","first-page":"23","DOI":"10.20982\/tqmp.08.1.p023","volume":"8","author":"KA Hallgren","year":"2012","unstructured":"Hallgren, K. A. (2012). Computing inter-rater reliability for observational data: An overview and tutorial. Tutorials in Quantitative Methods for Psychology, 8(1), 23\u201334.","journal-title":"Tutorials in Quantitative Methods for Psychology"},{"key":"9550_CR69","volume-title":"Nonparametric statistical methods","author":"M Hollander","year":"1999","unstructured":"Hollander, M., & Wolfe, D. A. (1999). Nonparametric statistical methods. Wiley."},{"issue":"1","key":"9550_CR70","doi-asserted-by":"publisher","first-page":"92","DOI":"10.5334\/irsp.82","volume":"30","author":"M Delacre","year":"2017","unstructured":"Delacre, M., Lakens, D., & Leys, C. (2017). Why psychologists should by default use Welch\u2019s t-Test instead of Student\u2019s t-Test. International Review of Social Psychology, 30(1), 92\u2013101. https:\/\/doi.org\/10.5334\/irsp.82.","journal-title":"International Review of Social Psychology"},{"issue":"3","key":"9550_CR71","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1080\/00401706.1964.10490181","volume":"6","author":"OJ Dunn","year":"1964","unstructured":"Dunn, O. J. (1964). Multiple comparisons using rank sums. Technometrics, 6(3), 241\u2013252. https:\/\/doi.org\/10.1080\/00401706.1964.10490181.","journal-title":"Technometrics"},{"key":"9550_CR72","doi-asserted-by":"publisher","DOI":"10.4324\/9781315806730","volume-title":"Ordinal methods for behavioral data analysis","author":"N Cliff","year":"2014","unstructured":"Cliff, N. (2014). Ordinal methods for behavioral data analysis. Psychology Press."},{"issue":"8","key":"9550_CR73","doi-asserted-by":"publisher","first-page":"1057","DOI":"10.1177\/1948550619876629","volume":"11","author":"J Hoover","year":"2020","unstructured":"Hoover, J., Portillo-Wightman, G., Yeh, L., Havaldar, S., Davani, A. M., Lin, Y., et al. (2020). Moral foundations twitter corpus: A collection of 35k tweets annotated for moral sentiment. Social Psychological and Personality Science, 11(8), 1057\u20131071. https:\/\/doi.org\/10.1177\/1948550619876629.","journal-title":"Social Psychological and Personality Science"},{"key":"9550_CR74","volume-title":"Quasi-experimentation\u2014design and analysis issues for field settings","author":"T Cook","year":"1979","unstructured":"Cook, T., & Campbell, D. (1979). Quasi-experimentation\u2014design and analysis issues for field settings. Houghton Mifflin Company."},{"key":"9550_CR75","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1016\/j.paid.2013.12.012","volume":"60","author":"VV Gouveia","year":"2014","unstructured":"Gouveia, V. V., Milfont, T. L., & Guerra, V. M. (2014). Functional theory of human values: Testing its content and structure hypotheses. Personality and Individual Differences, 60, 41\u201347. https:\/\/doi.org\/10.1016\/j.paid.2013.12.012.","journal-title":"Personality and Individual Differences"},{"issue":"1","key":"9550_CR76","doi-asserted-by":"publisher","first-page":"1","DOI":"10.9707\/2307-0919.1014","volume":"2","author":"G Hofstede","year":"2011","unstructured":"Hofstede, G. (2011). Dimensionalizing cultures: The Hofstede model in context. Online Readings in Psychology and Culture, 2(1), 1\u201326.","journal-title":"Online Readings in Psychology and Culture"},{"key":"9550_CR77","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1515\/9780691214429-005","volume-title":"Modernization and postmodernization","author":"R Inglehart","year":"1997","unstructured":"Inglehart, R. (1997). Modernization and postmodernization in 43 societies. Modernization and postmodernization (pp. 67\u2013107). Princeton University Press."},{"issue":"1","key":"9550_CR78","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1016\/j.trf.2020.08.017","volume":"74","author":"TG van den Berg","year":"2020","unstructured":"van den Berg, T. G., Kroesen, M., & Chorus, C. G. (2020). Does morality predict aggressive driving? A conceptual analysis and exploratory empirical investigation. Transportation Research Part F: Traffic Psychology and Behaviour, 74(1), 259\u2013271. https:\/\/doi.org\/10.1016\/j.trf.2020.08.017.","journal-title":"Transportation Research Part F: Traffic Psychology and Behaviour"},{"issue":"2","key":"9550_CR79","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1109\/MIC.2018.022021658","volume":"22","author":"N Ajmeri","year":"2018","unstructured":"Ajmeri, N., Guo, H., Murukannaiah, P. K., & Singh, M. P. (2018). Designing ethical personal agents. IEEE Internet Computing, 22(2), 16\u201322. https:\/\/doi.org\/10.1109\/MIC.2018.022021658.","journal-title":"IEEE Internet Computing"},{"key":"9550_CR80","doi-asserted-by":"crossref","unstructured":"Ajmeri, N., Guo, H., Murukannaiah, P.\u00a0K., & Singh, M.\u00a0P. (2018) . Robust norm emergence by revealing and reasoning about context: Socially intelligent agents for enhancing privacy. In Proceedings of the 27th international joint conference on artificial intelligence, IJCAI \u201918, Stockholm (pp. 28\u201334).","DOI":"10.24963\/ijcai.2018\/4"}],"container-title":["Autonomous Agents and Multi-Agent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10458-022-09550-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10458-022-09550-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10458-022-09550-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T12:39:26Z","timestamp":1675082366000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10458-022-09550-0"}},"subtitle":["An empirical comparison of general and context-specific values"],"short-title":[],"issued":{"date-parts":[[2022,3,28]]},"references-count":80,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,4]]}},"alternative-id":["9550"],"URL":"https:\/\/doi.org\/10.1007\/s10458-022-09550-0","relation":{},"ISSN":["1387-2532","1573-7454"],"issn-type":[{"value":"1387-2532","type":"print"},{"value":"1573-7454","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,28]]},"assertion":[{"value":"9 February 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 March 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"23"}}