{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T18:27:46Z","timestamp":1732040866118},"reference-count":76,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,10,13]]},"abstract":"Code review is an important quality assurance activity for software development. Code review discussions among developers and maintainers can be heated and sometimes involve personal attacks and unnecessary disrespectful comments, demonstrating, therefore, incivility. Although incivility in public discussions has received increasing attention from researchers in different domains, the knowledge about the characteristics, causes, and consequences of uncivil communication is still very limited in the context of software development, and more specifically, code review. To address this gap in the literature, we leverage the mature social construct of incivility as a lens to understand confrontational conflicts in open source code review discussions. For that, we conducted a qualitative analysis on 1,545 emails from the Linux Kernel Mailing List (LKML) that were associated with rejected changes. We found that more than half (66.66%) of the non-technical emails included uncivil features. Particularly, frustration, name calling, and impatience are the most frequent features in uncivil emails. We also found that there are civil alternatives to address arguments, while uncivil comments can potentially be made by any people when discussing any topic. Finally, we identified various causes and consequences of such uncivil communication. Our work serves as the first study about the phenomenon of in(civility) in open source software development, paving the road for a new field of research about collaboration and communication in the context of software engineering activities.<\/jats:p>","DOI":"10.1145\/3479497","type":"journal-article","created":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T06:39:17Z","timestamp":1634625557000},"page":"1-35","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":28,"title":["The \"Shut the f**k up\" Phenomenon: Characterizing Incivility in Open Source Code Review Discussions"],"prefix":"10.1145","volume":"5","author":[{"given":"Isabella","family":"Ferreira","sequence":"first","affiliation":[{"name":"Polytechnique Montr\u00e9al, Montr\u00e9al, PQ, Canada"}]},{"given":"Jinghui","family":"Cheng","sequence":"additional","affiliation":[{"name":"Polytechnique Montr\u00e9al, Montr\u00e9al, PQ, Canada"}]},{"given":"Bram","family":"Adams","sequence":"additional","affiliation":[{"name":"Queen's University, Kingston, ON, Canada"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2017.8115623"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00111"},{"key":"e_1_2_1_3_1","volume-title":"International journal of electronic commerce","author":"Alexander Hars Shaosong Ou","year":"2002","unstructured":"Shaosong Ou Alexander Hars. 2002. Working for free? Motivations for participating in open-source projects. International journal of electronic commerce, Vol. 6, 3 (2002), 25--39."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcc4.12009"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pragma.2012.06.011"},{"key":"e_1_2_1_6_1","volume-title":"2013 35th International Conference on Software Engineering (ICSE). 712--721","author":"Bacchelli A.","unstructured":"A. Bacchelli and C. Bird. 2013. Expectations, outcomes, and challenges of modern code review. In 2013 35th International Conference on Software Engineering (ICSE). 712--721."},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Teresa M Bejan. 2017. Mere Civility .Harvard University Press.","DOI":"10.4159\/9780674972728"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSM.2009.5306383"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1348\/096317905X26822"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2576451"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-5907.2007.00233.x"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/184656.180369"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-017-9546-9"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.953"},{"key":"e_1_2_1_15_1","volume-title":"Activity-Based Analysis of Open Source Software Contributors: Roles and Dynamics. In 2019 IEEE\/ACM 12th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE). 11--18","author":"Cheng J.","year":"2019","unstructured":"J. Cheng and J. L. C. Guo. 2019. Activity-Based Analysis of Open Source Software Contributors: Roles and Dynamics. In 2019 IEEE\/ACM 12th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE). 11--18."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcom.12104"},{"key":"e_1_2_1_17_1","unstructured":"Jonathan Corbet. 2018. A farewell to email. https:\/\/lwn.net\/Articles\/768483\/ Accessed: 2020--10--15."},{"key":"e_1_2_1_18_1","volume-title":"2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER). 49--60","author":"Ebert F.","unstructured":"F. Ebert, F. Castor, N. Novielli, and A. Serebrenik. 2019. Confusion in Code Reviews: Reasons, Impacts, and Coping Strategies. In 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER). 49--60."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380414"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2019.06.005"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEmotion.2019.00011"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675254"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2820018"},{"key":"e_1_2_1_24_1","volume-title":"Choosing civility: The twenty-five rules of considerate conduct","author":"Forni Pier Massimo","unstructured":"Pier Massimo Forni. 2010. Choosing civility: The twenty-five rules of considerate conduct .St. Martin's Press."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1177\/1532673X08316448"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-NIER.2017.18"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2575.2001.00108.x"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSR.2013.6624003"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173731"},{"key":"e_1_2_1_30_1","volume-title":"Motivation of software developers in Open Source projects: an Internet-based survey of contributors to the Linux kernel. Research policy","author":"Hertel Guido","year":"2003","unstructured":"Guido Hertel, Sven Niedner, and Stefanie Herrmann. 2003. Motivation of software developers in Open Source projects: an Internet-based survey of contributors to the Linux kernel. Research policy, Vol. 32, 7 (2003), 1159--1177."},{"key":"e_1_2_1_31_1","unstructured":"H. Hosseini S. Kannan B. Zhang and R. Poovendran. 2017. Deceiving google's perspective api built for detecting toxic comments. arXiv preprint arXiv:1702.08138 (2017)."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819950"},{"key":"e_1_2_1_33_1","unstructured":"IBM. [n.d.]. Watson Natural Language Understanding. https:\/\/www.ibm.com\/cloud\/watson-natural-language-understanding"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2018.08.030"},{"key":"e_1_2_1_35_1","volume-title":"Improving code review by predicting reviewers and acceptance of patches. Research on software analysis for error-free computing center Tech-Memo (ROSAEC MEMO 2009-006)","author":"Jeong Gaeul","year":"2009","unstructured":"Gaeul Jeong, Sunghun Kim, Thomas Zimmermann, and Kwangkeun Yi. 2009. Improving code review by predicting reviewers and acceptance of patches. Research on software analysis for error-free computing center Tech-Memo (ROSAEC MEMO 2009-006) (2009), 1--18."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.5555\/2487085.2487111"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2652524.2652542"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-016-9493-x"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1177\/0093650217699933"},{"key":"e_1_2_1_40_1","volume-title":"T test as a parametric statistic. Korean journal of anesthesiology","author":"Kim Tae Kyun","year":"2015","unstructured":"Tae Kyun Kim. 2015. T test as a parametric statistic. Korean journal of anesthesiology, Vol. 68, 6 (2015), 540."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180155.3180195"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1750-4716.2009.00035.x"},{"key":"e_1_2_1_43_1","unstructured":"Robert Love. 2010. Linux kernel development .Pearson Education."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274386"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359174"},{"key":"e_1_2_1_46_1","volume-title":"The chi-square test of independence. Biochemia medica","author":"McHugh Mary L","year":"2013","unstructured":"Mary L McHugh. 2013. The chi-square test of independence. Biochemia medica, Vol. 23, 2 (2013), 143--149."},{"key":"e_1_2_1_47_1","volume-title":"The role of civility and metacommunication in Facebook discussions. Communication studies","author":"Molina Roc'io Galarza","year":"2018","unstructured":"Roc'io Galarza Molina and Freddie J Jennings. 2018. The role of civility and metacommunication in Facebook discussions. Communication studies, Vol. 69, 1 (2018), 42--66."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379597.3387446"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2804381.2804387"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-021-09960-w"},{"key":"e_1_2_1_51_1","volume-title":"Democracy online: Civility, politeness, and the democratic potential of online political discussion groups. New media & society","author":"Papacharissi Zizi","year":"2004","unstructured":"Zizi Papacharissi. 2004. Democracy online: Civility, politeness, and the democratic potential of online political discussion groups. New media & society, Vol. 6, 2 (2004), 259--283."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274404"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377816.3381732"},{"key":"e_1_2_1_54_1","volume-title":"2008 ACM\/IEEE 30th International Conference on Software Engineering. 541--550","author":"Rigby P.","unstructured":"P. Rigby, D. German, and M. Storey. 2008. Open source software peer review practices. In 2008 ACM\/IEEE 30th International Conference on Software Engineering. 541--550."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S19-1031"},{"key":"e_1_2_1_56_1","volume-title":"The coding manual for qualitative researchers","author":"Salda\u00f1a Johnny","unstructured":"Johnny Salda\u00f1a. 2015. The coding manual for qualitative researchers 3rd ed.). Sage.","edition":"3"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2957792.2957801"},{"key":"e_1_2_1_58_1","volume-title":"Machine learning in automated text categorization. ACM computing surveys (CSUR)","author":"Sebastiani Fabrizio","year":"2002","unstructured":"Fabrizio Sebastiani. 2002. Machine learning in automated text categorization. ACM computing surveys (CSUR), Vol. 34, 1 (2002), 1--47."},{"key":"e_1_2_1_59_1","unstructured":"Brittany Shoot. [n.d.]. Linux Founder to Take Some Time Off: I Need to Change Some of My Behavior. http:\/\/fortune.com\/2018\/09\/17\/linux-git-linus-torvalds-bullying-abuse-time-off\/. Accessed: 2018--12--26."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1080\/10584609.2010.542360"},{"key":"e_1_2_1_61_1","volume-title":"Workshop on Global Software Development in a CSCW Perspective .","author":"Steinmacher Igor","year":"2014","unstructured":"Igor Steinmacher, Marco Aur\u00e9lio Gerosa, and David Redmiles. 2014. Attracting, onboarding, and retaining newcomer developers in open source software projects. In Workshop on Global Software Development in a CSCW Perspective ."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/CHASE.2013.6614728"},{"key":"e_1_2_1_63_1","volume-title":"Open coding. Basics of qualitative research: Grounded theory procedures and techniques","author":"Strauss Anselm","year":"1990","unstructured":"Anselm Strauss and Juliet Corbin. 1990. Open coding. Basics of qualitative research: Grounded theory procedures and techniques, Vol. 2, 1990 (1990), 101--121."},{"key":"e_1_2_1_64_1","volume-title":"Qualitative analysis for social scientists","author":"Strauss Anselm L","unstructured":"Anselm L Strauss. 1987. Qualitative analysis for social scientists .Cambridge university press."},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359210"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380920"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2014.49"},{"key":"e_1_2_1_68_1","unstructured":"David R Thomas. 2003. A general inductive approach for qualitative data analysis. (2003)."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-016--9452--6"},{"key":"e_1_2_1_70_1","volume-title":"Evolution and Reengineering (SANER), 2017 IEEE 24th International Conference on. IEEE, 24--33","author":"Tourani Parastou","year":"2017","unstructured":"Parastou Tourani, Bram Adams, and Alexander Serebrenik. 2017. Code of conduct in open source projects. In Software Analysis, Evolution and Reengineering (SANER), 2017 IEEE 24th International Conference on. IEEE, 24--33."},{"key":"e_1_2_1_71_1","volume-title":"Proceedings of 24th annual international conference on computer science and software engineering. IBM Corp., 34--44","author":"Tourani Parastou","year":"2014","unstructured":"Parastou Tourani, Yujuan Jiang, and Bram Adams. 2014. Monitoring sentiment in open source mailing lists: exploratory study on the apache ecosystem. In Proceedings of 24th annual international conference on computer science and software engineering. IBM Corp., 34--44."},{"key":"e_1_2_1_72_1","unstructured":"Anthony J Viera Joanne M Garrett et al. 2005. Understanding interobserver agreement: the kappa statistic. Fam med Vol. 37 5 (2005) 360--363."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376218"},{"key":"e_1_2_1_74_1","first-page":"45","article-title":"The art of coding and thematic exploration in qualitative research","volume":"15","author":"Williams Michael","year":"2019","unstructured":"Michael Williams and Tami Moser. 2019. The art of coding and thematic exploration in qualitative research. International Management Review, Vol. 15, 1 (2019), 45--55.","journal-title":"International Management Review"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-4625-2"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415179"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3479497","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,20]],"date-time":"2024-03-20T16:23:39Z","timestamp":1710951819000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3479497"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,13]]},"references-count":76,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2021,10,13]]}},"alternative-id":["10.1145\/3479497"],"URL":"https:\/\/doi.org\/10.1145\/3479497","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,13]]},"assertion":[{"value":"2021-10-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}