{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,12,25]],"date-time":"2024-12-25T05:21:15Z","timestamp":1735104075386,"version":"3.32.0"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","funder":[{"DOI":"10.13039\/https:\/\/doi.org\/10.13039\/100000879","name":"Alfred P. Sloan Foundation","doi-asserted-by":"publisher","award":["G-2021-16745"],"id":[{"id":"10.13039\/https:\/\/doi.org\/10.13039\/100000879","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/https:\/\/doi.org\/10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["RGPIN-2018-04470"],"id":[{"id":"10.13039\/https:\/\/doi.org\/10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2024,4,17]]},"abstract":"Usability is a crucial factor but one of the most neglected concerns in open source software (OSS). While far from an ideal approach, a common practice that OSS communities adopt to collaboratively address usability is through discussions on issue tracking systems (ITSs). However, there is little knowledge about the extent to which OSS community members engage in usability issue discussions, the aspects of usability they frequently target, and the characteristics of their collaboration around usability issue discussions. This knowledge is important for providing practical recommendations and research directions to better support OSS communities in addressing this important topic and improve OSS usability in general. To help achieve this goal, we performed an extensive empirical study on issues discussed in five popular OSS applications: three data science notebook projects (Jupyter Lab, Google Colab, and CoCalc) and two code editor projects (VSCode and Atom). Our results indicated that while usability issues are extensively discussed in the OSS projects, their scope tended to be limited to efficiency and aesthetics. Additionally, these issues are more frequently posted by experienced community members and display distinguishable characteristics, such as involving more visual communication and more participants. Our results provide important implications that can inform the OSS practitioners to better engage the community in usability issue discussion and shed light on future research efforts toward collaboration techniques and tools for discussing niche topics in diverse communities, such as the usability issues in the OSS context.<\/jats:p>","DOI":"10.1145\/3637307","type":"journal-article","created":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T14:05:31Z","timestamp":1714399531000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Characterizing Usability Issue Discussions in Open Source Software Projects"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-9601-8094","authenticated-orcid":false,"given":"Arghavan","family":"Sanei","sequence":"first","affiliation":[{"name":"Department of Computer and Software Engineering, Polytechnique Montreal, Montreal, PQ, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8474-5290","authenticated-orcid":false,"given":"Jinghui","family":"Cheng","sequence":"additional","affiliation":[{"name":"Department of Computer and Software Engineering, Polytechnique Montreal, Montreal, PQ, Canada"}]}],"member":"320","published-online":{"date-parts":[[2024,4,26]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2020.2967380"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3530019.3534082"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00058"},{"volume-title":"Open Source Ecosystems: Diverse Communities Interacting","author":"Bach Paula M","key":"e_1_2_2_4_1","unstructured":"Paula M Bach and John M Carroll. 2009. FLOSS UX design: An analysis of user experience design in Firefox and OpenOffice. org. In Open Source Ecosystems: Diverse Communities Interacting. Springer Berlin Heidelberg, Berlin, Heidelberg, 237--250."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518852"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753636"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3338939"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635887"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718918.1718972"},{"key":"e_1_2_2_10_1","article-title":"Latent Dirichlet Allocation","volume":"3","author":"Blei David M.","year":"2003","unstructured":"David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet Allocation. J. Mach. Learn. Res., Vol. 3, null (mar 2003), 993--1022.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2399016.2399121"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-017--9546--9"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/11774129_15"},{"key":"e_1_2_2_14_1","volume-title":"Culotta (Eds.)","volume":"22","author":"Chang Jonathan","year":"2009","unstructured":"Jonathan Chang, Sean Gerrish, Chong Wang, Jordan Boyd-graber, and David Blei. 2009. Reading Tea Leaves: How Humans Interpret Topic Models. In Advances in Neural Information Processing Systems, Y. Bengio, D. Schuurmans, J. Lafferty, C. Williams, and A. Culotta (Eds.), Vol. 22. Curran Associates, Inc., Red Hook, NY, USA, 288--296."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445573"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188467"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CHASE.2019.00011"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3352681"},{"key":"e_1_2_2_19_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction","volume":"5","author":"Ferreira Isabella","year":"2021","unstructured":"Isabella Ferreira, Jinghui Cheng, and Bram Adams. 2021. The \u201cShut the f** k up\" Phenomenon: Characterizing Incivility in Open Source Code Review Discussions. Proceedings of the ACM on Human-Computer Interaction, Vol. 5, CSCW2 (2021), 1--35."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1984.4767596"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00766-016-0247-5"},{"key":"e_1_2_2_22_1","volume-title":"Jinghui Cheng, and Jin LC Guo.","author":"Hellman Jazlyn","year":"2022","unstructured":"Jazlyn Hellman, Jiahao Chen, Md Sami Uddin, Jinghui Cheng, and Jin LC Guo. 2022. Characterizing User Behaviors in Open-Source Software User Forums: An Empirical Study. In 2022 IEEE\/ACM 15th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE). IEEE, New York, NY, USA, 46--55."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3451643"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2017.24"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1080\/0144929X.2010.503351"},{"volume-title":"Nordic Contributions in IS Research","author":"Iivari Netta","key":"e_1_2_2_26_1","unstructured":"Netta Iivari. 2013. `Configuring the User and the Designer' -- A Critical Inquiry on Usability Work in the Company Open Source Software Development Context. In Nordic Contributions in IS Research, Margunn Aanestad and Tone Bratteteig (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 1--17."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008689307411"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753576"},{"volume-title":"Content analysis: An introduction to its methodology","author":"Krippendorff Klaus","key":"e_1_2_2_29_1","unstructured":"Klaus Krippendorff. 2018. Content analysis: An introduction to its methodology. Sage publications, California, USA."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-022--10181-y"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3310276"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CHASE.2017.3"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449093"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783446.2783563"},{"key":"e_1_2_2_35_1","volume-title":"MALLET: A Machine Learning for Language Toolkit.","author":"McCallum Andrew Kachites","year":"2002","unstructured":"Andrew Kachites McCallum. 2002. MALLET: A Machine Learning for Language Toolkit. (2002). http:\/\/www.cs.umass.edu\/ mccallum\/mallet."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2018.08.003"},{"key":"e_1_2_2_37_1","volume-title":"Automatic Evaluation of Topic Coherence. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics","author":"Newman David","year":"2010","unstructured":"David Newman, Jey Han Lau, Karl Grieser, and Timothy Baldwin. 2010. Automatic Evaluation of Topic Coherence. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics (Los Angeles, California) (HLT '10). Association for Computational Linguistics, USA, 100--108."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1002\/spip.256"},{"volume-title":"Usability engineering. Morgan Kaufmann","author":"Nielsen Jakob","key":"e_1_2_2_39_1","unstructured":"Jakob Nielsen. 1994. Usability engineering. Morgan Kaufmann, San Francisco, CA, USA."},{"key":"e_1_2_2_40_1","unstructured":"Jakob Nielsen. 2020. Ten usability heuristics. http:\/\/www.nngroup.com\/articles\/ten-usability-heuristics\/"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","unstructured":"J. Noble J. Ferreira and R. Biddle. 2007. Agile Development Iterations and UI Design. In Agile 2007. IEEE Computer Society Los Alamitos CA USA 50--58. https:\/\/doi.org\/10.1109\/AGILE.2007.8","DOI":"10.1109\/AGILE.2007.8"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-021-09960-w"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME46990.2020.00020"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753707"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-019-09779-6"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702441"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341105.3374056"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1155\/2010\/517532"},{"key":"e_1_2_2_49_1","volume-title":"Qualitative analysis: What it is and how to begin. Research in nursing & health","author":"Sandelowski Margarete","year":"1995","unstructured":"Margarete Sandelowski. 1995. Qualitative analysis: What it is and how to begin. Research in nursing & health, Vol. 18, 4 (1995), 371--375."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/CHASE52884.2021.00009"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/1520340.1520395"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1093\/ptj"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306--4573(01)00045-0"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753476"},{"issue":"5","key":"e_1_2_2_55_1","first-page":"360","article-title":"Understanding interobserver agreement: the kappa statistic","volume":"37","author":"Viera Anthony J.","year":"2005","unstructured":"Anthony J. Viera and Joanne M. Garrett. 2005. Understanding interobserver agreement: the kappa statistic. Family Medicine, Vol. 37.5 (2005), 360--363.","journal-title":"Family Medicine"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196321.3196357"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376218"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2020.3009514"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASEW.2019.00037"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2576454"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3132864"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2638427"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2015.7357204"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3637307","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,24]],"date-time":"2024-12-24T12:10:15Z","timestamp":1735042215000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3637307"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,17]]},"references-count":63,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2024,4,17]]}},"alternative-id":["10.1145\/3637307"],"URL":"https:\/\/doi.org\/10.1145\/3637307","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2024,4,17]]},"assertion":[{"value":"2024-04-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}