{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,30]],"date-time":"2024-10-30T21:33:22Z","timestamp":1730324002778,"version":"3.28.0"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,10,12]]},"DOI":"10.1145\/3472714.3473659","type":"proceedings-article","created":{"date-parts":[[2021,10,13]],"date-time":"2021-10-13T00:47:22Z","timestamp":1634086042000},"page":"319-325","source":"Crossref","is-referenced-by-count":2,"title":["Detecting High-Quality Comments in Written Feedback with a Zero Shot Classifier"],"prefix":"10.1145","author":[{"given":"William","family":"Hart-Davidson","sequence":"first","affiliation":[{"name":"Michigan State University, United States"}]},{"given":"Ryan","family":"Omizo","sequence":"additional","affiliation":[{"name":"Temple University, United States"}]},{"given":"Melissa","family":"Meeks","sequence":"additional","affiliation":[{"name":"Eli Review, United States"}]}],"member":"320","published-online":{"date-parts":[[2021,10,12]]},"reference":[{"issue":"1","key":"e_1_3_2_1_1_1","first-page":"45","article-title":"The art of coding and thematic exploration in qualitative research","volume":"15","author":"Williams M.","year":"2019","unstructured":"Williams , M. , & Moser , T. 2019 . The art of coding and thematic exploration in qualitative research . International Management Review , 15 ( 1 ), 45 - 55 . Williams, M., & Moser, T. 2019. The art of coding and thematic exploration in qualitative research. International Management Review, 15(1), 45-55.","journal-title":"International Management Review"},{"key":"#cr-split#-e_1_3_2_1_2_1.1","doi-asserted-by":"crossref","unstructured":"Salda\u00f1a J. 2014. Coding and Analysis Strategies. In Patricia Leavy (ed) The Oxford handbook of qualitative research. DOI: 10.1093\/oxfordhb\/9780199811755.013.001. 10.1093\/oxfordhb","DOI":"10.1093\/oxfordhb\/9780199811755.013.001"},{"key":"#cr-split#-e_1_3_2_1_2_1.2","doi-asserted-by":"crossref","unstructured":"Salda\u00f1a J. 2014. Coding and Analysis Strategies. In Patricia Leavy (ed) The Oxford handbook of qualitative research. DOI: 10.1093\/oxfordhb\/9780199811755.013.001.","DOI":"10.1093\/oxfordhb\/9780199811755.013.001"},{"volume-title":"Coding streams of language: Techniques for the systematic coding of text, talk, and other verbal data","author":"Geisler C.","key":"e_1_3_2_1_3_1","unstructured":"Geisler , C. , & Swarts , J. 2019. Coding streams of language: Techniques for the systematic coding of text, talk, and other verbal data . WAC Clearinghouse . Geisler, C., & Swarts, J. 2019. Coding streams of language: Techniques for the systematic coding of text, talk, and other verbal data. WAC Clearinghouse."},{"key":"e_1_3_2_1_4_1","unstructured":"Brown T.B. Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan\u2020 Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel M. Ziegler Jeffrey Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei 2020. Language models are few-shot learners. arXiv preprint arXiv:2005.14165. Brown T.B. Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan\u2020 Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel M. Ziegler Jeffrey Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei 2020. Language models are few-shot learners. arXiv preprint arXiv:2005.14165."},{"key":"e_1_3_2_1_5_1","unstructured":"Radford A. Wu J. Child R. Luan D. Amodei D. & Sutskever I. 2019. Language models are unsupervised multitask learners. OpenAI blog 1(8) 9. Radford A. Wu J. Child R. Luan D. Amodei D. & Sutskever I. 2019. Language models are unsupervised multitask learners. OpenAI blog 1(8) 9."},{"key":"e_1_3_2_1_6_1","volume-title":"Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.","author":"Devlin J.","year":"2018","unstructured":"Devlin , J. , Chang , M. W. , Lee , K. , & Toutanova , K. 2018 . Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805. Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805."},{"key":"e_1_3_2_1_7_1","volume-title":"Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461.","author":"Lewis M.","year":"2019","unstructured":"Lewis , M. , Yinhan Liu , Naman Goyal, Marjan Ghazvininejad , Abdelrahman Mohamed, Omer Levy , Ves Stoyanov, Luke Zettlemoyer . 2019 . Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461. Lewis, M., Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, Luke Zettlemoyer. 2019. Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Petroni F. Rockt\u00e4schel T. Lewis P. Bakhtin A. Wu Y. Miller A. H. & Riedel S. 2019. Language models as knowledge bases?. arXiv preprint arXiv:1909.01066. Petroni F. Rockt\u00e4schel T. Lewis P. Bakhtin A. Wu Y. Miller A. H. & Riedel S. 2019. Language models as knowledge bases?. arXiv preprint arXiv:1909.01066.","DOI":"10.18653\/v1\/D19-1250"},{"key":"e_1_3_2_1_9_1","volume-title":"Benchmarking zero-shot text classification: Datasets, evaluation and entailment approach. arXiv preprint arXiv:1909.00161","author":"Yin W.","year":"2019","unstructured":"Yin , W. , Hay , J. , & Roth , D. ( 2019 ). Benchmarking zero-shot text classification: Datasets, evaluation and entailment approach. arXiv preprint arXiv:1909.00161 . Yin, W., Hay, J., & Roth, D. (2019). Benchmarking zero-shot text classification: Datasets, evaluation and entailment approach. arXiv preprint arXiv:1909.00161."},{"key":"e_1_3_2_1_10_1","volume-title":"International conference on machine learning (pp. 2152-2161)","author":"Romera-Paredes B.","year":"2015","unstructured":"Romera-Paredes , B. , & Torr , P. 2015 , June. An embarrassingly simple approach to zero-shot learning . In International conference on machine learning (pp. 2152-2161) . PMLR. Romera-Paredes, B., & Torr, P. 2015, June. An embarrassingly simple approach to zero-shot learning. In International conference on machine learning (pp. 2152-2161). PMLR."},{"key":"e_1_3_2_1_11_1","unstructured":"Sainz O. & Rigau G. 2021. Ask2Transformers: Zero-Shot Domain labelling with Pre-trained Language Models. arXiv preprint arXiv:2101.02661. Sainz O. & Rigau G. 2021. Ask2Transformers: Zero-Shot Domain labelling with Pre-trained Language Models. arXiv preprint arXiv:2101.02661."},{"volume-title":"Quantitative content analysis: Its use in technical communication","author":"Boettger R. K.","key":"e_1_3_2_1_12_1","unstructured":"Boettger , R. K. , & Palmer , L. A. 2010. Quantitative content analysis: Its use in technical communication . IEEE transactions on professional communication, 53(4), 346-357. Boettger, R. K., & Palmer, L. A. 2010. Quantitative content analysis: Its use in technical communication. IEEE transactions on professional communication, 53(4), 346-357."},{"key":"e_1_3_2_1_13_1","volume-title":"Sylvain Gugger, Mariama Drame, Quentin Lhoest, Alexander M. Rush.","author":"Wolf T.","year":"2019","unstructured":"Wolf , T. , Lysandre Debut , Victor Sanh, Julien Chaumond , Clement Delangue, Anthony Moi , Pierric Cistac, Tim Rault , R\u00e9mi Louf, Morgan Funtowicz , Joe Davison, Sam Shleifer , Patrick von Platen, Clara Ma , Yacine Jernite, Julien Plu , Canwen Xu , Teven Le Scao , Sylvain Gugger, Mariama Drame, Quentin Lhoest, Alexander M. Rush. 2019 . HuggingFace's Transformers : State-of-the-art natural language processing. arXiv preprint arXiv:1910.03771. Wolf, T., Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, R\u00e9mi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, Alexander M. Rush. 2019. HuggingFace's Transformers: State-of-the-art natural language processing. arXiv preprint arXiv:1910.03771."},{"key":"e_1_3_2_1_14_1","volume-title":"Genre analysis: English in academic and research settings","author":"Swales J.","year":"1990","unstructured":"Swales , J. ( 1990 ). Genre analysis: English in academic and research settings . Cambridge University Press . Swales, J. (1990). Genre analysis: English in academic and research settings. Cambridge University Press."},{"key":"e_1_3_2_1_15_1","volume-title":"The writing of research article introductions. Written communication, 4(2), 175-191","author":"Swales J.","year":"1987","unstructured":"Swales , J. , & Najjar , H. ( 1987 ). The writing of research article introductions. Written communication, 4(2), 175-191 . Swales, J., & Najjar, H. (1987). The writing of research article introductions. Written communication, 4(2), 175-191."},{"key":"e_1_3_2_1_16_1","volume-title":"An approach to corpus-based discourse analysis: The move analysis as example. Discourse studies, 11(5), 585-605","author":"Upton T. A.","year":"2009","unstructured":"Upton , T. A. , & Cohen , M. A. ( 2009 ). An approach to corpus-based discourse analysis: The move analysis as example. Discourse studies, 11(5), 585-605 . Upton, T. A., & Cohen, M. A. (2009). An approach to corpus-based discourse analysis: The move analysis as example. Discourse studies, 11(5), 585-605."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jeap.2015.05.004"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.esp.2017.01.001"},{"key":"e_1_3_2_1_19_1","volume-title":"Proceedings of the 38th ACM International Conference on Design of Communication (pp. 1-8).","author":"Kane M.","year":"2020","unstructured":"Kane , M. 2020 , October. Communicating the \u201cWrite\u201d Values: Developing Methods of Computer-Aided Text Analysis for Instructor Training . In Proceedings of the 38th ACM International Conference on Design of Communication (pp. 1-8). Kane, M. 2020, October. Communicating the \u201cWrite\u201d Values: Developing Methods of Computer-Aided Text Analysis for Instructor Training. In Proceedings of the 38th ACM International Conference on Design of Communication (pp. 1-8)."},{"key":"e_1_3_2_1_20_1","volume-title":"Proceedings of the 34th ACM International Conference on the Design of Communication (pp. 1-8).","author":"Larson B.","year":"2016","unstructured":"Larson , B. , Hart-Davidson , W. , Walker , K. C. , Walls , D. M. , & Omizo , R. 2016 , September. Use what you choose: Applying computational methods to genre studies in technical communication . In Proceedings of the 34th ACM International Conference on the Design of Communication (pp. 1-8). Larson, B., Hart-Davidson, W., Walker, K. C., Walls, D. M., & Omizo, R. 2016, September. Use what you choose: Applying computational methods to genre studies in technical communication. In Proceedings of the 34th ACM International Conference on the Design of Communication (pp. 1-8)."},{"volume-title":"Improving outcomes: Disciplinary writing, local assessment, and the aim of fairness","author":"Hart-Davidson W.","key":"e_1_3_2_1_21_1","unstructured":"Hart-Davidson W. , Meeks M.G. 2020. Feedback analytics for peer learning: Indicators of writing improvement in digital environments . In: Kelly-Riley D., Elliot N., editors. Improving outcomes: Disciplinary writing, local assessment, and the aim of fairness . Modern Language Association . Hart-Davidson W., Meeks M.G. 2020. Feedback analytics for peer learning: Indicators of writing improvement in digital environments. In: Kelly-Riley D., Elliot N., editors. Improving outcomes: Disciplinary writing, local assessment, and the aim of fairness. Modern Language Association."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Hattie J. & Timperley H. 2007. The power of feedback. Review of educational research 77(1) 81-112. Hattie J. & Timperley H. 2007. The power of feedback. Review of educational research 77(1) 81-112.","DOI":"10.3102\/003465430298487"},{"volume-title":"Visible learning: feedback","author":"Hattie J.","key":"e_1_3_2_1_23_1","unstructured":"Hattie , J. , & Clarke , S. 2018. Visible learning: feedback . New York : Routledge . Hattie, J., & Clarke, S. 2018. Visible learning: feedback. New York: Routledge."},{"volume-title":"D. Downs and E. Wardle. Writing about writing: A college reader.","author":"Swales J.","key":"e_1_3_2_1_24_1","unstructured":"Swales , J. 2014. Create a research space (CARS) model of research introductions . In D. Downs and E. Wardle. Writing about writing: A college reader. New York : Macmillan . 12-15.] Swales, J. 2014. Create a research space (CARS) model of research introductions. In D. Downs and E. Wardle. Writing about writing: A college reader. New York: Macmillan. 12-15.]"},{"volume-title":"The value of written peer criticism","author":"Holt M.","key":"e_1_3_2_1_25_1","unstructured":"Holt , M. 1992. The value of written peer criticism . College composition and Communication, 43(3), 384-392. Holt, M. 1992. The value of written peer criticism. College composition and Communication, 43(3), 384-392."},{"key":"e_1_3_2_1_26_1","volume-title":"2021 Writing Analytics Spring Virtual Symposium: Incubating Writing Analytics Research in the Time of COVID-19","author":"Gogan B.","year":"2021","unstructured":"Gogan , B. 2021 . Closing the text equity gap: Writing PACE meeting to increase writing practice and performance . 2021 Writing Analytics Spring Virtual Symposium: Incubating Writing Analytics Research in the Time of COVID-19 . writinganalytics.colostate.edu. Gogan, B. 2021. Closing the text equity gap: Writing PACE meeting to increase writing practice and performance. 2021 Writing Analytics Spring Virtual Symposium: Incubating Writing Analytics Research in the Time of COVID-19. writinganalytics.colostate.edu."},{"key":"e_1_3_2_1_27_1","unstructured":"Huang H. Chen Y. Tang W. Zheng W. Chen Q. G. Hu Y. & Yu P. 2020. Multi-label Zero-shot Classification by Learning to Transfer from External Knowledge. arXiv preprint arXiv:2007.15610. Huang H. Chen Y. Tang W. Zheng W. Chen Q. G. Hu Y. & Yu P. 2020. Multi-label Zero-shot Classification by Learning to Transfer from External Knowledge. arXiv preprint arXiv:2007.15610."},{"key":"e_1_3_2_1_28_1","unstructured":"Davidson Joe. 2020 May 29. \"Zero-Shot Learning Modern NLP.\" Retrieved from https:\/\/joeddav.github.io\/blog\/2020\/05\/29\/ZSL.html. Davidson Joe. 2020 May 29. \"Zero-Shot Learning Modern NLP.\" Retrieved from https:\/\/joeddav.github.io\/blog\/2020\/05\/29\/ZSL.html."},{"key":"e_1_3_2_1_29_1","unstructured":"Huggingface.co. n.d. Hugginface facebook\/bart-large-mnli. Retrieved from https:\/\/huggingface.co\/facebook\/bart-large-mnli. Huggingface.co. n.d. Hugginface facebook\/bart-large-mnli. Retrieved from https:\/\/huggingface.co\/facebook\/bart-large-mnli."},{"key":"e_1_3_2_1_30_1","volume-title":"The multi-genre nli corpus","author":"Williams A.","year":"2018","unstructured":"Williams , A. , Nangia , N. , & Bowman , S. R. ( 2018 ). The multi-genre nli corpus . Williams, A., Nangia, N., & Bowman, S. R. (2018). The multi-genre nli corpus."},{"key":"e_1_3_2_1_31_1","volume-title":"Annotation artifacts in natural language inference data. arXiv preprint arXiv:1803.02324","author":"Gururangan S.","year":"2018","unstructured":"Gururangan , S. , Swayamdipta , S. , Levy , O. , Schwartz , R. , Bowman , S. R. , & Smith , N. A. ( 2018 ). Annotation artifacts in natural language inference data. arXiv preprint arXiv:1803.02324 . Gururangan, S., Swayamdipta, S., Levy, O., Schwartz, R., Bowman, S. R., & Smith, N. A. (2018). Annotation artifacts in natural language inference data. arXiv preprint arXiv:1803.02324."},{"key":"e_1_3_2_1_32_1","unstructured":"Camburu O.M. Rockt\u00e4schel T. Lukasiewicz T. and Blunsom P. 2018. e-snli: Natural language inference with natural language explanations. arXiv preprint arXiv:1812.01193. Camburu O.M. Rockt\u00e4schel T. Lukasiewicz T. and Blunsom P. 2018. e-snli: Natural language inference with natural language explanations. arXiv preprint arXiv:1812.01193."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529786"},{"key":"e_1_3_2_1_34_1","volume-title":"Validity and Inter-Rater Reliability Testing of Quality Assessment Instruments [Internet]. Rockville (MD): Agency for Healthcare Research and Quality (US)","author":"Hartling L","year":"2012","unstructured":"Hartling L , Hamm M , Milne A , Validity and Inter-Rater Reliability Testing of Quality Assessment Instruments [Internet]. Rockville (MD): Agency for Healthcare Research and Quality (US) ; 2012 Mar. Table 2, Interpretation of Fleiss' kappa (\u03ba) (from Landis and Koch 1977) Available from: https:\/\/www.ncbi.nlm.nih.gov\/books\/NBK92295\/table\/methods.t2\/ Hartling L, Hamm M, Milne A, Validity and Inter-Rater Reliability Testing of Quality Assessment Instruments [Internet]. Rockville (MD): Agency for Healthcare Research and Quality (US); 2012 Mar. Table 2, Interpretation of Fleiss' kappa (\u03ba) (from Landis and Koch 1977) Available from: https:\/\/www.ncbi.nlm.nih.gov\/books\/NBK92295\/table\/methods.t2\/"},{"key":"e_1_3_2_1_35_1","unstructured":"Eli Review. 2021. Retrieved from https:\/\/elireview.com\/. Eli Review. 2021. Retrieved from https:\/\/elireview.com\/."},{"key":"e_1_3_2_1_36_1","first-page":"2825","volume-title":"Scikit-learn: Machine learning in Python. the Journal of machine Learning research, 12","author":"Pedregosa F.","year":"2011","unstructured":"Pedregosa , F. , Varoquaux , G. , Gramfort , A. , Michel , V. , Thirion , B. , Grisel , O. , Blondel , M. , Prettenhofer , P. , Weiss , R. , Dubourg , V. and Vanderplas , J. , 2011 . Scikit-learn: Machine learning in Python. the Journal of machine Learning research, 12 , pp. 2825 - 2830 . Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V. and Vanderplas, J., 2011. Scikit-learn: Machine learning in Python. the Journal of machine Learning research, 12, pp.2825-2830."}],"event":{"name":"SIGDOC '21: The 39th ACM International Conference on Design of Communication","sponsor":["SIGDOC ACM Special Interest Group for Design of Communications"],"location":"Virtual Event USA","acronym":"SIGDOC '21"},"container-title":["The 39th ACM International Conference on Design of Communication"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3472714.3473659","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,2]],"date-time":"2022-08-02T10:31:14Z","timestamp":1659436274000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3472714.3473659"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,12]]},"references-count":37,"alternative-id":["10.1145\/3472714.3473659","10.1145\/3472714"],"URL":"https:\/\/doi.org\/10.1145\/3472714.3473659","relation":{},"subject":[],"published":{"date-parts":[[2021,10,12]]}}}