{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,3,31]],"date-time":"2022-03-31T12:29:09Z","timestamp":1648729749287},"reference-count":26,"publisher":"World Scientific Pub Co Pte Ltd","issue":"10","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Soft. Eng. Knowl. Eng."],"published-print":{"date-parts":[[2021,10]]},"abstract":" In the field of software engineering, practitioners\u2019 share in the constructed knowledge cannot be underestimated and is mostly in the form of grey literature (GL). GL is a valuable resource though it is subjective and lacks an objective quality assurance methodology. In this paper, a quality assessment scheme is proposed for question and answer (Q&A) sites. In particular, we target stack overflow (SO) and stack exchange (SE) sites. We model the problem of author reputation measurement as a classification task on the author-provided answers. The authors\u2019 mean, median, and total answer scores are used as inputs for class labeling. State-of-the-art language models (BERT and DistilBERT) with a softmax layer on top are utilized as classifiers and compared to SVM and random baselines. Our best model achieves [Formula: see text] accuracy in binary classification in SO design patterns tag and [Formula: see text] accuracy in SE software engineering category. Superior performance in SE software engineering can be explained by its larger dataset size. In addition to quantitative evaluation, we provide qualitative evidence, which supports that the system\u2019s predicted reputation labels match the quality of provided answers. <\/jats:p>","DOI":"10.1142\/s0218194021500479","type":"journal-article","created":{"date-parts":[[2021,11,15]],"date-time":"2021-11-15T09:58:46Z","timestamp":1636970326000},"page":"1421-1445","source":"Crossref","is-referenced-by-count":0,"title":["Author Reputation Measurement on Question and Answer Sites by the Classification of Author-Generated Content"],"prefix":"10.1142","volume":"31","author":[{"given":"Erhan","family":"Sezerer","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, Izmir Institute of Technology, I\u02d9zmir, Turkey"}]},{"given":"Samet","family":"Tenekeci","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Izmir Institute of Technology, I\u02d9zmir, Turkey"}]},{"given":"Ali","family":"Acar","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Izmir Institute of Technology, I\u02d9zmir, Turkey"}]},{"given":"Bora","family":"Balo\u011flu","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Izmir Institute of Technology, I\u02d9zmir, Turkey"}]},{"given":"Selma","family":"Tekir","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Izmir Institute of Technology, I\u02d9zmir, Turkey"}]}],"member":"219","published-online":{"date-parts":[[2021,11,15]]},"reference":[{"key":"S0218194021500479BIB001","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20672"},{"key":"S0218194021500479BIB002","doi-asserted-by":"publisher","DOI":"10.1002\/asi.1081"},{"key":"S0218194021500479BIB003","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10016"},{"key":"S0218194021500479BIB004","first-page":"4171","volume-title":"Proc. Conf. North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin J.","year":"2019"},{"key":"S0218194021500479BIB006","doi-asserted-by":"publisher","DOI":"10.1002\/jrsm.1106"},{"key":"S0218194021500479BIB007","doi-asserted-by":"publisher","DOI":"10.1145\/2915970.2916008"},{"key":"S0218194021500479BIB008","doi-asserted-by":"publisher","DOI":"10.1111\/ijmr.12102"},{"key":"S0218194021500479BIB009","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2018.09.006"},{"key":"S0218194021500479BIB011","first-page":"91","volume-title":"Proc. ACM Conf. on Computer Supported Cooperative Work Companion","author":"Hanrahan B. V.","year":"2012"},{"key":"S0218194021500479BIB012","doi-asserted-by":"publisher","DOI":"10.1145\/2187980.2188202"},{"key":"S0218194021500479BIB013","first-page":"460","volume-title":"IEEE Int. Conf. Software Maintenance","author":"Bazelli B.","year":"2013"},{"key":"S0218194021500479BIB014","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2014.90"},{"key":"S0218194021500479BIB015","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-012-9231-y"},{"key":"S0218194021500479BIB016","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2014.12.038"},{"key":"S0218194021500479BIB017","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2017.02.005"},{"key":"S0218194021500479BIB018","doi-asserted-by":"publisher","DOI":"10.1145\/1341531.1341557"},{"key":"S0218194021500479BIB019","doi-asserted-by":"publisher","DOI":"10.1145\/1526709.1526717"},{"key":"S0218194021500479BIB020","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2013.10.030"},{"key":"S0218194021500479BIB021","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220043"},{"key":"S0218194021500479BIB022","doi-asserted-by":"publisher","DOI":"10.1142\/S0218194020400276"},{"key":"S0218194021500479BIB023","doi-asserted-by":"publisher","DOI":"10.1145\/3401026"},{"key":"S0218194021500479BIB024","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2020.354"},{"key":"S0218194021500479BIB025","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2016.11.012"},{"key":"S0218194021500479BIB026","doi-asserted-by":"publisher","DOI":"10.1201\/b11041"},{"key":"S0218194021500479BIB027","first-page":"2825","volume":"12","author":"Pedregosa F.","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"S0218194021500479BIB028","first-page":"5998","volume-title":"Advances in Neural Information Processing Systems","volume":"30","author":"Vaswani A.","year":"2017"}],"container-title":["International Journal of Software Engineering and Knowledge Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218194021500479","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,11,15]],"date-time":"2021-11-15T09:58:52Z","timestamp":1636970332000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0218194021500479"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10]]},"references-count":26,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2021,10]]}},"alternative-id":["10.1142\/S0218194021500479"],"URL":"https:\/\/doi.org\/10.1142\/s0218194021500479","relation":{},"ISSN":["0218-1940","1793-6403"],"issn-type":[{"value":"0218-1940","type":"print"},{"value":"1793-6403","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10]]}}}