乐胖代购免代理版

{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,10]],"date-time":"2024-08-10T11:17:03Z","timestamp":1723288623293},"reference-count":85,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2022,2,10]],"date-time":"2022-02-10T00:00:00Z","timestamp":1644451200000},"content-version":"vor","delay-in-days":365,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["IIS-1638099, CCF-1718040, CCF-1853374, CCF-1909414"],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"name":"USDA-NIFA","award":["2017-67021-25924"]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2021,4,30]]},"abstract":"Type annotations connect variables to domain-specific types. They enable the power of type checking and can detect faults early. In practice, type annotations have a reputation of being burdensome to developers. We lack, however, an empirical understanding of how and why they are burdensome. Hence, we seek to measure the baseline accuracy and speed for developers making type annotations to previously unseen code. We also study the impact of one or more type suggestions. We conduct an empirical study of 97 developers using 20 randomly selected code artifacts from the robotics domain containing physical unit types. We find that subjects select the correct physical type with just 51% accuracy, and a single correct annotation takes about 2 minutes on average. Showing subjects a single suggestion has a strong and significant impact on accuracy both when correct and incorrect, while showing three suggestions retains the significant benefits without the negative effects. We also find that suggestions do not come with a time penalty. We require subjects to explain their annotation choices, and we qualitatively analyze their explanations. We find that identifier names and reasoning about code operations are the primary clues for selecting a type. We also examine two state-of-the-art automated type annotation systems and find opportunities for their improvement.<\/jats:p>","DOI":"10.1145\/3439775","type":"journal-article","created":{"date-parts":[[2021,2,10]],"date-time":"2021-02-10T15:15:21Z","timestamp":1612970121000},"page":"1-29","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["An Empirical Study on Type Annotations"],"prefix":"10.1145","volume":"30","author":[{"given":"John-Paul","family":"Ore","sequence":"first","affiliation":[{"name":"North Carolina State University, Raleigh, NC"}]},{"given":"Carrick","family":"Detweiler","sequence":"additional","affiliation":[{"name":"University of Nebraska--Lincoln, Lincoln, NE"}]},{"given":"Sebastian","family":"Elbaum","sequence":"additional","affiliation":[{"name":"University of Virginia, Charlottesville, VA"}]}],"member":"320","published-online":{"date-parts":[[2021,2,10]]},"reference":[{"key":"#cr-split#-e_1_2_1_1_1.1","doi-asserted-by":"crossref","unstructured":"Kevin Crowston. 2012. Amazon mechanical turk: {A} research tool for organizations and information systems scholars. In Proceedings of the Shaping the Future of {ICT} Research. Methods and Approaches - {IFIP} {WG} 8.2 Working Conference Anol Bhattacherjee and Brian Fitzgerald (Eds.). IFIP Advances in Information and Communication Technology Vol. 389. Springer 210--221. DOI:10.1007\/978-3-642-35142-6_14 10.1007\/978-3-642-35142-6_14","DOI":"10.1007\/978-3-642-35142-6_14"},{"key":"#cr-split#-e_1_2_1_1_1.2","doi-asserted-by":"crossref","unstructured":"Kevin Crowston. 2012. Amazon mechanical turk: {A} research tool for organizations and information systems scholars. In Proceedings of the Shaping the Future of {ICT} Research. Methods and Approaches - {IFIP} {WG} 8.2 Working Conference Anol Bhattacherjee and Brian Fitzgerald (Eds.). IFIP Advances in Information and Communication Technology Vol. 389. Springer 210--221. DOI:10.1007\/978-3-642-35142-6_14","DOI":"10.1007\/978-3-642-35142-6_14"},{"key":"e_1_2_1_2_1","volume-title":"Clang: A C language family frontend for LLVM. https:\/\/clang.llvm.org (accessed","year":"2019","unstructured":"2018. Clang: A C language family frontend for LLVM. https:\/\/clang.llvm.org (accessed May 1, 2019 ). 2018. Clang: A C language family frontend for LLVM. https:\/\/clang.llvm.org (accessed May 1, 2019)."},{"key":"e_1_2_1_3_1","volume-title":"17th International Workshop (LCPC'04)","volume":"3602","author":"Lattner Chris","unstructured":"Chris Lattner and Vikram S. Adve . 2004. The {LLVM} compiler framework and infrastructure tutorial. In Languages and Compilers for High Performance Computing , 17th International Workshop (LCPC'04) , Rudolf Eigenmann, Zhiyuan Li and Samuel P. Midkiff (Eds.). Lecture Notes in Computer Science , Vol. 3602 . Springer, 15--16. DOI:10.1007\/11532378_2 10.1007\/11532378_2 Chris Lattner and Vikram S. Adve. 2004. The {LLVM} compiler framework and infrastructure tutorial. In Languages and Compilers for High Performance Computing, 17th International Workshop (LCPC'04), Rudolf Eigenmann, Zhiyuan Li and Samuel P. Midkiff (Eds.). Lecture Notes in Computer Science, Vol. 3602. Springer, 15--16. DOI:10.1007\/11532378_2"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/948576.948577"},{"key":"e_1_2_1_5_1","first-page":"119","article-title":"Approximate is better than exact for interval estimation of binomial proportions","volume":"52","author":"Agresti Alan","year":"1998","unstructured":"Alan Agresti and Brent A. Coull . 1998 . Approximate is better than exact for interval estimation of binomial proportions . American Statistician 52 , 2 (1998), 119 -- 126 . Alan Agresti and Brent A. Coull. 1998. Approximate is better than exact for interval estimation of binomial proportions. American Statistician 52, 2 (1998), 119--126.","journal-title":"American Statistician"},{"key":"e_1_2_1_6_1","volume-title":"\u201cThe SI Brochure\u201d)","author":"Le Syst\u00e8me BIPM.","unstructured":"BIPM. 2006. Le Syst\u00e8me International d\u2019unita\u00e9s \/ The International System of Units ( \u201cThe SI Brochure\u201d) ( 8 th ed.). Bureau international des poids et mesures. Retrieved from http:\/\/www.bipm.org\/en\/si\/si_brochure\/. BIPM. 2006. Le Syst\u00e8me International d\u2019unita\u00e9s \/ The International System of Units (\u201cThe SI Brochure\u201d) (8th ed.). Bureau international des poids et mesures. Retrieved from http:\/\/www.bipm.org\/en\/si\/si_brochure\/.","edition":"8"},{"key":"e_1_2_1_7_1","volume-title":"Mechanical Turk upends social sciences. Science 352, 6291","author":"Bohannon John","year":"2016","unstructured":"John Bohannon . 2016. Mechanical Turk upends social sciences. Science 352, 6291 ( 2016 ), 1263--1264. DOI:10.1126\/science.352.6291.1263 10.1126\/science.352.6291.1263 John Bohannon. 2016. Mechanical Turk upends social sciences. Science 352, 6291 (2016), 1263--1264. DOI:10.1126\/science.352.6291.1263"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/234313.234418"},{"key":"e_1_2_1_9_1","volume-title":"James","author":"Chalin Patrice","year":"2007","unstructured":"Patrice Chalin and Perry R . James . 2007 . Non-null references by default in Java : Alleviating the nullity annotation burden. In Object-Oriented Programming, 21st European, Proceedings (ECOOP\u2019 07). 227--247. DOI:https:\/\/doi.org\/10.1007\/978-3-540-73589-2_12 10.1007\/978-3-540-73589-2_12 Patrice Chalin and Perry R. James. 2007. Non-null references by default in Java: Alleviating the nullity annotation burden. In Object-Oriented Programming, 21st European, Proceedings (ECOOP\u201907). 227--247. DOI:https:\/\/doi.org\/10.1007\/978-3-540-73589-2_12"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/52.2021"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3092703.3092727"},{"key":"e_1_2_1_12_1","unstructured":"Al Danial. 2018. Count Lines of Code. Retrieved from https:\/\/github.com\/AlDanial\/cloc. Al Danial. 2018. Count Lines of Code. Retrieved from https:\/\/github.com\/AlDanial\/cloc."},{"key":"e_1_2_1_13_1","volume-title":"Barr","author":"Dash Santanu Kumar","year":"2018","unstructured":"Santanu Kumar Dash , Miltiadis Allamanis , and Earl T . Barr . 2018 . RefiNym: Using names to refine types. See [39], 107--117. DOI:https:\/\/doi.org\/10.1145\/3236024.3236042 10.1145\/3236024.3236042 Santanu Kumar Dash, Miltiadis Allamanis, and Earl T. Barr. 2018. RefiNym: Using names to refine types. See [39], 107--117. DOI:https:\/\/doi.org\/10.1145\/3236024.3236042"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2652524.2652567"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2664243.2664254"},{"key":"e_1_2_1_16_1","unstructured":"Sundar Dorai-Raj. 2014. binom: Binomial Confidence Intervals for Several Parameterizations. Retrieved from https:\/\/CRAN.R-project.org\/package=binom. Sundar Dorai-Raj. 2014. binom: Binomial Confidence Intervals for Several Parameterizations. Retrieved from https:\/\/CRAN.R-project.org\/package=binom."},{"key":"e_1_2_1_17_1","volume-title":"Hack: A new programming language for HHVM.","year":"2014","unstructured":"Facebook. 2014 . Hack: A new programming language for HHVM. Retrieved from https:\/\/engineering.fb.com\/developer-tools\/hack-a-new-programming-language-for-hhvm. Facebook. 2014. Hack: A new programming language for HHVM. Retrieved from https:\/\/engineering.fb.com\/developer-tools\/hack-a-new-programming-language-for-hhvm."},{"key":"e_1_2_1_18_1","volume-title":"International Symposium of Formal Methods Europe, Proceedings (FME\u201901)","author":"Flanagan Cormac","year":"2001","unstructured":"Cormac Flanagan and K. Rustan M. Leino . 2001 . Houdini, an annotation assistant for ESC\/Java. In Formal Methods for Increasing Software Productivity , International Symposium of Formal Methods Europe, Proceedings (FME\u201901) . 500--517. DOI:https:\/\/doi.org\/10.1007\/3-540-45251-6_29 10.1007\/3-540-45251-6_29 Cormac Flanagan and K. Rustan M. Leino. 2001. Houdini, an annotation assistant for ESC\/Java. In Formal Methods for Increasing Software Productivity, International Symposium of Formal Methods Europe, Proceedings (FME\u201901). 500--517. DOI:https:\/\/doi.org\/10.1007\/3-540-45251-6_29"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the 39th International Conference on Software Engineering (ICSE\u201917)","author":"Gao Zheng","year":"2017","unstructured":"Zheng Gao , Christian Bird , and Earl T. Barr . 2017. To type or not to type: Quantifying detectable bugs in JavaScript . In Proceedings of the 39th International Conference on Software Engineering (ICSE\u201917) . 758--769. DOI:https:\/\/doi.org\/10.1109\/ICSE. 2017 .75 10.1109\/ICSE.2017.75 Zheng Gao, Christian Bird, and Earl T. Barr. 2017. To type or not to type: Quantifying detectable bugs in JavaScript. In Proceedings of the 39th International Conference on Software Engineering (ICSE\u201917). 758--769. DOI:https:\/\/doi.org\/10.1109\/ICSE.2017.75"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2016.09.012"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/0096-0551(77)90010-8"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2804302.2804305"},{"key":"e_1_2_1_23_1","volume-title":"Annotation-less unit type inference for C. Final Project, 6.883: Program Analysis","author":"Guo Philip","year":"2005","unstructured":"Philip Guo and Stephen McCamant . 2005. Annotation-less unit type inference for C. Final Project, 6.883: Program Analysis ( 2005 ). Philip Guo and Stephen McCamant. 2005. Annotation-less unit type inference for C. Final Project, 6.883: Program Analysis (2005)."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-013-9289-1"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 31st International Conference on Software Engineering (ICSE\u201909)","author":"Hangal Sudheendra","year":"2009","unstructured":"Sudheendra Hangal and Monica S. Lam . 2009. Automatic dimension inference and checking for object-oriented programs . In Proceedings of the 31st International Conference on Software Engineering (ICSE\u201909) . 155--165. DOI:https:\/\/doi.org\/10.1109\/ICSE. 2009 .5070517 10.1109\/ICSE.2009.5070517 Sudheendra Hangal and Monica S. Lam. 2009. Automatic dimension inference and checking for object-oriented programs. In Proceedings of the 31st International Conference on Software Engineering (ICSE\u201909). 155--165. DOI:https:\/\/doi.org\/10.1109\/ICSE.2009.5070517"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177730388"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-015-0578-z"},{"key":"#cr-split#-e_1_2_1_28_1.1","doi-asserted-by":"crossref","unstructured":"Vincent J. Hellendoorn Christian Bird Earl T. Barr and Miltiadis Allamanis. 2018. Deep learning type inference. See [39] 152--162. DOI:https:\/\/doi.org\/10.1145\/3236024.3236051 10.1145\/3236024.3236051","DOI":"10.1145\/3236024.3236051"},{"key":"#cr-split#-e_1_2_1_28_1.2","doi-asserted-by":"crossref","unstructured":"Vincent J. Hellendoorn Christian Bird Earl T. Barr and Miltiadis Allamanis. 2018. Deep learning type inference. See [39] 152--162. DOI:https:\/\/doi.org\/10.1145\/3236024.3236051","DOI":"10.1145\/3236024.3236051"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/26.4.366"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.17705\/1CAIS.04114"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1134285.1134323"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2018.02.005"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/359488.359501"},{"key":"e_1_2_1_34_1","volume-title":"Phys: Probabilistic physical unit assignment and inconsistency detection. See [39], 563--573. DOI:https:\/\/doi.org\/10.1145\/3236024.3236035","author":"Kate Sayali","year":"2018","unstructured":"Sayali Kate , John-Paul Ore , Xiangyu Zhang , Sebastian G. Elbaum , and Zhaogui Xu . 2018 . Phys: Probabilistic physical unit assignment and inconsistency detection. See [39], 563--573. DOI:https:\/\/doi.org\/10.1145\/3236024.3236035 10.1145\/3236024.3236035 Sayali Kate, John-Paul Ore, Xiangyu Zhang, Sebastian G. Elbaum, and Zhaogui Xu. 2018. Phys: Probabilistic physical unit assignment and inconsistency detection. See [39], 563--573. DOI:https:\/\/doi.org\/10.1145\/3236024.3236035"},{"key":"#cr-split#-e_1_2_1_35_1.1","doi-asserted-by":"crossref","unstructured":"Andrew Kennedy. 2009. Types for units-of-measure: Theory and practice. In Central European Functional Programming School - Third Summer School (CEFP'09) Revised Selected Lectures. 268--305. DOI:https:\/\/doi.org\/10.1007\/978-3-642-17685-2_8 10.1007\/978-3-642-17685-2_8","DOI":"10.1007\/978-3-642-17685-2_8"},{"key":"#cr-split#-e_1_2_1_35_1.2","doi-asserted-by":"crossref","unstructured":"Andrew Kennedy. 2009. Types for units-of-measure: Theory and practice. In Central European Functional Programming School - Third Summer School (CEFP'09) Revised Selected Lectures. 268--305. DOI:https:\/\/doi.org\/10.1007\/978-3-642-17685-2_8","DOI":"10.1007\/978-3-642-17685-2_8"},{"key":"e_1_2_1_36_1","volume-title":"Experimental Design","author":"Kirk Roger E.","unstructured":"Roger E. Kirk . 1982. Experimental Design . Wiley Online Library . Roger E. Kirk. 1982. Experimental Design. Wiley Online Library."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPC.2012.6240483"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2018.03.002"},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the 2018 ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/SIGSOFT FSE\u201918)","author":"Leavens Gary T.","unstructured":"Gary T. Leavens , Alessandro Garcia , and Corina S . Pasareanu (Eds.). 2018 . Proceedings of the 2018 ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/SIGSOFT FSE\u201918) . ACM. http:\/\/dl.acm.org\/citation.cfm?id=3236024 Gary T. Leavens, Alessandro Garcia, and Corina S. Pasareanu (Eds.). 2018. Proceedings of the 2018 ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC\/SIGSOFT FSE\u201918). ACM. http:\/\/dl.acm.org\/citation.cfm?id=3236024"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings (SATE\u201918)","volume":"11293","author":"Luo Yang","year":"2018","unstructured":"Yang Luo , Wanwangying Ma , Yanhui Li , Zhifei Chen , and Lin Chen . 2018 . Recognizing potential runtime types from python docstrings. In Software Analysis, Testing, and Evolution - 8th International Conference , Proceedings (SATE\u201918) (Lecture Notes in Computer Science), Lei Bu and Yingfei Xiong (Eds.) , Vol. 11293 . Springer, 68--84. DOI:https:\/\/doi.org\/10.1007\/978-3-030-04272-1_5 10.1007\/978-3-030-04272-1_5 Yang Luo, Wanwangying Ma, Yanhui Li, Zhifei Chen, and Lin Chen. 2018. Recognizing potential runtime types from python docstrings. In Software Analysis, Testing, and Evolution - 8th International Conference, Proceedings (SATE\u201918) (Lecture Notes in Computer Science), Lei Bu and Yingfei Xiong (Eds.), Vol. 11293. Springer, 68--84. DOI:https:\/\/doi.org\/10.1007\/978-3-030-04272-1_5"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/382280.382281"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2016.09.015"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-011-0124-6"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1809400.1809422"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2384616.2384666"},{"key":"e_1_2_1_46_1","volume-title":"Acquiescence and recency response-order effects in interview surveys. Sociological Methods 8 Research 20, 1","author":"McClendon McKee J.","year":"1991","unstructured":"McKee J. McClendon . 1991. Acquiescence and recency response-order effects in interview surveys. Sociological Methods 8 Research 20, 1 ( 1991 ), 60--103. McKee J. McClendon. 1991. Acquiescence and recency response-order effects in interview surveys. Sociological Methods 8 Research 20, 1 (1991), 60--103."},{"key":"e_1_2_1_47_1","volume-title":"Oxford Research Encyclopedia of Education.","author":"Mihas Paul","unstructured":"Paul Mihas . 2019. Qualitative data analysis . In Oxford Research Encyclopedia of Education. Paul Mihas. 2019. Qualitative data analysis. In Oxford Research Encyclopedia of Education."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/0022-0000(78)90014-4"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/605466.605469"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3092703.3092722"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3092703.3098219"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2017.8202229"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3238173"},{"key":"e_1_2_1_54_1","volume-title":"Formal Methods (FM\u201912) (Lecture Notes in Computer Science), Dimitra Giannakopoulou and Dominique M\u00e9ry (Eds.)","author":"Owre Sam","unstructured":"Sam Owre , Indranil Saha , and Natarajan Shankar . 2012. Automatic dimensional analysis of cyber-physical systems . In Formal Methods (FM\u201912) (Lecture Notes in Computer Science), Dimitra Giannakopoulou and Dominique M\u00e9ry (Eds.) . Springer , Berlin , 356--371. Sam Owre, Indranil Saha, and Natarajan Shankar. 2012. Automatic dimensional analysis of cyber-physical systems. In Formal Methods (FM\u201912) (Lecture Notes in Computer Science), Dimitra Giannakopoulou and Dominique M\u00e9ry (Eds.). Springer, Berlin, 356--371."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2001420.2001445"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.401"},{"key":"e_1_2_1_57_1","volume-title":"Types and Programming Languages","author":"Pierce Benjamin C.","unstructured":"Benjamin C. Pierce . 2002. Types and Programming Languages . MIT Press . Benjamin C. Pierce. 2002. Types and Programming Languages. MIT Press."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.677186"},{"issue":"2","key":"e_1_2_1_59_1","first-page":"5","article-title":"ROS: An open-source robot operating system","volume":"3","author":"Quigley Morgan","year":"2009","unstructured":"Morgan Quigley , Ken Conley , Brian Gerkey , Josh Faust , Tully Foote , Jeremy Leibs , Rob Wheeler , and Andrew Y. Ng . 2009 . ROS: An open-source robot operating system . In ICRA Workshop on Open Source Software , Vol. 3 . 2 . 5 . Morgan Quigley, Ken Conley, Brian Gerkey, Josh Faust, Tully Foote, Jeremy Leibs, Rob Wheeler, and Andrew Y. Ng. 2009. ROS: An open-source robot operating system. In ICRA Workshop on Open Source Software, Vol. 3.2. 5.","journal-title":"ICRA Workshop on Open Source Software"},{"key":"e_1_2_1_60_1","volume-title":"R: A Language and Environment for Statistical Computing","author":"Team R Core","year":"2013","unstructured":"R Core Team . 2013 . R: A Language and Environment for Statistical Computing . R Foundation for Statistical Computing, Vienna, Austria . Retrieved from http:\/\/www.R-project.org\/. R Core Team. 2013. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved from http:\/\/www.R-project.org\/."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2676726.2676971"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3126905"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-06859-7_148"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2003.1240326"},{"key":"e_1_2_1_65_1","unstructured":"Pritam Roy and Natarajan Shankar. 2010. SimCheck: An expressive type system for Simulink. Retrieved from https:\/\/ntrs.nasa.gov\/search.jsp?R=20100018536. Pritam Roy and Natarajan Shankar. 2010. SimCheck: An expressive type system for Simulink. Retrieved from https:\/\/ntrs.nasa.gov\/search.jsp?R=20100018536."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2018.00024"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393596.2393624"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1017\/iop.2015.29"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/2577080.2577098"},{"key":"e_1_2_1_70_1","volume-title":"Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM\u201910)","author":"Kathryn","year":"1852","unstructured":"Kathryn T. Stolee and Sebastian Elbaum. 2010. Exploring the use of crowdsourcing to support empirical studies in software engineering . In Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM\u201910) . ACM, New York, NY, 35:1--35:4. DOI:https:\/\/doi.org\/10.1145\/ 1852 786.1852832 10.1145\/1852786.1852832 Kathryn T. Stolee and Sebastian Elbaum. 2010. Exploring the use of crowdsourcing to support empirical studies in software engineering. In Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM\u201910). ACM, New York, NY, 35:1--35:4. DOI:https:\/\/doi.org\/10.1145\/1852786.1852832"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047849.2047861"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/2837614.2837630"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2017.08.038"},{"key":"e_1_2_1_74_1","volume-title":"Tipler and Gene Mosca","author":"Paul","year":"2007","unstructured":"Paul A. Tipler and Gene Mosca . 2007 . Physics for Scientists and Engineers. Macmillan . Paul A. Tipler and Gene Mosca. 2007. Physics for Scientists and Engineers. Macmillan."},{"key":"e_1_2_1_75_1","volume-title":"Judgment under uncertainty: Heuristics and biases. Science 185, 4157","author":"Tversky Amos","year":"1974","unstructured":"Amos Tversky and Daniel Kahneman . 1974. Judgment under uncertainty: Heuristics and biases. Science 185, 4157 ( 1974 ), 1124--1131. Amos Tversky and Daniel Kahneman. 1974. Judgment under uncertainty: Heuristics and biases. Science 185, 4157 (1974), 1124--1131."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/185009.185036"},{"key":"e_1_2_1_77_1","volume-title":"37th IEEE\/ACM International Conference on Software Engineering (ICSE\u201915)","volume":"1","author":"Vakilian Mohsen","year":"2015","unstructured":"Mohsen Vakilian , Amarin Phaosawasdi , Michael D. Ernst , and Ralph E. Johnson . 2015. Cascade: A universal programmer-assisted type qualifier inference tool . In 37th IEEE\/ACM International Conference on Software Engineering (ICSE\u201915) , Volume 1 . 234--245. DOI:https:\/\/doi.org\/10.1109\/ICSE. 2015 .44 10.1109\/ICSE.2015.44 Mohsen Vakilian, Amarin Phaosawasdi, Michael D. Ernst, and Ralph E. Johnson. 2015. Cascade: A universal programmer-assisted type qualifier inference tool. In 37th IEEE\/ACM International Conference on Software Engineering (ICSE\u201915), Volume 1. 234--245. DOI:https:\/\/doi.org\/10.1109\/ICSE.2015.44"},{"key":"e_1_2_1_78_1","doi-asserted-by":"crossref","unstructured":"W. N. Venables and B. D. Ripley. 2002. Modern Applied Statistics with S (4th ed.). Springer New York. Retrieved from http:\/\/www.stats.ox.ac.uk\/pub\/MASS4. W. N. Venables and B. D. Ripley. 2002. Modern Applied Statistics with S (4th ed.). Springer New York. Retrieved from http:\/\/www.stats.ox.ac.uk\/pub\/MASS4.","DOI":"10.1007\/978-0-387-21706-2"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661088.2661101"},{"key":"e_1_2_1_80_1","unstructured":"Mitchell Wand and Patrick O\u2019Keefe. 1991. Automatic dimensional inference. In Computational Logic - Essays in Honor of Alan Robinson. 479--483. Mitchell Wand and Patrick O\u2019Keefe. 1991. Automatic dimensional inference. In Computational Logic - Essays in Honor of Alan Robinson. 479--483."},{"key":"e_1_2_1_81_1","volume-title":"Proceedings of the 34th International Conference on Computer Safety, Reliability, and Security -","volume":"9337","author":"Xiang Jian","unstructured":"Jian Xiang , John C. Knight , and Kevin J. Sullivan . 2015. Real-world types and their application . In Proceedings of the 34th International Conference on Computer Safety, Reliability, and Security - Volume 9337 (SAFECOMP\u201915). Springer-Verlag New York, Inc., New York, NY, 471--484. Jian Xiang, John C. Knight, and Kevin J. Sullivan. 2015. Real-world types and their application. In Proceedings of the 34th International Conference on Computer Safety, Reliability, and Security - Volume 9337 (SAFECOMP\u201915). Springer-Verlag New York, Inc., New York, NY, 471--484."},{"key":"e_1_2_1_82_1","volume-title":"18th IEEE International Symposium on High Assurance Systems Engineering (HASE\u201917)","author":"Xiang Jian","year":"2017","unstructured":"Jian Xiang , John C. Knight , and Kevin J. Sullivan . 2017. Is my software consistent with the real world? In 18th IEEE International Symposium on High Assurance Systems Engineering (HASE\u201917) . IEEE Computer Society, 1--4. DOI:https:\/\/doi.org\/10.1109\/HASE. 2017 .20 10.1109\/HASE.2017.20 Jian Xiang, John C. Knight, and Kevin J. Sullivan. 2017. Is my software consistent with the real world? In 18th IEEE International Symposium on High Assurance Systems Engineering (HASE\u201917). IEEE Computer Society, 1--4. DOI:https:\/\/doi.org\/10.1109\/HASE.2017.20"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3439775","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3439775","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T19:57:20Z","timestamp":1672603040000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3439775"}},"subtitle":["Accuracy, Speed, and Suggestion Effectiveness"],"short-title":[],"issued":{"date-parts":[[2021,2,10]]},"references-count":85,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,4,30]]}},"alternative-id":["10.1145\/3439775"],"URL":"https:\/\/doi.org\/10.1145\/3439775","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,10]]},"assertion":[{"value":"2019-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-02-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}