{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,4,21]],"date-time":"2025-04-21T17:30:10Z","timestamp":1745256610778},"reference-count":51,"publisher":"Wiley","issue":"8","license":[{"start":{"date-parts":[[2021,12,20]],"date-time":"2021-12-20T00:00:00Z","timestamp":1639958400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100003593","name":"Conselho Nacional de Desenvolvimento Cient\u00edfico e Tecnol\u00f3gico","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002322","name":"Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Software Testing Verif & Rel"],"published-print":{"date-parts":[[2022,12]]},"abstract":"Summary<\/jats:title>The use of mutation testing for mobile applications (apps for short) is still a challenge. Mobile apps are usually event\u2010driven and encompass graphical user interfaces (GUIs) and a complex execution environment. Then, they require mutant operators to describe specific apps faults, and the automation of the mutation process phases like execution and analysis of the mutants is not an easy task. To encourage research addressing such challenges, this paper presents results from a mapping study on mutation testing for mobile apps. Following a systematic plan, we found 16 primary studies that were analysed according to three aspects: (i) trends and statistics about the field; (ii) study characteristics such as focus, proposed operators and automated support for the mutation testing phases; and (iii) evaluation aspects. The great majority of studies (98%) have been published in the last 3\u2009years. The most addressed language is Java, and Android is the only operating system considered. Mutant operators of GUI and configuration types are prevalent in a total of 138 operators found. Most studies implement a supporting tool, but few tools support mutant execution and analysis. The evaluation conducted by the studies includes apps mainly from the finance and utility domain. Nevertheless, there is a lack of benchmarks and more rigorous experiments. Future research should address other specific types of faults, languages, and operating systems. They should offer support for mutant execution and analysis, as well as to reduce the mutation testing cost and limitations in the mobile context.<\/jats:p>","DOI":"10.1002\/stvr.1801","type":"journal-article","created":{"date-parts":[[2021,12,21]],"date-time":"2021-12-21T03:06:16Z","timestamp":1640055976000},"update-policy":"http:\/\/dx.doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A mapping study on mutation testing for mobile applications"],"prefix":"10.1002","volume":"32","author":[{"given":"Henrique Neves","family":"Silva","sequence":"first","affiliation":[{"name":"Computer Science Department Federal University of Paran\u00e1 (UFPR) Curitiba Brazil"}]},{"given":"Jackson","family":"Prado Lima","sequence":"additional","affiliation":[{"name":"Computer Science Department Federal University of Paran\u00e1 (UFPR) Curitiba Brazil"}]},{"given":"Silvia Regina","family":"Vergilio","sequence":"additional","affiliation":[{"name":"Computer Science Department Federal University of Paran\u00e1 (UFPR) Curitiba Brazil"}]},{"given":"Andre Takeshi","family":"Endo","sequence":"additional","affiliation":[{"name":"Department of Computing Federal University of Technology\u2014Paran\u00e1 (UTFPR) Corn\u00e9lio Proc\u00f3pio Brazil"}]}],"member":"311","published-online":{"date-parts":[[2021,12,20]]},"reference":[{"key":"e_1_2_10_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2016.04.012"},{"key":"e_1_2_10_3_1","doi-asserted-by":"crossref","unstructured":"ChoudharySR GorlaA OrsoA.Automated test input generation for android: Are we there yet? (e). In2015 30th ieee\/acm international conference on automated software engineering (ase).Institute of Electrical and Electronics Engineers Inc. 2015;429\u2013440.","DOI":"10.1109\/ASE.2015.89"},{"key":"e_1_2_10_4_1","doi-asserted-by":"crossref","unstructured":"SuT MengG ChenY WuK YangW YaoY et al.Guided stochastic model\u2010based GUI testing of android apps. InProceedings of the 2017 11th joint meeting on foundations of software engineering ESEC\/FSE 2017 paderborn germany september 4\u20108 2017 2017;245\u2013256.","DOI":"10.1145\/3106237.3106298"},{"key":"e_1_2_10_5_1","doi-asserted-by":"crossref","unstructured":"MaoK HarmanM JiaY.Sapienz: multi\u2010objective automated testing for android applications. InProceedings of the 25th international symposium on software testing and analysis ISSTA 2016.Association for Computing Machinery:New York NY USA 2016;94\u2013105.","DOI":"10.1145\/2931037.2931054"},{"key":"e_1_2_10_6_1","doi-asserted-by":"crossref","unstructured":"GuT SunC MaX CaoC XuC YaoY othes.Practical GUI testing of Android applications via model abstraction and refinement. InProceedings of the 41st international conference on software engineering ICSE'19.IEEE Press 2019;269\u2013280.","DOI":"10.1109\/ICSE.2019.00042"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2016.03.065"},{"key":"e_1_2_10_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-018-9418-6"},{"key":"e_1_2_10_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TR.2018.2865733"},{"key":"e_1_2_10_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10515-013-0128-9"},{"key":"e_1_2_10_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2889160.2891043"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3300963"},{"key":"e_1_2_10_13_1","doi-asserted-by":"crossref","unstructured":"FerreiraJ PaivaACR.Android testing crawler 2019;313\u2013326.","DOI":"10.1007\/978-3-030-29238-6_23"},{"key":"e_1_2_10_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2895504"},{"key":"e_1_2_10_15_1","doi-asserted-by":"crossref","unstructured":"DengL MirzaeiN AmmannP OffuttJ.Towards mutation analysis of Android apps. InProceedings of the eighth international conference on software testing verification and validation workshops ICSTW.IEEE 2015;1\u201310.","DOI":"10.1109\/ICSTW.2015.7107450"},{"key":"e_1_2_10_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.62"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/bs.adcom.2018.03.015"},{"key":"e_1_2_10_18_1","unstructured":"PetersenK FeldtR MujtabaS MattssonM.Systematic mapping studies in software engineering. InProceedings of the 12th international conference on evaluation and assessment in software engineering 2008;68\u201377."},{"key":"e_1_2_10_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2013.44"},{"key":"e_1_2_10_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2016.01.017"},{"key":"e_1_2_10_21_1","unstructured":"SouzaFCM PapadakisM DurelliVHS DelamaroME.Test data generation techniques for mutation testing: a systematic mapping. InCibse.Curran Associates 2014;419\u2013432."},{"key":"e_1_2_10_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2019.04.031"},{"key":"e_1_2_10_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2019.07.100"},{"key":"e_1_2_10_24_1","unstructured":"M\u00e9ndez\u2010PorrasA Quesada\u2010L\u00f3pezC JenkinsM.Automated testing of mobile applications: a systematic map and review. InCibse.Curran Associates Inc. 2015;195."},{"key":"e_1_2_10_25_1","doi-asserted-by":"crossref","unstructured":"JabbarvandR MalekS.\u03bcDroid: an energy\u2010aware mutation testing framework for Android. InProceedings of the 11th joint meeting on foundations of software engineering ESEC\/FSE.ACM 2017;208\u2013219.","DOI":"10.1145\/3106237.3106244"},{"key":"e_1_2_10_26_1","doi-asserted-by":"crossref","unstructured":"Linares\u2010VsquezM BavotaG TufanoM MoranK Di PentaM VendomeC et al.Enabling mutation testing for Android apps. InProceedings of the 2017 11th joint meeting on foundations of software engineering ESEC\/FSE.ACM:New York NY USA 2017;233\u2013244.","DOI":"10.1145\/3106237.3106275"},{"key":"e_1_2_10_27_1","doi-asserted-by":"crossref","unstructured":"MoranK TufanoM Bernal\u2010CrdenasC Linares\u2010VsquezM BavotaG VendomeC et al.Mdroid+: a mutation testing framework for Android. InProceedings of the 40th international conference on software engineering: Companion ICSE\u2010Companion.ACM 2018;33\u201336.","DOI":"10.1145\/3183440.3183492"},{"key":"e_1_2_10_28_1","doi-asserted-by":"crossref","unstructured":"MoherD LiberatiA TetzlaffJ AltmanDG.Preferred Reporting Items for Systematic Reviews and Meta\u2010Analyses: the PRISMA statement 2009. BMJ 339.","DOI":"10.1136\/bmj.b2535"},{"key":"e_1_2_10_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2915970.2916008"},{"key":"e_1_2_10_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2018.09.006"},{"key":"e_1_2_10_31_1","doi-asserted-by":"crossref","unstructured":"WohlinC.Guidelines for snowballing in systematic literature studies and a replication in software engineering. InProceedings of the 18th international conference on evaluation and assessment in software engineering EASE'14.ACM 2014;38:1\u201338:10.","DOI":"10.1145\/2601248.2601268"},{"key":"e_1_2_10_32_1","doi-asserted-by":"crossref","unstructured":"SilvaHN Prado LimaJA EndoAT VergilioSR.Supplementary material\u2014a mapping study on mutation testing in mobile applications 2021.https:\/\/doi.org\/10.17605\/OSF.IO\/SBGM7","DOI":"10.1002\/stvr.1801"},{"key":"e_1_2_10_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00766-005-0021-6"},{"key":"e_1_2_10_34_1","doi-asserted-by":"publisher","DOI":"10.18517\/ijaseit.10.1.10194"},{"key":"e_1_2_10_35_1","doi-asserted-by":"crossref","unstructured":"DengL OffuttJ SamudioD.Is mutation analysis effective at testing Android apps?InProceedings of the international conference on software quality reliability and security QRS.IEEE 2017;86\u201393.","DOI":"10.1109\/QRS.2017.19"},{"key":"e_1_2_10_36_1","doi-asserted-by":"crossref","unstructured":"UsaolaMP RojasG RodrguezI HernndezS.An architecture for the development of mutation operators. InProceedings of the international conference on software testing verification and validation workshops ICSTW.IEEE 2017;143\u2013148.","DOI":"10.1109\/ICSTW.2017.31"},{"key":"e_1_2_10_37_1","doi-asserted-by":"crossref","unstructured":"DengL OffuttJ.Reducing the cost of android mutation testing. InProceedings of the 30th international conference on software engineering and knowledge engineering SEKE.KSI Research Inc. and Knowledge Systems Institute Graduate School 2018;542\u2013591.","DOI":"10.18293\/SEKE2018-184"},{"key":"e_1_2_10_38_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0218194018400193"},{"key":"e_1_2_10_39_1","doi-asserted-by":"crossref","unstructured":"LunaE El ArissO.Edroid: a mutation tool for android apps. InProceedings of the 6th international conference in software engineering research and innovation CONISOFT.IEEE 2018;99\u2013108.","DOI":"10.1109\/CONISOFT.2018.8645883"},{"key":"e_1_2_10_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3356317.3356320"},{"key":"e_1_2_10_41_1","doi-asserted-by":"crossref","unstructured":"Escobar\u2010VelsquezC Osorio\u2010RiaM Linares\u2010V\u00e1quezM.MutAPK: source\u2010codeless mutant generation for Android apps. InProceedings of the international conference on automated software engineering ASE.IEEE 2019;1090\u20131093.","DOI":"10.1109\/ASE.2019.00109"},{"key":"e_1_2_10_42_1","doi-asserted-by":"crossref","unstructured":"PaivaACR GouveiaJMEP ElizabethJ\u2010D DelamaroME.Testing when mobile apps go to background and come back to foreground. InIn 2019 IEEE International Conference on Software Testing Verification and Validation Workshops (ICSTW) 2019;102\u2013111.","DOI":"10.1109\/ICSTW.2019.00038"},{"key":"e_1_2_10_43_1","doi-asserted-by":"crossref","unstructured":"LiuJ XiaoCX XuL DouL PodgurskiCA XiaoX PodgurskiA.DroidMutator: an effective mutation analysis tool for Android applications. InProceedings of the 42nd international conference on software engineering companion ICSE\u2010Companion.ACM 2020.","DOI":"10.1145\/3377812.3382134"},{"key":"e_1_2_10_44_1","unstructured":"WeiY.Mudroid: mutation testing for android apps 2015.https:\/\/github.com\/Yuan-W\/muDroid"},{"key":"e_1_2_10_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-019-09776-9"},{"key":"e_1_2_10_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2011.6100138"},{"key":"e_1_2_10_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2016.07.002"},{"key":"e_1_2_10_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372788"},{"key":"e_1_2_10_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/0164-1212(93)90005-I"},{"key":"e_1_2_10_50_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1471"},{"key":"e_1_2_10_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/174146.154265"},{"key":"e_1_2_10_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-4625-2"}],"container-title":["Software Testing, Verification and Reliability"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/stvr.1801","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/stvr.1801","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/stvr.1801","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,21]],"date-time":"2023-08-21T15:53:42Z","timestamp":1692633222000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/stvr.1801"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,20]]},"references-count":51,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["10.1002\/stvr.1801"],"URL":"https:\/\/doi.org\/10.1002\/stvr.1801","archive":["Portico"],"relation":{},"ISSN":["0960-0833","1099-1689"],"issn-type":[{"value":"0960-0833","type":"print"},{"value":"1099-1689","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,20]]},"assertion":[{"value":"2021-05-06","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-05","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}