{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,4,9]],"date-time":"2025-04-09T17:13:49Z","timestamp":1744218829759,"version":"3.37.3"},"reference-count":51,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,3,26]],"date-time":"2022-03-26T00:00:00Z","timestamp":1648252800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"Software defect prediction studies aim to predict defect-prone components before the testing stage of the software development process. The main benefit of these prediction models is that more testing resources can be allocated to fault-prone modules effectively. While a few software defect prediction models have been developed for mobile applications, a systematic overview of these studies is still missing. Therefore, we carried out a Systematic Literature Review (SLR) study to evaluate how machine learning has been applied to predict faults in mobile applications. This study defined nine research questions, and 47 relevant studies were selected from scientific databases to respond to these research questions. Results show that most studies focused on Android applications (i.e., 48%), supervised machine learning has been applied in most studies (i.e., 92%), and object-oriented metrics were mainly preferred. The top five most preferred machine learning algorithms are Na\u00efve Bayes, Support Vector Machines, Logistic Regression, Artificial Neural Networks, and Decision Trees. Researchers mostly preferred Object-Oriented metrics. Only a few studies applied deep learning algorithms including Long Short-Term Memory (LSTM), Deep Belief Networks (DBN), and Deep Neural Networks (DNN). This is the first study that systematically reviews software defect prediction research focused on mobile applications. It will pave the way for further research in mobile software fault prediction and help both researchers and practitioners in this field.<\/jats:p>","DOI":"10.3390\/s22072551","type":"journal-article","created":{"date-parts":[[2022,3,28]],"date-time":"2022-03-28T01:31:25Z","timestamp":1648431085000},"page":"2551","source":"Crossref","is-referenced-by-count":34,"title":["Machine Learning-Based Software Defect Prediction for Mobile Applications: A Systematic Literature Review"],"prefix":"10.3390","volume":"22","author":[{"given":"Manzura","family":"Jorayeva","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, Istanbul K\u00fclt\u00fcr University, Istanbul 34158, Turkey"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9789-5012","authenticated-orcid":false,"given":"Akhan","family":"Akbulut","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Istanbul K\u00fclt\u00fcr University, Istanbul 34158, Turkey"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0959-2930","authenticated-orcid":false,"given":"Cagatay","family":"Catal","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Qatar University, Doha 2713, Qatar"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1275-2050","authenticated-orcid":false,"given":"Alok","family":"Mishra","sequence":"additional","affiliation":[{"name":"Informatics and Digitalization Group, Faculty of Logistics, Molde University College-Specialized University in Logistics, 6410 Molde, Norway"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Kaur, A., and Kaur, K. (2015, January 2\u20134). An investigation of the accuracy of code and process metrics for defect prediction of mobile applications. Proceedings of the 2015 4th International Conference on Reliability, Infocom Technologies and Optimization (ICRITO) (Trends and Future Directions), Noida, India.","DOI":"10.1109\/ICRITO.2015.7359220"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kha1id, H.E., and Shihab, M. (2015). What do mobile app users complain about? a study on free ios apps. IEEE Softw., 32, 222.","DOI":"10.1109\/MS.2014.50"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Harman, M., Jia, Y., and Zhang, Y. (2012, January 2\u20133). App store mining and analysis: MSR for app stores. Proceedings of the 2012 9th IEEE Working Conference on Mining Software Repositories (MSR), Zurich, Switzerland.","DOI":"10.1109\/MSR.2012.6224306"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Xia, X., Shihab, E., Kamei, Y., Lo, D., and Wang, X. (2016, January 8\u20139). Predicting crashing releases of mobile applications. Proceedings of the 10th ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement, Ciudad Real, Spain.","DOI":"10.1145\/2961111.2962606"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1109\/TDSC.2004.2","article-title":"Basic concepts and taxonomy of dependable and secure computing","volume":"1","author":"Avizienis","year":"2004","journal-title":"IEEE Trans. Dependable Secur. Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1034","DOI":"10.1016\/j.asoc.2016.04.032","article-title":"An empirical framework for defect prediction using machine learning techniques with Android software","volume":"49","author":"Malhotra","year":"2016","journal-title":"Appl. Soft Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1276","DOI":"10.1109\/TSE.2011.103","article-title":"systematic literature review on fault prediction performance in software engineering","volume":"38","author":"Hall","year":"2011","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Mishra, A., Shatnawi, R., Catal, C., and Akbulut, A. (2021). Techniques for Calculating Software Product Metrics Threshold Values: A Systematic Mapping Study. Appl. Sci., 11.","DOI":"10.3390\/app112311377"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"7346","DOI":"10.1016\/j.eswa.2008.10.027","article-title":"A systematic review of software fault prediction studies","volume":"36","author":"Catal","year":"2009","journal-title":"Expert Syst. Appl."},{"key":"ref_10","first-page":"1","article-title":"Software fault prediction for object-oriented systems: A systematic literature review","volume":"36","author":"Malhotra","year":"2011","journal-title":"ACMSIGSOFT Softw. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1016\/j.asoc.2014.11.023","article-title":"A systematic review of machine learning techniques for software fault prediction","volume":"27","author":"Malhotra","year":"2015","journal-title":"Appl. Soft Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1016\/j.infsof.2013.02.009","article-title":"Software fault prediction metrics: A systematic literature review","volume":"55","author":"Radjenovic","year":"2013","journal-title":"Inf. Softw. Technol."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Misirli, A.T., and Bener, A.B. (2014, January 3). A mapping study on Bayesian networks for software quality prediction. Proceedings of the 3rd International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering, Hyderabad, India.","DOI":"10.1145\/2593801.2593803"},{"key":"ref_14","unstructured":"Murillo-Morera, J., Quesada-L\u00f3pez, C., and Jenkins, M. (2015). Software Fault Prediction: A Systematic Mapping Study, CIbSE."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.jss.2018.06.025","article-title":"Early software defect prediction: A systematic map and review","volume":"144","author":"Tarhan","year":"2018","journal-title":"J. Syst. Softw."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Son, L.H., Pritam, N., Khari, M., Kumar, R., Phuong, P.T.M., and Thong, P.H. (2019). Empirical Study of Software Defect Prediction: A Systematic Mapping. Symmetry, 11.","DOI":"10.3390\/sym11020212"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Najm, A., Zakrani, A., and Marzak, A. (2019, January 22\u201324). Decision Trees Based Software Development Effort Estimation: A Systematic Mapping Study. Proceedings of the 2019 International Conference of Computer Science and Renewable Energies (ICCSRE), Agadir, Morocco.","DOI":"10.1109\/ICCSRE.2019.8807544"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"106214","DOI":"10.1016\/j.infsof.2019.106214","article-title":"A systematic literature review of machine learning techniques for software maintainability prediction","volume":"119","author":"Alsolai","year":"2020","journal-title":"Inf. Softw. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"110669","DOI":"10.1016\/j.jss.2020.110669","article-title":"Similarity-based analyses on software applications: A systematic literature review","volume":"168","author":"Auch","year":"2020","journal-title":"J. Syst. Softw."},{"key":"ref_20","first-page":"20","article-title":"Android application memory and energy performance: Systematic literature review","volume":"21","author":"Degu","year":"2019","journal-title":"IOSR J. Comput. Eng."},{"key":"ref_21","first-page":"1","article-title":"Systematic literature review of mobile application development and testing effort estimation","volume":"34","author":"Kaur","year":"2018","journal-title":"J. King Saud Univ.Comput. Inf. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Del Carpio, A.F., and Angarita, L.B. (2020, January 26\u201328). Trends in Software Engineering Processes using Deep Learning: A Systematic Literature Review. Proceedings of the 2020 46th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), Portoro\u017e, Slovenia.","DOI":"10.1109\/SEAA51224.2020.00077"},{"key":"ref_23","first-page":"61267","article-title":"A Systematic Literature Review on Empirical Analysis of the Relationship between Code Smells and Software Quality Attributes","volume":"27","author":"Kaur","year":"2019","journal-title":"Arch. Comput. Methods Eng."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kaya, A., Keceli, A.S., Catal, C., and Tekinerdogan, B. (2020). Model analytics for defect prediction based on design-level metrics and sampling techniques. Model Management and Analytics for Large Scale Systems, Academic Press.","DOI":"10.1016\/B978-0-12-816649-9.00015-6"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Kaur, A., Kaur, K., and Kaur, H. (2016). Application of machine learning on process metrics for defect prediction in mobile application. Information Systems Design and Intelligent Applications, Springer.","DOI":"10.1007\/978-81-322-2755-7_10"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhao, K., Xu, Z., Yan, M., Tang, Y., Fan, M., and Catolino, G. (2021, January 22\u201326). Just-in-time defect prediction for Android apps via imbalanced deep learning model. Proceedings of the 36th Annual ACM Symposium on Applied Computing, Online.","DOI":"10.1145\/3412841.3442019"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sewak, M., Sahay, S.K., and Rathore, H. (2020, January 16-19). Assessment of the Relative Importance of different hyper-parameters of LSTM for an IDS. Proceedings of the 2020 IEEE REGION 10 CONFERENCE (TENCON), Osaka, Japan.","DOI":"10.1109\/TENCON50793.2020.9293731"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"114595","DOI":"10.1016\/j.eswa.2021.114595","article-title":"Machine learning based methods for software fault prediction: A survey","volume":"172","author":"Pandey","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bhavana, K., Nekkanti, V., and Jayapandian, N. (2019). Internet of things enabled device fault prediction system using machine learning. International Conference on Inventive Computation Technologies, Springer.","DOI":"10.1007\/978-3-030-33846-6_101"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"107541","DOI":"10.1016\/j.knosys.2021.107541","article-title":"DNNAttention: A deep neural network and attention based architecture for cross project defect number prediction","volume":"233","author":"Pandey","year":"2021","journal-title":"Knowl. Based Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.infsof.2008.09.009","article-title":"Systematic literature reviews in software engineering\u2014A systematic literature review","volume":"51","author":"Kitchenham","year":"2009","journal-title":"Inf. Softw. Technol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"106773","DOI":"10.1016\/j.cie.2020.106773","article-title":"Machine learning applications in production lines: A systematic literature review","volume":"149","author":"Kang","year":"2020","journal-title":"Comput. Ind. Eng."},{"key":"ref_33","unstructured":"Kitchenham, B., and Charters, S. (2007). Guidelines for Performing Systematic Literature Reviews in Software Engineering, EBSE. Technical Report."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Catal, C., Sevim, U., and Diri, B. (2010). Metrics-driven software quality prediction without prior fault data. Electronic Engineering and Computing Technology, Springer.","DOI":"10.1007\/978-90-481-8776-8_17"},{"key":"ref_35","first-page":"75","article-title":"A Comparison of Semi-Supervised Classification Approaches for Software Defect Prediction","volume":"23","author":"Catal","year":"2014","journal-title":"J. Intell. Syst."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3440","DOI":"10.1016\/j.eswa.2010.08.130","article-title":"Thresholds based outlier detection approach for mining class outliers: An empirical case study on software measurement datasets","volume":"38","author":"Alan","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ricky, M.Y., Purnomo, F., and Yulianto, B. (April, January 29). Mobile application software defect prediction. Proceedings of the 2016 IEEE Symposium on Service-Oriented System Engineering (SOSE), Oxford, UK.","DOI":"10.1109\/SOSE.2016.25"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Bi\u00e7er, M.S., and Diri, B. (2015). Predicting defect-prone modules in web applications. International Conference on Information and Software Technologies, Springer.","DOI":"10.1007\/978-3-319-24770-0_49"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"6567","DOI":"10.3233\/JIFS-18473","article-title":"Empirical assessment of feature selection techniques in defect prediction models using web applications","volume":"36","author":"Malhotra","year":"2019","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"106307","DOI":"10.1016\/j.infsof.2020.106307","article-title":"An empirical comparison of predictive models for web page performance","volume":"123","author":"Ramakrishnan","year":"2020","journal-title":"Inf. Softw. Technol."},{"key":"ref_41","unstructured":"Kang, D., and Bae, D.H. (2010, January 19\u201323). Software fault prediction models for web applications. Proceedings of the 2010 IEEE 34th Annual Computer Software and Applications Conference Workshops, Seoul, Korea."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Catolino, G., Di Nucci, D., and Ferrucci, F. (2019, January 25\u201326). Cross-project just-in-time bug prediction for mobile apps: An empirical assessment. Proceedings of the 2019 IEEE\/ACM 6th International Conference on Mobile Software Engineering and Systems (MOBILESoft), Montreal, QC, Canada.","DOI":"10.1109\/MOBILESoft.2019.00023"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Kumar, A., Chugh, R., Girdhar, R., and Aggarwal, S. (2017, January 25\u201327). Classification of faults in Web applications using machine learning. Proceedings of the 2017 International Conference on Intelligent Systems, Metaheuristics & Swarm Intelligence, Hong Kong, China.","DOI":"10.1145\/3059336.3059353"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4018\/IJWSR.2020070101","article-title":"Fault Prediction in SOA-Based Systems Using Deep Learning Techniques","volume":"17","author":"Bhandari","year":"2020","journal-title":"Int. J. Web Serv. Res."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.comcom.2020.02.078","article-title":"Towards predictive analysis of android vulnerability using statistical codes and machine learning for IoT applications","volume":"155","author":"Cui","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1109\/TDSC.2014.2373377","article-title":"Web Application Vulnerability Prediction Using Hybrid Program Analysis and Machine Learning","volume":"12","author":"Shar","year":"2014","journal-title":"IEEE Trans. Dependable Secur. Comput."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Malhotra, R., and Khurana, A. (2017, January 20\u201322). Analysis of evolutionary algorithms to improve software defect prediction. Proceedings of the 2017 6th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO), Noida, India.","DOI":"10.1109\/ICRITO.2017.8342442"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Pang, Y., Xue, X., and Wang, H. (2017, January 2\u20134). Predicting vulnerable software components through the deep neural network. Proceedings of the 2017 International Conference on Deep Learning Technologies, Chengdu, China.","DOI":"10.1145\/3094243.3094245"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1007\/s40747-020-00154-3","article-title":"Success prediction of android applications in a novel repository using neural networks","volume":"6","author":"Dehkordi","year":"2020","journal-title":"Complex Intell. Syst."},{"key":"ref_50","first-page":"261","article-title":"Software reusability metrics prediction by using evolutionary algorithms: The interactive mobile learning application RozGaar","volume":"22","author":"Padhy","year":"2018","journal-title":"Int. J. Knowl.-Based Intell. Eng. Syst."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1109\/TSE.2007.256941","article-title":"Data Mining Static Code Attributes to Learn Defect Predictors","volume":"33","author":"Menzies","year":"2006","journal-title":"IEEE Trans. Softw. Eng."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/7\/2551\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,27]],"date-time":"2024-07-27T21:19:14Z","timestamp":1722115154000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/7\/2551"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,26]]},"references-count":51,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,4]]}},"alternative-id":["s22072551"],"URL":"https:\/\/doi.org\/10.3390\/s22072551","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,3,26]]}}}