Abstract
[Context & Motivation] Machine learning (ML) use has increased significantly, [Question/Problem] however, organizations still struggle with operationalizing ML. [Principle results] In this paper, we explore the intersection between machine learning operations (MLOps) and Requirements engineering (RE) by investigating the current problems and best practices associated with developing an MLOps process. The goal is to create an artifact that would guide MLOps implementation from an RE perspective, aiming for a more systematic approach to managing ML models in production by identifying and documenting the goals and objectives. The study adopted a Design Science Research methodology, examining the difficulties currently faced in creating an MLOps process, identified potential solutions to these difficulties, and assessed the effectiveness of one particular solution, an artifact containing guiding Requirements Questions sorted by ML stages and practitioner roles. [Contribution] By establishing a more thorough understanding of how the two domains interact and by offering practical guidance for implementing MLOps processes from an RE perspective, this study advances both the MLOps and RE fields.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Baier, L., Kühl, N., Satzger, G.: How to cope with change?-preserving validity of predictive services over time (2019)
Bastajic, M., Boman Karinen, J.: Requirements grounded MLOps - a design science study. Master’s thesis, Chalmers (2023)
Chui, M., Hall, B., Singla, A., Sukharevsky, A.: The state of AI in 2021 (2021). https://www.mckinsey.com/capabilities/quantumblack/our-insights/global-survey-the-state-of-ai-in-2021
John, M.M., Olsson, H.H., Bosch, J.: Towards MLOps: a framework and maturity model. In: 2021 47th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), pp. 1–8. IEEE (2021)
Knauss, E.: Constructive master’s thesis work in industry: guidelines for applying design science research. In: 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET), pp. 110–121 (2021)
Kolltveit, A.B., Li, J.: Operationalizing machine learning models - a systematic literature review. In: 2022 IEEE/ACM 1st International Workshop on Software Engineering for Responsible Artificial Intelligence (SE4RAI), pp. 1–8 (2022)
Kreuzberger, D., Kühl, N., Hirschl, S.: Machine learning operations (MLOps): overview, definition, and architecture (2022). https://arxiv.org/abs/2205.02302
Kumara, I., Arts, R., Di Nucci, D., Van Den Heuvel, W.J., Tamburri, D.A.: Requirements and reference architecture for MLOps: insights from industry. Authorea Preprints (2023)
Microsoft: Machine learning operations (MLOps) framework to upscale machine learning lifecycle with azure machine learning. Microsoft Azure, blog (2024). https://learn.microsoft.com/en-us/azure/architecture/ai-ml/guide/mlops-technical-paper
Ng, A.: Machine learning engineering for production (MLOps) specialization. Coursera (2024). https://www.coursera.org/specializations/machine-learning-engineering-for-production-mlops
Nuseibeh, B., Easterbrook, S.: Requirements engineering: a roadmap. In: Proceedings of the Conference on the Future of Software Engineering, pp. 35–46 (2000)
Pandey, D., Suman, U., Ramani, A.: An effective requirement engineering process model for software development and requirements management. In: 2010 International Conference on Advances in Recent Technologies in Communication and Computing, pp. 287–291 (2010)
Saldaña, J.: The Coding Manual for Qualitative Researchers, pp. 1–440 (2021)
Subramanya, R., Sierla, S., Vyatkin, V.: From DevOps to MLOps: overview and application to electricity market forecasting. Appl. Sci. 12(19), 9851 (2022)
Tamburri, D.A.: Sustainable MLOps: trends and challenges. In: 2020 22nd International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), pp. 17–23 (2020)
Villamizar, H., Escovedo, T., Kalinowski, M.: Requirements engineering for machine learning: a systematic mapping study. In: 2021 47th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), pp. 29–36. IEEE (2021)
Vogelsang, A., Borg, M.: Requirements engineering for machine learning: perspectives from data scientists. In: 2019 IEEE 27th International Requirements Engineering Conference Workshops (REW), pp. 245–251. IEEE (2019)
Acknowledgements
We are grateful for the support of Emanuella Wallin at Polestar, and for the time and input of all participants. We thank the REFSQ reviewers for helpful feedback which improved the paper
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Bastajic, M., Boman Karinen, J., Horkoff, J. (2024). Operationalizing Machine Learning Using Requirements-Grounded MLOps. In: Mendez, D., Moreira, A. (eds) Requirements Engineering: Foundation for Software Quality. REFSQ 2024. Lecture Notes in Computer Science, vol 14588. Springer, Cham. https://doi.org/10.1007/978-3-031-57327-9_15
Download citation
DOI: https://doi.org/10.1007/978-3-031-57327-9_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-57326-2
Online ISBN: 978-3-031-57327-9
eBook Packages: Computer ScienceComputer Science (R0)