Operationalizing Machine Learning Using Requirements-Grounded MLOps | SpringerLink
Skip to main content

Operationalizing Machine Learning Using Requirements-Grounded MLOps

  • Conference paper
  • First Online:
Requirements Engineering: Foundation for Software Quality (REFSQ 2024)

Abstract

[Context & Motivation] Machine learning (ML) use has increased significantly, [Question/Problem] however, organizations still struggle with operationalizing ML. [Principle results] In this paper, we explore the intersection between machine learning operations (MLOps) and Requirements engineering (RE) by investigating the current problems and best practices associated with developing an MLOps process. The goal is to create an artifact that would guide MLOps implementation from an RE perspective, aiming for a more systematic approach to managing ML models in production by identifying and documenting the goals and objectives. The study adopted a Design Science Research methodology, examining the difficulties currently faced in creating an MLOps process, identified potential solutions to these difficulties, and assessed the effectiveness of one particular solution, an artifact containing guiding Requirements Questions sorted by ML stages and practitioner roles. [Contribution] By establishing a more thorough understanding of how the two domains interact and by offering practical guidance for implementing MLOps processes from an RE perspective, this study advances both the MLOps and RE fields.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 7550
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 9437
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Baier, L., Kühl, N., Satzger, G.: How to cope with change?-preserving validity of predictive services over time (2019)

    Google Scholar 

  2. Bastajic, M., Boman Karinen, J.: Requirements grounded MLOps - a design science study. Master’s thesis, Chalmers (2023)

    Google Scholar 

  3. Chui, M., Hall, B., Singla, A., Sukharevsky, A.: The state of AI in 2021 (2021). https://www.mckinsey.com/capabilities/quantumblack/our-insights/global-survey-the-state-of-ai-in-2021

  4. John, M.M., Olsson, H.H., Bosch, J.: Towards MLOps: a framework and maturity model. In: 2021 47th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), pp. 1–8. IEEE (2021)

    Google Scholar 

  5. Knauss, E.: Constructive master’s thesis work in industry: guidelines for applying design science research. In: 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET), pp. 110–121 (2021)

    Google Scholar 

  6. Kolltveit, A.B., Li, J.: Operationalizing machine learning models - a systematic literature review. In: 2022 IEEE/ACM 1st International Workshop on Software Engineering for Responsible Artificial Intelligence (SE4RAI), pp. 1–8 (2022)

    Google Scholar 

  7. Kreuzberger, D., Kühl, N., Hirschl, S.: Machine learning operations (MLOps): overview, definition, and architecture (2022). https://arxiv.org/abs/2205.02302

  8. Kumara, I., Arts, R., Di Nucci, D., Van Den Heuvel, W.J., Tamburri, D.A.: Requirements and reference architecture for MLOps: insights from industry. Authorea Preprints (2023)

    Google Scholar 

  9. Microsoft: Machine learning operations (MLOps) framework to upscale machine learning lifecycle with azure machine learning. Microsoft Azure, blog (2024). https://learn.microsoft.com/en-us/azure/architecture/ai-ml/guide/mlops-technical-paper

  10. Ng, A.: Machine learning engineering for production (MLOps) specialization. Coursera (2024). https://www.coursera.org/specializations/machine-learning-engineering-for-production-mlops

  11. Nuseibeh, B., Easterbrook, S.: Requirements engineering: a roadmap. In: Proceedings of the Conference on the Future of Software Engineering, pp. 35–46 (2000)

    Google Scholar 

  12. Pandey, D., Suman, U., Ramani, A.: An effective requirement engineering process model for software development and requirements management. In: 2010 International Conference on Advances in Recent Technologies in Communication and Computing, pp. 287–291 (2010)

    Google Scholar 

  13. Saldaña, J.: The Coding Manual for Qualitative Researchers, pp. 1–440 (2021)

    Google Scholar 

  14. Subramanya, R., Sierla, S., Vyatkin, V.: From DevOps to MLOps: overview and application to electricity market forecasting. Appl. Sci. 12(19), 9851 (2022)

    Article  Google Scholar 

  15. Tamburri, D.A.: Sustainable MLOps: trends and challenges. In: 2020 22nd International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), pp. 17–23 (2020)

    Google Scholar 

  16. Villamizar, H., Escovedo, T., Kalinowski, M.: Requirements engineering for machine learning: a systematic mapping study. In: 2021 47th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), pp. 29–36. IEEE (2021)

    Google Scholar 

  17. Vogelsang, A., Borg, M.: Requirements engineering for machine learning: perspectives from data scientists. In: 2019 IEEE 27th International Requirements Engineering Conference Workshops (REW), pp. 245–251. IEEE (2019)

    Google Scholar 

Download references

Acknowledgements

We are grateful for the support of Emanuella Wallin at Polestar, and for the time and input of all participants. We thank the REFSQ reviewers for helpful feedback which improved the paper

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jennifer Horkoff .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bastajic, M., Boman Karinen, J., Horkoff, J. (2024). Operationalizing Machine Learning Using Requirements-Grounded MLOps. In: Mendez, D., Moreira, A. (eds) Requirements Engineering: Foundation for Software Quality. REFSQ 2024. Lecture Notes in Computer Science, vol 14588. Springer, Cham. https://doi.org/10.1007/978-3-031-57327-9_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-57327-9_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-57326-2

  • Online ISBN: 978-3-031-57327-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics