A Systematic Mapping Study of Empirical Research Methods in Software Ecosystems | SpringerLink
Skip to main content
Springer Nature Link
Log in

A Systematic Mapping Study of Empirical Research Methods in Software Ecosystems

  • Conference paper
  • First Online:
Software Business (ICSOB 2022)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 463))

Included in the following conference series:

  • 1483 Accesses

Abstract

The field of software ecosystems is rapidly maturing and significant numbers of articles are published each year to further develop our understanding of this concept and support innovation through it. The growth of the field also brings along challenges, such as findability and reusability of research results, coordination of research initiatives, and significant review pressure on members of the community. In this mapping study of empirical research methods in the field, we show that few studies do a good job of reporting their research methods and results. Using data from the study, we provide guidelines for performing empirical research in software ecosystems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 11439
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 14299
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Latest standards https://github.com/acmsigsoft/EmpiricalStandards/.

References

  1. Bosch, J.: From software product lines to software ecosystems. In: SPLC, vol. 9, pp. 111–119 (2009). https://doi.org/10.1145/1753235.1753251

  2. Carlile, P.R.: Transferring, translating, and transforming: an integrative framework for managing knowledge across boundaries. Organ. Sci. 15(5), 555–568 (2004). https://doi.org/10.1287/ORSC.1040.0094

    Article  Google Scholar 

  3. Decan, A., Mens, T.: What do package dependencies tell us about semantic versioning? IEEE Trans. Softw. Eng. 47(6), 1226–1240 (2021). https://doi.org/10.1109/TSE.2019.2918315

    Article  Google Scholar 

  4. Easterbrook, S., Singer, J., Storey, M.A., Damian, D.: Selecting empirical methods for software engineering research, pp. 285–311 (2008). https://doi.org/10.1007/978-1-84800-044-5_11

  5. Engstrom, E., Storey, M.A., Runeson, P., Höst, M., Baldassarre, M.T.: How software engineering research aligns with design science: a review 25, 2630–2660 (2020). https://doi.org/10.48550/arXiv.1904.12742

  6. Russpatrick, S.: Understanding platform ecosystems for development: enabling innovation in digital global public goods software platforms. In: Bandi, R.K., Ranjini, C.R., Klein, S., Madon, S., Monteiro, E. (eds.) IFIPJWC 2020. IAICT, vol. 601, pp. 148–162. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-64697-4_12

    Chapter  Google Scholar 

  7. Garcia-Holgado, A., Garcia-Penalvo, F.J.: Mapping the systematic literature studies about software ecosystems. In: TEEM 10-2018 (2018). https://doi.org/10.1145/3284179.3284330

  8. Jacobides, M.G.: In the Ecosystem Economy, What’s Your Strategy? September 2019. https://hbr.org/2019/09/in-the-ecosystem-economy-whats-your-strategy

  9. Jansen, S., Cusumano, M.A.: Defining software ecosystem: a survey of software platforms and business network governance (2013). https://doi.org/10.4337/9781781955628.00008

  10. Jansen, S., Cusumano, M.A., Brinkkemper, S.: Software Ecosystems: Analyzing and Managing Business Networks in the Software Industry. Edward Elgar (2013). https://doi.org/10.4337/9781781955628.00008

  11. Kitchenham, B., Charters, S.: Guidelines for performing systematic literature reviews in software engineering 2, 66 (2007). https://doi.org/10.1016/j.infsof.2008.09.009

  12. Kuhn, T.S.: The Structure of Scientific Revolutions, vol. 111. University of Chicago Press, Chicago, January 1970

    Google Scholar 

  13. Manikas, K.: Software ecosystems - a systematic literature review. J. Syst. Softw. (2013). https://doi.org/10.1145/3284179.3284330

    Article  Google Scholar 

  14. Manikas, K., Hansen, K.M.: Reviewing the health of software ecosystems–a conceptual framework proposal. In: Proceedings of the 5th International Workshop on Software Ecosystems (IWSECO), pp. 33–44. Citeseer (2013)

    Google Scholar 

  15. Petersen, K., Vakkalanka, S., Kuzniarz, L.: Guidelines for conducting systematic mapping studies in software engineering: an update. Inf. Softw. Technol. 64, 1–18 (2015). https://doi.org/10.1016/j.infsof.2015.03.007

    Article  Google Scholar 

  16. Plakidas, K., Stevanetic, S., Schall, D., Ionescu, T.B., Zdun, U.: How do software ecosystems evolve? A quantitative assessment of the r ecosystem. In: Proceedings of the 20th International Systems and Software Product Line Conference, pp. 89–98 (2016). https://doi.org/10.1145/2934466.2934488

  17. Ralph, P., et al.: Empirical standards for software engineering research (2020). https://arxiv.org/abs/2010.03525. https://doi.org/10.48550/arXiv.2010.03525

  18. Runeson, P., Host, M.: Guidelines for conducting and reporting case study research in software engineering. Empir. Softw. Eng. 14 (2009). Article Number: 131. https://doi.org/10.1007/s10664-008-9102-8

  19. Tashakkori, A., Creswell, J.W.: The new era of mixed methods 01, 3–7 (2007). https://doi.org/10.1177/2345678906293042

  20. Teixeira, J., Robles, G., González-Barahona, J.M.: Lessons learned from applying social network analysis on an industrial Free/Libre/Open Source Software ecosystem. J. Internet Serv. Appl. 6(1), 1–27 (2015). https://doi.org/10.1186/s13174-015-0028-2

    Article  Google Scholar 

  21. Van Aken, J.E.: Management research as a design science: articulating the research products of mode 2 knowledge production in management 16, 19–36 (2005). https://doi.org/10.1111/j.1467-8551.2005.00437.x

  22. Wareham, J., Fox, P.B., Cano Giner, J.L.: Technology ecosystem governance. Organiz. Sci. 25(4), 1195–1215 (2014). https://doi.org/10.2139/ssrn.2201688

  23. Wilkinson, M.D., et al.: The fair guiding principles for scientific data management and stewardship. Sci. Data 3(1), 1–9 (2016). https://doi.org/10.1038/sdata.2016.18

    Article  Google Scholar 

  24. Wohlin, C., Mendes, E., Romero Felizardo, K., Kalinowski, M.: Guidelines for the search strategy to update systematic literature reviews in software engineering. J. Syst. Softw. (2020). https://doi.org/10.1016/j.infsof.2020.106366

    Article  Google Scholar 

  25. Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B., Wesley, A.: Experimentation in Software Engineering. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-29044-2

  26. Zaggl, M.A., Schweisfurth, T.G., Herstatt, C.: The dynamics of openness and the role of user communities: a case study in the ecosystem of open-source gaming handhelds. IEEE Trans. Eng. Manag. 67(3), 712–723 (2019). https://doi.org/10.1109/TEM.2019.2897900

    Article  Google Scholar 

  27. Zelkowitz, M., Wallace, D.: Experimental models for validating technology 31, 23–31 (1998). https://doi.org/10.1109/2.675630

Download references

Acknowledgements

We thank Kari Smolander for organizing the session that sprouted this research.

Author information

Authors and Affiliations

  1. LUT University, Lappeenranta, Finland

    Larry Abdullai, Hatef Shamshiri, Hasan Mahmud, Muhammad Hamza, Essi Aittamaa, Jaakko Vuolasto, Mikhail O. Adisa, Roope Luukkainen, Sonja M. Hyrynsalmi, Niina Mässeli, Nasreen Azad, Bahalul Haque, Juha-Pekka Joutsenlahti, Wondemeneh Legesse, Ahmed Abdelsalam, Anastasiia Gurzhii, Jouni Ikonen & Slinger Jansen

  2. Utrecht University, Utrecht, The Netherlands

    Slinger Jansen & Casper van Schothorst

Authors
  1. Larry Abdullai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hatef Shamshiri
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hasan Mahmud
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Muhammad Hamza
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Essi Aittamaa
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jaakko Vuolasto
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Mikhail O. Adisa
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Roope Luukkainen
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Sonja M. Hyrynsalmi
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Niina Mässeli
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Nasreen Azad
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Bahalul Haque
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Juha-Pekka Joutsenlahti
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Wondemeneh Legesse
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Ahmed Abdelsalam
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Anastasiia Gurzhii
    View author publications

    You can also search for this author in PubMed Google Scholar

  17. Jouni Ikonen
    View author publications

    You can also search for this author in PubMed Google Scholar

  18. Slinger Jansen
    View author publications

    You can also search for this author in PubMed Google Scholar

  19. Casper van Schothorst
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Casper van Schothorst .

Editor information

Editors and Affiliations

  1. University of Galway, Galway, Ireland

    Noel Carroll

  2. University of South-Eastern Norway, Bø, Norway

    Anh Nguyen-Duc

  3. Free University of Bozen-Bolzano, Bolzano, Italy

    Xiaofeng Wang

  4. University of Oslo, Oslo, Norway

    Viktoria Stray

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Abdullai, L. et al. (2022). A Systematic Mapping Study of Empirical Research Methods in Software Ecosystems. In: Carroll, N., Nguyen-Duc, A., Wang, X., Stray, V. (eds) Software Business. ICSOB 2022. Lecture Notes in Business Information Processing, vol 463. Springer, Cham. https://doi.org/10.1007/978-3-031-20706-8_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-20706-8_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-20705-1

  • Online ISBN: 978-3-031-20706-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation