First Steps towards Validating a Cost-Benefit Model of Reviews and Tests | SpringerLink
Skip to main content
Springer Nature Link
Log in

First Steps towards Validating a Cost-Benefit Model of Reviews and Tests

  • Conference paper
Software Process and Product Measurement (Mensura 2008, MetriKon 2008, IWSM 2008)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 5338))

Abstract

Software project managers’ decisions on reviews and tests are difficult. This paper describes a cost-benefit model for specific decisions on quality assurance. The quantitative model is based on single relationships and is quantified with historical data. Its results are shown and are compared with cost estimations. The model is able to reflect reported results of process improvement. Data collected in student projects is used to evaluate the model. Project averages and single projects are considered. Furthermore, results of a cross-validation are shown.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Biffl, S.: Software Inspection Techniques to Support Project and Quality Management, Habilitationsschrift. Shaker Verlag (2001)

    Google Scholar 

  2. Biffl, S., Halling, M.: Investigating the Influence of Inspector Capability Factors with Four Inspection Techniques on Inspection Performance. In: Proc. of METRICS 2002 (2002)

    Google Scholar 

  3. Biffl, S., Halling, M.: Investigating the Defect Detection Effectiveness and Cost Benefit of Nominal Inspection Teams. IEEE Trans. on Softw. Eng. 29(5) (2003)

    Google Scholar 

  4. Boehm, B.W.: Software Engineering Economics. Prentice Hall, Englewood Cliffs (1981)

    MATH  Google Scholar 

  5. Boehm, B.W.: Software Cost Estimation with COCOMO II. Prentice Hall, Englewood Cliffs (2000)

    Google Scholar 

  6. Boehm, B.W., Huang, L., Jain, A., Madachy, R.: The ROI of Software Dependability: The iDave Model. IEEE Softw. 21(3) (2004)

    Google Scholar 

  7. Bossel, H.: Systeme, Dynamik, Simulation. Books on Demand (2004)

    Google Scholar 

  8. Cangussu, J.W., Mathur, A.P., Karcich, R.M., DeCarlo, R.A.: Software Release Control using Defect Based Quality Estimation. In: Proc. of ISSRE 2004 (2004)

    Google Scholar 

  9. Cuadrado-Gallego, J.J., Fernandez-Sanz, L., Sicilia, M.-A.: Enhancing Input Value Selection in Parametric Software Cost Estimation Models through Second Level Cost Drivers. Software Quality Journal 14(4) (2006)

    Google Scholar 

  10. Dahl, O.-J., Dijkstra, E.W., Hoare, C.A.R.: Structured Programming. Academic Press, London (1972)

    MATH  Google Scholar 

  11. Diaz, M., King, J.: How CMM Impacts Quality, Productivity, Rework, and the Bottom Line. CrossTalk (March 2002)

    Google Scholar 

  12. Drappa, A., Deininger, M., Ludewig, J., Melchisedech, R.: Modeling and Simulation of Software Projects. In: Proc. of the 20th Annual Softw. Eng. Workshop (1995)

    Google Scholar 

  13. El Emam, K.: The ROI from Software Quality. Auerbach Publications (2005)

    Google Scholar 

  14. Endres, A., Rombach, H.D.: A Handbook of Software and Systems Engineering. Empirical Observations, Laws and Theories. Pearson, London (2003)

    Google Scholar 

  15. Fagan, M.E.: Advances in Software Inspections. IEEE Trans. on Softw. Eng. SE-12(7) (1986)

    Google Scholar 

  16. Fenton, N.E., Pfleeger, S.L.: Software Metrics. A Rigorous & Practical Approach, 2nd edn. PWS Publishing Company (1997)

    Google Scholar 

  17. Freedman, D.P., Weinberg, G.M.: Handbook of Walkthroughs, Inspections, and Technical Reviews, 3rd edn. Little, Brown and Company (1982)

    Google Scholar 

  18. Freimut, B., Briand, L.C., Vollei, F.: Determining Inspection Cost-Effectiveness by Combining Project Data and Expert Opinion. IEEE Trans. on Softw. Eng. 31(12) (2005)

    Google Scholar 

  19. Grady, R.B.: Practical Software Metrics for Project Management and Process Improvement. Prentice Hall, Englewood Cliffs (1992)

    Google Scholar 

  20. Haley, T., Ireland, B., Wojtaszek, E., Nash, D., Dion, R.: Raytheon Electronic Systems Experience in Software Process Improvement. CMU/SEI-95-TR-017 (1995)

    Google Scholar 

  21. Hampp, T., Knauß, M.: Eine Untersuchung über Korrekturkosten von Software-Fehlern. Softwaretechnik-Trends 28(2) (2008)

    Google Scholar 

  22. Huang, C.-Y., Lyu, M.R.: Optimal Release Time for Software Systems Considering Cost, Testing-Effort, and Test Efficiency. IEEE Trans. on Reliability 54(4) (2005)

    Google Scholar 

  23. Jalote, P.: CMM in Practice: Processes for Executing Software Projects at Infosys. Addison-Wesley, Reading (2000)

    Google Scholar 

  24. Jones, C.: Applied Software Measurement. 2nd edn. McGraw-Hill, New York (1997)

    Google Scholar 

  25. Jones, C.: Estimating Software Costs. McGraw-Hill, New York (2007)

    Google Scholar 

  26. Kan, S.H.: Metrics and Models in Software Quality Engineering, 2nd edn. Addison-Wesley, Reading (2003)

    MATH  Google Scholar 

  27. Kemerer, C.F.: An Empirical Validation of Software Cost Estimation Models. Comm. of the ACM 30(5) (1987)

    Google Scholar 

  28. Kusumoto, S., Matsumoto, K., Kikuno, T., Torii, K.: A New Metrics for Cost Effectiveness of Software Reviews. IEICE Trans. on Inf. and Syst. E75-D(5) (1992)

    Google Scholar 

  29. Liggesmeyer, P.: Software-Qualität. Spektrum (2002)

    Google Scholar 

  30. Ludewig, J. (ed.): Praktische Lehrveranstaltungen im Studiengang Softwaretechnik. Bericht der Fakultät Informatik, Universität Stuttgart, 2nd edn. (2001)

    Google Scholar 

  31. Martin, R., Raffo, D.M.: Application of a Hybrid Process Simulation Model to a Software Development Project. Journal of Systems and Software 59(3) (2001)

    Google Scholar 

  32. Mizuno, O., Shigematsu, E., Takagi, Y., Kikuno, T.: On Estimating Testing Effort Needed to Assure Field Quality in Software Development. In: Proc. of ISSRE 2002 (2002)

    Google Scholar 

  33. Müller, M.: Analyzing Software Quality Assurance Strategies through Simulation. Dissertation, Fraunhofer IESE (2007)

    Google Scholar 

  34. Piwowarski, P., Ohba, M., Caruso, J.: Coverage Measurement Experience During Function Test. In: Proc. of ICSE 1993 (1993)

    Google Scholar 

  35. Rubey, R.J., Browning, L.A., Roberts, A.R.: Cost Effectiveness of Software Quality Assurance. In: Proc. of NAECON (1989)

    Google Scholar 

  36. Van Megen, R., Meyerhoff, D.B.: Costs and Benefits of Early Defect Detection: Experiences from Developing Client Server and Host Applications. Software Quality Journal 4(4) (1995)

    Google Scholar 

  37. Wagner, S.: Cost-Optimisation of Analytical Software Quality Assurance. Dissertation, TU München (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institut für Softwaretechnologie, Universität Stuttgart, 70569, Stuttgart, Germany

    Tilmann Hampp

Authors
  1. Tilmann Hampp
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute for Distributed Systems, University of Magdeburg, P.O. Box 4120, 39106, Magdeburg, Germany

    Reiner R. Dumke

  2. Fakultät für Informatik, Institut für Verteilte Systeme, AG Softwaretechnik, Otto-von-Guericke-Universität Magdeburg, Universitätsplatz 2, 39106, Magdeburg, Germany

    René Braungarten

  3. Büren & Partner Software-Design GbR, Nürnberg, Germany

    Günter Büren

  4. Département de génie logiciel et des TI, École de technologie supérieure, Université du Québec, 1100, rue Notre-Dame Ouest, H3C 1K3, Montréal, Québec, Canada

    Alain Abran

  5. University of Alcalá, Autovia A-2 km 33.6, 28871, Alcalá de Henares, Madrid, Spain

    Juan J. Cuadrado-Gallego

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Hampp, T. (2008). First Steps towards Validating a Cost-Benefit Model of Reviews and Tests. In: Dumke, R.R., Braungarten, R., Büren, G., Abran, A., Cuadrado-Gallego, J.J. (eds) Software Process and Product Measurement. Mensura MetriKon IWSM 2008 2008 2008. Lecture Notes in Computer Science, vol 5338. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89403-2_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-89403-2_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-89402-5

  • Online ISBN: 978-3-540-89403-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics