{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,1,11]],"date-time":"2025-01-11T17:18:51Z","timestamp":1736615931080,"version":"3.32.0"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2006,10,20]],"date-time":"2006-10-20T00:00:00Z","timestamp":1161302400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Empir Software Eng"],"published-print":{"date-parts":[[2006,11,20]]},"DOI":"10.1007\/s10664-006-9024-2","type":"journal-article","created":{"date-parts":[[2006,10,19]],"date-time":"2006-10-19T09:28:39Z","timestamp":1161250119000},"page":"583-611","source":"Crossref","is-referenced-by-count":68,"title":["An evaluation of combination strategies for test case selection"],"prefix":"10.1007","volume":"11","author":[{"given":"Mats","family":"Grindal","sequence":"first","affiliation":[]},{"given":"Birgitta","family":"Lindstr\u00f6m","sequence":"additional","affiliation":[]},{"given":"Jeff","family":"Offutt","sequence":"additional","affiliation":[]},{"given":"Sten F.","family":"Andler","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2006,10,20]]},"reference":[{"key":"9024_CR1","doi-asserted-by":"crossref","unstructured":"Ammann P, Offutt AJ (1994) Using formal methods to derive test frames in category-partition testing. Proceedings of the Ninth Annual Conference on Computer Assurance (COMPASS\u201994), Gaithersburg MD, IEEE Computer Society Press, pp\u00a069\u201380","DOI":"10.1109\/CMPASS.1994.318466"},{"key":"9024_CR2","unstructured":"Anderson T, Avizienis A, Carter W, Costes A, Christian F, Koga Y, Kopetz H, Lala J, Laprie J, Meyer, J Randell B, Robinson A (1994) Dependability: basic concepts and terminology. Technical report, IFIP. WG 10.4"},{"key":"9024_CR3","unstructured":"Archibald R (1992) Managing high-technology programs and projects. John Wiley and Sons, Inc."},{"key":"9024_CR4","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1002\/(SICI)1099-1689(199709)7:3<139::AID-STVR136>3.0.CO;2-R","volume":"7","author":"R Bache","year":"1997","unstructured":"Bache R (1997) The effect of fault size on testing. The Journal of Software Testing, Verification, and Reliability 7:\u00a0139\u2013152","journal-title":"The Journal of Software Testing, Verification, and Reliability"},{"issue":"6","key":"9024_CR5","doi-asserted-by":"crossref","first-page":"758","DOI":"10.1109\/32.6156","volume":"SE-14","author":"VR Basili","year":"1988","unstructured":"Basili VR, Rombach HD (1988) The TAME project: Towards improvement-oriented software environments. IEEE Transactions on Software Engineering SE-14(6):\u00a0758\u2013773","journal-title":"IEEE Transactions on Software Engineering"},{"issue":"12","key":"9024_CR6","doi-asserted-by":"crossref","first-page":"1278","DOI":"10.1109\/TSE.1987.232881","volume":"SE-13","author":"V Basili","year":"1987","unstructured":"Basili V, Selby R (1987) Comparing the effectiveness of software testing strategies. IEEE Transactions on Software Engineering SE-13(12):\u00a01278\u20131296","journal-title":"IEEE Transactions on Software Engineering"},{"key":"9024_CR7","unstructured":"Basili V, Shull F, Lanubile F (1999) Using experiments to build a body of knowledge. Perspectives of System Informatics, Third International Andrei Ershov Memorial Conference (PSI 99). Akademgorodok, Novosibirsk, Russia, 6-9 July 1999, Proceedings, pp\u00a0265\u2013282"},{"key":"9024_CR8","doi-asserted-by":"crossref","unstructured":"Briand L, Pfahl D (1999) Using simulation for assessing the real impact of test coverage on defect coverage. Proceedings of the International Conference on Software Maintenance (ICSM99), Oxford, The UK, 30th of Aug - 3rd Sept 1999, pp\u00a0475\u2013482","DOI":"10.1109\/ISSRE.1999.809319"},{"issue":"3","key":"9024_CR9","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1002\/j.1538-7305.1992.tb00164.x","volume":"71","author":"R Brownlie","year":"1992","unstructured":"Brownlie R, Prowse J, Phadke M (1992) Robust testing of AT&T PMX\/StarMAIL using OATS. AT&T technical Journal 71(3):\u00a041\u201347","journal-title":"AT&T technical Journal"},{"key":"9024_CR10","unstructured":"Burr K, Young W (1998) Combinatorial test techniques: Table-based automation, test generation and code coverage. Proceedings of the International Conference on Software Testing, Analysis, and Review (STAR\u201998). San Diego, CA, USA, pp\u00a026\u201328"},{"key":"9024_CR11","doi-asserted-by":"crossref","unstructured":"Cohen D, Dalal S, Kajla A, Patton G (1994) The automatic efficient test generator (AETG) system. Proceedings of Fifth International Symposium on Software Reliability Engineering (ISSRE\u201994), Los Alamitos, California, USA, 6-9 November 1994, IEEE Computer Society, pp\u00a0303\u2013309","DOI":"10.1109\/ISSRE.1994.341392"},{"issue":"5","key":"9024_CR12","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1109\/52.536462","volume":"13","author":"D Cohen","year":"1996","unstructured":"Cohen D, Dalal S, Parelius J, Patton G (1996) The combinatorial design approach to automatic test generation. IEEE Software 13(5):\u00a083\u201389","journal-title":"IEEE Software"},{"issue":"7","key":"9024_CR13","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1109\/32.605761","volume":"23","author":"D Cohen","year":"1997","unstructured":"Cohen D, Dalal S, Fredman M, Patton G (1997) The AETG System: An approach to testing based on combinatorial design. IEEE Transactions on Software Engineering 23(7):\u00a0437\u2013444","journal-title":"IEEE Transactions on Software Engineering"},{"key":"9024_CR14","doi-asserted-by":"crossref","unstructured":"Cohen M, Gibbons P, Mugridge W, Colburn C (2003) Constructing test cases for interaction testing, Proceedings of the 25th International Conference on Software Engineering, (ICSE\u201903), Portland, Oregon, USA, 3-10 May 2003, IEEE Computer Society, pp\u00a038\u201348","DOI":"10.1109\/ICSE.2003.1201186"},{"issue":"3","key":"9024_CR15","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1080\/00401706.1998.10485524","volume":"50","author":"S Dalal","year":"1998","unstructured":"Dalal S, Mallows C (1998) Factor-covering designs for testing software. Technometrics 50(3): 234\u2013243","journal-title":"Technometrics"},{"key":"9024_CR16","doi-asserted-by":"crossref","unstructured":"Dunietz I, Ehrlich W, Szablak B, Mallows C, Iannino A (1997) Applying design of experiments to software testing. Proceedings of 19th International Conference on Software Engineering (ICSE\u201997). Boston, MA, USA 1997, ACM, pp\u00a0205\u2013215","DOI":"10.1145\/253228.253271"},{"key":"9024_CR17","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1109\/32.707695","volume":"24","author":"P Frankl","year":"1998","unstructured":"Frankl P, Hamlet R, Littlewood B, Stringini L (1998) Evaluating testing methods by delivered reliability. IEEE Transactions on Software Engineering 24:\u00a0586\u2013601","journal-title":"IEEE Transactions on Software Engineering"},{"key":"9024_CR18","unstructured":"Grindal M, Lindstr\u00f6m B, Offutt AJ, Andler SF (2003) An evaluation of combination strategies for test case selection. Technical Report. Technical Report HS-IDA-TR-03-001. Department of Computer Science, University of Sk\u00f6vde"},{"issue":"3","key":"9024_CR19","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1002\/stvr.319","volume":"15","author":"M Grindal","year":"2005","unstructured":"Grindal M, Offutt AJ, Andler SF (2005) Combination testing strategies: A survey. Software Testing, Verification, and Reliability 15(3):\u00a0167\u2013199","journal-title":"Software Testing, Verification, and Reliability"},{"key":"9024_CR20","unstructured":"Harman M, Hierons R, Holocombe M, Jones B, Reid S, Roper M, Woodward, M (1999) Towards a maturity model for empirical studies of software testing. Proceedings of the 5th Workshop on Empirical Studies of Software Maintenance (WESS\u201999). Keble College, Oxford, UK"},{"key":"9024_CR21","doi-asserted-by":"crossref","unstructured":"Kamsties E, Lott C (1995a) An empirical evaluation of three defect detection techniques. Technical Report ISERN 95-02. Dept of Computer Science, University of Kaiserslauten","DOI":"10.1007\/3-540-60406-5_25"},{"key":"9024_CR22","doi-asserted-by":"crossref","unstructured":"Kamsties E, Lott C (1995b) An empirical evaluation of three defect detection techniques. Proceedings of the 5th European Software Engineering Conference (ESEC95). Sitges, Barcelona, Spain, 25-28 September 1995","DOI":"10.1007\/3-540-60406-5_25"},{"key":"9024_CR23","doi-asserted-by":"crossref","unstructured":"Kropp N, Koopman P, Siewiorek D (1998) Automated robustness testing of off-the-shelf software components. Proceedings of FTCS\u201998: Fault Tolerant Computing Symposium, 23\u201325 June 1998 Munich, Germany. IEEE, pp\u00a0230\u2013239","DOI":"10.1109\/FTCS.1998.689474"},{"key":"9024_CR24","doi-asserted-by":"crossref","unstructured":"Lei Y, Tai K (1998) In-parameter-order: A test generation strategy for pair-wise testing. Proceedings of the third IEEE High Assurance Systems Engineering Symposium, IEEE, pp\u00a0254\u2013261","DOI":"10.1109\/HASE.1998.731623"},{"key":"9024_CR25","unstructured":"Lei Y, Tai K (2001) A test generation strategy for pairwise testing. Technical Report TR-2001-03. Department of Computer Science, North Carolina State University, Raleigh"},{"key":"9024_CR26","doi-asserted-by":"crossref","unstructured":"Lindstr\u00f6m B, Grindal M, Offutt J (2004) Using an existing suite of test objects: Experience from a testing experiment. Workshop on Empirical Research in Software Testing, ACM SIGFOST Software Engineering Notes. Boston, MA, USA","DOI":"10.1145\/1022494.1022535"},{"key":"9024_CR27","unstructured":"Lott C (n.d.) A repeatable software experiment. URL: www.chris-lott.org\/work\/exp\/"},{"issue":"3","key":"9024_CR28","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1007\/BF00127447","volume":"1","author":"C Lott","year":"1996","unstructured":"Lott C, Rombach H (1996) Repeatable software engineering experiments for comparing defect-detection techniques. Journal of Empirical Software Engineering 1(3):\u00a0241\u2013277","journal-title":"Journal of Empirical Software Engineering"},{"issue":"10","key":"9024_CR29","doi-asserted-by":"crossref","first-page":"1054","DOI":"10.1145\/4372.4375","volume":"28","author":"R Mandl","year":"1985","unstructured":"Mandl R (1985) Orthogonal latin squares: An application of experiment design to compiler testing. Communications of the ACM 28(10):\u00a01054\u20131058","journal-title":"Communications of the ACM"},{"issue":"1","key":"9024_CR30","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1016\/0950-5849(94)00456-3","volume":"37","author":"J Miller","year":"1995","unstructured":"Miller J, Roper M, Wood M, Brooks A (1995) Towards a benchmark for the evaluation of software testing techniques. Information and Software Technology 37(1):\u00a05\u201313","journal-title":"Information and Software Technology"},{"key":"9024_CR31","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/52.199724","volume":"10","author":"J Musa","year":"1993","unstructured":"Musa J (1993) Operational profiles in software-reliability engineering. IEEE Software 10:\u00a014\u201332","journal-title":"IEEE Software"},{"key":"9024_CR32","unstructured":"Myers G (1979) The Art of Software Testing, John Wiley and Sons"},{"key":"9024_CR33","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1109\/TSE.1984.5010308","volume":"SE-10","author":"SC Ntafos","year":"1984","unstructured":"Ntafos SC (1984) On required element testing. IEEE Transactions on Software Engineering SE-10: 795\u2013803","journal-title":"IEEE Transactions on Software Engineering"},{"key":"9024_CR34","doi-asserted-by":"crossref","unstructured":"Offutt AJ, Hayes JH (1996) A semantic model of program faults. Proceedings of the 1996 International Symposium on Software Testing, and Analysis. ACM Press, San Diego, CA, pp\u00a0195\u2013200","DOI":"10.1145\/229000.226317"},{"key":"9024_CR35","doi-asserted-by":"crossref","unstructured":"Offutt AJ, Xiong Y, Liu S (1999) Criteria for generating specification-based tests. Fifth IEEE International Conference on Engineering of Complex Systems (ICECCS\u201999). Las Vegas NV, IEEE, pp\u00a0119\u2013129","DOI":"10.1109\/ICECCS.1999.802856"},{"issue":"6","key":"9024_CR36","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1145\/62959.62964","volume":"31","author":"T Ostrand","year":"1988","unstructured":"Ostrand T, Balcer M (1988) The category-partition method for specifying and generating functional tests. Communications of the ACM 31(6):\u00a0676\u2013686","journal-title":"Communications of the ACM"},{"key":"9024_CR37","doi-asserted-by":"crossref","unstructured":"Piwowarski P, Ohba M, Caruso, J (1993) Coverge measure experience during function test. Proceedings of 14th International Conference on Software Engineering (ICSE\u201993). Los Alamitos, CA, USA 1993, ACM, pp\u00a0287\u2013301","DOI":"10.1109\/ICSE.1993.346035"},{"key":"9024_CR38","doi-asserted-by":"crossref","unstructured":"Reid S (1997) An empirical analysis of equivalence partitioning, boundary value analysis and random testing. Proceedings of the 4th International Software Metrics Symposium (METRICS\u201997), Albaquerque, New Mexico, USA, 5\u20137 Nov 1997, IEEE, pp\u00a064\u201373","DOI":"10.1109\/METRIC.1997.637166"},{"key":"9024_CR39","doi-asserted-by":"crossref","unstructured":"Shiba T, Tsuchiya T, Kikuno T ( 2004) Using artificial life techniques to generate test cases for combinatorial testing. Proceedings of 28th Annual International Computer Software and Applications Conference (COMPSAC\u201904) 2004. Hong Kong, China, IEEE Computer Society, 28\u201330 September 2004, pp\u00a072\u201377","DOI":"10.1109\/CMPSAC.2004.1342808"},{"issue":"3","key":"9024_CR40","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1002\/stvr.248","volume":"12","author":"S So","year":"2002","unstructured":"So S, Cha S, Shimeall T, Kwon Y (2002) An empirical evaluation of six methods to detect faults in software. Software Testing, Verification and Reliability 12(3):\u00a0155\u2013171","journal-title":"Software Testing, Verification and Reliability"},{"issue":"4","key":"9024_CR41","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1142\/S021853930100058X","volume":"8","author":"DR Wallace","year":"2001","unstructured":"Wallace DR, Kuhn D (2001) Failure modes in medical device software: An analysis of 15 years of recall data. International Journal of Reliability, Quality, and Safety Engineering 8(4): 351\u2013371","journal-title":"International Journal of Reliability, Quality, and Safety Engineering"},{"key":"9024_CR42","doi-asserted-by":"crossref","unstructured":"Williams A (2000) Determination of test configurations for pair-wise interaction coverage. Proceedings of the 13th International Conference on the Testing of Communicating Systems (TestCom 2000). Ottawa, Canada, August 2000, pp\u00a059\u201374","DOI":"10.1007\/978-0-387-35516-0_4"},{"key":"9024_CR43","doi-asserted-by":"crossref","unstructured":"Williams A, Probert R (1996) A practical strategy for testing pair-wise coverage of network interfaces. Proceedings of the 7th International Symposium on Software Reliability Engineering (ISSREt\u201996). White Plains, New York, USA, Oct 30 \u2013 Nov 2 1996, pp 246\u2013254","DOI":"10.1109\/ISSRE.1996.558835"},{"key":"9024_CR44","doi-asserted-by":"crossref","unstructured":"Wood M, Roper M, Brooks A, Miller J (1997) Comparing and combining software defect detection techniques: A replicated study. Proceedings of the Sixth European Software Engineerng Conference (ESEC\/FSE 97). Lecture Notes in Computer Science Nr. 1013, Springer Verlag, pp 262\u2013277","DOI":"10.1145\/267896.267915"},{"key":"9024_CR45","doi-asserted-by":"crossref","unstructured":"Woodward MR, Al-Khanjari ZA (2000) Testability, fault size and the domain-to-range ratio: An eternal triangle. Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis (ISSTA \u201900). ACM Press, Portland, Oregon, USA, pp\u00a0168\u2013172","DOI":"10.1145\/347324.349016"},{"key":"9024_CR46","unstructured":"Yin H, Lebne-Dengel Z, Malaiya Y (1997) Automatic test generation using checkpoint encoding and antirandom testing. Technical Report CS-97-116. Colorado State University"},{"issue":"4","key":"9024_CR47","first-page":"39","volume":"1","author":"S Zweben","year":"1992","unstructured":"Zweben S, Heym W (1992) Systematic Testing of Data Abstractions Based on Software Specifications. Journal of Software Testing, Verification, and Reliability 1(4):\u00a039\u201355","journal-title":"Journal of Software Testing, Verification, and Reliability"}],"container-title":["Empirical Software Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-006-9024-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10664-006-9024-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10664-006-9024-2","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,11]],"date-time":"2025-01-11T16:36:23Z","timestamp":1736613383000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10664-006-9024-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,10,20]]},"references-count":47,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2006,11,20]]}},"alternative-id":["9024"],"URL":"https:\/\/doi.org\/10.1007\/s10664-006-9024-2","relation":{},"ISSN":["1382-3256","1573-7616"],"issn-type":[{"type":"print","value":"1382-3256"},{"type":"electronic","value":"1573-7616"}],"subject":[],"published":{"date-parts":[[2006,10,20]]}}}