{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,12]],"date-time":"2024-09-12T11:58:40Z","timestamp":1726142320205},"reference-count":220,"publisher":"Wiley","issue":"5","license":[{"start":{"date-parts":[[2021,5,20]],"date-time":"2021-05-20T00:00:00Z","timestamp":1621468800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["incose.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Systems Engineering"],"published-print":{"date-parts":[[2021,9]]},"abstract":"Abstract<\/jats:title>Product development efforts now more than ever are in need of methodologies that can address the challenges of increased system complexities, shortening time to market, increased demands in mass customization, market instabilities, geographical barriers, improved innovation, and adaptability to emerging technologies. To address these challenges most companies will need to make key decisions early in the product development life\u2010cycle. In this early phase there are high levels of information uncertainty and information ambiguity. Under these circumstances many companies will converge too early to a point design (Point Based Design\u2014PBD) which will lead to increased cost and schedule delays due to reworking the design later in the product development life cycle. To overcome these challenges many researchers have proposed the Set\u2010Based Design (SBD) methodology. However, there has been limited guidance on how to define, reason, and narrow sets while improving the level of abstraction of the design. To address such concerns, a literature review was conducted. The contributions of this research include: (1) aggregated literature from over 100 sources on quantitative methods (QM) that has not been considered SBD but does support set\u2010based thinking, (2) consolidated body of knowledge on QM to help industrial practitioners implement SBD, (3) \u200bdefined gaps and opportunities for future research, and (4) defined strengths and limitations of QM and techniques to define, reason and narrow sets.<\/jats:p>","DOI":"10.1002\/sys.21580","type":"journal-article","created":{"date-parts":[[2021,5,20]],"date-time":"2021-05-20T13:04:32Z","timestamp":1621515872000},"page":"269-292","update-policy":"http:\/\/dx.doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Survey on set\u2010based design (SBD) quantitative methods"],"prefix":"10.1002","volume":"24","author":[{"ORCID":"http:\/\/orcid.org\/0000-0001-8082-4250","authenticated-orcid":false,"given":"Shawn","family":"Dullen","sequence":"first","affiliation":[{"name":"Combat Capabilities Development Command (CCDC) Armaments Center Picatinny Arsenal New Jersey USA"}]},{"given":"Dinesh","family":"Verma","sequence":"additional","affiliation":[{"name":"Systems Engineering Research Center (SERC) Stevens Institute of Technology Hoboken New Jersey USA"}]},{"given":"Mark","family":"Blackburn","sequence":"additional","affiliation":[{"name":"Systems Engineering Research Center (SERC) Stevens Institute of Technology Hoboken New Jersey USA"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-9569-5295","authenticated-orcid":false,"given":"Cliff","family":"Whitcomb","sequence":"additional","affiliation":[{"name":"Systems Engineering Department U.S. Naval Postgraduate School Monterey California USA"}]}],"member":"311","published-online":{"date-parts":[[2021,5,20]]},"reference":[{"key":"e_1_2_7_2_1","doi-asserted-by":"crossref","unstructured":"BORCHANIMF et al. \"Mechatronic System Design using Model\u2010Based Systems Engineering and Set\u2010Based Concurrent Engineering Principles \"2018 12th France\u2010Japan and 10th Europe\u2010Asia Congress on Mechatronics 2018 pp. 32\u201038 doi: 10.1109\/MECATRONICS.2018.8495824.","DOI":"10.1109\/MECATRONICS.2018.8495824"},{"key":"e_1_2_7_3_1","volume-title":"Contracting Considerations for Agile Solutions Key Agile Concepts and Sample Work Statement Language","author":"(DoD) DoD","year":"2019"},{"key":"e_1_2_7_4_1","volume-title":"Set\u2010Based Product Development in the Manufacturing Industry","author":"Schuh G","year":"2016"},{"key":"e_1_2_7_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0263-2373(98)00073-5"},{"key":"e_1_2_7_6_1","volume-title":"Paper presented at: ICED17: 21st International Conference on Engineering Design","author":"James TJY","year":"2017"},{"key":"e_1_2_7_7_1","volume-title":"Trends in Nunn\u2010McCurdy Breaches and Tools to Manage Weapon Systems Acquisition Costs","author":"GAO","year":"2011"},{"key":"e_1_2_7_8_1","volume-title":"Product Development Cycle Time Characterization Through Modeling of Process Iteration","author":"Osborne SM","year":"1993"},{"key":"e_1_2_7_9_1","volume-title":"Positive vs Negative Iteration in Design","author":"Ballard G","year":"2000"},{"key":"e_1_2_7_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/sys.21269"},{"key":"e_1_2_7_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2019.05.062"},{"key":"e_1_2_7_12_1","volume-title":"DoD Instruction 5000.02: Operation of the Defense Acquisition System: Author","author":"Defense Do","year":"2015"},{"key":"e_1_2_7_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/0923-4748(93)90059-R"},{"key":"e_1_2_7_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2013.11.017"},{"key":"e_1_2_7_15_1","volume-title":"Considering Shared Epistemic Uncertainty in Set\u2010Based Design","author":"Rekuc SJ","year":"2005"},{"key":"e_1_2_7_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1559-3584.2009.00226.x"},{"key":"e_1_2_7_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00170-004-2463-2"},{"issue":"2","key":"e_1_2_7_18_1","first-page":"67","article-title":"Toyota's principles of set\u2010based concurrent engineering","volume":"40","author":"Sobek DK","year":"1999","journal-title":"MIT Sloan Management Review"},{"key":"e_1_2_7_19_1","volume-title":"Iteration in Engineering Design: Inherent and Unavoidable or Product of Choices Made?","author":"Costa R","year":"2003"},{"key":"e_1_2_7_20_1","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.13.4.402.2948"},{"key":"e_1_2_7_21_1","doi-asserted-by":"publisher","DOI":"10.1080\/01446190600658529"},{"key":"e_1_2_7_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1559-3584.2011.00331.x"},{"key":"e_1_2_7_23_1","unstructured":"ParsonsMG SingerDJ.A hybrid agent approach for set\u2010basedconceptual ship design. Paper presented at: 10th International Conference onComputer Applications in Shipbuilding (ICCAS) 1999."},{"key":"e_1_2_7_24_1","doi-asserted-by":"publisher","DOI":"10.1115\/DETC2014-35597"},{"key":"e_1_2_7_25_1","doi-asserted-by":"publisher","DOI":"10.1177\/1063293X13495220"},{"key":"e_1_2_7_26_1","volume-title":"Enabling Set\u2010Based Concurrent Engineering in Traditional Product Development","author":"Raudberget DS","year":"2011"},{"key":"e_1_2_7_27_1","article-title":"Trade\u2010off analytics for set based design","author":"Specking E","year":"2017","journal-title":"Design Sciences Series: Set Based Design"},{"key":"e_1_2_7_28_1","doi-asserted-by":"crossref","volume-title":"Reducing Design Rework using Set\u2010based Design in a Model Centric Environment","author":"Dullen S","DOI":"10.1007\/978-3-030-82083-1_18"},{"key":"e_1_2_7_29_1","volume-title":"A Theory of Quantitative Inference for Artifact Sets, Applied to a Mechanical Design Compiler","author":"Ward AC","year":"1989"},{"key":"e_1_2_7_30_1","volume-title":"DTM at 25: Essays on Themes and Future Directions","author":"Braha D","year":"2013"},{"key":"e_1_2_7_31_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.2919320"},{"key":"e_1_2_7_32_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022947329200"},{"key":"e_1_2_7_33_1","doi-asserted-by":"publisher","DOI":"10.1115\/DETC97\/DTM-3886"},{"key":"e_1_2_7_34_1","first-page":"43\u201043","article-title":"The second Toyota paradox: how delaying decisions can make better cars faster","volume":"36","author":"Ward A","year":"1995","journal-title":"Sloan Management Review"},{"issue":"1","key":"e_1_2_7_35_1","first-page":"47\u201054","article-title":"Extending the constraint propagation of intervals","volume":"4","author":"Ward AC","year":"1990","journal-title":"AI EDAM"},{"key":"e_1_2_7_36_1","doi-asserted-by":"publisher","DOI":"10.1115\/DETC1991-0058"},{"key":"e_1_2_7_37_1","first-page":"279","volume-title":"In Pursuit of a Design Mathematics: Generalizing the Labeled Interval Calculus","author":"Habib W","year":"1991"},{"issue":"3","key":"e_1_2_7_38_1","first-page":"231","article-title":"Generalized set\u2010propagation operations over relations of more than three variables","volume":"9","author":"Finch WW","year":"1995","journal-title":"AI EDAM"},{"issue":"5","key":"e_1_2_7_39_1","first-page":"409","article-title":"Generalized set propagation operations for concurrent engineering","volume":"11","author":"Habib WE","year":"1997","journal-title":"AI EDAM"},{"key":"e_1_2_7_40_1","volume-title":"Quantified Relations: a Class of Predicate Logic Design Constraints Among Sets of Manufacturing, Operating, and Other Variations","author":"Finch WW","year":"1996"},{"key":"e_1_2_7_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/17.509982"},{"key":"e_1_2_7_42_1","volume-title":"Lean Product and Process Development","author":"Ward AC","year":"2007"},{"key":"e_1_2_7_43_1","volume-title":"Product Development for the Lean Enterprise: Why Toyota's System is Four Times More Productive and How You can Implement it","author":"Kennedy MN","year":"2003"},{"key":"e_1_2_7_44_1","volume-title":"Ready, Set, Dominate: Implement Toyota's Set\u2010Based Learning for Developing Products and Nobody can Catch you","author":"Kennedy M","year":"2008"},{"key":"e_1_2_7_45_1","doi-asserted-by":"publisher","DOI":"10.4324\/9781482293746"},{"key":"e_1_2_7_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-85729-024-3_33"},{"key":"e_1_2_7_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/SysEng.2017.8088290"},{"key":"e_1_2_7_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2011.12.008"},{"issue":"11","key":"e_1_2_7_49_1","first-page":"685","article-title":"Practical applications of set\u2010based concurrent engineering in industry","volume":"56","author":"Raudberget D","year":"2010","journal-title":"Strojniski Vestnik"},{"key":"e_1_2_7_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00163-017-0262-7"},{"key":"e_1_2_7_51_1","volume-title":"Applying Set Based Methodology in Submarine Concept Design","author":"Frye MC","year":"2010"},{"key":"e_1_2_7_52_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1559-3584.2011.00332.x"},{"key":"e_1_2_7_53_1","volume-title":"Implementing Set\u2010Based Design in DOD Acquisitions","author":"Doerry N","year":"2019"},{"key":"e_1_2_7_54_1","article-title":"Set\u2010based design","author":"Singer D","year":"2017","journal-title":"SNAME T&R Bulletin"},{"key":"e_1_2_7_55_1","unstructured":"GuminaJM.A Set\u2010Based Approach to Systems Design. Naval Postgraduate School;2019."},{"key":"e_1_2_7_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-85729-799-0_51"},{"key":"e_1_2_7_57_1","volume-title":"The Construction of a Model for lean Product Development","author":"Khan MS","year":"2012"},{"key":"e_1_2_7_58_1","volume-title":"Preliminary Design Enhancement by Incorporating Set\u2010Based Design Principles and a Navigator","author":"Dobrovolskyte N","year":"2015"},{"key":"e_1_2_7_59_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procir.2016.04.194"},{"key":"e_1_2_7_60_1","doi-asserted-by":"publisher","DOI":"10.1177\/1063293X14537654"},{"key":"e_1_2_7_61_1","first-page":"399","volume-title":"Combining Set\u2010Based Concurrent Engineering and Function\u2014Means Modelling to Manage Platform\u2010Based Product Family Design","author":"Raudberget DS","year":"2014"},{"key":"e_1_2_7_62_1","doi-asserted-by":"publisher","DOI":"10.1017\/dsi.2019.243"},{"key":"e_1_2_7_63_1","doi-asserted-by":"publisher","DOI":"10.1080\/09544828.2013.780201"},{"issue":"2","key":"e_1_2_7_64_1","first-page":"51","article-title":"Literature review: exploring the role of set\u2010based design in trade\u2010off analytics","volume":"130","author":"Specking EA","year":"2018","journal-title":"Naval Engineers Journal"},{"key":"e_1_2_7_65_1","doi-asserted-by":"publisher","DOI":"10.1017\/dsj.2020.16"},{"key":"e_1_2_7_66_1","doi-asserted-by":"publisher","DOI":"10.1002\/sys.21549"},{"key":"e_1_2_7_67_1","volume-title":"Extension of Set\u2010Based Inference Mechanism for Predicate Logic Design Constraints with an Application to Automotive Power Window Design","author":"Seshan AV","year":"2000"},{"key":"e_1_2_7_68_1","doi-asserted-by":"publisher","DOI":"10.1177\/1063293X07083083"},{"key":"e_1_2_7_69_1","volume-title":"A New Framework for Collaborative Set\u2010Based Design: Application to the Design Problem of a Hollow Cylindrical Cantilever Beam","author":"Canbaz B","year":"2011"},{"key":"e_1_2_7_70_1","volume-title":"Constraint Satisfaction, Databases, and Logic","author":"Kolaitis PG","year":"2003"},{"key":"e_1_2_7_71_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-2217(98)00364-6"},{"key":"e_1_2_7_72_1","first-page":"7","article-title":"Constraint programming: what is behind","author":"Bart\u00e1k R","year":"1999","journal-title":"Proceedings of the Workshop on Constraint Programming in Decision and Control"},{"key":"e_1_2_7_73_1","volume-title":"Artificial Intelligence: a Modern Approach","author":"Russell SJ","year":"2016"},{"key":"e_1_2_7_74_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(77)90007-8"},{"key":"e_1_2_7_75_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2010.02.003"},{"key":"e_1_2_7_76_1","volume-title":"The Computational Complexity of Quantified Constraint Satisfaction","author":"Chen HM","year":"2004"},{"key":"e_1_2_7_77_1","doi-asserted-by":"publisher","DOI":"10.1504\/IJPD.2014.060037"},{"key":"e_1_2_7_78_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00366-012-0262-1"},{"key":"e_1_2_7_79_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.4034581"},{"key":"e_1_2_7_80_1","volume-title":"Data Domain Description Using Support Vectors","author":"Tax DM","year":"1999"},{"key":"e_1_2_7_81_1","volume-title":"Paper presented at: Fourth ISPE International Conference on Concurrent Engineering, ISPE\/CE97","author":"Parunak HV","year":"1997"},{"key":"e_1_2_7_82_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0890060499133079"},{"key":"e_1_2_7_83_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.4026034"},{"key":"e_1_2_7_84_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8640.1988.tb00284.x"},{"key":"e_1_2_7_85_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.364485"},{"key":"e_1_2_7_86_1","volume-title":"Fuzzy Logic with Engineering Applications","author":"Ross TJ","year":"2005"},{"key":"e_1_2_7_87_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0019-9958(65)90241-X"},{"key":"e_1_2_7_88_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.17.4.B141"},{"key":"e_1_2_7_89_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01223303"},{"key":"e_1_2_7_90_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00170-004-2213-5"},{"key":"e_1_2_7_91_1","doi-asserted-by":"publisher","DOI":"10.1177\/1063293X05053797"},{"key":"e_1_2_7_92_1","doi-asserted-by":"crossref","unstructured":"Chen W & Yuan C. \"A Probabilistic\u2010Based Design Model for Achieving Flexibility in Design.\" Proceedings of the ASME 1997 Design Engineering Technical Conferences. Volume 3: 9th International Design Theory and Methodology Conference. Sacramento California USA. September 14\u201317 1997. V003T30A017.","DOI":"10.1115\/DETC97\/DTM-3882"},{"key":"e_1_2_7_93_1","volume-title":"Application of Sustainable Aspects to the Set\u2010Based Design Method","author":"Inoue M","year":"2010"},{"key":"e_1_2_7_94_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procir.2014.07.080"},{"key":"e_1_2_7_95_1","doi-asserted-by":"publisher","DOI":"10.1115\/IMECE2009-12714"},{"key":"e_1_2_7_96_1","doi-asserted-by":"crossref","unstructured":"ToyotaY KanaoS IokibeK Design of Vialess Open\u2010stub EBG Structure by Using Preference Set\u2010based Design Method. Paper presented at:2019 International Symposium on Electromagnetic Compatibility\u2010EMC EUROPE 2019.","DOI":"10.1109\/EMCEurope.2019.8871971"},{"key":"e_1_2_7_97_1","doi-asserted-by":"crossref","unstructured":"KayanoY MiyanagaK InoueH KamiY Application of the Preference Set\u2010based Design Method to Cantilever for Electrical Contact. Paper presented at:2018 IEEE Holm Conference on Electrical Contacts 2018.","DOI":"10.1109\/HOLM.2018.8611660"},{"key":"e_1_2_7_98_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-44511-1_24"},{"key":"e_1_2_7_99_1","unstructured":"IshikawaH NahmY Set\u2010based design support by using multiagent approach. Paper presented at:10th ISPE International Conference on Concurrent Engineering: Research and Applications Madeira Island Portugal 2003."},{"key":"e_1_2_7_100_1","volume-title":"A Hybrid Agent Approach For Set\u2010Based Conceptual Ship Design Through the Use of a Fuzzy Logic Agent to Facilitate Communications and Negotiation","author":"Singer DJ","year":"2004"},{"key":"e_1_2_7_101_1","doi-asserted-by":"publisher","DOI":"10.1002\/9780470599655.ch2"},{"key":"e_1_2_7_102_1","doi-asserted-by":"crossref","unstructured":"McKenneyT GrayA MadridC SingerD The use of a fuzzy logic set\u2010based design tool to evaluate varying complexities of late\u2010stage design changes.The Transactions of The Royal Institution of Naval Architects Volume 154 Part A4 International Journal of Maritime Engineering Paper: T2012\u20104 Transactions.2012.","DOI":"10.5750\/ijme.v154iA4.887"},{"key":"e_1_2_7_103_1","unstructured":"GrayAW Enhancement of Set\u2010Based Design Practices Via Introduction of Uncertainty Through Use of Interval Type\u20102 Modeling and General Type\u20102 Fuzzy Logic Agent Based Methods;2011."},{"key":"e_1_2_7_104_1","doi-asserted-by":"publisher","DOI":"10.1109\/TFUZZ.2017.2648882"},{"issue":"4","key":"e_1_2_7_105_1","first-page":"923\u2010934","article-title":"Enhanced karnik\u2013mendel algorithms","volume":"17","author":"Wu D","year":"2009","journal-title":"IEEE Transactions on Fuzzy Systems"},{"issue":"1","key":"e_1_2_7_106_1","first-page":"77\u201089","article-title":"A Hybrid agent type\u20101 fuzzy logic system for set\u2010based conceptual ship design communications and negotiations","volume":"128","author":"Gray AW","year":"2016","journal-title":"Naval Engineers Journal"},{"key":"e_1_2_7_107_1","first-page":"245","article-title":"Performance analysis through fuzzy logic in set\u2010based design","volume":"1","author":"Yuan H","year":"2018","journal-title":"Marine Design XIII"},{"key":"e_1_2_7_108_1","unstructured":"McKenneyTA.An Early\u2010Stage Set\u2010Based Design Reduction Decision Support Framework Utilizing Design Space Mapping and a Graph Theoretic Markov Decision Process Formulation.2013."},{"key":"e_1_2_7_109_1","doi-asserted-by":"crossref","unstructured":"ShahanDW.Bayesian network classifiers for set\u2010based collaborative design;2010.","DOI":"10.1115\/DETC2010-28724"},{"key":"e_1_2_7_110_1","unstructured":"BacklundPB.A classifier\u2010guided sampling method for early\u2010stage design of shipboard energy systems.2012."},{"key":"e_1_2_7_111_1","doi-asserted-by":"crossref","unstructured":"RosenDW.A set\u2010based design method for material\u2010geometry structures by design space mapping. Paper presented at:ASME 2015 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference 2015.","DOI":"10.1115\/DETC2015-46760"},{"key":"e_1_2_7_112_1","doi-asserted-by":"crossref","unstructured":"MorrisC SeepersadCC Efficient identification of promising regions in high\u2010dimensional design spaces with multilevel materials design applications. Paper presented at:ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference 2018.","DOI":"10.1115\/DETC2018-85273"},{"issue":"3","key":"e_1_2_7_113_1","article-title":"Supervised machine learning: a review of classification techniques","volume":"31","author":"Kotsiantis S","year":"2007","journal-title":"Informatica"},{"key":"e_1_2_7_114_1","unstructured":"ChengJ GreinerR.Comparing Bayesian network classifiers. Paper presented at:Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence 1999."},{"key":"e_1_2_7_115_1","doi-asserted-by":"crossref","unstructured":"KulkarniVY SinhaPK.Pruning of random forest classifiers: a survey and future directions. Paper presented at:2012 International Conference on Data Science & Engineering (ICDSE) 2012.","DOI":"10.1109\/ICDSE.2012.6282329"},{"key":"e_1_2_7_116_1","doi-asserted-by":"publisher","DOI":"10.1109\/5326.897072"},{"key":"e_1_2_7_117_1","doi-asserted-by":"publisher","DOI":"10.1145\/2576868"},{"key":"e_1_2_7_118_1","first-page":"149\u2010153","volume-title":"The Handbook of Brain Theory and Neural Networks","author":"Pearl J","year":"1995"},{"issue":"2","key":"e_1_2_7_119_1","first-page":"131\u2010163","article-title":"Bayesian network classifiers","volume":"29","author":"Friedman N","year":"1997","journal-title":"Machine learning"},{"key":"e_1_2_7_120_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2012.12.051"},{"key":"e_1_2_7_121_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csda.2019.02.004"},{"key":"e_1_2_7_122_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijar.2008.08.008"},{"key":"e_1_2_7_123_1","first-page":"60","article-title":"Naive bayes classifiers","volume":"18","author":"Murphy KP","year":"2006","journal-title":"University of British Columbia"},{"issue":"3","key":"e_1_2_7_124_1","first-page":"4","article-title":"On the effectiveness of parzen window classifier","volume":"2","author":"Sariinas R","year":"1991","journal-title":"Informatica"},{"key":"e_1_2_7_125_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.4006323"},{"key":"e_1_2_7_126_1","doi-asserted-by":"crossref","unstructured":"ShahanD SeepersadCC Sequential sampling with kernel\u2010based bayesian network classifiers. Paper presented at:ASME 2011 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference 2011.","DOI":"10.1115\/DETC2011-48318"},{"key":"e_1_2_7_127_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1749-6632.1960.tb42846.x"},{"key":"e_1_2_7_128_1","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1007\/978-94-015-7744-1_2","volume-title":"Simulated Annealing: Theory and Applications","author":"Van Laarhoven PJ","year":"1987"},{"key":"e_1_2_7_129_1","volume-title":"Practical Genetic Algorithms","author":"Haupt RL","year":"2004"},{"key":"e_1_2_7_130_1","doi-asserted-by":"crossref","unstructured":"ShahanDW BacklundPB SeepersadCC Classifier\u2010guided sampling for discrete variable discontinuous design space exploration. Paper presented at:ASME 2013 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference 2013.","DOI":"10.1115\/DETC2013-13138"},{"key":"e_1_2_7_131_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.4032774"},{"key":"e_1_2_7_132_1","doi-asserted-by":"crossref","unstructured":"MatthewsJ KlattT SeepersadCC HabermanM ShahanD.Bayesian network classifiers and design flexibility metrics for set\u2010based multiscale design with materials design applications. Paper presented at:ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference 2014.","DOI":"10.1115\/DETC2014-34436"},{"key":"e_1_2_7_133_1","doi-asserted-by":"crossref","unstructured":"MorrisC SeepersadCC HabermanMR.A set\u2010based method for multilevel design of materials and structures with manufacturing uncertainty. Paper presented at:ASME 2016 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference 2016.","DOI":"10.1115\/DETC2016-59401"},{"key":"e_1_2_7_134_1","doi-asserted-by":"crossref","unstructured":"MorrisC SeepersadCC.Identification of high performance regions of high\u2010dimensional design spaces with materials design applications. Paper presented at:ASME 2017 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference 2017.","DOI":"10.1115\/DETC2017-67769"},{"key":"e_1_2_7_135_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11222-007-9033-z"},{"key":"e_1_2_7_136_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2004.1262185"},{"key":"e_1_2_7_137_1","doi-asserted-by":"crossref","unstructured":"SharpeC MorrisC GoldsberryB SeepersadCC HabermanMR Bayesian network structure optimization for improved design space mapping for design exploration with materials design applications. Paper presented at:ASME 2017 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference 2017.","DOI":"10.1115\/DETC2017-67643"},{"key":"e_1_2_7_138_1","doi-asserted-by":"publisher","DOI":"10.1080\/0305215X.2014.908869"},{"key":"e_1_2_7_139_1","doi-asserted-by":"crossref","unstructured":"WiestT SeepersadCC HabermanM Design space exploration in sparse mixed continuous\/discrete spaces via synthetically enhanced classification. Paper presented at:ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference 2018.","DOI":"10.1115\/DETC2018-85274"},{"key":"e_1_2_7_140_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.953"},{"key":"e_1_2_7_141_1","unstructured":"Winterfeldt Detlof V and Ward Edwards.Evaluation of complex stimuli using multi\u2010attribute utility procedures. MICHIGAN UNIV ANN ARBOR ENGINEERING PSYCHOLOGY LAB 1973.https:\/\/apps.dtic.mil\/dtic\/tr\/fulltext\/u2\/770188.pdf"},{"key":"e_1_2_7_142_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511611308.014"},{"key":"e_1_2_7_143_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139174084"},{"key":"e_1_2_7_144_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.27.4.810"},{"key":"e_1_2_7_145_1","doi-asserted-by":"publisher","DOI":"10.2514\/1.9204"},{"key":"e_1_2_7_146_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cad.2008.06.004"},{"issue":"6","key":"e_1_2_7_147_1","first-page":"1949\u20101992","article-title":"Comparative statics, informativeness, and the interval dominance order","volume":"77","author":"QUAH JK\u2010H","year":"2009","journal-title":"Econometrica"},{"key":"e_1_2_7_148_1","doi-asserted-by":"crossref","unstructured":"DesterckeS.A decision rule for imprecise probabilities based on pair\u2010wise comparison of expectation bounds.2010:189\u2010197.","DOI":"10.1007\/978-3-642-14746-3_24"},{"key":"e_1_2_7_149_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.proeng.2017.01.249"},{"key":"e_1_2_7_150_1","volume-title":"Tools of Risk Management in Product Verification","author":"Zhang P","year":"2003"},{"key":"e_1_2_7_151_1","doi-asserted-by":"crossref","unstructured":"SmallC ParnellG PohlE et\u00a0al.Engineering resilience for complex systems.2018:3\u201015.","DOI":"10.1007\/978-3-319-62217-0_1"},{"key":"e_1_2_7_152_1","unstructured":"(DoD) DoD.Department of Defense instruction (DoDI) 5000.02: operation of the defense acquisition system;2015."},{"key":"e_1_2_7_153_1","doi-asserted-by":"publisher","DOI":"10.3390\/systems6040045"},{"key":"e_1_2_7_154_1","volume-title":"Convergent Set\u2010Based Design in Integrated Analysis of Alternatives: Designing Engineered Resilient Systems","author":"Wade Z","year":"2018"},{"key":"e_1_2_7_155_1","doi-asserted-by":"publisher","DOI":"10.1201\/b19628"},{"key":"e_1_2_7_156_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2019.05.052"},{"key":"e_1_2_7_157_1","doi-asserted-by":"publisher","DOI":"10.1177\/1548512919872822"},{"key":"e_1_2_7_158_1","volume-title":"Multi\u2010Objective Optimization Using Evolutionary Algorithms","author":"Deb K","year":"2001"},{"key":"e_1_2_7_159_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2014.08.071"},{"key":"e_1_2_7_160_1","article-title":"Nonlinear multiobjective optimization","volume":"12","author":"Miettinen K","year":"1999","journal-title":"International Series in Operations Research & Management Science"},{"key":"e_1_2_7_161_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-2217(97)00317-2"},{"key":"e_1_2_7_162_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1971.4308298"},{"key":"e_1_2_7_163_1","doi-asserted-by":"publisher","DOI":"10.1002\/9781118897072"},{"key":"e_1_2_7_164_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.4001345"},{"key":"e_1_2_7_165_1","doi-asserted-by":"crossref","unstructured":"ParkerRR MalakRJJr.Technology characterization models and their use in designing complex systems. Paper presented at:ASME 2011 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference 2011.https:\/\/doi.org\/10.1115\/DETC2011\u201048365","DOI":"10.1115\/DETC2011-48365"},{"key":"e_1_2_7_166_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2009.2016569"},{"key":"e_1_2_7_167_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.996017"},{"key":"e_1_2_7_168_1","doi-asserted-by":"crossref","unstructured":"HannapelS VlahopoulosN SingerD Including principles of set\u2010based design in multidisciplinary design optimization. Paper presented at:12th AIAA Aviation Technology Integration and Operations (ATIO) Conference and 14th AIAA\/ISSMO Multidisciplinary Analysis and Optimization Conference 2012.","DOI":"10.2514\/6.2012-5444"},{"key":"e_1_2_7_169_1","doi-asserted-by":"crossref","unstructured":"MoshaiovA SnirA SaminaBConcept\u2010based evolutionary exploration of design spaces by a resolution\u2010relaxation\u2010Pareto approach. Paper presented at: 2015 IEEE Congress on Evolutionary Computation (CEC); 25\u201328 May 2015 2015.","DOI":"10.1109\/CEC.2015.7257111"},{"key":"e_1_2_7_170_1","doi-asserted-by":"publisher","DOI":"10.2514\/2.2063"},{"key":"e_1_2_7_171_1","doi-asserted-by":"crossref","unstructured":"FarhiE MoshaiovA Window\u2010of\u2010interest based multi\u2010objective evolutionary search for satisficing concepts. Paper presented at:2017 IEEE International Conference on Systems Man and Cybernetics (SMC) 2017.","DOI":"10.1109\/SMC.2017.8123209"},{"key":"e_1_2_7_172_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2016.2634625"},{"key":"e_1_2_7_173_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8655(99)00087-2"},{"key":"e_1_2_7_174_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.4025960"},{"key":"e_1_2_7_175_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.4043201"},{"key":"e_1_2_7_176_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.advengsoft.2013.12.007"},{"key":"e_1_2_7_177_1","unstructured":"MistreeF The compromise decision support problem and the adaptivelinear programming algorithm.Progress in Astronautics and Aeronautics 1993;150."},{"key":"e_1_2_7_178_1","doi-asserted-by":"crossref","unstructured":"GurnaniAP LewisK An Approach to Improved Decentralized Design: The Modified Approximation\u2010Based Decentralized Design (MADD) Framework. Paper presented at: ASME 2007 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference 2007.","DOI":"10.1115\/DETC2007-35534"},{"key":"e_1_2_7_179_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02512227"},{"key":"e_1_2_7_180_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.3987"},{"key":"e_1_2_7_181_1","doi-asserted-by":"publisher","DOI":"10.1201\/9781439821091"},{"key":"e_1_2_7_182_1","article-title":"Deep reinforcement learning: an overview","author":"Li Y","year":"2017","journal-title":"arXiv preprint arXiv:170107274"},{"key":"e_1_2_7_183_1","volume-title":"Foundations of Adaptive Networks","author":"Barto AG","year":"1990"},{"key":"e_1_2_7_184_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.2838671"},{"key":"e_1_2_7_185_1","doi-asserted-by":"crossref","unstructured":"MillerSW SimpsonTW YukishMA Design as a sequential decision process: a method for reducing design set space using models to bound objectives. Paper presented at:ASME 2015 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference 2015.","DOI":"10.1115\/DETC2015-46909"},{"key":"e_1_2_7_186_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00158-017-1697-1"},{"key":"e_1_2_7_187_1","doi-asserted-by":"publisher","DOI":"10.1002\/sys.21449"},{"key":"e_1_2_7_188_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00158-018-2145-6"},{"key":"e_1_2_7_189_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"issue":"1","key":"e_1_2_7_190_1","first-page":"377\u2010383","article-title":"Multiattribute and Multi\u2010criteria Decision Making Model for technology selection using fuzzy logic","volume":"2","author":"Kalbande DR","year":"2009","journal-title":"International Journal of Computing Science and Communication Technologies"},{"issue":"2","key":"e_1_2_7_191_1","first-page":"56\u201066","article-title":"An analysis of multi\u2010criteria decision making methods","volume":"10","author":"Velasquez M","year":"2013","journal-title":"International Journal of Operations Research"},{"key":"e_1_2_7_192_1","doi-asserted-by":"crossref","unstructured":"HardyT.Fuzzy logic approaches to multi\u2010objective decision\u2010making in aerospace applications.Paper presented at: 30th Joint Propulsion Conference and Exhibit 1994.","DOI":"10.2514\/6.1994-3163"},{"key":"e_1_2_7_193_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecolmodel.2006.11.033"},{"key":"e_1_2_7_194_1","first-page":"1","article-title":"Applying fuzzy logic to risk assessment and decision\u2010making","author":"Shang K","year":"2013","journal-title":"Casualty Actuarial Society, Canadian Institute of Actuaries Society of Actuaries"},{"key":"e_1_2_7_195_1","doi-asserted-by":"crossref","unstructured":"CheungTL OkamotoK MakerIIIF LiuX AkellaV.Markov decision process (MDP) framework for optimizing software on mobile phones. Paper presented at:Proceedings of the seventh ACM international conference on Embedded software 2009.","DOI":"10.1145\/1629335.1629338"},{"key":"e_1_2_7_196_1","first-page":"1","article-title":"A method to efficiently localize non\u2010dominated regions using surrogate modeling with multi\u2010fidelity data from a sequential decision process","author":"Chhabra JP","year":"2019","journal-title":"Structural and Multidisciplinary Optimization"},{"key":"e_1_2_7_197_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclepro.2012.10.048"},{"issue":"1","key":"e_1_2_7_198_1","first-page":"55\u201063","article-title":"Engineering reasoning in set\u2010based design","volume":"131","author":"Whitcomb C","year":"2019","journal-title":"Naval Engineers Journal"},{"key":"e_1_2_7_199_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.2334-5837.2008.tb00871.x"},{"key":"e_1_2_7_200_1","volume-title":"Design as a Sequential Decision Process: A Method for Reducing Set Space Using Models to Bound Objectives","author":"Miller SW","year":"2017"},{"key":"e_1_2_7_201_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11205-017-1832-9"},{"key":"e_1_2_7_202_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.4037623"},{"issue":"13","key":"e_1_2_7_203_1","first-page":"391\u2010418","article-title":"On indeterminate probabilities","volume":"71","author":"Levi I","year":"1975","journal-title":"The Journal of Philosophy"},{"key":"e_1_2_7_204_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6377(02)00189-X"},{"key":"e_1_2_7_205_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ress.2010.01.001"},{"key":"e_1_2_7_206_1","unstructured":"DoerryN EarnestyM WeaverC et\u00a0al.Using set\u2010based design in concept exploration.Paper presented at: SNAME Chesapeake Section Technical Meeting Army Navy Country Club Arlington VA 2014."},{"key":"e_1_2_7_207_1","doi-asserted-by":"publisher","DOI":"10.1061\/AJRUA6.0000816"},{"issue":"2005","key":"e_1_2_7_208_1","first-page":"1","article-title":"Quantile regression: overview and selected applications","volume":"4","author":"Buhai S","year":"2005","journal-title":"Ad Astra"},{"key":"e_1_2_7_209_1","volume-title":"Taguchi's Quality Engineering Handbook","author":"Taguchi G","year":"2005"},{"key":"e_1_2_7_210_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00158-004-0450-8"},{"key":"e_1_2_7_211_1","unstructured":"RossJE.Determining Feasibility Resilience: Set Based Design Iteration Evaluation Through Permutation Stability Analysis.2017."},{"key":"e_1_2_7_212_1","doi-asserted-by":"crossref","unstructured":"ToshonT SomanR WiegandC IsraelM FaruqueM SteurerM Set\u2010based design for naval shipboard power systems using pertinent metrics from product development tools. Paper presented at:2017 IEEE Electric Ship Technologies Symposium (ESTS) 2017.","DOI":"10.1109\/ESTS.2017.8069275"},{"key":"e_1_2_7_213_1","doi-asserted-by":"crossref","unstructured":"SimpsonTW RosenD AllenJK MistreeF.Metrics forassessing design freedom and information certainty in the early stages of design. Presented at:ASME 1996 Design Engineering Technical Conferences andComputers in Engineering Conference 1996.","DOI":"10.1115\/96-DETC\/DTM-1521"},{"key":"e_1_2_7_214_1","doi-asserted-by":"publisher","DOI":"10.1017\/dsj.2019.7"},{"key":"e_1_2_7_215_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.4036180"},{"key":"e_1_2_7_216_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEM.2017.2654223"},{"key":"e_1_2_7_217_1","doi-asserted-by":"publisher","DOI":"10.1002\/sys.21463"},{"key":"e_1_2_7_218_1","doi-asserted-by":"publisher","DOI":"10.1002\/sys.21481"},{"key":"e_1_2_7_219_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.2334-5837.2019.00608.x"},{"key":"e_1_2_7_220_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procir.2019.04.276"},{"key":"e_1_2_7_221_1","article-title":"SNAME T&R Bulletin No. 7\u201012","author":"Singer D","year":"2017","journal-title":"Set\u2010Based Design"}],"container-title":["Systems Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/sys.21580","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/sys.21580","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/sys.21580","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,25]],"date-time":"2023-08-25T20:50:25Z","timestamp":1692996625000},"score":1,"resource":{"primary":{"URL":"https:\/\/incose.onlinelibrary.wiley.com\/doi\/10.1002\/sys.21580"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,20]]},"references-count":220,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["10.1002\/sys.21580"],"URL":"https:\/\/doi.org\/10.1002\/sys.21580","archive":["Portico"],"relation":{},"ISSN":["1098-1241","1520-6858"],"issn-type":[{"value":"1098-1241","type":"print"},{"value":"1520-6858","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,20]]},"assertion":[{"value":"2020-12-18","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-12","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-05-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}