{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,2,15]],"date-time":"2024-02-15T14:10:46Z","timestamp":1708006246854},"reference-count":56,"publisher":"Wiley","issue":"5","license":[{"start":{"date-parts":[[2019,4,14]],"date-time":"2019-04-14T00:00:00Z","timestamp":1555200000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["incose.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Systems Engineering"],"published-print":{"date-parts":[[2019,9]]},"abstract":"Abstract<\/jats:title>This article examines how the ilities, or nonfunctional attributes, help to understand the concept of resiliency in engineered systems. For engineered systems, resiliency describes the ability of a system to react to and return to full function after an interruption to system operation. The literature on resiliency of engineered systems defines resiliency in both the context of mission and platform resiliency; however, it leaves an opportunity to research how to understand, manage, and achieve resiliency. This work proposes an application of the systems engineering ilities to resiliency to understand how systems engineers can account for resiliency in the design process and incorporate resiliency into systems. Quality, robustness, and agility assist in understanding the components of resiliency and the ilities of repairability, extensibility, flexibility, adaptability, and versatility provide means for systems to achieve resiliency. This article applies this framework to examine two cases of DoD systems, the B\u201052 bomber and the F\u2010117 stealth fighter. These two examples demonstrate how nonfunctional attributes enable engineered systems to achieve resiliency and help to better understand the concept of resiliency in engineered systems.<\/jats:p>","DOI":"10.1002\/sys.21488","type":"journal-article","created":{"date-parts":[[2019,4,15]],"date-time":"2019-04-15T02:49:50Z","timestamp":1555296590000},"page":"389-400","update-policy":"http:\/\/dx.doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Achieving resiliency in major defense programs through nonfunctional attributes"],"prefix":"10.1002","volume":"22","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-7895-6606","authenticated-orcid":false,"given":"James R.","family":"Enos","sequence":"first","affiliation":[{"name":"Department of Systems Engineering United States Military Academy West Point NY 10996"}]}],"member":"311","published-online":{"date-parts":[[2019,4,14]]},"reference":[{"key":"e_1_2_6_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/10429247.2013.11431982"},{"key":"e_1_2_6_3_1","doi-asserted-by":"publisher","DOI":"10.1080\/10429247.2008.11431783"},{"key":"e_1_2_6_4_1","doi-asserted-by":"publisher","DOI":"10.1002\/sys.20106"},{"key":"e_1_2_6_5_1","doi-asserted-by":"crossref","unstructured":"GoergerSR MadniAM EslingerOJ.Engineered resilient systems: a DoD perspective. 2014 Conference on Systems Engineering Research. Redondo Beach CA: Procedia Computer Science;2014:865\u2013872.","DOI":"10.1016\/j.procs.2014.03.103"},{"key":"e_1_2_6_6_1","unstructured":"SmallC ParnellG PohlE et\u00a0al.Engineering resilience for complex systems. 15th Annual Conference on Systems Engineering Research. Redondo Beach CA;2017."},{"key":"e_1_2_6_7_1","doi-asserted-by":"crossref","unstructured":"SperoE AveraMP ValdezPE GoergerSR.Tradespace exploration for the engineering of resilient systems. Conference on Systems Engineering Research (CSER 2014) Redondo Beach CA;2014.","DOI":"10.1016\/j.procs.2014.03.072"},{"issue":"1","key":"e_1_2_6_8_1","first-page":"57","article-title":"Resilience in engineered resilient systems","volume":"12","author":"Buchanan RK","year":"2015","journal-title":"J Def Model Simul"},{"key":"e_1_2_6_9_1","volume-title":"Digital Engineering Strategy","author":"Office of the Deputy Assistant Secretary of Defense","year":"2018"},{"key":"e_1_2_6_10_1","doi-asserted-by":"publisher","DOI":"10.21236\/ADA385628"},{"key":"e_1_2_6_11_1","volume-title":"Understanding the Current State of US Defense Systems of Systems and Systems Conference","author":"Dahmann J","year":"2008"},{"key":"e_1_2_6_12_1","volume-title":"Opportunities Exist to Improve the Department of Defense's Portfolio Management","author":"Government Accountability Office","year":"2015"},{"key":"e_1_2_6_13_1","unstructured":"U.S. Air Force.B\u201052 Stratofortress Fact Sheet.2015. Retrieved October 20 2016 from U.S. Air Foce Factsheets:http:\/\/www.af.mil\/AboutUs\/FactSheets\/Display\/tabid\/224\/Article\/104465\/b-52-stratofortress.aspx"},{"key":"e_1_2_6_14_1","volume-title":"The Development of the B\u201052 and Jet Propulsion","author":"Mandeles MA","year":"1998"},{"key":"e_1_2_6_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0094-5765(02)00241-2"},{"key":"e_1_2_6_16_1","unstructured":"Air Combat Command.F\u2010117A Nighthawk. (U.S. Air Force).2005. Retrieved November 11 2016 fromhttp:\/\/www.acc.af.mil\/AboutUs\/FactSheets\/Display\/tabid\/5768\/Article\/199186\/f-117a-nighthawk.aspx"},{"issue":"4","key":"e_1_2_6_17_1","first-page":"136","article-title":"Radar versus stealth: passive radar and the future of U.S. military power","volume":"55","author":"Westra AG","year":"2009","journal-title":"Joint Forces Q"},{"issue":"1","key":"e_1_2_6_18_1","first-page":"4","article-title":"Baghdad, the urban sanctuary in desert storm?","volume":"11","author":"Arkin WM","year":"1997","journal-title":"Airpower J"},{"issue":"4","key":"e_1_2_6_19_1","first-page":"4","article-title":"The stealth revolution in aerial combat","volume":"45","author":"Bowie CJ","year":"1998","journal-title":"Airpower Hist"},{"issue":"2","key":"e_1_2_6_20_1","first-page":"8","article-title":"Kosovo and the continuing SEAD challenge","volume":"16","author":"Lambeth BS","year":"2002","journal-title":"Air Space Power J"},{"issue":"549","key":"e_1_2_6_21_1","first-page":"42","article-title":"U.S. must reverse bomber blueprint","volume":"84","author":"Thompson LB","year":"1999","journal-title":"Natl Def"},{"issue":"638","key":"e_1_2_6_22_1","first-page":"40","article-title":"Aging aircraft, war costs weigh heavily in future budget","volume":"91","author":"Magnuson S","year":"2007","journal-title":"Natl Def"},{"key":"e_1_2_6_23_1","first-page":"133","article-title":"The comanche and the albatross","author":"Pietrucha MW","year":"2014","journal-title":"Air Space Power J"},{"key":"e_1_2_6_24_1","doi-asserted-by":"publisher","DOI":"10.1002\/sys.21234"},{"key":"e_1_2_6_25_1","doi-asserted-by":"crossref","unstructured":"SitterleVB FreemanDF GoergerSR EnderTR.Systems Engineering Resiliency: Guiding Tradespace Exploration within an Engineered Resilient Systems Context. Conference on Systems Engineering Research Hoboken NJ;2015.","DOI":"10.1016\/j.procs.2015.03.013"},{"key":"e_1_2_6_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ress.2013.07.004"},{"key":"e_1_2_6_27_1","doi-asserted-by":"crossref","unstructured":"KlingensmithK MadniAM.Architecting cyber\u2010secure resilient system\u2010of\u2010systems. 15th Annual Conference on Systems Engineering Research Redondo Beach CA;2017.","DOI":"10.1007\/978-3-319-62217-0_12"},{"key":"e_1_2_6_28_1","doi-asserted-by":"crossref","unstructured":"LeonardW.Resilient cyber secure systems and system of systems: implications for the Department of Defense. 15th Annual Conference on Systems Engineering Research. Redondo Beach CA;2017.","DOI":"10.1007\/978-3-319-62217-0_11"},{"key":"e_1_2_6_29_1","doi-asserted-by":"publisher","DOI":"10.1002\/sys.21206"},{"key":"e_1_2_6_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10669-013-9462-5"},{"key":"e_1_2_6_31_1","doi-asserted-by":"crossref","unstructured":"MadniAM SieversMW HumannJ OrdoukhanianE D'AmbrosioJ SundaramP.Model\u2010based approach for engineering resilient system\u2010of\u2010systems: application to autonomous vehicle networks. 15th Annual Conference on Systems Engineering Research Redondo Beach CA;2017.","DOI":"10.1007\/978-3-319-62217-0_26"},{"key":"e_1_2_6_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ress.2015.03.011"},{"key":"e_1_2_6_33_1","article-title":"A framework for incorporating \u201cilities\u201d in tradespace studies","author":"McManus H","year":"2009","journal-title":"American Institute of Aeronautics and Astronautics"},{"key":"e_1_2_6_34_1","unstructured":"deWeckOL RossAM RhodesDH.Investigating relationships and semantic sets amongst system lifecycle properties (ilities). Third International Engineering Systems Symposium Delft NL;2012."},{"key":"e_1_2_6_35_1","doi-asserted-by":"crossref","unstructured":"EnosJR.Using Sytems Engineering ilities to Better Understand Resiliency. Conference on Systems Engineering Research Charlottsville VA;2018.","DOI":"10.1007\/978-3-030-00114-8_3"},{"key":"e_1_2_6_36_1","doi-asserted-by":"publisher","DOI":"10.1201\/9781420054927.ch6"},{"key":"e_1_2_6_37_1","volume-title":"ESD Terms and Definitions (Version 12)","author":"ESD Symposium Committee","year":"2002"},{"key":"e_1_2_6_38_1","doi-asserted-by":"crossref","unstructured":"BauerW EleziF RothM MaurerM.Determination of the required product platform flexibility from a change perspective. 9th Annual IEEE International Systems Conference;2015.","DOI":"10.1109\/SYSCON.2015.7116723"},{"key":"e_1_2_6_39_1","first-page":"99","article-title":"An ontological framework for clarifying flexibility\u2010related terminology via literature survey","author":"Ryan ET","year":"2012","journal-title":"Syst Eng"},{"key":"e_1_2_6_40_1","doi-asserted-by":"crossref","unstructured":"SchapiroSB HenryMH.Engineering agile systems through architectural modularity. 2012 International Systems Conference. Vancouver BC;2012.","DOI":"10.1109\/SysCon.2012.6189529"},{"key":"e_1_2_6_41_1","doi-asserted-by":"crossref","unstructured":"TurnerAJ MonahanaW CotteraM.Quantifying the ilities: a literature review of robustness interoperability and agility. 15th Annual Conference on Systems Engineering Research. Redondo Beach CA;2017.","DOI":"10.1007\/978-3-319-62217-0_72"},{"key":"e_1_2_6_42_1","doi-asserted-by":"crossref","unstructured":"RossAM RhodesDH HastingsDE.Using Pareto Trace to determine system passive value robustness. 3rd Annual IEEE International Systems Conference Vancouver BC: IEEE;2009:285\u2013290.","DOI":"10.1109\/SYSTEMS.2009.4815813"},{"key":"e_1_2_6_43_1","doi-asserted-by":"crossref","unstructured":"FitzgeraldME RossAM.Mitigating contextual uncertainties with valuable changeability analysis in the multi\u2010epoch domain. SysCon2012 \u2013 IEEE International Systems Conference. Vancouver BC;2012.","DOI":"10.1109\/SysCon.2012.6189466"},{"key":"e_1_2_6_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ress.2006.10.016"},{"key":"e_1_2_6_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ress.2016.01.020"},{"key":"e_1_2_6_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ress.2017.05.003"},{"key":"e_1_2_6_47_1","volume-title":"Manual for the Operation of the Joint Capability Integration and Development System (JCIDS)","author":"Joint Chiefs of Staff","year":"2015"},{"key":"e_1_2_6_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1443-8461(03)80015-1"},{"key":"e_1_2_6_49_1","doi-asserted-by":"crossref","unstructured":"BershadBN SavageS PardyakP et\u00a0al.Extensibility safety and performance in the SPIN operating system. Fifteenth ACM Symposium on Operating Systems Principles Copper Mountain CO;1995:267\u2013284.","DOI":"10.1145\/224056.224077"},{"key":"e_1_2_6_50_1","doi-asserted-by":"publisher","DOI":"10.1002\/sys.20098"},{"key":"e_1_2_6_51_1","doi-asserted-by":"crossref","unstructured":"BeesemyerJC RossAM RhodesDH.An empirical investigation of system changes to frame links between design decisions and ilities. Conference on Systems Engineering Research (CSER) St. Louis MO:2012.","DOI":"10.1016\/j.procs.2012.01.010"},{"key":"e_1_2_6_52_1","doi-asserted-by":"crossref","unstructured":"PapeL GiammarcoK ColombiJ DagliC Kilicay\u2010ErginN RebovichG.A fuzzy evaluation method for system of systems meta\u2010architectures. 2013 Conference on Systems Engineering Research Atlanta GA: Procedia Computer Science;2013:245\u2013254.","DOI":"10.1016\/j.procs.2013.01.026"},{"key":"e_1_2_6_53_1","doi-asserted-by":"publisher","DOI":"10.1002\/sys.20062"},{"key":"e_1_2_6_54_1","doi-asserted-by":"crossref","unstructured":"AgarwalS PapeLE DagliCH et\u00a0al.Flexible and intelligent learning architectures for SoS (FILA\u2010SoS): architectural evolution in systems\u2010of\u2010systems. 2015 Conference on Systems Engineering Research Hoboken NJ: Procedia Computer Science;2015:76\u201385.","DOI":"10.1016\/j.procs.2015.03.005"},{"key":"e_1_2_6_55_1","doi-asserted-by":"publisher","DOI":"10.1002\/sys.10054"},{"issue":"9","key":"e_1_2_6_56_1","first-page":"36","article-title":"Bomber","volume":"84","author":"Tirpak JA","year":"2001","journal-title":"Air Force Mag"},{"key":"e_1_2_6_57_1","volume-title":"Jane's Land Based Air Defence 2005\u20132006","author":"O'Halloran JC","year":"2005"}],"container-title":["Systems Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fsys.21488","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/sys.21488","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/sys.21488","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/sys.21488","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,9]],"date-time":"2023-09-09T12:17:52Z","timestamp":1694261872000},"score":1,"resource":{"primary":{"URL":"https:\/\/incose.onlinelibrary.wiley.com\/doi\/10.1002\/sys.21488"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,14]]},"references-count":56,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2019,9]]}},"alternative-id":["10.1002\/sys.21488"],"URL":"https:\/\/doi.org\/10.1002\/sys.21488","archive":["Portico"],"relation":{},"ISSN":["1098-1241","1520-6858"],"issn-type":[{"value":"1098-1241","type":"print"},{"value":"1520-6858","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,4,14]]},"assertion":[{"value":"2018-07-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-04-02","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-04-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}