Modeling and Simulation). The RFP and supporting technical documentation clearly define the Government’s expectations in terms of the performance and functional specifications, program planning, program process, risks, and assumptions. DoDI 5000.02, Enc 6, sec. Enabling operation in degraded electromagnetic (EM), space or cyber environments. The primary objective of the Technology Maturation and Risk Reduction (TMRR) phase is to reduce technical risk and develop a sufficient understanding of the materiel solution to support sound investment decisions at the pre-Engineering and Manufacturing Development (EMD) Review and at Milestone B regarding whether to initiate a formal acquisition program. The manufacturing and production strategy is complete and adequate, Integrated Master Schedule (IMS) adequately identifies the critical path and is resourced at reasonable levels, based on realistic performance/efficiency expectations, Unique work requirements for risk reduction prototyping and competitive prototyping have been identified, Product support plan and sustainment concepts have been defined with the corresponding metrics, Assess whether a balanced definition of the system’s major elements has been developed, including their functionality and performance requirements, Assess whether the functional baseline is technically achievable with regard to cost, schedule and performance, Confirm that the system performance specification (typically put on contract) is realistic and provides a sound technical foundation for preliminary design, Establish functional baseline and verification criteria to be used during FCA. It is a holistic, integrative discipline, whereby the contributions across engineering disciplines, such as structural engineers, electrical engineers, mechanical designers, software engineers, human factors engineers and reliability engineers, are evaluated and balanced to produce a coherent capability -- the system. Models, simulations, data and artifacts should be developed in a well-defined and controlled engineering environment to support the program's reuse of the information across the acquisition life cycle or for reuse and repurposing in support of other acquisition efforts. Concerns here can include 'glue' code required for integration, and integration and interface concerns that can complicate integration and testing. TPMs should be identified, tailored and updated in the SEP to fit the acquisition phase of the program. TPMs should be chosen that will both confirm the performance of the program in the current phase, but also provide leading indicators to future risk and issues in the next phase. Important to note is that Contingency is allocated as part of each WCE data point and typically decreases as the system and measurements mature, while Margin is not allocated. The Physical Configuration Audit (PCA) is a formal examination of the "as-built" configuration of the system or a configuration item against its technical documentation to establish or verify its product baseline. and CH 5–3.1. Key Systems Engineering design considerations. acquisition models. The Acquisition Streamlining and Standardization Information System (ASSIST) database is the official source for current Department of Defense (DoD) specifications and standards. If the program’s Acquisition Strategy (AS) includes competing contractual efforts, an SFR should be held with each participating developer. Should-cost management does not mean trading away the long-term value of sound design practices and disciplined SE activities for short-term gain; it does mean eliminating low-value-added activities and reports that are not required and that are deemed unessential. For Major Defense Acquisition Programs, the PM ensures that the program office is structured to interface with the SE WIPT (a multidisciplinary team responsible for the planning and execution of SE) to address DoD leadership concerns and interests. Software may be refined as needed in response to Operational Test and Evaluation (OT&E) activities, and in support of the Full-Rate Production and/or Full Deployment Decision and Initial Operational Capability (IOC). Early and frequent involvement with stakeholders by both the PM and the Systems Engineer facilitates the successful execution of SE activities throughout the acquisition life cycle. A key method for doing this is to identify technical risks associated with achieving entrance criteria at each of these points (see the DoD Risk, Issue and Opportunity Management Guide for Defense Acquisition Programs available on the DASD(SE) web site.) During development of the Systems Engineering Plan (SEP) and Program Protection Plan (PPP), the PM, Systems Engineer and Product Support Manager should consider these relationships and develop plans to address the threat. Risk Management, to address and manage program issues with resourced action plans, as appropriate. Consistency between a product and its design requirements, supporting documentation and associated production and sustainment systems. The CONOPS/OMS/MP is a document consistent with the validated/approved capability requirements document to include the operational tasks, events, durations, frequency, operating conditions and environments under which the recommended materiel solution is to perform each mission and each phase of a mission. The ICD, AoA Guidance, and AoA Study Plan should be available prior to the start of the MSA phase. and DoDI 5000.02, Enc 3, sec. Ensuring adequate plans are in place to complete the necessary technical activities for the ASR. Among concerns with using COTS products are: The marketplace drives COTS product definition, application and evolution. The DAPS Methodology includes: Insights from PSAs aid the development of the Systems Engineering Plan (SEP) (see CH 3–2.2. Technical Reviews and Audits for more on this incremental approach. The Systems Engineer should be aware of the worldwide rules for spectrum management and the need to obtain host-nation permission for each transmitter and frequency assignment. 17), the Program Manager (PM) and Systems Engineer for munitions programs and other energetic devices (such as ordnance, warheads, bombs and rocket motors) and munitions handling, storage and transport programs have an overriding responsibility to address safety aspects of their programs in trade studies, design reviews, milestone reviews and in JCIDS documents. Require that CSI deliveries and services performed meet all technical and quality requirements established by the DCA. Other technical information (such as models and simulations) may be useful for understanding both the need and its context. While the processes support risk management, the risk mitigation plans, which focus on risk reduction for individual risks (i.e., the output of the processes), are significantly more important. As illustrated in the figure, there are four attributes of a good metric: To achieve an accurate status, TPM reporting should account for uncertainties such as measurement error and the immaturity of the item being measured. When acquiring Intellectual Property (IP) license rights, the acquisition community should consider the core principles described in the, Ability to modify or interface COTS software with other software even if Government-generated or owned, Ability to have insight into configuration management, and the features and functions of upgrades and changes, Ability to instrument and/or test aspects of COTS products. Early consideration of supportability needs during Requirements Analysis, Architecture Design and Implementation processes are critical to ensure the delivered capability is operationally suitable, effective, sustainable and affordable. ), Request for Proposal (RFP) for SE support to O&S activities, Program Protection Plan (PPP) (See DoDI 5000.02, Enc 3, sec. Supportability analysis begins in stakeholder requirements definition, as part of the Analysis of Alternatives (AoA), and continues through the design, test and evaluation, production and deployment activities/phases of the system. Special attention should be made to ensure the consistency of analysis that supports key decision and transition points throughout the program's life cycle. The PM should provide a transmittal letter to the involved test organization with a detailed listing of the system hazards germane to the test that includes the current risk level and documented risk acceptance along with information on all implemented mitigations. This guidance establishes standard user-level operating practices for aviation CSIs across the Services, the Defense Logistics Agency (DLA), the Defense Contract Management Agency (DCMA), and other Federal agencies. Decision Analysis can be the central process for formulating, managing and executing an effective and efficient program at any point in the life cycle. How progress toward these are tracked over the acquisition life cycle. Regardless of this relationship, the PDR assessment is done after PDR and prior to Milestone B to support the MDA decision to enter detailed design. Continuously Evaluate and Update SW Schedule Estimates: Adopt Continuous Integration/Delivery and Automated Testing: Continuously Assess Sufficiency of SW Staffing: USD(AT&L) memorandum, "Better Buying Power 2.0: Continuing the Pursuit for Greater Efficiency and Productivity in Defense Spending," November 13, 2012, DoD Open Systems Architecture Contract Guidebook for Program Managers, The Streamlined Life Cycle Assessment Process for Sustainability in DoD Acquisitions, OMB memo, "Myth-busting 3: Further Improving Industry Communication with Effective Debriefings", "Guide for Integrating Systems Engineering into DoD Acquisition Contracts, Version 1.0, 2006", Manufacturing Readiness Level (MRL) Deskbook, March 2012 Government Accountability Office (GAO) report, "Assessments of Selected Weapon Programs,", Integrated Master Plan and Integrated Master Schedule Preparation and Use Guide, Defense Acquisition Program Support (DAPS), DoDI 5400.16, "DoD Privacy Impact Assessment (PIA) Guidance". Support the establishment of realistic affordability caps as documented in the program’s Acquisition Program Baseline (APB). While the initial SEP and Integrated Master Schedule have the expected occurrence in the time of various milestones (such as overall system CDR), the plan should be updated to reflect changes to the actual timing of SE activities, reviews and decisions. In the early stages, production readiness assessments should focus on high-level manufacturing concerns such as the need for identifying high-risk and low-yield manufacturing processes or materials, or the requirement for manufacturing development efforts to satisfy design requirements.