Systems Engineering and Software Engineering
Processes, Products, and People
from a
Standards Perspective
(Subtitle: Stand on the Standards)
A Tutorial Presented to the
Hampton Roads Area and Southern Maryland Chapters of INCOSE
Systems Engineering Seminar 2003
November 13, 2003
John O. Clark
Chief Engineer
Warfare Systems Engineering
Defense Mission Systems
Northrop Grumman Information Technology
Slide 1
Overview
• Heritage of Systems Engineering and Software
Engineering Standards
• What is a System?
• What is Systems Engineering?
• What is Systems Engineering Management?
• Standards Process Overviews
• User Scorecard
• Standards Detailed Overviews
• Future of Systems Engineering and Software
Engineering Standards
• Recommendations & Summary
Revision A of Tutorial H04 Presented at the
INCOSE 2003 Annual International Symposium
Washington, DC
June 30, 2003
Slide 2
Copyright Accreditation
Accreditation
•
All EIA, IEEE, ANSI, and ISO/IEC copyright material
has been removed from this version in order to
provide this version in softcopy. Refer to the figures
in the standards.
•
INCOSE Systems Engineering Handbook, Version 2.0,
July 2000, Copyright © 2002 by INCOSE, subject to the
following restrictions: INCOSE use. Permission to
reproduce this document and to prepare derivative
works from this document for INCOSE use is granted,
provided this copyright notice is included with all
reproductions and derivative works.
From _________. Copyright ________. All rights reserved.
Slide 3
Heritage of SE and SW Standards
INCOSE & JOC
MIL-STDs to Commercial Stds to CMMs
Systems
Engineering
1969
MIL-STD499
1974
MIL-STD499A
Data Item
Descriptions
1968-
1985
DOD-STD2167
1998
IEEE 1220
1998
1994
IEEE 1220
1994
1995
ISO/IEC
12207
1988
DOD-STD2167A
1987
DOD-STD1703
1988
DOD-STD7935A
1994
MIL-STD498
1995
IEEE 1498
/EIA 640
(Draft)
1998
IEEE/EIA
12207
1995
EIA/IEEE
J-STD-016
1999-2002
Instructions/
Handbooks/
Manuals/
Guides
2003
ISO/IEC
19760
Guide
2003+
ISO/IEC
15288
IEEE
1220
Harmon
2003+
ISO/IEC
15288
12207
Harmon
Supercedes
Derived From
(Interim)
2003+
DIDs
Defense
Specifications
2002
ISO/IEC
15288
1999
EIA/IS- CMMI
731
(SE-CM)
(Interim)
(Trial Use)
Software
Engineering
1980
MIL-STD1679A
1998
ANSI/EIA632
1994
EIA/IS632
1994
MIL-Std499B
(Not
Released)
1968MIL-STD1679
Primary Focus of this Tutorial
Sec Perry
Letter
Jan 1994
DIDs
1995
MIL-STD961D
2003
MIL-STD961E
Slide 4
Heritage of SE and SW Standards (cont)
INCOSE & JOC
1998
EIA/IS 731
SE Capab Model
Systems
Engineering
1998
1994
1969
Mil-Std499
1974
1994
Mil-Std499A
Mil-Std499B
EIA/IS
632
(Interim)
ANSI/EIA
632
CMMI
2000
INCOSE SE
Handbook V2
2004 2005
V2A
V3
2002
1994
1998
IEEE
1220
(Trial Use)
IEEE
1220
ISO/IEC
15288
2003
NAVAIR
SE Guide
1999
DSMC/DMU
SE Fundamentals
Others ...
1995
ISO/IEC
12207
1988
Software
Engineering
1996
IEEE/EIA
12207
Dod-Std2167A
1987
1994
Mil-Std498
Dod-Std1703
1988
1995
1995
IEEE 1498
/EIA 640
EIA/IEEE
J-Std-016
(Draft)
(Interim)
Dod-Std7935A
Based On
Referenced In
Updated From INCOSE SE Handbook. Copyright 2002. All rights reserved.
Slide 5
What is a System? (cont)
Key Terms
EIA/IS-632 & JOC
EIA/IS-632-1994
System
People
System
From EIA/IS-632-1994. Copyright 1995 EIA. All rights reserved.
Products
Processes
People
Slide 6
What is Systems Engineering? (cont)
Key Terms and Relationships
JOC
Requirements
System/Subsystem Specification (SSS)
System Requirements Document (SRD)
System Requirements Specification (SRS)
System/Subsystem Design Description (SSDD)
System Specification (SS) (MIL-STD-961D)
Functions
Requirement: “Noun shall verb.”
(SSDD/SS)
Components
Example: The car shall stop within 100 feet at 50 mph.
Functional
Performance
Function: “Verb Noun.” Example: Stop Car or “Verb-ing.” Example: Stopping.
Component: “Noun.” Example: Brake.
Slide 7
What is Systems Engineering? (cont)
Related Terms
•
•
•
•
•
•
•
•
•
•
•
•
•
JOC
Functional Requirement: What?
Performance Requirement: How well?
Capability: A group of related requirements. Synonyms include
function, subject, object, or other term useful for presenting the
requirements.
Configuration Item (CI): Any item designated for Configuration Mgmt.
Preliminary Design: High-Level Design, one level below (inside) the CI.
Detailed Design: Low-Level Design, lowest level of the CI.
Validation: Right system?
Verification: System right?
Verification Methods: Analysis (including modeling and simulation),
Demonstration, Test, and Inspection.
Use Case: A scenario-driven functional thread through the system.
Decompose: Parse or separate.
Derive: Deduce (e.g., if a=b+c then c=a-b, or I’ll know it when I see it).
Synthesis: Design. Translate requirements (problems) into solutions.
Slide 8
What is Systems Engineering? (cont)
Processes, Architectures, and Baselines
JOC
Systems Analysis
• Requirements Trade Studies and
Assessments
• Effectiveness Analysis, etc.
• Define Requirements
• Define Interfaces
• Decompose and Derive Requirements
• Define Constraints & Conditions
• Define Requirements Architecture
• Establish Requirements Baseline
Requirements Architecture
Sys
R11
• Define Functions
• Allocate Requirements to Functions
• Define Functional Interfaces
• Decompose Functions to Subfunctions
• Allocate Decomposed and Derived
Requirements to Subfunctions
• Define Functional Architecture
• Develop Functional Flow Block Diagrams
• Establish Functional Baseline
Functional Architecture
I/F
I/F
R2
R1
R22
R21
• Physical Design Trade Studies
and Assessments
• Effectiveness Analysis, etc.
Functional Analysis & Allocation
Requirements Analysis
I/F
• Functional Trade Studies and
Assessments
• Effectiveness Analysis, etc.
F1
R22
F11
I/F
Sys
F2
I/F
I/F
F31
I/F
Sub1
F3
Requirements Loop
Verification Loop
• Risk Management
• Configuration & Data Management
• Interface Management
I/F
I/F
I/F
F12
Physical Design & Allocation
• Define Subsystems and Components
• Allocate Functions and Subfunctions to
Subsystems and Components
• Define Subsystem & Component Requirements
• Define Subsystem & Component Interfaces
• Establish Allocated Baseline
• Define Physical Architecture
• Develop Physical Flow Block Diagrams
• Establish Physical/Product Baseline
Physical Architecture
C1
F32
Sys
I/F
I/F
Sub2
I/F
C2
I/F
Sub3
C3
Design Loop
Control
• Performance-Based Progress Measurement:
- SEMS/IMP & SEDS/IMS - Technical Reviews
- TPMs & Metrics
- Earned Value
• SOW, Deliverables
• WBS, SBS, PBS
• Work & Planning Packages
Slide 9
What is Systems Engineering? (cont)
Functional Flow Diagram (FFD) Example
INCOSE SE HDBK
From INCOSE SE Handbook, Version 2.0, Copyright 2002 by INCOSE.
Slide 10
What is Systems Engineering? (cont)
Functional Flow Block Diagram (FFBD) Example
DSMC
From DSMC SE Fundamentals, October 1999
Slide 11
What is Systems Engineering? (cont)
INCOSE SE HDBK
One Type of N2 Chart Using Functions
Input
Function
Output
F1
1
(F1)
F1
F1
Function
F2
F2
F1
F3
F4
F5
3
(F3)
F3
F3
Function
F3
F5
F3
F4
F4
F4
F2
F5
F2
Function
F2
F1
F5
F2
F3
F3
F4
F4
F2
F2
F1
F1
Cells are blank if no interface.
2
(F2)
F3
F1
F5
4
(F4)
Note: Doesn’t follow prior FFD example.
F4
F5
F4
F5
Other uses include interfaces between:
•
Systems
•
Spaces
•
Products
•
Processes
•
People, and
•
Organizations
Function
F5
5
(F5)
Output
Input
From INCOSE SE Handbook, Version 2.0, Copyright 2002 by INCOSE.
Slide 12
What is Systems Engineering? (cont)
Another Type of N2 Chart Using Systems
System 1
System 2
System 3
S2
System 1
S1
S1
S2
System 3
S1
System 4
S1
S5
S4
S5
S3
S5
S4
S2
S4
S3
S5
S5
Cells can contain
interface direction,
data, status, an X,
etc.
S5
S3
S2
Cells are blank if
no interface.
S2
S3
S4
S4
System 5
S2
S3
S3
S4
S2
S1
S5
S1
S1
S3
S2
System 5
S4
S3
S1
System 2
System 4
JOC
S4
S5
Slide 13
What is Systems Engineering? (cont)
INCOSE SE HDBK
Functional Thread Analysis / Use Cases
ATM Card
Accep t Card
PIN
Accep t PIN
Display
In correct PIN
Scenario 1 Bad PIN
Display
Pin
Re ques t
Display
In correct
PIN
ATM Card
Accep t Card
PIN
Accep t PIN
Display
M enu
Display
Pin
Re ques t
Display
M ENU
Scenario 2 Good PIN
Requirements Specifications and Test Procedures can be written using Use Cases.
From INCOSE SE Handbook, Version 2.0, Copyright 2002 by INCOSE.
Slide 14
What is Systems Engineering? (cont)
Functional - Physical Allocation Matrix Example
DSMC
Can also be used for Requirements - Functional and Requirements - Physical allocations.
From DSMC SE Fundamentals, October 1999
Slide 15
What is Systems Engineering? (cont)
Systems Engineering Development Strategies
• Waterfall (once through)
• Evolutionary
– Incremental (end requirements known)
– Spiral (end requirements not known)
• Iterative (small increments)
• Combinations of Above
Slide 16
What is Systems Engineering? (cont)
JOC
Incremental and Iterative SE Process Example
Level of Effort
Process
1
2
3
4
Increment 1
Iterations
5
6
7
8
9
Requirements
Analysis
Iteration Reviews:
R
F
PD/CD
Functional Analysis
and Allocation
Synthesis/
Design
Systems
Analysis
A
Control
PCA
Validation
TR
Verification
TC/SV/FCA
Increment 1 Reviews:
A:
R:
F:
Alternative
Requirements
Functional
A
SS:
HS:
PD:
R
Software Spec
Hardware Spec
Preliminary Design
F
SS/HS
CD:
TR:
TC:
PD
Critical Design
Test Readiness
Test Completion
CD
TR
TC/SV/FCA
PCA
SV: System Verification
FCA: Functional Configuration Audit
PCA: Physical Configuration Audit
Slide 17
What is Systems Engineering? (cont)
USD (AT&L)
From Evolutionary Acquisition and Spiral Development, USD (AT&L), April 2002
Slide 18
Systems Engineering Management? (cont)
C/SCSC Joint Guide & JOC
Work Breakdown Structure (WBS) Example
PROGRAM WORK BREAKDOWN STRUCTURE (PWBS)
•
•
•
(CWBS)
System Breakdown
Structure (SBS)
Organizational Breakdown
Structure (OBS)
JOC
Additions
From Cost/Schedule Control Systems Joint Implementation Guide, AFSCP 173-5 & DLAH 8315.2, October 1980. Also see MIL-HDBK-881.
Slide 19
Systems Engineering Management? (cont)
JOC
Plans Tree
Acquirer
PMP
RMP
DMP&CMP
RMP
DMP
HDP
SDP
Acquirer Plan
Supplier/
Developer Plan
CMP
Supplier/
Developer
PMP
SEMP
HSIP
IMP&IMS
CMP – Configuration Management Plan
DMP – Data Management Plan
HDP – Hardware Development Plan
HSIP – Human Systems Integration Plan
ILSP – Integrated Logistics Support Plan
IMP – Integrated Master Plan
IMS – Integrated Master Schedule
I&TP – Integration and Test Plan
TEMP
ILSP
I&TP
ILSP
PAP
RM&AP
TP
PAP – Product Assurance Plan
PMP – Program Management Plan
RM&AP – Reliability, Maintainability & Availability Plan
RMP – Risk Management Plan
SDP – Software Development Plan
SEMP – Systems Engineering Management Plan
TEMP – Test and Evaluation Management Plan
TP – Training Plan
Slide 20
Systems Engineering Management? (cont)
JOC
Heritage of the SEMP and SDP
EIA/IS-632
1994
NAVSEA
SE Policy
PEO-TSC
SEMP Hdbk
PEO-TSC
TRM
PEO-TSC
SE Ops Man
IEEE 1220
1998
NAVAIR
SE Guide
EIA-632
1998
DSMC
SE Fund
ISO 15288
2002
INCOSE
SE Hdbk
EIA-731
1999
Contract
SOW
DD 1423s
CDRLs
Sources
SEMP
Organization
Process
Document
Program
SEMP
CMMI
DOD
5000
IEEE/EIA
J-STD-016
SDP
CDRL – Contract Data Requirements List
CMMI – Capability Maturity Model Integrated
DOD – Department of Defense
DSMC – Defense Systems Management College
INCOSE – International Council on SE
NAVAIR – Naval Air Systems Command
NAVSEA – Naval Sea Systems Command
PEO – Program Executive Office
SEMP – Systems Engineering Management Plan
SOW – Statement of Work
TRM – Technical Review Manual
TSC – Theater Surface Combatants
Slide 21
Systems Engineering Management? (cont)
JOC
Technical Baselines, Documents, and Reviews
Baselines
Performance
Final
Documents
Reviews
ORD, TLR
Requirements
SSS, SRD, SRS
External IRS
RR
Functional
SSS, SRD, SRS
FR
Allocated
SSDD, SS, SRS, HRS,
Internal IRS
PDR
HDD (Drawings)
SDD, DBDD, IDD
CDR
Hardware
Software
FCA/SVR
PCA
Developmental
Physical/Product
Slide 22
Systems Engineering Management? (cont)
Technical Baselines, Documents, and Reviews (cont)
A
R
F
I
PD
CD
TR
TC
JOC
FCA
VR
PCA
Rpt
Rpt
Rpt
Review Types:
FULL MENU
Document Types:
SYSTEM
LEVEL
Studies SSS
IRS
ASR
System Requirements
Baseline
System Allocated Baseline
= Subsystem Requirements
Baseline
Subsystem
requirements
allocated to
component
COMPONENT
LEVEL
SRR
Studies SSS
IRS
System
requirements
allocated to
subsystem
SUBSYSTEM
LEVEL
SSS
IRS
SSDD
Subsystem Allocated Baseline
= Component Requirements
Baseline (e.g., Software
Requirements Baseline)
SFR
ISR
SSS
IRS
SSDD
Flow
Down:
SDD SDD
HDD HDD
IDD
IDD
DBDD DBDD
T Pln T Rpt
T Pro
SPDR SCDR
STRR
STCR
SVR
SSDD SSDD
T Pln
T Pro
Rpt
Rpt
SPCA
Rpt
Roll
Up:
SSRR
SSFR
SSS
SSS
IRS
SSDD
Flow
Down:
SSPDR SSCDR SSTRR SSTCR
SSDD
SSDD
T Pln
T Pro
T Rpt
SSFCA
SSPCA
Rpt
Rpt
Roll
Up:
SSR/
SWRR SWFR SWPDR SWCDR SWTRR
SRS
SRS
IRS
SDD
IDD
DBDD
SDD
IDD
DBDD
T Pln
T Pro
SWTCR
SWFCA
SWPCA
T Rpt
Rpt
Rpt
Slide 23
Systems Engineering Management? (cont)
Technical Baselines, Documents, and Reviews (cont)
Technical Review
Baseline
Document
Concept Papers, etc.
System Specification (SS/SRD/SRS)
External Interface Requirements Specifications (IRSs)
Subsystem Specifications (SSSs)
All Other Plans (PMP, SEMP, SDP, HDP, I&TP, QAP,
etc.)
Systems Engineering Master Schedule (SEMS) /
Integrated Master Plan (IMP)
Systems Engineering Detailed Schedule (SEDS) /
Integrated Master Schedule (IMS)
System/Subsystem Design Descriptions (SSDDs)
Hardware Requirements Specifications (HRSs)
Software Requirements Specifications (SRSs)
Internal Interface Requirements Specifications (IRSs)
Software Design Descriptions (SDDs)
Interface Design Specifications (IDSs)/
Interface Design Descriptions (IDDs)
Database Design Descriptions (DBDDs)
Hardware Design Descriptions / Drawings (HDDs)
Integration and Verification Plan (IVP)
Formal Qualification Test Plan (FQTP)
Formal Qualification Test Descriptions (FQTD)
Formal Qualification Test Report (FQTR)
Software Product Specification (SPS)
Software Version Description (SVD)
Integration and Verification Report (IVR)
Interim System Review (ISR) Report
ASR
PRB
F
P
P
SRR
FRB
PFB
SFR
FFB
SSR
PDR
PAB
CDR
FAB
PPB
TRR
TCR
JOC
FCA
SVR
PCA
FPB
U
U
U
U
U
U
U
U
U
F
F
P
P
F
F
U
U
U
U
P
F
U
U
U
P
F
U
U
U
U
U
U
U
U
U
U
U
U
U
U
U
U
U
U
U
U
U
U
U
U
U
U
F
F
F
P
U
U
U
U
U
U
U
U
F
U
U
U
U
U
U
U
U
U
P
P
P
P
P
F
F
F
F
P
P
P
P
F
P
F
F
F
F
F
P
F
P
P
P
ISR
F
Legend: P = Preliminary; F = Final; U = Update; RB = Requirements Baseline; FB = Functional Baseline; AB = Allocated Baseline; PB = Product Baseline; ASR = Alternative
Systems Review; SRR = System Requirements Review; SFR = System Functional Review; SSR = Software Specification Review; PDR = Preliminary Design Review; CDR =
Critical Design Review; TRR = Test Readiness Review; TCR = Test Completion Review; FCA = Functional Configuration Audit; SVR = System Verification Review; PCA =
Physical Configuration Audit; ISR = Interim System Review.
Note: PPB = Preliminary Product Baseline = Developmental Baseline (DB). IRSs = all interface requirements specifications, and IDSs/IDDs = all interface design specifications or
descriptions, regardless of which document (IRS/IDS/IDD) contains them.
Slide 24
Systems Engineering Management? (cont)
Technical Document Trees
DIDs, IEEE/EIA J-016, JOC
IEEE 1220-1998
TLR/ORD
Rqmts
Rqmts
OCD
SSS
External IRSs
Design
DBDD
SSDD
External IDDs
Rqmts
HRSs
SRSs
Internal IRSs
Design
HDDs
SDDs
Internal IDDs
From IEEE 1220-1998. Copyright 1999 IEEE. All rights reserved.
DIDs, IEEE/EIA J-016, JOC
MIL-STD-961E
TLR/ORD
System Spec
(Incl IRSs)
Rqmts
TEMP
Rqmts
Item Spec
Software Spec
Process Spec
Material Spec
Design
Detail Spec
Detail Spec
Detail Spec
Detail Spec
SSS
System Test Plan
Drawings
SDDs
Proc Def
Workmanship
IDDs
Mat’l Def
Manuf Stds
DBDDs
Inspec Rqmts
Inspec Rqmts
Code
Hardware Test Plan
Software Test Plan
Hardware Test Procedures
Software Test Procedures
Hardware Test Reports
Software Test Reports
Hardware Trouble Reports
Software Trouble Reports
Workmanship
Slide 25
Systems Engineering Management? (cont)
System/Subsystem Design Description (SSDD)
SSDD DID
SSDD
Scope
1.0
Ref Docs
2.0
System-Wide
Design Decisions
3.0
System
Architecture Design
4.0
System
Components
4.1
Concept of
Execution
4.2
HWCI Y
4.1.X.1.Y
ID
4.1.X.1.Y.1
Relationships
4.1.X.1.Y.2
Appxs
Interface X
4.3.X
Manual Ops
4.1.X.3
SWCIs
4.1.X.2
SWCI Y
4.1.X.2.Y
Notes
Interface
Design
4.3
ID & Diags
4.3.1
Component X
4.1.X
HWCIs
4.1.X.1
Req Trace
5.0
MO Y
4.1.X.3.Y
Alloc of Sys Reqs
& Des Decisions
4.1.X.1.Y.3
Comp HW
Resources
4.1.X.1.Y.4
Slide 26
Standards Process Overviews
• EIA/IS-632 Systems Engineering
• IEEE 1220-1994 IEEE Trial-Use Standard for Application and
•
•
•
•
•
Management of the Systems Engineering Process
IEEE 1220-1998 IEEE Standard for Application and Management
of the Systems Engineering Process
ANSI/EIA-632 Processes for Engineering a System
ISO/IEC 15288 Systems Engineering – System Life Cycle
Processes
IEEE/EIA 12207 Industry Implementation of International
Standard ISO/IEC 12207:
– IEEE/EIA 12207.0 Software Life Cycle Processes
– IEEE/EIA 12207.1 Life Cycle Data
– IEEE/EIA 12207.2 Implementation Considerations
DoD 5000 (policy)
– DoD 5000.1 The Defense Acquisition System
– DoD 5000.2 Operation of the Defense Acquisition System
– Interim Defense Acquisition Guidebook (formerly DoD 5000.2-R)
Slide 27
DoD 5000
DOD 5000.2
Requirements and Acquisition Process
Overarching Policy
NSS/NMS/Joint vision
Joint Concept of Operations
Functional
Area
Analysis
Functional Area
Functional Concept
Integrated Architecture
Feedback
D
O
T
M
L
P
F
MS B
- Materiel Process
Analysis of
Materiel
Approaches
MS C
CDD
MS A
DOTLPF
Process
JROC DAB
CPD
AoA
ICD
JROC
CD
Technology
Development
Concept
Refinement
DAB
JROC DAB
Increment 1
Demo
AoA – Analysis of Alternatives
ICD – Initial Capabilities Document
CDD – Capability Development Document
CPD – Capability Production Document
CD – Concept Decision
DAB – Defense Acquisition Board
MS – Milestone
NSS – National Security Systems
JROC – Joint Requirements Oversight Council
DOTMLPF – Doctrine, Organization, Training, Material, Leadership, Personnel, Facilities.
MS B
Demo
MS C
Increment 2
MS B
Demo
MS C
Increment 3
From New Signed DoD 5000.2, 12 May 2003
Slide 28
Used Scorecard
JOC
Standard
User
DSMC/DMU – 1999
EIA/IS632-1994
IEEE
1220-1994
√
√
EIA/IS-731 – 1999
ANSI/EIA632-1998
√
NAVSEA PMS 465 CEC – 1999
√
NAVSEA PEO-TSC – 1999-2000
√
√
√
√
√
√
√
NAVAIR SE – 2003
Total Score
√
√?
NAVSEA PEO-TSC - 2001
NAVSEA SE – 2002
√
√
INCOSE – 2000
OSD OSJTF – 2001
IEEE
1220-1998
5
3
Note: Later users generally tend to reference the later standards (
√
√
4 or 5
4
)
Slide 29
Standards Detailed Overviews
• EIA/IS-632 Systems Engineering
• IEEE 1220-1998
• ANSI/EIA-632
• ISO/IEC 15288
• IEEE/EIA 12207
• DoD 5000
Slide 30
PEO-TSC SEMP HDBK
PEO-TSC
Phase 0
Phase I
MS 0
Government
Approves
.
Draft
.
MS I
Functional Analysis/Allocation
• Decomposition is Lower-Level Functions
• Allocate Performance & Other Limiting
Requirements is Lower-Level Functions
• Define/Refine Functional Interfaces (Internal/External)
• Define/Refine/Integrate
Requirements Analysis
Functional Architecture
• Analyze Missions & Environments
• Identify Functional Requirements
• Define/Refine Performance & Design
Constraint Requirements
Requirements Loop
Synthesis
• Transform Architecture (Functional to Physical)
• Define Alternative Product Concepts
• Define/Refine Physical Interfaces (Internal/External)
• Define Alternative Product & Process Solutions
Allocated Baseline
Developmental
.
System
PROCESS INPUT
• Customer Needs/
Objectives/
Requirements
. . Mission/
Operations
. . Measures of
Effectiveness
. . Environments
. . Constraints
• Technology Base
• Prior Output Data
• Program Decision
Requirements
• Requirements From
Tailored Standards
and Specifications
• Select Preferred
Alternatives
• Trade-Off Studies
• Effectiveness Analysis
• Risk Management
• Configuration
Management
• Interface Management
• Data Management
• Performance-Based
• Progress Measurement
. . SEMS
. . TPM
. . Technical Reviews
MS III
MS II
.
Systems Analysis
& Control
Phase III
Conceptual Performance Baseline
Functional Baseline
Concept
PROCESS INPUT
• Customer Needs/
Objectives/
Requirements
. . Mission/
Operations
. . Measures of
Effectiveness
. . Environments
. . Constraints
• Technology Base
• Prior Output Data
• Program Decision
Requirements
• Requirements From
Tailored Standards
and Specifications
Phase II
Functional Analysis/Allocation
• Decomposition is Lower-Level Functions
• Allocate Performance & Other Limiting
Requirements is Lower-Level Functions
• Define/Refine Functional Interfaces (Internal/External)
• Define/Refine/Integrate
Requirements Analysis
Functional Architecture
• Analyze Missions & Environments
• Identify Functional Requirements
• Define/Refine Performance & Design
Constraint Requirements
Requirements Loop
Synthesis
• Transform Architecture (Functional to Physical)
• Define Alternative Product Concepts
• Define/Refine Physical Interfaces (Internal/External)
• Define Alternative Product & Process Solutions
Design Loop
Product Baseline
Deficiency
Correction
Subsystems
PROCESS INPUT
• Customer Needs/
Objectives/
Requirements
. . Mission/
Operations
. . Measures of
Effectiveness
. . Environments
. . Constraints
• Technology Base
• Prior Output Data
• Program Decision
Requirements
• Requirements From
Tailored Standards
and Specifications
Systems Analysis
& Control
• Select Preferred
Alternatives
• Trade-Off Studies
• Effectiveness Analysis
• Risk Management
• Configuration
Management
• Interface Management
• Data Management
• Performance-Based
• Progress Measurement
. . SEMS
. . TPM
. . Technical Reviews
Functional Analysis/Allocation
• Decomposition is Lower-Level Functions
• Allocate Performance & Other Limiting
Requirements is Lower-Level Functions
• Define/Refine Functional Interfaces (Internal/External)
• Define/Refine/Integrate
Requirements Analysis
Functional Architecture
• Analyze Missions & Environments
• Identify Functional Requirements
• Define/Refine Performance & Design
Constraint Requirements
PROCESS INPUT
• Customer Needs/
Objectives/
Requirements
. . Mission/
Operations
. . Measures of
Effectiveness
. . Environments
. . Constraints
• Technology Base
• Prior Output Data
• Program Decision
Requirements
• Requirements From
Tailored Standards
and Specifications
Systems Analysis
& Control
Requirements Loop
Synthesis
• Transform Architecture (Functional to Physical)
• Define Alternative Product Concepts
• Define/Refine Physical Interfaces (Internal/External)
• Define Alternative Product & Process Solutions
• Select Preferred
Alternatives
• Trade-Off Studies
• Effectiveness Analysis
• Risk Management
• Configuration
Management
• Interface Management
• Data Management
• Performance-Based
• Progress Measurement
. . SEMS
. . TPM
. . Technical Reviews
Functional Analysis/Allocation
• Decomposition is Lower-Level Functions
• Allocate Performance & Other Limiting
Requirements is Lower-Level Functions
• Define/Refine Functional Interfaces (Internal/External)
• Define/Refine/Integrate
Requirements Analysis
Functional Architecture
• Analyze Missions & Environments
• Identify Functional Requirements
• Define/Refine Performance & Design
Constraint Requirements
Requirements Loop
Synthesis
• Transform Architecture (Functional to Physical)
• Define Alternative Product Concepts
• Define/Refine Physical Interfaces (Internal/External)
• Define Alternative Product & Process Solutions
Mods/Product
Improvements
Systems Analysis
& Control
• Select Preferred
Alternatives
• Trade-Off Studies
• Effectiveness Analysis
• Risk Management
• Configuration
Management
• Interface Management
• Data Management
• Performance-Based
• Progress Measurement
. . SEMS
. . TPM
. . Technical Reviews
PROCESS INPUT
• Customer Needs/
Objectives/
Requirements
. . Mission/
Operations
. . Measures of
Effectiveness
. . Environments
. . Constraints
• Technology Base
• Prior Output Data
• Program Decision
Requirements
• Requirements From
Tailored Standards
and Specifications
Functional Analysis/Allocation
• Decomposition is Lower-Level Functions
• Allocate Performance & Other Limiting
Requirements is Lower-Level Functions
• Define/Refine Functional Interfaces (Internal/External)
• Define/Refine/Integrate
Requirements Analysis
Functional Architecture
• Analyze Missions & Environments
• Identify Functional Requirements
• Define/Refine Performance & Design
Constraint Requirements
Requirements Loop
Synthesis
• Transform Architecture (Functional to Physical)
• Define Alternative Product Concepts
• Define/Refine Physical Interfaces (Internal/External)
• Define Alternative Product & Process Solutions
Design Loop
Design Loop
Verification
Verification
Verification
PROCESS OUTPUT
• Integrated Decision Data Base
. . Decision Support Data
. . System Functional
Physical Architectures
. . Specifications & Baseline
• Baseline System Solution
Verification
PROCESS OUTPUT
• Integrated Decision Data Base
. . Decision Support Data
. . System Functional
Physical Architectures
. . Specifications & Baseline
• Baseline System Solution
Technical Management Plan (TMP)
• Select Preferred
Alternatives
• Trade-Off Studies
• Effectiveness Analysis
• Risk Management
• Configuration
Management
• Interface Management
• Data Management
• Performance-Based
• Progress Measurement
. . SEMS
. . TPM
. . Technical Reviews
Design Loop
Design Loop
Verification
Systems Analysis
& Control
PROCESS OUTPUT
• Integrated Decision Data Base
. . Decision Support Data
. . System Functional
Physical Architectures
. . Specifications & Baseline
• Baseline System Solution
Update
PROCESS OUTPUT
• Integrated Decision Data Base
. . Decision Support Data
. . System Functional
Physical Architectures
. . Specifications & Baseline
• Baseline System Solution
Update
PROCESS OUTPUT
• Integrated Decision Data Base
. . Decision Support Data
. . System Functional
Physical Architectures
. . Specifications & Baseline
• Baseline System Solution
Update
Preplanned Product Improvement (P3I)
ASR
SRR
SFR
SSR PDR
CDR TRR
FCA
PCA
ENGINEERING CHANGE
REVIEWS
Mission
Need
Statement
Operational
Requirement
Document
(ORD)
System
Threat
Assessment
Operational
Requirement
Document
(ORD)
System
Threat
Assessment
Operational
Requirement
Document
(ORD)
System
Threat
Assessment
System Performance Specification
Item Performance Specification
Item Detail Specification
Reassess Threat
Reassess Threat
Reassess Threat
From PEO-TSC SEMP Handbook, TSCBT3HDBK 4810.1Rev 0, 2 August 1999
Slide 31
Standards Details
• EIA/IS-632
• IEEE 1220-1998
IEEE Standard for Application and
Management of the Systems Engineering Process
• ANSI/EIA-632
• ISO/IEC 15288
• IEEE/EIA 12207
• DoD 5000
Slide 32
Standards Detailed Overview
• EIA/IS-632
• IEEE 1220-1998
• ANSI/EIA-632 Processes for Engineering a System
• ISO/IEC 15288
• IEEE/EIA 12207
• DoD 5000
Slide 33
Standards Detailed Overview
• EIA/IS-632
• IEEE 1220-1998
• ANSI/EIA-632
• ISO/IEC 15288 Systems Engineering – System Life
Cycle Processes
• IEEE/EIA 12207
• DoD 5000
Slide 34
Standards Detailed Overview
• EIA/IS-632
• ANSI/EIA-632
• IEEE 1220-1998
• ISO/IEC 15288
• IEEE/EIA 12207
Industry Implementation of
International Standard ISO/IEC 12207:
– IEEE/EIA 12207.0 Software Life Cycle Processes
– IEEE/EIA 12207.1 Life Cycle Data
– IEEE/EIA 12207.2 Implementation Considerations
• DoD 5000
Slide 35
Standards Detailed Overview
• EIA/IS-632
• IEEE 1220-1998
• ANSI/EIA-632
• ISO/IEC 15288
• IEEE/EIA 12207
• DoD 5000 (policy)
– DoD 5000.1 The Defense Acquisition System
– DoD 5000.2 Operation of the Defense Acquisition
System
– Interim Defense Acquisition Guidebook (formerly DoD
5000.2-R)
Slide 36
DoD 5000
DOD 5000.2
Requirements and Acquisition Process
Overarching Policy
NSS/NMS/Joint vision
Joint Concept of Operations
Functional
Area
Analysis
Functional Area
Functional Concept
Integrated Architecture
Feedback
D
O
T
M
L
P
F
MS B
- Materiel Process
Analysis of
Materiel
Approaches
MS C
CDD
MS A
DOTLPF
Process
JROC DAB
CPD
AoA
ICD
JROC
CD
Technology
Development
Concept
Refinement
DAB
JROC DAB
Increment 1
Demo
AoA – Analysis of Alternatives
ICD – Initial Capabilities Document
CDD – Capability Development Document
CPD – Capability Production Document
CD – Concept Decision
DAB – Defense Acquisition Board
MS – Milestone
NSS – National Security Systems
JROC – Joint Requirements Oversight Council
DOTMLPF – Doctrine, Organization, Training, Material, Leadership, Personnel, Facilities.
MS B
Demo
MS C
Increment 2
MS B
Demo
MS C
Increment 3
From New Signed DoD 5000.2, 12 May 2003
Slide 37
USD AT&L
USD (AT&L)
From Evolutionary Acquisition and Spiral Development, USD (AT&L), April 2002
Slide 38
DoD 5000 (cont)
DOD 5000.2
User Needs &
Technology Opportunities

Process entry at Milestones A, B, or C

Entrance criteria met before entering phase

Evolutionary Acquisition or Single Step to Full
Capability
(Program
Concept
Refinement
C
B Initiation)
A
Technology
Development
System Development
& Demonstration
IOC
Production &
Deployment
Concept
Decision
Design
Readiness
Review
Pre-Systems Acquisition
Systems Acquisition
LRIP/IOT&E
FOC
Operations &
Support
FRP
Decision
Review
Sustainment
From New Signed DoD 5000.2, 12 May 2003
Slide 39
Future of SE and SW Standards
INCOSE & JOC
MIL-STDs to Commercial Stds to CMMs
Systems
Engineering
1969
MIL-STD499
1974
MIL-STD499A
Data Item
Descriptions
1968-
1985
DOD-STD2167
1998
IEEE 1220
1998
1994
IEEE 1220
1994
1995
ISO/IEC
12207
1988
DOD-STD2167A
1987
DOD-STD1703
1988
DOD-STD7935A
1994
MIL-STD498
1995
IEEE 1498
/EIA 640
(Draft)
1998
IEEE/EIA
12207
1995
EIA/IEEE
J-STD-016
1999-2002
Instructions/
Handbooks/
Manuals/
Guides
2003
ISO/IEC
19760
Guide
2003+
ISO/IEC
15288
IEEE
1220
Harmon
2003+
ISO/IEC
15288
12207
Harmon
Supercedes
Derived From
(Interim)
2003+
DIDs
Defense
Specifications
2002
ISO/IEC
15288
1999
EIA/IS- CMMI
731
(SE-CM)
(Interim)
(Trial Use)
Software
Engineering
1980
MIL-STD1679A
1998
ANSI/EIA632
1994
EIA/IS632
1994
MIL-Std499B
(Not
Released)
1968MIL-STD1679
Primary Focus of this Tutorial
Sec Perry
Letter
Jan 1994
DIDs
1995
MIL-STD961D
2003
MIL-STD961E
Slide 40
Recommendations
JOC
• Stand on the Standards (Don’t Rely on Others)
• Read, Understand, Select, Tailor, and Apply Them
• Keep Abreast of Standards Evolution
• Develop a Corporate and/or Project Tailored Set of
Processes, Product Templates, and SEMP
• Map the Standards To and From the Processes,
Templates, and SEMP. Describe Any Tailoring.
• Start with a Pilot Project
• Refine the Processes, Templates, and SEMP
• Have Fun!
Slide 41
Summary
• Heritage of Systems Engineering and Software
Engineering Standards
• What is a System?
• What is Systems Engineering?
• What is Systems Engineering Management?
• Standards Process Overviews
• User Scorecard
• Standards Detailed Overviews
• Future of Systems Engineering and Software
Engineering Standards
• Recommendations & Summary
Slide 42
Almost the End!
JOC
• Questions?
Slide 43
THE END!
For More Information Contact:
John O. Clark
Northrop Grumman Information Technology
Defense Mission Systems
Warfare Systems Engineering
468 Viking Drive
Virginia Beach, VA 23452-7308 USA
john.o.clark@ngc.com
(757) 534-4805 or (757) 481-1504
Slide 44