Systems Engineering
Synopsis of Current SE Efforts within NDIA
Bob Rassa
Chair, NDIA Systems Engineering Division
National Defense Industrial Association
National Defense Industrial Association
SYSTEMS ENGINEERING DIVISION
CHAIR
Steering Committee
Affiliations & Liaisons
“Rusty” Rentsch - AIA
Ken Ptack - INCOSE
Jerrell Stracener - SMU
Steve Kuehl - AIAA
Paul Croll - IEEE Computer Society
Mike Cardinale - IEEE AESS
Rene Smith - SOLE
Les Orlidge - IEEE SCC20
Elliot Axelband - RAND Corp
Greg DiBenedetto - GEIA
John Kreger - Mitre
Ken Nidiffer - SEI
Systems Engineering Education & Training
Effectiveness
Committee
Committee
Alan Brown
Don Gelosh
Boeing
OSD (AT&L)SSE/ED
Tom Wickstrom,
John Snoderly
IBM
Defense Acquisition
Mike Ucchino
USAF/CSE
University
Mike Persson
U S Navy
(open)
U S Army
Gov’t Steering Committee
Bob Rassa
Div Chairs plus:
Pete Larkin - GD, Electric Boat
Jim Clamons - Harris Corp
Ted Kuriata – BAE Systems
Nick Fritz - Burdeshaw Associates
Jeff Dutton – Jacobs Technology
Jim Sturges - Lockheed Martin
Mark Schaeffer- ManTech Int’l
Paula Nowak - SAIC
Dev Banerjee - Boeing
Gregg Beardsley - L3 COM
Wendy Irion Talbot – CSC
Kristen Baldwin - OSD (Chair)
(open) – MDA
George Mooney - USAF
Jesse McCurdy - NAVAIR
Rebecca Davies - DCMA
(open) - FAA
Steve Kapurch - NASA
Jack Zavin - OSD(NII)
Doug Wiltsie – Army
Carl Siel – USNavy-ASN/RDA
Terry Jaggers – SAF/AQR
open – OSD/MRMP
Raytheon
(IEEE)
VICE-CHAIR
Hal Wilson
Northrop Grumman
2nd Vice-Chair
Geoff Draper
Harris Corp
Executive Advisory Group
NDIA
COMMITTEE EXECUTIVE
Sam Campagna
CMMI Project
Bob Rassa, Raytheon
CMMI Working Group
Geoff Draper, Harris Corp
Interoperability
Committee
Jack Zavin, OASD(NII)
Rich Eilers, IBM
Tom Croak, CSC
Software Experts
Panel
Paul Croll, CSC
Software
Committee
Paul Croll
CSC
Kristen Baldwin
OSD(A&T)SSE
Modeling & Simulation
Committee
Jim Hollenbach
Simulation Strategies
Gary Belie
Lockheed Martin
Automatic Test
Committee
Les Orlidge, AAI Corp
Steve Karlovic, EADS-NA
Enterprise Health
Management
Committee
Howard Savage
SCI
Dennis Hecht
Boeing (St Louis)
Systems
Assurance
Committee
Paul Croll
CSC
Kristen Baldwin
OUSD(AT&L)
Mitch Komaroff
ASD(NII)
Development Test & Evaluation
Committee
John Lohse, Raytheon
Tom Wissink, Lockheed Martin
Darlene Mosser-Kerner, OSD
System Safety Committee
Sherman Forbes, USAF
Paige Ripani, BAH
Engrg In Mfg Committee
Tom Christian, USAF
TBD, TBD
Quality
Assurance
Committee
Cyndi Reichardt
DCMA - HQ
Paul Thornberry
NSWC - Corona
(open)
Raytheon
Randy Baker
Boeing
Life Cycle Support
Committee
Joel Moorvitch
Raytheon
(Open)
OSD/MRMP
07/20/08
SE Division Affiliates/Partners












IEEE AES Society
IEEE Computer Society
IEEE Systems Council
INCOSE
SAE International
GEIA
AIA
AIAA
Software Engineering Institute, Carnegie Mellon
Southern Methodist University
RAND Corp
MITRE Corp
SE Division Charter: Objectives
•To serve as the NDIA focal point for the identification, study, and
resolution of issues associated with performance and costbenefits
derived
from
commercial-off-the-shelf
(COTS)
procurements for government and industry.
•To provide Government with collective industry viewpoints,
recommendations and advice on Military & Government Systems
Engineering, support and interoperability concepts, policies,
plans, programs, requirements, technologies, problems,
implementation or impact of pending legislation, regulations and
procedures. Special studies will be conducted to this end as may
be required.
•To foster mutual understanding and effective working
relationships between Government and industry for the purpose
of ensuring effective and reliable systems engineering, support
and interoperability concepts, and systems that meet
Government requirements at reasonable costs.
Mission Statement
To promote the widespread use of Systems
Engineering in the DoD Acquisition Process in
order to achieve affordable and supportable
systems that meet the needs of the military and
government users, and to provide a forum for the
open exchange between government and industry
to trade ideas and concepts, and develop a new
understanding of a streamlined acquisition
process.
OSD Interactions on SE

NDIA SE Div works hand in hand, literally on a
daily basis, with OUSD(AT&L) Systems and
Software Engineering on SE strategy issues.




Policy, key messages
Conduct Workshops & Summits on SE issues
Guides & Directives
CMMI
Top 5 Systems Engineering Issues





Lack of awareness of the importance, value,
timing, accountability, and organizational structure
of SE on programs
Adequate, qualified SE resources are generally not
available within Government and industry for
allocation on major programs
Insufficient SE tools and environments exist to
effectively execute SE on programs
Requirements definition, development and
management is not applied consistently and
effectively
Poor initial program formulation
NDIA SE Division Formal Report submitted to OSD, April 2003
Top 5 SE Issues-2006 update

Key systems engineering practices known to be effective are not
consistently applied across all phases of the program life cycle.

Insufficient systems engineering is applied early in the program
life cycle, compromising the foundation for initial requirements
and architecture development.

Requirements are not always well-managed, including the
effective translation from capabilities statements into executable
requirements to achieve successful acquisition programs.

The quantity and quality of systems engineering expertise is
insufficient to meet the demands of the government and the
defense industry.

Collaborative environments, including SE tools, are inadequate to
effectively execute SE at the joint capability, system of systems
(SoS), and system levels.
Report submitted to OSD, August 2006
Top SW Issues
•
•
•
•
•
•
•
The impact of requirements upon software is not consistently
quantified and managed in development or sustainment.
Fundamental system engineering decisions are made without full
participation of software engineering.
Software life-cycle planning and management by acquirers and
suppliers is ineffective.
The quantity and quality of domain-knowledgeable software
engineering expertise is insufficient to meet the demands of
government and the defense industry.
Traditional software verification techniques are costly and
ineffective for dealing with the scale and complexity of modern
systems.
There is a failure to assure correct, predictable, safe, secure
execution of complex software in distributed environments.
Inadequate attention is given to total lifecycle issues for COTS/NDI
impacts on lifecycle cost and risk.
Report submitted to OSD, Sept 2006
Major Prior Activity
Conduct Workshops on comprehensive attributes of
SE, especially the ancillary aspects such as Test &
Evaluation, Education, Program Performance,
Quality, etc. – all of which are ingredients or have
relevance to good SE








Education Summit, October 2003
Program Performance Summit, June 2004
BIT/Prognostics Workshop June 2004
Test & Evaluation in SE Summit, August 2004
Quality Summit, November 3&4, 2004
Systems Engineering Conference (every October)
Net Centric Operations Conference (every Spring)
CMMI Technology Conference (every November)
Major 2006 Activity












Update of Top 5 SE Issues
Top 5 (7) SW Issues
Review OSD Risk Mgmt Guide (Mar 06)
Review Contracting for SE Guide (May 06)
Software (Systems Assurance) Workshop, Sept 05
CMMI Issues Summit, Sept 05
ONR Integrated Topside Workshop, Sept 06
OSD “SE Town Hall” May 05
SE Effectiveness Study – ongoing
Navy NCEP Guide Review, Sept 05
BIT/Prognostics Workshops, 2005-2006
OSD/NDIA Top 5 Programs
Major 2007 Activity

Navy Topside Workshops
 SE Effectiveness Study
 Systemic Root Cause Analysis
 Systems Assurance Guidebook
 CMMI V2.0/Beyond v1.2 Workshops
 USAF SE Effectiveness Study
(National Academy of Sciences)
 SEP Preparation Guide Review
 Navy SW Development Techniques Review
 DoD Software Acquisition Workshop
Major 2008 Activity




Chartered SW Industry Experts Panel
Chartered Architecture Framework Working Group
Formed Engineering in Manufacturing Committee
Serve as “Technical Arm” of the NDIA ICPM



Formed CMMI Working Group
Finalized Systemic Root Cause Analysis Study





Report in final preparation
Completed Systems Assurance Guidebook
Review of USAF Systems Assessment Model
Participate in DoD SPRDE Expert Panel


Industrial Committee on Program Management
SPRDE = Systems Planning, Research, Development and
Engineering Career Field
Task on Chemical Risk Management
Task on Health Management Systems

i.e. Prognostics/Diagnostics
Top 5 Programs Awards




Given to Top 5 Programs based on performance driven by
SE
Dual Awards to government and industry
Formerly Top 5 SW Programs, awarded at STC
2007 winners:





Advanced Field Artillery Tactical Data System (AFATDS)/Army
PM Battle Command/Raytheon Ft Wayne
DDG 1000 MK57 Vertical Launching System (VLS) /Raytheon
Integrated Defense Systems/BAE Systems
A-10 Precision Engagement /USAF Aeronautical Systems
Center/Lockheed-Martin Systems Integration
Advanced Extremely High Frequency AEHF) Mission Control
Segment (MCS)/USAF Military Satellite Communications
Wing/Lockheed Martin Space Systems
Portable Excalibur Fire Control System (PEFCS) /Army EPIAFS
PM/Army ARDEC Fire Control Systems Picatinny
CMMI®

Capability Maturity Model Integration®

Developed to cause Integration of software engineering,
systems engineering, general hardware/design engineering,
and program management
NDIA SE Div is overall Industry sponsor, and serves as CMMI
Steering Group Chair
OSD Systems & Software Engineering is DoD sponsor
Software Engineering Institute is designated custodian
Released Dec 2001
Update v1.2 (CMMI-DEV) released Aug 25, 06









Incorporated many “integrity” changes
Includes new “Constellation” architecture, with CMMI-DEV,
CMMI-ACQ, and CMMI-SVC
CMMI-ACQ released mid-2007 – CMMI for Acquirers!
CMMI-SVC in development – CMMI for providers of service
For more info on CMMI go to http://www.sei.cmu.edu/cmmi
®CMMI
is registered by the U S Patent & Trademark Office by Carnegie Mellon University, Software Engineering Institute
IEEE SE Council

IEEE Systems Council formed






IEEE Societies are almost 100% focused on Research and
Technology
Systems Council focuses on Application
SE Council plans to bring tremendous leverage to our
industry community (65% of all IEEE members are
industry)
IEEE Systems Conference:
 April 2007, Honolulu
 April 2008, Montreal QUE
 April 2009, Vancouver BC
IEEE Systems Journal, 1st issue 2Q2007
IEEE SE Accreditation effort starting now
 Will be followed shortly by SE Certification to include
domain experience
Implications for Academia



OSD and Services have recognized need for better
SE on programs
Services have allowed their SE capability to atrophy,
presuming that all SE content will come from
Industry
Both Industry and Services are in need of more
experienced SE talent



All major defense contractors have partnered with academia
on SE master’s programs
Per Stevens Institute data, there are only 30 SE Master’s
programs in US Universities, and 70+ total SE programs
Many companies have additional in-house programs for
senior SE capability development
Questions or
comments?


Q
u
e
s
t
i
o
n
s
?
C
o
m
m
e
n
t
s
?