Modeling, Simulation and Analysis
Framework
(MSAF)
August 2013
Bottom Line Up-Front

AGI’s MSAF is an open, commercially available environment for rapid and re-usable
modeling, simulation and analysis across an enterprise
– Multi-domain, mission-driven analytics & modeling (supports Systems of Systems)
– Efficient re-use/creation of best of breed GOTs, custom and COTs tools
– Automated, scalable analytics for engineering and/or operational decisions
– Visually intuitive and robust interrogation and communication tools

The MSAF software enables analytics across key elements systems lifecycle
– Acquisition, engineering, training & mission operations
– Course of Action (COA) development, mission planning and event prediction
– Supports program & portfolio decision-making (Cost, Risk, Schedule, Capability….)

AGI software has improved efficiencies & effectiveness of analytical decision making
– Commercial model driving interoperability, extensibility and total ownership cost advantages
– Multiple DOD & industry agencies standardizing on STK
– Available and accepted analysis, collaboration and decision-making support tools
Pg. 2 of 20
Analytical Graphics introduction
 Industry standard software
– Model your system
– Analyze your mission
– Convey your results
Space Systems
C4ISR
 Offices in US, Europe and Asia
 Founded in 1989
Missile Defense
 40,000+ registered installations
 700+ buying organizations
 STK (FREE Offering)
 Desktop, server and
development API’s
UAV & Aircraft
Missions
RF & Cyber
Mission
Assurance
Systems Engineering – “Call to Action”
•…
•….
• Enterprise
discoverability,
consistency & usage
• Rapidly composed &
executed analysis
• Intuitive &
interactive decision
support
• Multi-domain &
mission enabled
environment
• Efficient use of trade
studies, simulations
& decision calculus
•…
• Standalone users
• Custom tools &
models
• Lengthy cycle
times
Pg. 4 of 20
Also see “DMMF – Results of Feasibility Study”, Frank Mullen, 2/21/2013
MSAF Core Goals

Model-based enterprise M&S framework
– Multi-level, Mission-driven simulation engine
– Engineering through campaign-level linkages
– Trade studies through Live, Virtual & Constructive simulation

Improved enterprise M&S efficiency and effectiveness
– Multi-role support for technology SMEs, Systems Engineers, data analysts, decision makers
– Scalable & distributed computational environment
– Collaboration support
– Data discovery

Deliver capabilities today which support trends in methods & needs
– Re-use capabilities (IP) currently available and in-use within the industry
– Allow for industry wide scalability & collaboration
– Leverage commercial software before custom SW or FOS, per 2009 DSB Study
– Deliver future capability – relying on adaptable API and data models
– Support evolution of M&S architectures, tools, models and methodologies

Evolve capabilities along a visible, industry-needs-driven path
Pg. 5 of 20
Modeling, Simulation, and Analysis Framework
(MSAF)
Decision Maker
• Scenario Design
• Analysis / Trade space
• Results View
System Designer
Role-based
Web-Portal
• Architecture
• Definitions
• Configurations
Decomposition, Integration, and Orchestration
Process control, Translation, and Traceabilty
Complexity
Nth
Level
Models
Correlation
Detailed
Engineering
Aggregation
System
Performance
Abstraction
Systems of
Systems
Nth
Level
Models
Simulation and Analysis Synchronization Environment
Temporal and Geospatial State - Commonality
Fundamentals
and Algorithms
Environment
and Interaction
Behavior and
Procedures
Data, Models, and Analysis Repository
Orchestration Governance: Model Schema, Data Model, Assumptions, and Integration Rules
Supplementary Models: Manufacturing, Costing, Optimization, Approximation, and trade algorithms
MBSE Architecture System Definitions: Structure and Parametric, Behavior, and Requirements
Architecture Execution - (Sequence, State, and Activity)
Pg. 6 of 20
Infrastructure Partner
• Visual environment for
process integration
• Graphically link analyses
together
• Perform trade studies
The workflow
Define
measures of
effectiveness
Model
Pg. 8 of 20
Discover and/or
build models
Combine into
system of
systems model
Simulate
Run simulations
and evaluate
performance
Analyze
Convey results
Leverage expertise
Mission Engineer
Design Engineer System Engineer Configuration Mgr
IT Manager
Decision Makers
Modeling Simulation and Analysis Framework
Synchronization
Tool Integration
Capability Acquisition
Ops Analysis
System Design
Pg. 9 of 20
Orchestration
Cluster Computing
Data Management
User-specific Workflows
Test & Evaluation
Data Interaction
Operational Planning
Wargaming
Training & Rehearsal
Video
Pg. 10 of 20
The use cases
 Model-driven, mission-based simulations
–
–
–
–
–
Simulate mission threads
Vet system performance in the definition phase
Compose system and Systems of Systems models
Manage and explore existing tools, data or models
Serve interactive analysis to the entire community
 Applied to:
–
–
–
–
–
–
Acquisition decision-making
Product development
Test and evaluation
Training and simulation
Course of action planning
Operations analysis
Pg. 11 of 20
Program Lifecycle Example
Verification
OA
ITF
JTP
Software
Development
•
•
•
•
•
Improved enterprise communication of analysis and results
Efficiently and consistently employ model-based analytical methods
Discoverable & managed collaboration environment
User-driven workflows to improve execution efficiency
Provide intuitive results and capability assessment visualizations
Pg. 12 of 20
MSAF
•
•
•
•
•
Custom Tools
Platform Models
Analysis results
Data & Scenarios
Workflows
Portfolio Assessment
Link model-based simulation to decision calculus
MSAF Reporting
Program Portfolio View
Block/
Option
Priority
Status/
Trend
Option A
Option B
Block/Option A Assessment
Capability /
Requirement
Priority
Capability X
1
Capability Y
2
Status/
Trend
Value
Cost
Risk
Elasticity
VV
$$
RR
EE
VV
$$
RR
EE
-
Priority
Capability Y
1
Capability Z
2
Pg. 13 of 20
Status/
Trend
+
Cost
Risk
Elasticity
-
VV
$$
RR
EE
+
VV
$$
RR
EE
MSAF Analysis
Block/Option B Assessment
Capability /
Requirement
-
Value
Value
Cost
Risk
Elasticity
VV
$$
RR
EE
VV
$$
RR
EE
Leverage existing GOTs, COTs & custom IP
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
COTS Tools
Scalable Networks – Qualnet
Mathworks - Matlab
Anark Core – data file exchange
Opnet - NG using HLA
Lightwave – IGES,STEP conversion
SystemVue by Agilent
LabVIEW
DOORS
IBM Rational
HFSS – antenna models
Xplane
Real Flow – Importing wave motion
RTLogic - Channel Simulator
Elekrobit - PropSim
Rhode & Schwartz–RF Channel Simulator
Spirent – GNSS Simulator.
CAST - Navigation
MSoft Excel, PowerPoint
Harpoon 3 Naval Warfare sim.
Virtual Sim Tasker - VirtualSim CGF
FuzzyTech. Fuzzy Logic Engine Controller
Sharepoint - collaboration
Pheonix Integation - Model Center
ESRI.
TruePlanning – Cost estimation system
CARPET - a radar simulation tool that
generates radar parameters
Pg. 14 of 20
GOTS Analysis and Operations Tools &
Data
• FalconView - comms analysis
• DCGS-AF
• EADSIM
• Navy's Missile Planning Tool by APL
• JMPS - by Gnostech
• Naval Sim System by Metron
• NETWARS - Cyber Hacking
• SEAS ( http://teamseas.com/)
• NASA SPICE and CCDS
• GPS Almanacs
• TLE data
• BVI - BattleSpace Visualization tool
• GDM (INSCOM )
• coming soon....
• ESAMS – by Booz Allen Hamilton
• HF RAD - OTH Radar model
Hardware/ Software/ Protocols
Touch Table
Next Computing
Scalable Display Technologies
Max Vision
MS Surface
Droid OS
Sys ML
Magnolia Forge.
Google Earth - KML import/export
MS Virtual Studio - through JAVA, Com,
.NET APIs
• TCP/IP API - network based interactions
• DIS/HLA/TENA
•
•
•
•
•
•
•
•
•
•
• NORAD - Operational Risk Assessment tool.
•
•
•
•
•
•
•
•
•
•
Data Providers, formats and Imagery
Scribe Workbench
Simulize - Flight Control
JP2, NITF, etc
DTED, DEM...
Navteq - urban data
ITU - satellite payload data
OCG
NMEA
AIS Data
Shapefile import/export
•
•
•
•
•
•
•
•
Third Party Applications
(also sold as a separate product by the
source company)
Remcom – Urban comms modeling
Alion - TIREM
VT Mak – SimMetrics
AER – Weather Data
SDL – Electro Optic Sensor Modeling
Satsoft – Antenna Design
ASI - Satellite Simulation
SAIC – Missile modeling
Off the Shelf Plug-ins
SolidWorks
Product Design
System/Mission Simulation
• Given design parameters, predicts
performance characteristics:
• Given performance characteristics,
predicts how a system will react to
various stimulus over time:
• How much will it weigh?
• How high can it fly?
• What will it cost?
• Useful for designing hardware
• Wrap your code or use plugins:
• Matlab
• Mathcad
• Excel
•Fluent
•Nastran
Pg. 15 of 20
• ANSYS
• LS-DYNA
• Price
• Seer
• CAD
• Hit rate?
• Access times?
• Throughput?
• Useful for designing systems
• Wrap your code or use plugins:
• Flames
• Magic Draw
•ProModel
• Rhapsody
• STK
•Extend
• Vensim
• Aceit
• Arena
Industry Scalability - Current STK customers
• DOD
• DTRA
• OSD / PA&E
• DISA
• Executive Agent for Space
• JFCC Space
• JFCC ISR
• Joint Navigation Warfare Center
• Joint Personnel Recovery
Agency
• Joint SOC
• Missile Defense Agency
• US Army
• US Army A2C2S
• US Army PEO C3T
• US Army 513th Military
Intelligence
• US Army AMRDEC
• US Army CERDEC
• US Army Electronic Proving
Grounds
• US Army Europe
• US Army Fort Gordon
• US Army Fort Huachuca
• US Army INSCOM
• US Army JITC
• US Army JTC: IED Integ. Center
• US Army Northcom
• US Army Research Lab – SLAD
• US Army SMDC
• US Army WSMR
• US Coast Guard
• US Coast Guard C2CEN
• US Coast Guard R&D Center
• US Marine Corp – MCCDC
• US Naval Observatory
• US Navy Information Operations
Cmd.
• US Navy NAVAIR
• US Navy NAVNETWARCOM
• US Navy NUWC
Pg. 16 of 20
• US Navy NAWC
• USAF 50th SW, 3 SOPS
• US Navy PMRF
• USAF AFB – JNIC
• US Navy SPAWAR
• USAF Vandenberg AFB
• US Navy NSWC
• USAF Wright Paterson AFB
• US Southern Command
• US Strategic Command
• USAF Cannon AFB
• USAF AFSTC
• INTEL
• USAF Electronic Systems Center • CIA
• USAF 21st SW 20th SCS
• DIA
• USAF 25th Space Range
• NGA
Squadron
• NRO
• USAF 453rd Electronic Warfare • NSA
Support
• ONI – JDISS CMMA
• USAF 45th Space Wing
• USAF NASIC
• USAF 50th SWS 1 SOPS
• USAF 601st Tyndall AFB
• LABS/FFRDCs
• USAF 918th Armament Systems • Institute for Defense Analysis
Group
• Johns Hopkins APL
• USAF A5XS
• Lawrence Livermore Natl. Lab
• USAF A9HQ
• Los Alamos National Lab
• USAF AFOTEC
• MIT Lincoln Lab
• USAF Technical Applications
• MITRE
• Pacific Northwest National Lab
Center
• USAF Arnold AFB
• Penn State APL
• USAF Buckley AFB
• Sandia National Lab
• USAF Det 1, 392nd Training
• Space Dynamics Lab
Squadron
• The Aerospace Corporation
• USAF Eagle Vision
• USAF Research Lab – Rome
• USAF Florida Air Natl. Guard
• USAF Research Lab – WPAFB
• USAF Germany
• USAF Research Lab – Kirkland
• USAF Holloman AFB
AFB
• USAF Kirkland AFB
• USAF SMC/SS (MDA)
• Civil Agencies
• USAF NORAD
• DHS
• USAF Patrick AFB
• Federal Aviation Administration
• USAF Pentagon
• FCC
• USAF Peterson AFB
• NASA AMES
• USAF Schriever 50th Ops Group • NASA Dryden
• USAF 50th SW, 1SOPS
• NASA Glenn
• USAF 50th SW, 2 SOPS
• NASA Goddard
• USAF AFSPC
• NASA Jet Propulsion Lab
.
• NASA Johnson
• NASA Kennedy
• NASA Langley
• NASA Marshall
• NASA Stennis
• NASA Wallops
• NOAA
• GeoEye
• Gray Research
• Harris Corporation
• Honeywell
• Huntington Ingalls
• InDyne, Inc.
• ITT Exelis
• L-3 Communications
• Commercial Supporting DoD • Lockheed Martin
• Accenture
• Mantech International
• Aerojet
• MDA Federal
• Aerospace Testing Alliance
• Miltec Corporation
• AeroVironment
• MTSI
• Alion Science & Technology
• Northrop Grumman
• Alliant Techsystems
• Orbital Sciences
• Apogee Integration
• Pratt & Whitney Rocketdyne
• Applied Defense Solutions
• Raytheon Company
• Applied Minds
• Rockwell Collins
• Applied Research Associates
• RT Logic
• ARES Corporation
• SAIC
• ARINC
• Scitor
• ATK (Alliant Techsystems)
• Serco
• Aurora Flight Sciences
• Sierra Nevada Corporation
• BAE Systems
• Skybox Imaging
• Ball Aerospace & Technologies • SkySentry
• BIT Systems
• Solers, Inc.
• Boeing
• Sonalysts
• Booz Allen & Hamilton
• Southwest Research Institute
• Brashear
• Spectral Sciences
• Braxton Technologies
• SRA
• CAST Navigation
• SRI International
• Cobham Analytic Solutions
• TASC
• COLSA Corporation
• Teledyne
• Computer Science Corporation • Textron Defense Systems
• Cubic Defense Systems
• The SI Organization
• DigitalGlobe
• Trimble Navigation Ltd.
• DRS Tactical Systems
• Ultra Electronics, ProLogic
• Dynetics
• United Launch Alliance
• EMSolutions
• United Space Alliance
• General Atomics
• UTC Aerospace Systems
• General Dynamics
• ViaSat, Inc.
MSAF Functional Capability Roadmap
 Collaborative multi-access, multi-role environment
– Web-accessible, cloud-utilized, virtual instantiations
 Integration, Aggregation, and Abstraction
– Access and integration of disparate and distributed models
 Problem-space decomposition and model orchestration
– Model assembly via information/data model mappings
 Common, synchronized simulation infrastructure
– Temporal and spatial state management
 Composite Execution and Simulation
– Complex trade space analysis (cost, capability, resiliency (risk), etc.)
– What-if, mission architecture/course-of-action discovery and assessment
 Data discovery, management, and evolution
– Searchable, scalable and federated configuration managed repositories
Pg. 17 of 20
Video 2
Pg. 18 of 20
Question for the Audience
 What are among the most used GOTs tool(s) in your
organization?
Pg. 19 of 20
Wrap-up
Our mission is as an industry resource to enhance Engineering
productivity
 Your feedback is needed
 Your collaboration is welcome
 Your support is desired
 Questions???
Pg. 20 of 20
Use Cases
USMC – Radar Acquisition Trade Study
Background Marine Corps artillery regiment
upgrade “Firefinder” radar
system to G/ATOR system.
Initial approach was 1:1
replacement (38 systems).
Approach
• Use STK to conduct Counter
Battery Radar (CBR) study.
Insert image here
• Incorporate optimal system
placement.
• Assess effectiveness against threat scenarios
Outcome
• >25% reduction in number of systems required (38  28)
• Saved $295M excluding reduction in operational costs
Pg. 22 of 20
Airborne ISR Study
Systems Engineering
HEADQUARTERS U.S. AIR FORCE A9
 Problem
– Determine optimal mix of
airborne assets to improve
kill-chain effectiveness
What ISR investments should the
Air Force make?
<?
 Solution
– STK sensors, platforms, scenarios, visualizations combined with
in-house models via MATLAB and Ruby
 Outcome
– Reduced typical study time from one year to one month
“STK has enabled A9 to quickly respond to some
of the most challenging questions in the DoD.”
— Timothy Booher, senior analyst, USAF
Pg. 23 of 20
Command ,Control, Battle Management and Communications Trainer
C2BMC Trainer
Problem:
The Missile Defense National Team
is building a C2BMC training system
that will teach operators to make
quick and accurate threat
engagement decisions
Solution:
STK software is used to generate
trajectories and missile tracks from
realistic sensors to be played into the
C2BMC operational systems
Outcome:
STK scenarios can be easily
constructed to train the C2BMC user.
The solution is deployed to
STRATCOM
AGI COTS technology allowed the MDNT to build an operational trainer in
months, on time and budget with minimal risk
Pg. 24 of 20
Naval Strike and Air Warfare Center
Improved Training – NSAWC
Problem: Manually intensive
procedures for pre-flight
planning and post-flight
learning
Solution: Use STK MSAF for
accurate, efficient and
visually intuitive learning
experience
Outcome: Integrated training mission model that allows instructors to model all
aspects of the flight and review outcomes with students using a dynamic
3D environment.
“Cost avoidance for re-flys
and
mission failure is off the charts”
Pg. 25 of 20
(Retired Naval Aviator)