NETC N7 Status
Update to AIM FRB
Roy Hoyt, NETC N74
George Vogel, NAVMAC 00C
Tiffany Dombrowski, AIM Pgm Mgr,
NAWCTSD
3 Apr 12
Overview
•
NAVEDTRA policy and process documents
•
NETC N7 policy/process for migration from NAVEDTRA
130/131 to NAVEDTRA 136 for new content development
•
NETC N7 learning content development IDIQ
•
Upcoming JDTA projects as candidates for NAVEDTRA 136 /
CPM-LO Module efforts
•
AIM Central Site implementation
•
AIM I-II/CPM/LO Module interfaces with ETMDS Atlas Pro
•
CPM status support of OCCSTD capture/validation
•
NETC/OPNAV N15 integration of NETC domain/acquisition
community business processes
Promulgated NAVEDTRAs
•
•
•
•
•
•
•
•
130B (Task-Based Learning Content)
131B (PPP-Based Learning Content)
132 (Testing)
133 (HPRR)
134A (Navy Instructor Manual)
135C (Schoolhouse Mgmt)
136 (ILE Learning Content)
137 (JDTA)
NAVEDTRA Drafts
•
•
•
•
138 (FEA)
All NAVEDTRA’s currently under revision
Revisions to be completed by Aug 2012
Re-engagement with NAVAIR Standards
to recommence in Sep 2012
Naval Education and Training Command
Course Development & Revision Process
Trigger Initiating Process
Date: 24Jan2012_V1/rh/ko/jtw
(1 of 2)
External Training
Requirement Sources:
Trigger Initiating Process
Training Requirement
Identification & Resource
Sponsor Commitment
NETCINST 1500.9
3 December 2010
NTSP Revision
OPNAV N1 Training
Requirement Sources
Operational Risk
Management (ORM)
Assessment
Revision to Enlisted
Occupational Standard
Requirement Sponsor
Provides Formal
Correspondence
Identifying
Training
Requirement
Fleet
Performance
Assessment
Resource Sponsor /
Training Support Agent
Commits
to Resource
Training
Requirement
Rating Merger
Direct Fleet
Input
Establishment or
Revision of a NEC
Human Performance
Requirements Review
(HPRR)
End
Process
NAVEDTRA 133
Human Performance
Requirements Review
Management Manual
June 2011
Perform
Job Duty
Task Analysis
(JDTA)
Perform
Front End
Analysis
(FEA)
Perform Content
Quality Review for
Content Re-Use
or Re-Purpose
Develop
Business Case
Analysis
(BCA)
NAVEDTRA 137
Job Duty Task Analysis
(JDTA) Management Manual
July 2011
Front End Analysis
(FEA) User Guide
NETCINST 1500.6
9 March 2010
NAWCTSD Orlando, FL
Quality Evaluation Tool
Technical Report 2005-002
June 2005
Business Case Analysis
(BCA) Policy
NETCINST 1510.3
20 October 2009
Develop
Training
Project Plan
(TPP)
Develop
New Course
or Revise
Existing Course
and Pilot
Deliver
Course of
Instruction
Course Development / Revision End - to - End Process
NETC Course Development / Revision End - to - End Process
Course Development
&
Revision Process Color Key:
External
External Training
Training
Requirement
Requirement Sources
Sources
Requirement Sponsor &
Resource Sponsor Actions
OPNAV
OPNAVN1
N1Training
Training
OPNAV
N1 Training
Requirement
Sources
Requirement
Sources
Requirement Sources
Course
Development
and
NETC
Course
Development
Revision
Process
and
Revision
Process
NAVEDTRA 130B
Task Based Curriculum
Development Manual
August 2009
NAVEDTRA 135C
Navy School
Management Manual
March 2010
NAVEDTRA 131B
PPP Based Curriculum
Development Manual
November 2010
NAVEDTRA 134A
Navy Instructor Manual
August 2009
NAVEDTRA 136
ILE Course
Development & Life-Cycle
Maintenance Manual
November 2010
NAVEDTRA 132
Navy School
Testing Program
Management Manual
March 2011
Trigger Initiating E2E Process:
Naval Education and Training Command
Course Development & Revision Process
External Training
Requirement Sources
*
Date: 24Jan2012_V1/rh/ko/jtw
(2 of 2)
NTSP Revision
Operational Risk
Management (ORM)
Assessment
*
*
*
Fleet
Performance
Assessment
Direct Fleet
Input
NAVEDTRA 137
Job Duty Task Analysis
(JDTA) Management Manual
July 2011
Front End Analysis
(FEA) User Guide
NETCINST 1500.6
9 March 2010
NAWCTSD Orlando, FL
Quality Evaluation Tool
Technical Report 2005-002
June 2005
Business Case Analysis
(BCA) Policy
NETCINST 1510.3
20 October 2009
Perform
Job Duty
Task Analysis
(JDTA)
Perform
Front End
Analysis
(FEA)
Perform Content
Quality Review for
Content Re-Use
or Re-Purpose
Develop
Business Case
Analysis
(BCA)
NAVEDTRA 130B
Task Based Curriculum
Development Manual
August 2009
NAVEDTRA 135C
Navy School
Management Manual
March 2010
NAVEDTRA 131B
PPP Based Curriculum
Development Manual
November 2010
NAVEDTRA 134A
Navy Instructor Manual
August 2009
NAVEDTRA 136
ILE Course
Development & Life-Cycle
Maintenance Manual
November 2010
NAVEDTRA 132
Navy School
Testing Program
Management Manual
March 2011
OPNAV N1 Training
Requirement Sources
Revision to an Enlisted
Occupational Standard
Develop
New Course
or Revise
Existing Course
and Pilot
Develop
Training
Project Plan
(TPP)
Course Development / Revision End - to - End Process
NETC Course Development / Revision End - to - End Process
Rating Merger
Establishment or
Revision of a NEC
Course Development & Revision
Process Color Key:
Learning Center
Change in
Work Requirement
Course
Surveillance
External Training
Requirement Source
Formal Course
Review
Fleet Feedback
As Directed
by the CCA
Human Performance
Requirements Review
(HPRR)
*
NAVEDTRA 133
Human Performance
Requirements Review
Management Manual
June 2011
*
External Training Requirement Sources
Requires NETCINST 1500.9 Submission
*
OPNAV N1 Training Requirement Sources
Change in
Delivery Method or
Performance Standard
Triggers That Could Cause a LC
to Conduct a HPRR
Possible Take-always from a HPRR
Change in Resource
Requirement; CDP
Addition or Deletion
NETC Course Development and
Revision Process
NETC Policy Documents
Change in
Course Length
Deliver
Course of
Instruction
NETC N7 Policy/Process for Migration from
NAVEDTRA 130/131 to NAVEDTRA 136
• NETC NOTE defining policy:
‒ Proposed Verbiage: Any new development
within the NETC domain or revision of 50% or
greater will be performed using AIM CPM/LO
Module. Legacy AIM I/II will remain for the sole
purpose of sustaining existing courses and
content that do not reach the above threshold.
LC’s should strive to convert all courses to AIM
CPM as workload permits.
NETC N7 Learning Content Development
IDIQ
• Award status
• Will be primary vehicles for NETC Learning
Centers to acquire new content and revise
existing learning content
• Role of CPM/LO Module and interface with
CBT authoring tools
Upcoming JDTA projects as Candidates for
NAVEDTRA 136 / CPM-LO Module efforts
• JDTAs required for all revisions that add new
work to a course (tasks) regardless of
development tool (AIM I/II/CPM).
• New builds within NETC will use CPM/LO
Module
AIM Central Site Implementation
•
•
•
Management points of contact:
‒
NETC N74: Leslie Desenburg
‒
NETPDTC: Peg David
Center-by-Center implementation schedule:
‒
Managed by Leslie Desenburg
‒
Resumed in legacy environment in Jan 12;
transition to eDMZ upon ATO granting
Peg David to brief in more detail
Center
AIM POC
Revised Post C&A Plan
Submission
CID
Donald Kania
Dec/Jan
CSS
Michael Buechel
Jan
CSCS
Jessie Harris
Jan/Feb
CHAPS
Claire Olona
March
CPPD
Rick Bly
Apr
SWOS
D. Harrison-Youngs
Apr
CEODD
Marion Conley and Frank Carbone
May
CSF
Roy Wilde
May
SLC
Pedro Moore
Jun
AIM I-II/CPM/LO Module Functional
Interfaces with Atlas Pro
• Atlas Pro LMS: AIM I/AIM II/LO Module will output
SCORM 2004 ILT content packages that can be
delivered to ECR and tracked via LMS
• ROCCE: LO Module will export to and import from
ROCCE CBT design data and metadata to support
integrated development and life-cycle maintenance
• Assessment Engine: AIM I/AIM II/LO Module will
output test planning data and test items to
Assessment Engine and import test item analysis
data
OCCSTDS Support in CPM
•
•
How did we get here?:
–
Started with NETC N74/NAVMAC discussions
–
AIM Team provided a CPM “sandbox” for NAVMAC familiarization
–
NAVMAC developed an OCCSTDS Storybook PPT to describe highlevel functionality
–
Initial OCCSTDS tab implementation in Rel 5.0 for
creation/management of OCCSTDS data by NAVMAC – crawl
functionality
Working toward business rule definition of:
–
How OCCSTDS data pulls forward into JDTA tab
–
Life-cycle impacts of OCCSTDS revisions on JDTA-based learning
content
Integration of NETC Domain/Acquisition
Community Business Processes
NETC N74 working with aviation community
(Kelee Plagis of CNAF) on ‘harmonizing’
NAVEDTRA 136-137-138 business process with
that in Naval Aviation Training System (NATS)
Handbook for NETC domain and acquisition
community standardization
** Will recommence Sep 2012 post NAVEDTRA
revisions and Stand-up of OPNAV N9’s
•
Questions?
Backup Slides
AIM Interface with Atlas Pro LMS
Technical Data Repository
[XML/HTML/smart PDF IETMs as well as S1000D Issue 3 IETMs]
Links to Authoritative Tech Data / Updates
AIM I / AIM II / LO Module
ILT Development and
Maintenance
- complete ILT learning object
development
- change impact identification and
content versioning
- test items
- SCORM XML output of approved
baseline content package
Legend
Baseline content authoring tools
Content delivery tools
Baseline ILT
content
Updated ILT
content
LMS
- direct delivery of ILT
- student accounts and tracking mgmt
- presentation support and
classroom mgmt provided by
NetSupport School or equivalent ECR
software solution
- student performance / completion
data entered into LMS manually by
instructor
ILT LP/TG
content
controlled by
classroom
instructor
Student
performance
data entered
by instructor
Electronic Classroom
AIM Interface with ROCCE
Technical Data Repository
[XML/HTML/smart PDF IETMs as well as S1000D Issue 3 and 4 IETMs]
Links to Authoritative Tech Data / Updates
Content Outline
Draft w
Versioned
Learning
Objectives and
Metadata
LO Module
Baseline ILT
content
ILT Development
Self-paced Content Design
Content Planning
Module (CPM)
Versioned
Learning
Objective and
Content Outline
Updates
Blended Content
Surveillance/ILT Maintenance
Updated ILT
content
Atlas Pro
LMS
Work Performance
Definition
Blended Learning
Content Design
Self-paced
content
design
data
Change
Completed
Impact
self-paced
data for
content
self-paced
data
content
- deliver, track, and
report run-time ILT and
self-paced content
Revised
selfpaced
content
data
Baseline selfpaced
content
ROCCE
Legend
Authoring tools
Content delivery tools
Schema-based API
Self-paced Content
Development /
Maintenance
Updated selfpaced content
Learner
PC for
selfpaced
ECR for
ILT
AIM Interface with ROCCE (detail)
LO Module
ILT Development / Self-paced IMI Design / Blended Content Surveillance-Maintenance
- complete ILT learning objects
- test items
- detailed IMI content outline and
- change impact identification for IMI
storyboard/lesson spec report with links to JDTA-defined
content
performance reqts and to authoritative tech/procedural data
- export preliminary IMI design data/metadata to standard XML schema from database
- import final IMI content data/metadata/URL links to LO Module database
Content outline;
Metadata;
links to JDTA and
IETMs;
SME inputs on
narrative,
interactions,
graphics;
test items
Finished IMI data
and metadata to
support
surveillance /
maintenance
Chg Impact data
to individual
screen level in
self-paced IMI
Revised IMI data and
metadata to support
surveillance /
maintenance
ROCCE
Self-paced IMI Development / Surveillance-Maintenance
-
dvlp initial self-paced IMI on-screens from design input
coord review comments
finalize and publish IMI content
export data/metadata
update IMI per Chg Impact Reports
tests
- export finished initial and revised IMI data/metadat/HTML URL link
to standard XML schema from database
AIM Interface with Assessment Engine
Legend
Content Planning Module (CPM)
OCCSTDS data
Existing
Interface
Learning Objectives/
COI data
Job Duty Task
Analysis (JDTA) data
ROCCE/
Assessment
Engine
(AE)
All ILT and selfpaced in-course
testing
AIM I/AIM II
Test item analysis data
Test data for ILT/CBT incourse exams
[test items plus test planning
data]
Test item analysis data
AIM
ETMDS
application
Learning
objectives,
content
outline,
JDTA Links
Test data for ILT in-course exams
[test items plus test planning data]
Planned
Interface
Learning
Object [LO]
Module
(ILE ILT
content
objects/CBT
object design)
(Traditional
LP/TG
Content)
Note: existing
capability to
export AIM I/II
test items to
CeTARS testing
via standard
Excel model
AIM Interface with Assessment Engine
(contd)
ROCCE/Assessment Engine Test Item Types Support for ETMDS
Multiple choice with option for "All of the Above" and "None
of the Above"
Multiple Select Select one or more correct answers
Match list of text strings in one column to another list of text
Matching
strings in a second text column
One or more blanks in a question and each blank can contain
Fill in the Blanks
one or more correct text answers ( case sensitive)
Fill in the Drop
One or more dropdowns in a question and each dropdown can
Down
contain two or more items in the dropdown
True/False
Ranking - Sorting Sort two or more of text strings
Create a background image providing the hot spot coordinates
Hot Spot
to select to provide your answer
Ability to create a question and provide a answer that falls in a
Numeric
numeric decimal range
Match list of text strings in one column to another list of text
Drag and Drop
strings in a second text column
Narrative description of instructor-administered performance
Performance
assessment (not support by ROCCE AE)
Multiple Choice
AIM Test
Module
X
X
X
X
X