FEA NETC Guidance

advertisement
Information solicited from you:
1. What is missing?
2. Do you have any Center specific requirements we should consider?
3. What can we do better (or recommendations to do differently)?
FEA NETC Guidance
NETCINST 1500.6
Triggers respond to demand signals and call for an
analysis of new or existing work requirements.
These demand signals may result in the development
of new or revised course content.
Revision to a Fleet Requirement Revision to an
Enlisted Occupational Standard, A New System Not
Addressed in the Acquisition Process
Fleet Feedback, Formal Course Review
Establishment/Disestablishment or Revision of a
Navy Enlisted Classification, Rating Merger,
As Directed by the Curriculum Control Authority,
Human Performance Requirement Review.
FEA User Interface
FEA Communication:
Reason for conducting NETC FEA (Trigger from
drop-down selection)
CPM Modification / FEA Functional Requirement
A CPM FEA field “Section 1: Reason for FEA” will
contain drop-down fields for ‘trigger’ leading to FEA
and any other fields that can be standardized based on
NETCINST 1500.6 (Triggers: Revision to Fleet
Requirement, Revision to an Enlisted Occupational
Standard, New System Not Addressed in the
Acquisition Process, Fleet Feedback, Formal Course
Review (FCR), Establishment/Disestablishment or
Revision of a Navy Enlisted Classification, Rating
Merger, As Directed by the Curriculum Control
Authority, and Human Performance Requirement
Review(HPRR), and other areas of feedback).
A CPM FEA “Section 1: Reason for FEA” field as
supplemental free text field for further clarification
with a limit of 300 characters
A CPM FEA “Section 1: Reason for FEA” field
containing check boxes to indicate If FEA for a new
or revised course.
NOTE: Section 1: Reason for FEA, must be
completed before the system will allow user to
proceed.
FEA NETC Guidance
NAVEDTRA 136
NETC FRONT END ANALYSIS
The NETC FEA occurs after the JDTA (see
NETCINST 1500.6 (series)). This analysis further
refines the FEA that is performed by the acquisition
community during the development of the NTSP (see
OPNAVINST 1500.76 (series)). The goal of the
NETC FEA is to further analyze the skills and
knowledge needed to perform the job, assess the
technologies available for training the skills and
knowledge, perform a media analysis to recommend
the best mix of delivery media, and determine the
best methodology to develop and deliver training
content that will satisfy the outstanding training need.
FEA User Interface
The analysis provides a list of alternatives (e.g.,
media strategies and methods) used in leveraging
existing training interventions for previously selected
tasks, and identifies interventions needed to be
developed. This analysis will be further refined
during the Design Phase and captured in the
Instructional Media Design Package (IMDP). During
the NETC FEA process, every attempt is made to
redeploy, rearrange, repurpose and rewrite (R4)
existing content.
The completed NETC FEA shall be routed to the
CCA for approval and NETC for concurrence.
NETCINST 1500.6
Document reason for conducting FEA
Reason for conducting NETC FEA (Trigger from
drop-down selection)
CPM Modification / FEA Functional Requirement
FEA NETC Guidance
NETCINST 1500.6
Document existing (AS-IS) training requirements
a. Existing training requirements can be captured
from Course Training Task Lists (CTTL), Personal
Performance Profile (PPP) Tables, or Training
Course Control Document (TCCD). This process
ensures all existing training requirements described
in the CTTL/PPP or TCCD are associated with the
existing course material. When submitting for
approval, attach a copy of the CTTL, PPP, or TCCD
with the FEA.
Note: If no CTTL/PPP or TCCD information exists
or is not available at the time of the FEA process, use
the most current JDTA data. If JDTA data does not
exist, it must be developed (refer to NETCINST
1500.4, JDTA process).
a. If using JDTA data, attach a copy to the FEA
document.
NETCINST 1500.6
Document new (TO-BE) training requirements
There are several ways to identify new training
requirements. These include periodic training gap
analyses, reviews of changes to operational or
maintenance requirements, and monitoring of
changes to equipment or systems. Regardless of how
the training requirements are identified, the
foundation is the Job Duty Task Analysis (JDTA).
The JDTA output PROVIDES THE INPUT TO
THE FEA PROCESS.
FEA User Interface
Existing (AS-IS) training requirements
Note: When conducting an evaluation of existing
training materials the Quality Evaluation Tool
shall be used to assess the materials under
consideration
Note: Organizations, as part of the NETC FEA,
are required to search for existing content before
creating new content (refer to DoDI 1322.26).
Such materials may be available at the Advanced
Distributed Learning-Registry (ADL Registry) or
DefenseImagery.mil
Existing interventions data can come from CTTL,
PPP, JDTA, and TCCD as well as other required
source searches – A copy of the source document
will link to the final submission documents for
approval
If no CTTL/PPP or TCCD information exists or is
not available at the time of the FEA process, CPM
will default to using the most current JDTA data.
If JDTA data does not exist, CPM will not allow
moving to next step in the process refer to
NETCINST 1500.4, JDTA process).
Enter New (TO-BE) training requirements in
order of precedence
CPM Modification / FEA Functional Requirement
The capability for auto-populating FEA fields if
applicable data already exists in CPM (see Appendix
A) (data may be obtained from CTTL, PPP, JDTA,
TCCD,and existing interventions)
A CPM FEA field titled “Section 2: Requirements
Part 1: Existing, Part 2: To-Be” will be entered in
free text format
A “search for existing interventions” functionality to
assist in populating existing (AS-IS) training
requirements (Search existing course(s) material for
Reuse, Repurposing and Referencing (R3) to support
new training requirements can populate drop-down
for selection by user if determined applicable – this
will give a starting point based on links to objectives)
User will select if existing intervention is adequate,
not adequate, or does not exist from drop-down
menu.
A CPM FEA field titled “Section 2: Requirements
Part 1: Existing, Part 2: To-Be” will be entered in
free text format
Functionality to allow addition of new (TO-BE)
training requirements as free text
FEA NETC Guidance
NETCINST 1500.6
Compare existing (AS-IS) training requirements with
new (TO-BE) training requirements and determine if
a gap in training does, or does not exist
FEA User Interface
Comparison findings of existing (AS-IS) training
requirements with new (TO-BE) training
requirements and determine if a gap in training
exists
If a gap exists, document differences (delta) in
training requirements
User will document differences (delta) in training
requirements
If no ‘gap’ exists, user will indicate so by
selecting “no gap exists”, otherwise, the user will
enter the delta in free text format
CPM Modification / FEA Functional Requirement
A search functionality to conduct semi-gap analysis
(comparison of As-Is and To-Be requirements) to
assist in populating training requirements
FEA NETC Guidance
NETC 1500.6
Search existing course(s) material for Reuse,
Repurposing and Referencing (R3) to support new
training requirements
If existing course material exists, evaluate for
potential use in new training requirements and
document
Note. Specify (in bold) which course(s) material will
be used for reuse, repurposing and/or referencing:
Reuse - Using the same content, without modification
Repurposing - Using the same piece of content in
new contexts or in different ways
Referencing - Taking relevant materials and changing
the examples, imagery, writing style, or removing
irrelevant information If there are no existing course
materials for R3, proceed to step 6
FEA User Interface
Search results for existing course(s) material for
redeploy, rearrange, repurpose and rewrite (R3) to
support new training requirements via links to
search engines for identification of existing
intervention for re-use and repurposing – once a
course is selected by the user, a selection boxes
will activate to allow user to indicate intent of
selected material (Reuse, Repurposing, or
Reference) to support new training requirements
Reusing, Repurposing, Referencing
A user can reuse, repurpose, or reference an
existing intervention once it has been approved.
The reused, repurposed, or referenced intervention
will appear as New in the location it was cited and
needs to go through the same Approval process as
a intervention, since it is being used under a
different occupational structure (i.e., a task being
reused under another duty) and its inclusion in the
new structure needs to be validated by authorized
personnel.
Reusing, repurposing, or referencing an
intervention, by default, will only link to the
selected objectives within the intervention as
identified by the originator.
Approving an intervention will cause the item to
be added to all locations the intervention item is
used.
Links to interventions can be added or deleted
without affecting the original intervention or any
other uses of it. Thus, two usages of an
intervention may be the same, similar, or
completely different.
CPM Modification / FEA Functional Requirement
Capability to search existing course(s) material for
reuse, repurpose or reference to support new training
requirements via links to search engines for
identification of existing intervention for re-use and
repurposing – once a course is selected by the user, a
selection boxes will activate to allow user to indicate
intent of selected material (Reuse, Repurposing, or
Reference)
FEA NETC Guidance
NETC 1500.6
Determine New (TO-BE), training requirements
delivery methods (list in order of precedence)
Education codes will vary depending upon the course
of instruction. When determining which code to use
for training delivery methods, see the complete list of
CeTARS database codes and a description of the type
of training each code represents (see Appendix C).
Determine which code is the best code for training
NAVEDTRA 132
Assign Performance Test Proficiency Level.
Following test type determination, it is necessary to
assign the level of skill proficiency that each learning
objective will be tested to, as determined by the
Requirement Sponsor. This should be the same level
that the learning objective is taught to.
1. The skill proficiency level is assigned by using
course source data elements, from the JDTA: verb,
(behavior), condition, and standard.
a. Behavior, (verb). A behavior is a Knowledge,
Skill, or Ability (KSA) that is observable and
measurable.
b. Condition. A condition identifies the situation
under which the trainee is expected to demonstrate a
behavior.
c. Standard. A standard defines the criteria for
acceptable performance in terms of time, quantity,
quality, and accuracy.
2. These three attributes provide the data necessary
for curriculum developers to assign the level of skill
proficiency that the course will be trained to and each
learning objective tested to. The goal is to match
what is done on-the-job as closely as possible; allow
technical documentation use if done on-the-job; test
for knowledge of safety by recall or observance; and
test for time if it is important on-the-job. Align each
learning objective to be tested to the appropriate level
of proficiency
FEA User Interface
Determination of new (TO-BE) training
requirements delivery methods (listed in order of
precedence)
Media selection will contain
Objective for project
TTA data elements for project specific tasks
Special Considerations (Geographical,
Sailorization, etc.)
Knowledge and/or Skill Level requirement for
project specific tasks (user will selection from
NAVEDTRA criteria)
Likert Scale elements from NETC criteria (20
categories – user will rate element each based on
1-5 scale). Note: This functionality will initially
be done via Excel spreadsheet, CPM will house a
place-holder for future development once process
is further defined by NETC
CPM Modification / FEA Functional Requirement
Drop-down selection option for CeTARs delivery codes
for the identification of delivery method for To-Be training
requirements (see appendix C)
Functionality to allow multiple selections of CeTARs
delivery method codes (to be selected in order of
precedence) and identify “Choice 1, Choice 2, etc.
Note: CeTARS codes changing – CPM will need to be
able to identify changes/ receive updatesA
CPM data field will be added as a multiple choice
selection for identifying tasks as “knowledge (K)” and/or
“Skill (S)” based training (check box) for tasks selected for
a project as part of the CTTL development
Where available “K” and “S” data from AIM I & II CTTL
or PPP tables pull forward to CPM
Tasks selected for the project will populate the “media
selection” sub-tab to further identify the level of
knowledge or skill requirement based on the NAVEDTRA
132 criteria. Selection will be made by allowing multiple
selection from standardized options
Level of knowledge and skill requirements will require
relative weighting to determine the appropriate level (via
an algorithm) in the event multiple levels are selected
Media Selection tab will populate with “objective for
project”, TTA data elements for tasks, K and/or S
designation
Media Selection tab will also contain free text field for
indicating Geographic, Sailorization, and other issues
impacting media selection options or considerations
Media Selection tab will contain a place-holder for data
elements for media selection based on Excel spreadsheet
(under development by NETC) and contain a Likert scale
for 20 categories used to determine and support media
selection recommendations
FEA NETC Guidance
NAVEDTRA 132
During the JDTA, attributes are assigned to each task
that will be used during NETC's Front End Analysis
(FEA). The output of the JDTA is the input to the
NETC's FEA.
Skill Proficiency Levels (SPLs). After careful
consideration, NETC has adopted a three level
instructional model: imitation, repetition, and habit.
The model provides a learning schema where basic
skills start low and progressively advance to more
sophisticated skills.
a. Skill Proficiency Level 1 (SPL1) - (Imitation). The
skill expectation for imitation is: can perform a task
but is not proficient. This level of proficiency
requires the condition of supervision. This level’s
attributes are: work will require corrective action, and
excessive time will be required to complete the task.
b. Skill Proficiency Level 2 (SPL2) - (Repetition).
The skill expectation for repetition is: can perform
tasks, but has not had enough repetitions to achieve
expert proficiency. This level of proficiency requires
the condition of minimal supervision. This level’s
attributes are: work may (but generally will not)
require corrective action, and time on task will be
within established standards.
c. Skill Proficiency Level 3 (SPL3) - (Habit).
Performance of the skill becomes second nature.
When the trainees reach this level, they are able to
create their own versions of the skill and teach others.
The skill expectation for habit is: can perform any
task with an expert’s proficiency. This level of
proficiency requires the condition of no supervision.
This level’s attributes are ―speed, accuracy, and
precision."
FEA User Interface
CPM Modification / FEA Functional Requirement
FEA NETC Guidance
NAVEDTRA 132 -. Knowledge Proficiency Levels
(KPLs). Knowledge proficiency in the NETC training
organization is scaled to three levels. The three levels are
based upon Bloom’s taxonomy of the cognitive domain
(which are collapsed from six to three). The three
groupings (levels of proficiency) from Bloom's six
categories are: (1) knowledge and comprehension, (2)
application and analysis, and (3) synthesis and evaluation.
These three levels of proficiency can be thought of as
degrees of difficulty that are progressively mastered (in
sequence). The following is a description of NETC's three
KPLs:
a. Knowledge Proficiency Level 1 (KPL1) - (Knowledge/
Comprehension). Knowledge proficiency expectations are:
knowledge - can recall data or information; comprehension
- understands the meaning, translation, interpolation, and
interpretation of instructions and problems (can state a
problem in one's own words). Knowledge is a fact, process
or procedure. It lacks ambiguity; there is only one correct
answer. Generally, there are rules and documentation for
correct answers.
b. Knowledge Proficiency Level 2 (KPL2) - (Application/
Analysis). Knowledge proficiency expectations are:
application - can use a concept in a new situation or
unprompted use of an abstraction (applies what was
learned in the classroom into novel work situations);
analysis - can separate material or concepts into
component parts so that its organizational structure may be
understood (distinguishes between facts and inferences).
Principles and concepts are added to processes and
procedures. There is some ambiguity, but there is always a
―best answer.
c. Knowledge Proficiency Level 3 (KPL3) - (Synthesis/
Evaluation). Knowledge proficiency expectations are:
synthesis - builds a structure or pattern from diverse
elements (put parts together to form a whole, with
emphasis on creating a new meaning or structure);
evaluation - makes judgments about the value of ideas or
materials. This level of proficiency requires the
performance of prediction, demonstration of concept
mastery, and implementation of principles in
accomplishing a task. Key skills are troubleshooting and
problem solving. In this situation, opinion lines up with
theory.
FEA User Interface
CPM Modification / FEA Functional Requirement
FEA NETC Guidance
NETCINST 1500.6
Provide recommendations and solutions to close the
gap in training
FEA User Interface
Recommendations and solutions to close the gap
in training
Once a gap in training has been identified, provide
recommendations for closing the gap. Include all
possible recommended delivery methods for each
Duty assigned
CPM Modification / FEA Functional Requirement
A field titled “Section 3: Recommendations” will
provide recommendations and solutions to close the
identified gap in training through free text entry
(Recommend using check box statements to identify
Skill and knowledge proficiency requirements to
automate system in selection of recommendation
based on future NAVEDTRA 132).
“Section 3” will auto-populate with each Duty
assigned still requiring training. Multiple selection
capability will be allowed as user’s are to include all
possible recommended delivery methods for each
Duty assigned.
“Section 3” will require user to indicate duty as
complete before moving on to “section 4”
NETCINST 1500.6
Prepare FEA Output Statement
The FEA output statement should contain a
detailed description of the gap in training, the
selected solutions/delivery methods and any options
to close the gap, and a rationale for the solution(s).
Provide bulleted item for each (Current situation,
New Requirements, Findings, and
Solutions/rationale). Include as much detailed
information as possible to convey the intended
outcome. Every effort should be made to ensure all
are in compliance with information assurance
associated with the recommendations and solutions
proposed
Output statement
Will contain a detailed description of the gap in
training, the selected solutions/delivery methods
and any options to close the gap, and a rationale
for the solution(s). User will have the option to
select predetermined bulleted items for each
(Current situation, New Requirements, Findings,
and Solutions/rationale) or be allowed to free text
in entries is a predetermined statement does not
adequately meet the user’s needs
A field titled “Section 4: Output Statement” will
utilize free text (for detailed description of gap in
training) and drop-down boxes (selected
solutions/delivery methods – pulled forward from
section 3, standardized bulleted statements for
Current situation, New Requirements, Findings, and
Solutions/rationale) to prepare and finalize NETC
FEA output statement in accordance with
NETCINST 1500.6
FEA will be formatted in accordance with
NETCINST 1500.6
Will have the capability for printing FEA to .pdf
Will have XML/Web service data output to
NETC/OPNAV systems that consume pertinent FEA
data
FEA NETC Guidance
NETCINST 1500.6
Note: Prior to routing the FEA to the Curriculum
Control Authority (CCA), for approval, complete the
FEA Approval Request, (see Appendix D), and the
FEA Requirements Sponsor Approval, (see Appendix
E) for concurrence, and attach each with the FEA.
NETCINST 1500.6
Finalize the FEA process
Finalize the FEA process. Route the completed
FEA to the CCA for approval. Attach any of the
following documents which are available; CTTL,
PPP, TCCD, or JDTA and all forms with the FEA.
FEA User Interface
When the user believes all elements of the FEA are
finished, it is Submitted by the user.
CPM sends an email to the user assigned the role of
Reviewer
The Reviewer logs into CPM and navigates to the
submitted FEA documents.
The Reviewer has the option to either Accept or Reject
the FEA. They cannot edit the FEA input.
On rejection, the user must enter an explanation.
During the rejection process, the user also has the
option to mark the FEA ‘Rejected for Update’. This
indicates to the original submitter that it should be
modified and re-submitted. If the FEA is just marked as
rejected, it can no longer be edited.
If the FEA is rejected, CPM sends the originator of the
FEA an email with explanation.
If the FEA is accepted, CPM sends the user(s) assigned
the role of Approver as well as the originator of the
FEA an email notification (CCA for approval and
NETC for concurrence).
Approvers have the same choices to make as the
Reviewer.
When the FEA has been Submitted a red flag will
appear on the Project indicating approval is pending.
When the FEA has been Accepted a green flag will
appear on the Project indicating the plan is approved
and the project can proceed accordingly. (Note: not
having a green flag does not prohibit users from
moving forward, however, approval is required before
project can be submitted).
The flags on an FEA will appear only if the user has
privileges to address the flag or is on the project team
(in the case of an approval flag). For example, a
Reviewer will only see flags for items that have been
submitted, but not accepted. Once the item is accepted,
they will not see the flag again. In this way, the
Reviewers and Approvers see flags for just the items
they need to deal with.
Once the FEA is approved, the flags will disappear for
the Reviewers and Approvers, indicating that no further
action is required on that FEA.
Approving an FEA does not mean all elements of the
project are approved, it just means the content of the
FEA has been approved and the User can move
forward with the BCA and project in accordance with
Navy Guidance.
CPM Modification / FEA Functional Requirement
Selection of choices to retrieve existing data from
CTTL, PPP, TCCD or JDTA Skills Hierarchy Report
Functionality to identify if CTTL, PPP, TCCD, or
JDTA Skills Hierarchy Report are not available – If
not available CPM will not allow final submission
until a JDTA is conducted in accordance with
NETCINST 1500.4, JDTA process and a JDTA
Skills Hierarchy Report can be accessed
A final submission button that will trigger an e-mail
to the designated authoritative reviewer and approver
with standardized statement for submission and
return standardized statement for approval (see
appendix D & E) –
System will populate form based on previous data
entered in CPM and link to source documents such as
CTTL, TCCD, JDTA, and PPP in accordance with
NETCINST 1500.6
Status built into FEA functionality (Incomplete,
Complete, Locked for Review, Approved)
Submit/ review /approval workflow built into FEA
functionality based on appropriate privilege levels
FEA NETC Guidance
FEA User Interface
CPM Modification / FEA Functional Requirement
Creating a New Version
A newer version of an FEA can be created only
within its originating Center, but may be created
on any usage within that Center. Select FEA from
the drop-down tab (same as KSATR Tree)
Highlight an approved FEA duty in the Skills’
Tree.
Click the Create New Version button. A new FEA
will be created indicating this is a revision and
populating the revision box as well as all
previously entered data.
User must modify the existing data to indicate
revisions requested by performing all
editing/submitting/accepting / approving actions
as with a new FEA.
Once the FEA revision is approved, the flags to
indicate that it has been submitted or accepted will
disappear.
The filtering drop-down on the Skills screen will
have an option to see recently approved Duties.
Flagging
On approval, flags will be generated on:
All usages within the JDTA of earlier versions of
the Duty.
All Modules/Lessons/Sections that cite any earlier
version of the Duty.
Flags will be generated on items regardless of
their status (thus, Approved items will get
flagged).
System flags (those that indicate related material
changes) will differ (in color?) from Maintenance
flags (those that indicate a change has been made
on an item). That is, a user will be able to tell the
difference between an intervention that was
flagged because it was modified vice a
justification that was modified.
FEA NETC Guidance
FEA User Interface
Versioning for Reuse
Only the latest approved version of an FEA can be
reused.
A reused FEA will get the same version number
as the original FEA. This is done to keep the
version numbers of a Skill in sync across all
usages.
When a newer version of an FEA is approved, the
following actions take place on all re-usages of
previous versions:
Flags are generated on all re-usages (as mentioned
in 0 above.
Any unapproved re-usage will be prevented from
being approved.
Any re-usage that has not been submitted will be
prevented from being submitted.
Any re-usage that has been submitted, but not
approved, will automatically be marked Rejected
for Modification, which will reject the FEA and
force the user to make any appropriate decision
and re-submit.
For each usage of an FEA with a newer version,
the appropriate user will have to decide on an
action to take:
If the newer version is desired, they can update
the usage to the latest version.
If the newer version is not wanted, they will need
to “break the link” to the original FEA, creating a
new FEA no longer tied to the original usage.
CPM Modification / FEA Functional Requirement
Data Manipulation
CPM will be modified to:
Conduct comparisons with other user-identified
projects
Capture FEA data as part of the Instructional Media
Design Package (IMDP)
Link TCCD, PPP, CTTL, or JDTA source data for
existing interventions to final approval request
Determine recommended solutions through weighted
calculation based on results of answers to questions
for the level Skill proficiency and level of
Knowledge proficiency requirement based in
NAVEDTRA 132 and algorithm for Likert scale
results from NETC data elements (currently Excel
spreadsheet)
Download