Human Systems Integration Metrics (HSI-Metrics)
Training Documents
Report
s
Graphi
cs
HSI-Metrics Portal
COST
~
SPIDER
Data
IBFT
Web Services
Metrics
TORIS
ESC
F
F
F
F
F
Insert
Delete
Scroll
12
3F
56F
7M
8F
990_+\
1F
1'"[=
12345678
}]Enter
| Print
Q
W
E4F
RT
YUIOP{
ASD
ZXC
Alt
N
H
JKL:
,<>?
.F
/;1-F
Shift
FG
VB
Shift
12`Tab
Alt
012
Introduction and Methodology
Introduction
The Human Systems Integration Metrics (HSIM) pilot project focuses on the data
required to support the Human Systems Integration (HSI) elements of Command,
Control, Communications, Computers and Combat Intelligence (C5I) training. HSIM will
provide a Measures of Effectiveness (MOE) not now available by pulsing data from the
Afloat Training Group Pacific (ATGPAC) Operational Readiness Hub. This data, along with
data from Space and Naval Warfare (SPAWAR) sources, such as the Integrated Battle
Force Training (IBFT) and the Enlisted Manpower Report (EMR) will be analyzed through
Computer Aided Software Engineering (CASE) or similar process. The SPAWAR-PEO
Integrated Data Environment & Repository (SPIDER) is SPAWAR’s secure web
environment where the HSI-Metrics portal functions and resides.
The HSIM Project is intended to demonstrate both the ability and utility of web
services protocols to acquire and process information residing on multiple Department of
Navy databases. It does this by providing a pilot web services based application (HSIM)
intended for use by a subset of U.S. Navy data consumers. HSIM was designed to allow
an Acquisition Program Manager responsible for a C5I system to view a metric reflecting
the contribution of required training courses for the effective operation of that system.
This specific application was chosen because it provided an answer to a question that is
not currently supported by U.S. Navy databases and because it required the use of data
from more than one U.S. Navy database.
Introduction and Methodology
Methodology
To form this metric for a particular system, HSIM uses data from three separate databases.
First, the Training and Operational Readiness Information Services (TORIS) database, maintained by the ATGPAC
provides a score for a sailor’s operation of the system.
Second, the IBFT provides a list of the courses that the sailor took and that are related to the system.
Third, because TORIS identifies sailors by pay rate, last name, and their assigned ship at the time of evaluation, the
Enlisted Manpower Report (EMR) is used to identify the sailor in the TORIS database so that he can be found in the IBFT.
Finally, training cost is the cost of the type of training per day times the actual number of days training provided. In
the first step of the algorithm, the sailors found in the TORIS database who were evaluated on the requested system are
identified and a score calculated from the data within TORIS. This data contains, for each system, the steps required to
operate the system were completed and the amount of time taken by the sailor. The score is calculated by Dividing the
number of steps completed by the sailor with the number of steps required and multiplying that by a weighting factor w1,
Dividing the minimum amount of time expected to perform the tasks by the amount of time taken by the sailor and
multiplying that by a weighting factor w2,
And adding the quantities.The weighting factors are chosen by HSIM for each system to produce a maximum score of
100.The TORIS database does not identify sailors by Social Security Number (SSN) or a unique employment id. Rather, they
are identified by their pay-grade, rate, last name, and the ship to which they are assigned when evaluated. In order to
convert that information to an identifier that can by used to look up the sailor in the IBFT, the EMR is consulted to find their
SSN so that can be used with the IBFT for the next step. The SSN is used internally while generating the report and is never
made available to any user.
The next step consults the IBFT to determine the training completed by the sailors at the time they were evaluated.
Only training that the IBFT list as for the system is considered. Note that the IBFT table consulted holds all training courses
related to a system, not just the training required.
Thus, among a set of sailors operating a system, even if all have received the required training by the time they are
evaluated, some sailors will have received additional training related to the system. The HSIM algorithms sorts the sailors
into groups so that all sailors in a group have all received the same system related training.
For each of these groups, an average and a median of their scores are calculated. To produce a metric reflecting the
cost effectiveness of training, the average scores are divided by the cost of all the training they received.
Finally, these results are displayed in a table, each row of which corresponds to one of the groups of identically trained
sailors. The total training cost is the cost of the type of training per day times the actual number of days training provided.
Other reports are available from the HSIM web site. They include lists of training available that related to a given
system and lists of training that relate to any system on a given ship. These are described later in this document.
TABLE OF CONTENTS
Human Systems Integration Metrics (HSI-Metrics)
Introduction and Methodology
Introduction
Methodology
Use of the HSI-Metrics System
HSI-Metrics Portal: Opening Screen
HSI-Metrics Portal: Obtaining an Account
HSI-Metrics Portal: Logging On
HSI-Metrics Portal: Selecting the HSI-Reports Menu
HSI-Metrics Portal: Selecting Training Effectiveness
HSI-Metrics Portal: Selecting the Ships System
HSI-Metrics Portal: Selecting a Ship
HSI-Metrics Portal: Selecting All Training Available to a System
HSI-Metrics Portal: Selecting Course Details
HSI-Metrics Portal: Selecting List of All Training Courses in the IBFT to a
System or a Ship