D P A
D
ESIGN OF A
P
ROCEDURE
A
NALYSIS
T
OOL
(PAT)
F
OR
A
FFORDABLE
H
UMAN
F
ACTORS
C
ERTIFICATION OF
A
VIATION
D
EVICES
New Regulation
More thorough device certification
DER
Team Members: Heather Johnson, Houda Kerkoub, Shaida Latifi, Mumtahina Mahmud, Alexis Nittoli
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Agenda
Context
Stakeholders Analysis
Problem Statement
Proposed Solution
Objectives Hierarchy and Requirements
Method of Analysis
Prototype: Procedure Analysis Tool (PAT)
Business Case - Alternatives
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
2
Flightcrew Errors as Major Accidents Factor
3
139 commercial jet aircraft accidents between 1993-2002
67% of error was due to flight crew
In 2009, flight crew errors were 56%
Source: Statistic analysis of airplane accidents, Copyright 2005-2014
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
In Response to Accidents
Complemented by
AC 25.1302
Issuance of FAR 25.1302 enforcing Human Factors evaluation in the device certification process.
Requirements
“ the applicant
1 must show that […] flightcrew […] can safely perform all of the procedures associated with the systems' and equipment's intended functions”
“Section 25.1302(b)(2) requires controls and information be accessible and usable by the flightcrew in a manner consistent with the urgency, frequency , and duration of their tasks”
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
4
Airline Standard Operating Procedures (SOP) and Tasks
Standard Operating Procedures (SOP): Instructions with purpose of documenting how to perform a routine or emergency activity and to ensure safety, consistency, and quality of a product.
SOP can be found in:
Airline Operations Manual (part B)
Training Manuals
Airline Computer Based Training (CBT)
Test Case: Swiss European RJ100 (CBT)
Item
Procedures
Tasks
Sub-tasks
Count
104
642
1,263
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
5
Device
Example device is the Multifunction Control Display Unit
(MCDU) incorporates:
A small screen
A keyboard or touchscreen
Main input to the flight management computer (automation)
Swiss European CBT displays 62 tasks
6
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Selected Tasks on Device
7
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Time on Task
LOGINV(RAND(), )
EXPON.DIST(RAND(), 1,1)
500 𝑖=1
NORMINV(RAND(), 2,
1)
Replication
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
8
Tasks and Operator Actions
9
Example Procedure: Change Hold Parameters
Stimulus:
ATC call: Swiss XX Hold at Present Position, 1 nm legs, left turns, ECHT
1220Z
Note : this task is a second task after completing the Hold at Present Position Task, hence the Working Memory retrieval as a trigger to the task Identification
# Operator Action (OA)
1 from clearance to hold, remember the hold parameters
2 Identify task "change the directiion of turn, inbound course, and speed"
3 select functions TURN DIR, INBD CRS, and TGT SPD
4 L2: turn dirction is right
Operator Action Category (OAC) Rand Num working memory item retrieval 1.104217234
decision (TSL Id)
TSL Select visual cue: Rare frequency
0.55805178
0.103369032
1.65063597
5 LM: remember TURN DIR means direction of the turn
6 LM: remember you can change the direction by a direct scratchpad entry long term memory item retrieval 4.250202572
long term memory item retrieval 4.250202572
7 LM: remember how to use the scratchpad: make the entry then select the field long term memory item retrieval 4.250202572
8 letter L on the alphanumerical keys visual cue: Rare frequency 1.65063597
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Task Decomposed into 3 Operator Actions (OA)
LOGINV(RAND(), )
EXPON.DIST(RAND(), 1,1)
500 𝑖=1
NORMINV(RAND(), 2,
1)
Replication
10
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Probability of Failure to Complete Procedure
11
L. Sherry and e. al., "Estimating the Benefits of Human Factors Engineering in NextGen Development: Towards a Formal
Definition of Pilot Proficiency," in 9th AIAA Aviation Technology, Integration, And Operations Conference (ATIO) , 2009.
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Probability of Failure to Complete
Working memory retrieval
+
TSL ID
+
TSL Select
+
Visual Cue
Simulating flightcrew performance and keeping track of their timing while executing procedures on a device enables affordable automation for task/usability analysis.
12
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Regulation Guidelines (Advisory Circular)
13
Advisory Circular 25.1302 provides guidelines for Methods of Compliance with
FAR 25.1302
Focusing on requirement b-2
Implementation of accessible and
usable control by flight crew
Urgency
Frequency
Task duration
Source: AC 25.1302
Mr. George Blaha
2 Methods for Means of
Compliance:
Inspection testing
Human in the loop testing
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
The Current way of Certification (Pre-Regulation)
Inspection Human in the Loop
14
4 hours per crew per 30 functions
Tactile evaluation
Color differences
Position of device and reachability
Readability in both sunlight and darkness
Captain and first officer (2 crew members) are tested within in a simulator or flight test aircraft
This test must be completed 10-20 times to guarantee statistical significance crew
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
The Problem: Certification as Required by FAR25.1302
Inspection
15
Human in the Loop New Regulation
More thorough device certification crew
Mr. George Blaha
4 hours per crew per 30 functions
For 600 functions device, increase above time 20 folds
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Agenda
Context
Stakeholders Analysis
Problem Statement
Proposed Solution
Objectives Hierarchy and Requirements
Method of Analysis
Prototype: Procedure Analysis Tool (PAT)
Business Case - Alternatives
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
16
Stakeholders
Aircraft
Operator
Employs
Pilots
Pilot
Communicate Air
Traffic Information
Air Traffic
Controller
Tension
Interactions
Primary
Secondary
Tertiary
Provide
Airworthiness
Certification
Demand
Increase
Safety, Lower
Cost of Travel
Federal Aviation
Administration
Support the
Certification
Human
Factor
Specialist
(Inspector)
Congress
Change
Regulations
Passenger
Mr. George Blaha
Certify HF
Device
Certify HF
Device
Aircraft
Build
Approve
Technical Data
Maintain Safety through
Certification
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Product
Manager
Aviation
Manufacturer
Push to Sell
Device
Designated
Engineer
Representative
(DER)
The AC25.1302 describes Evaluation as
“assessments of the design conducted by the applicant (or their agent), who then provides a report of the results to the FAA”
17
Stakeholder Tensions upon DER
FAA Human Factors Specialist
Aviation Manufacturer
Product Manager
18
Designated Engineering
Representative
DERs
DER must perform certification tests and report to FAA inspector while being employed by applicant for certification
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Agenda
Context
Stakeholders Analysis
Problem Statement
Proposed Solution
Objectives Hierarchy and Requirements
Method of Analysis
Prototype: Procedure Analysis Tool (PAT)
Business Case - Alternatives
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
19
Costs of Tasks Pre and Post FAR 25.1302
Certification time:
T
Process
(x) = T
INSP
(x) + T
HITL
(x) = 5x
C
Process
(x) = C
INSP
(x) + C
HITL
(x)= 1600x
PRE FAR 25.1302: Evaluation of 30 over 600 tasks ONLY
Inspection Costs
Human in the Loop Costs
Total
$500
$14,000
$14,500
POST FAR 25.1302: Evaluation of 600 tasks MUST be completed
5 hours
80 hours
85 hours
Inspection Costs
Human in the Loop Costs
Total
$10,000
$979,000
$989,000
100 hours
1600 hours
1700 hours
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
20
Problem Statement
The new regulation FAR25.1302 requirement to evaluate all
Procedures is cost and time prohibitive if it has to be accomplished by the currently approved Human-in-the-Loop testing.
Pre – FAR 25.1302 Post – FAR 25.1302
$14,500
85 Hours
$989,000
1700 Hours
Time and Cost increase dramatically due to
FAR 25.1302
21
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Additional Problems
1. Stakeholders tension creates pressure on the DER* who is both employed by the applicant and must report to the
FAA inspector during the certification process
2. Current means of compliance are subjective
3. Lack of cockpit interaction in the current certification process
22
*DER: Designated Engineering Representative
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Agenda
Context
Stakeholders Analysis
Problem Statement
Proposed Solution
Objectives Hierarchy and Requirements
Method of Analysis
Prototype: Procedure Analysis Tool (PAT)
Business Case - Alternatives
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
23
Concept of Operations
DER
24
The PAT simulates crew performance and tracks their timing while executing procedures on a device enabling affordable automation for task/usability analysis.
Tool for DER that substitutes the current certification process by PAT testing on
ALL tasks.
Dedicate HitL testing to only procedures with high PFtoC.
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Current Process vs. Solution
Current Process
T
Process
(x) = T
INSP
(x) + T
HITL
(x) = 5x
C
Process
(x) = C
INSP
(x) + C
HITL
(x)= 1600x
SOLUTION- New Process with PAT
T
Alt2,2
= T
INSP
(x) + T
PAT
+10%T
HITL
(x) = 2x
C
Alt2.2
(x) = C
INSP
+ C
PAT
+ 10%C
HITL
= 500x
Note : Calculations based on inspector wage, pilot wage, and inspection time
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
25
Proposed Solution
Provide automated evaluation which is significantly faster and cheaper
Eliminate stakeholders’ tensions by providing rapid, yet objective means of analysis
Enable implementation of accessible and usable control and information consistent with (1) urgency, (2) frequency, and (3) task duration
26
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Agenda
Context
Stakeholders Analysis
Problem Statement
Proposed Solution
Objectives Hierarchy and Requirements
Method of Analysis
Prototype: Procedure Analysis Tool (PAT)
Business Case - Alternatives
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
27
Mission Requirements
MR.1 PAT shall enable compliance with the FAR 25.1302 requirements
MR.2 PAT shall reduce the post FAR25.1302 certification cost by at least 65% to match the pre-FAR 25.1302 cost
MR.3 PAT shall remove the stakeholder tensions between the FAA, the Applicant, and the DER
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
28
Technology Requirements
TR1. PAT shall use a Graphical User Interface (GUI) to enable user input and tool output display
TR2. PAT shall use a Database to store Operator
Performance data
TR3. PAT shall accept up to 600 procedures for decomposition
TR4. PAT shall use a lookup function to map the
OA to their statistical distributions
TR5. PAT shall use an algorithm to generate random numbers and sum them into total procedure time
TR6. PAT shall use Monte Carlo Simulation to simulate 500 operators performing the SOP procedure
DER
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
29
Objectives Hierarchy for PAT
O.1 Maximize Compliance with FAR 25.1302 ( w=58% )
O.2 Minimize Operational Costs ( w=16% )
O.2.1 Minimize Set Up Costs
O.2.2 Minimize evaluation cost
O.3 Optimize Performance ( w=26% )
O.3.1 Maximize Availability of PAT tool
O.3.2 Maximize Maintainability
O.3.3 Maximize Reliability of Procedure Analysis Tool
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
30
Agenda
Context
Stakeholders Analysis
Problem Statement
Proposed Solution
Objectives Hierarchy and Requirements
Method Of Analysis
Prototype: Procedure Analysis Tool (PAT)
Business Case - Alternatives
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
31
Process Modeled
OA: operator action
OAC: operator action categories
SOP: standard operating procedure
PFtoC: probability of failure to complete
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
32
IDEF0 Diagram – System Steps
DER decomposes the procedures into OA and categorizes them
OAC
PAT maps the OA to its statistical distribution
PAT sums up all the OA times
PAT performs Monte Carlo simulation
PAT displays output
DER inputs threshold
DER inputs acceptable PFtoC
PAT displays results
PAT provides option to perform sensitivity analysis
DER selects option to perform
SA
DER inputs SA parameters
PAT shows results
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
33
Human Factors OAC Database
Literature Review
Experiment
Desing not started
Operator Action Category (OAC) button push decision (TSL Id) decision/choice flight controls manipulation (feet) flight controls manipulation (hands) listen to audio (ATC Clearance, Aural Warning) long term memory item retrieval
MCC callout
MCC readback
Talk to ATC (including Readback) thrust levers manipulation
TSL Select visual check visual cue: Routine visual cue: Moderate frequency visual cue: Rare frequency working memory item retrieval
34
Distribution
Normal(0.3, 0.01)
Normal(0.5,0.002)
Lognormal(2,1)
Normal(2.31, 0.651)
Lognormal(1.12, 0.231) exponential (1)
Lognormal(1.21, 2.1)
Normal(2,1)
Normal(1.5, 0.2) exponential (0.9)
Triangular(0.1,2,3.5)
Normal(0.1,0.002)
Normal (1, 0.5)
Normal( 0.632, 0.011 )
Normal( 1, 0.02 )
Normal( 1.632, 0.03 )
Lognormal(0.737, 1.21)
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Operator Actions Distribution
Long term memory Expo(1.21,2.1)
Working Memory Log (0.737, 1.21)
35
Completion time (sec)
Participant 1: Time keeper
From the Standard Operating Procedures dictate a task. Ex:
Press HOLD
Press 6R
Review the default
Press EXEC to activate holding patterns
After a 51 second interval
Ask designated questions
Repeat it for 10 times with 5 subjects
50 data points
Tabulate the data in Microsoft Excel
Participant 2: Subject
Follow Participant 1’s instructions
Mr. George Blaha
Completion time (sec)
Same experiment was performed after 10 days but without showing the task steps to subjects.
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Sequential Variables Process
LOGINV(RAND(), )
EXPON.DIST(RAND(), 1,1)
500 𝑖=1
NORMINV(RAND(), 2,
1)
Replication
Assumptions:
Independent Variables
No Dual Tasks Performance
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
36
Agenda
Context
Stakeholders Analysis
Problem Statement
Proposed Solution
Objectives Hierarchy and Requirements
Method of Analysis
Prototype: Procedure Analysis Tool (PAT)
Business Case - Alternatives
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
37
Example Task Decomposition – “Initialize Position”
38
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Prototype PAT
1. DER enters
Decomposition here
2. DER categorizes the
OA here
3. PAT generates random numbers here and computes sum on the last row
4. Pressing this button displays the 500 task times here
5. Pressing this button displays frequency distribution
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
39
Results - 15 Tasks
40
# Procedure
PAT Entry time [hr]
PAT Run
Time [sec]
Mean
1 Initialize the Position
2 Enter Company Flightplan
4 Check Flgihtplan Progress
5 Switch MCDU ON
6 Enter Runway and SID info
7 Enter flightplan manually
8 Hold at Present Postion
9 Change turn direction, speed…
10 Check Climb/Cruise Settings …
11 Change Speed and Altitude …
12 Select Arrival and Approach…
13 Enter a Runway Extension
14 Enter Hold ExitTime
15 Select Speed Restriction
-Total Time
-Average
Acceptable PFtoC the task was set to 2.5%
*PFtoC: Probability of Failure to Complete the task
1:05
1:30
1:00
0:15
0:30
1:28
2:30
0:21
0:23
0:36
0:47
0:36
0:26
3.76
3.21
3.66
19
16
13
10
14
13
13
14
13
13
0:40
12:47
11
173.44
00:47 11.5626667
Mr. George Blaha
145
208
238
135
238
219
217
92
107
89
170
90
215
105
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Std
145
175
192
133
192
175
328
98
104
62
123
99
165
145
Threshold
= 3std from mean
*PFtoC
815 1.60%
742 2.60%
1200 1.00%
386 3.40%
578 1.00%
733 2.60%
815 1.50%
533 1.60%
419 1.80%
275 2.20%
539 2.20%
385 2.40%
708 2.40%
540
--
0.4%
2%
Percent
OAC -
Visual Cue
(%)
47.27%
40.82%
45.16%
41.18%
59.57%
52.00%
39.00%
39.29%
48.00%
51.51%
61.70%
41.18%
50.00%
--
48.0%
47%
Verification and Validation
Preliminary verification and validation results using GMU students performing tasks on a device.
Experiment without Cognition
Experiment with Cognition
41
Normal Distribution with Mean of
1.06 and Standard Deviation of 0.43
Lognormal Distribution with Mean of
2.93 and Standard Deviation of 1.04
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Agenda
Context
Stakeholders Analysis
Problem Statement
Proposed Solution
Objectives Hierarchy and Requirements
Method of Analysis
Prototype: Procedure Analysis Tool (PAT)
Business Case - Alternatives
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
42
Business Models used for PAT
1. A La Carte Model: $200 per function
2. License Model: $75,000 per year with recurring annual fee of
$25,000 thereafter
3. Application Purchase Model: $500,000
43
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Market Analysis
Market prospection:
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
44
Acquisition of Customers
45
Phase 1: First 5 years
Year 1
Year 2
Year 3
Year 4
Year 5
1 new “A La Carte” customer
2 new “A La Carte” customers
1 customer shift to “License” Model
1 new “A La Carte” customer
2 customers shift to “License” Model
7 new customers use “License” Model
1 customer shifts to “Purchase” Model
Phase 2: Following 5 years – Radom numbers generated per following uniformly distributed intervals
A la Carte
New: between(0,3)
License Purchase
New between(0,7)
Shift to License: between(1,2)
*Lost customer: between(0,1)
Shift to Application: between(0,2)
*Lost customer: between(0,2)
Application Purchase
New: between(0,1)
*Lost: customer 0
* Lost customers modeled over the 10 years period
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices Mr. George Blaha
Market Penetration per Business Model
46
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Annual Costs
Startup Costs
–
Software development: $250,000
–
Marketing, sales, business management: $250,000
Recurrent Costs:
–
$ 250,000 scales with consulting business and product support services growth
Time Cumm. Revenue Cumm. Cost Profit ROI year0 year1 year2 year3 year4 year5
$ -
$ 50,000
$ 350,000
$ 875,000
$ 2,550,000
$ 3,850,000
$ 500,000
$ 750,000
$ 1,000,000
$ 1,250,000
$ 1,500,000
$ 1,750,000
$ (500,000)
$ (700,000)
$ (650,000)
$ (375,000)
$ 1,050,000
$ 2,100,000
-200%
-193%
-165%
-130%
-30%
20%
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
47
Return on Investment and Breakeven Point
At end of year 5, ROI is 20%
Breakeven point is forecasted to occur after year 4:
48
ROI -193% -165% -130% -30% 20%
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Risk Analysis
49
FMEA Matrix (1 to 10 scale)
Risk Area Failure business market size is too small uncertainty market is not growing regulatory trends are not aligned with service/product
Severity (S) likelihood (L) Detectability (D) RPN
8
6
9
1
1
5
5
5
6
40
30
270 operational risks financial model uncertainties not able to deliver service in time staff issues fall under worse scenario or below (breakeven and ROI) recession
5
5
10
7
3
5
4
5
3 45
5 125
1 40
6 210
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Conclusions and Recommendations
The PAT reduces the evaluation time by 70% per function and therefore solves the problem imposed by FAR25.1302.
The PAT was demonstrated to work on 15 Procedures on the MCDU device.
Evaluating the 15 procedures with PAT took 12:47 hr. entry time, 11.56 sec. average runtime, and analysis showed that PFtoC ranged between 0.4% and
2.6%. Also, 3 over 15 procedures (20%) were flagged for HitL testing.
The Visual Cue category gathered the greatest OAC percentage which highlights the importance of semantic cues to recognizing emerging mission situations and prompting the next step of the procedure process.
Further exploration of the Operator Action Categories and their impact on the PFtoC is recommended.
50
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Thank You
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Questions?
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
Task Decomposition follows TSL
53
•
TSL framework showing interaction between all three agents (lifelines)
•
Arrows show flow of information between agents through six steps
•
Cognitive actions are shown as recursive arrows on the Operator
•
TSL Steps are shown in red
•
Top to bottom shows time progression
Mr. George Blaha
Department of Systems Engineering and Operations Research
Design of a PAT for Affordable Human Factors Certification of Aviation Devices
