Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
16.422 Human Supervisory Control
of Automated Systems
Prof. R. John Hansman
Prof. Missy Cummings
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Course Objectives
y This is a graduate student class designed to examine the
fundamental issues of human supervisory control, wherein humans
interact with complex dynamic systems, mediated through various
levels of automation. This course will explore how humans interact
with automated systems of varying complexities, what decision
processes can be encountered in complex man-machine systems,
and how automated systems can be designed to support both human
strengths and weaknesses. Several case studies will be presented
from a variety of domains as illustrations. A secondary objective of
this class is to provide an opportunity to improve both oral and written
presentation skills.
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Evolution of Cockpit Displays
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Types of Automation
y Mechanical Automation (eg Factory > Industrial Revolution)
y Mixed ; Information and Mechanical (eg Aircraft)
† Decision Aid
† Supervisory Control
Decision Aid
System
Supervisory
Control
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Verplank Notions
Direct Observation
Supervisory Control
Architecture
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Direct Observation
Display
Control
Supervisory
Control
Computer
System
Interface
Sensors
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Supervisory Control
Examples
y Autopilot - Flight Management System
y Autonomous Vehicle
y Process Control Plant
y Thermostat
y Word Processing Program
y Cruise Control
y Automated Steering??
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Sheridan Notions
Spectrum of Automation
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Models
Direct Observation
Tele-Systems
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Distance
Human
Interactive
Operator
Computer
/Interface
Comm
Comm
Task
Interactive
Aircraft
Computer
/Autopilot
Bandwidth
Loss of Direct Feedback
Communications Latency
Task Interactive Computer - Human Interactive Computer
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Tele-System Examples
y Autonomous Vehicle
† Aircraft, AAV, RPV
† Rover - Mars, Bomb
† Underwater UUV, AUV
y Web System
y Virtual Presence
y Tele-medicine
y Other
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Decision Aid Architecture
Display
Decision Aiding
Logic Computer
Sensors
System
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Decision Aid Examples
y Alerting Systems
† Gear Warning
† Idiot Light (eg Oil Pressure)
† TCAS
y Automated Planning Systems
† Path Planners
y Suggesters
† Spell Check
y “What if” Tools
† Analysis Tools
y Data Analysis
† Filters
† Interactive Data Analysis Tools
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Question
y What is good design practice for development of human
supervisory and decision aiding systems
†
†
†
†
†
†
†
†
Distribution of Authority
Architecture
Intuitiveness of System
Interface Issues
Usability
Performance robustness
Safety
Cost Benefit
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Spectrum of Automation
Manual
Fully Autonomous
y Historically - Human required to compensate for limitations of
system
† Skilled Operators
† Training
y Human limits >>> System Limits
y Distribution of Authority (Human vs Automation)
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
y
Strengths
†
†
†
†
†
†
†
†
Pattern Recognition
Inference
Data Assimilation
Adaptation
Intuition
Judgment
Intuition
Morality
Humans
y
Limits
† Latency - Response time
† Bandwidth
† Data Input
‹ Visual
‹ Audio
‹ Tactical
† Cognitive Capacity
† Inconsistent Performance
† Boredom - Saturation
† Endurance
† Life Support
† Cost
† Training
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
y
Strengths
†
†
†
†
Can be fast
Does not get bored
Consistent
Good for predictable cases
Automation
y
Limits
†
†
†
†
†
†
Dumb
Needs rules
Adaptability
Cost
Input requirements
Interface with system
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
y
Why Automate ?
Enhance Human
† Extend, Relieve, Backup Replace
y
Performance
† Speed, Accuracy, Strength
y
Cost
† 2 person crew
y
Reliability/Repeatability
y
Hazards to Operators
† UCAV
y
Human Limitations
† G levels, Life Support
y
Market Perception
y
Distributed Geography
† Telepresece, Web
y
Safety
† True?
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Does Automation Increase
Safety?
y Confounded with other Effects
† System Improvements
y Changes Error Modes
† Automation Errors (eg A320)
y Workload Distribution
† Cruise decreased, approach increased
y System Failure
† Over-reliance/Dependence on Automation
y Complexity Induced Issues
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
High Angle of Attack
Protection
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
Airspeed scale
CL
CL
140
VLS
Vα Prot
Vα Floor
α Angle of Attack (AOA)
120
Vα Max
α Stall: Sudden loss of lift and or aircraft control
α Max:
Angle of attack reached with full aft stick
(max aircraft performance)
α Floor: Angle of attack, where TOGA thrust is
automatically applied by the A/THR
α Prot: Angle of attack from which stick input is converted
into angle of attack demand (stick neutral α Prot)
α VLS: Angle of attack reached at approach speed (VLS)
Direct Observation
Display
Supervisory
Control
Computer
System
Control
Interface
Sensors
A320 Thrust Control
Thrust levers
• Moved manually (no servomotor)
• Transmit their position to the
respective FADEC (Full Authority
Digital Engine Control)