GENERAL MOTORS
COMPANY
 Traces roots to 1908
 Worldwide Employment:
213,000
 2012 Worldwide Vehicle
Sales: 9.3 million
 2012 Global Vehicle
Market: 11.5%
 2012 Global Revenue:
$152.3 billion
 2012 Net Income:
$4.9 billion
CHIEF TECHNOLOGY
OFFICER
Driving three sources of advanced
technology
 Internally developed
 Externally from startups
 Externally from established partners
INNOVATION
STRATEGY:
DEVELOP, INVEST
& PARTNER
Take the BEST of what
the OUTSIDE has to offer
COMBINED with the
BEST WE have to offer
R&D KEY TECHNOLOGY AREAS
Sensors, Processors and Memory – Technologies that
improve functionality or solve technical challenges like
automated driving, advanced safety features, etc.
Connected Vehicle – Technologies at the intersection of
information and entertainment in the vehicle including HMI, speech
recognition, cloud services, integration of personal devices, etc.
Advanced Materials – Materials that create mass efficiency,
performance, cost and/or environmental benefits
Automotive Cleantech – Technologies related to vehicle
propulsion, fuel economy, emissions, energy, etc.
Manufacturing Technology – Technologies that advance
efficiency and change the manufacturing paradigm
Advanced Tech Center Israel / Research Groups
Smart Sensing and Computer Vision



Active safety & Autonomous Driving (sensors’ fusion, scanning MEMS
Lidar, MIMO radar, sensor fault detection, 2D/3D Vision, signal processing,
electro-optics)
Machine Learning and Pattern Recognition
Flexible and Agile Manufacturing systems
Human Machine Interface (HMI)



Speech Technologies (enhance natural speech, advanced dialog managers,
user models, context algorithms and noise robustness)
Driver centric Adaptive Automation system for Automated vehicles
Integrated Experience and Multimodal Interfaces (speech, gestures,
tactile/touch... )
Wireless Enablers for Connected Vehicle




Cellular Technologies (4G, LTE), Infotainment, Navigation, cyber-security
Software Defined Radio and Cognitive Communication
Vehicle2Vehicle Network Evolution and distributed infrastructureless “Fog”
application
Low cost, low data rate, intra vehicular sensor networks with power harvesting
Vehicle Controls and Robotics

Advanced Controls, Estimation Theory, Signal Processing, Actuation, Power
Electronics, Artificial Intelligence and Cognitive Systems, Computational
Motor Control, Robotics
 TBD (CyberSecurity, Electrification….
A Very Brief History of
HMI
Clusters
HMI
Infotainment
Systems
HMIofofofInstrument
Vehicle Interior
1950’s
1920’s
1950’s
1950’s
2000’s
2000’s
2000’s
6
SAFETY AND CRASH AVOIDANCE
TECHNOLOGIES
Lane Departure Warning
Cadillac DTS
Cadillac STS
Buick
Lucerne
LDW w/Traffic Sign Recognition
“Opel Eye”
Opel Insignia
Opel Astra
Side Blind Zone Alert
Cadillac DTS
Cadillac STS
Cadillac Escalade
Buick Lucerne
Buick LaCrosse
GMC Yukon/
Yukon Denali
Chevrolet Tahoe/
Suburban
Dual Feature Front Camera:
Lane Departure Warning and
Forward Collision Alert
Chevrolet
Equinox
GMC Terrain
Speed/Curve Advisor
Cadillac STS
Cadillac DTS
Cadillac SRX
Rear Vision Camera
Many Models
Adaptive Cruise Control
w/Forward Collision Alert
Cadillac DTS
Cadillac STS
Side Blind Zone Spotter Mirror
Electronic Stability Control
Chevrolet
Traverse
Many Models
Adaptive Cruise Control
and Auto Collision
Mitigation Braking
Opel Zafira
CONSUMER ELECTRONICS IS DRIVING MANY OF
TODAY’S IN-VEHICLE “CONNECTIVITY” FEATURES
iPhone and App
Eco-system
Personal Media
Pervasive GPS
+
Social Networking
ANY TIME
ANY CONTENT
ANY WHERE
Personal Navigation
Mobile Data Plan
HHMI
M IChallenge for Current & Future Vehicles
Information Overload!!!
- Humans




Cognitive Workload, Driver Distraction
Situation awareness
Cultural differences
Digital natives vs. Aging drivers
– Machines (Technology)





Automated driving
Active safety devices and warnings
Connected vehicles - information
Communication: phone, sms, web,
Entertainment
– Interfaces (Interactions)





Speech technologies
Gestures and Haptics
Multimodal interfaces
New displays (3D, conformal HUD)
Configurable, personalized, adaptive
E – Environmental Factors




Urbanization
Traffic congestion
Cost of energy
Mixed technologies, mobile world
9
HMI Research Methods
Traditional/Existing
 Usability testing
 Driving Simulator testing for
performance, workload, and
situation awareness
 User centered design approach
 Contextual inquiry, ethnographic
studies
 Field operation tests for user
interface testing
 Focus groups
Further Needed
 Predictive engineering models
 Theory for adaptive user
interfaces
 Data mining of large-scale
deployed systems and online
updates to HMI
 Understanding Integration of
information and flow
10
Human Machine Interface in GM ATC-I
Technical Charter of HMI
group in Israel
Areas of Expertise
Human Machine Interaction technologies,
methods, and expert knowledge for:
Speech Technologies
• Speech and Multimodal Interaction
• Contextual HMI
• Tools and Methods
Human Automation Interaction
Artificial Intelligence
Machine Learning and Adaptation
Formal Methods; Modeling and Verification
Acoustics and Noise Control
Linguistics and Language Development
Natural Language Processing
Multi-agent Systems
Automotive Human Factors
Integration and Organization of Information
Multimodal Interaction
Oct. 2012
11
HMI Laboratory Setup
Test Vehicle with programmable
instrument cluster for user
testing.
Real-time information flow from
CAN Bus for Rear Seat
Infotainment applications and for
testing adaptive automation
concepts
Driving simulator
(NADS Minisim)
Off-head gaze tracking system
(Smart Eye)
Multimodal infotainment
interface with Wizard of Oz
Implementation
Wide-View Head Up Display for
content generation & testing
Speech recognition laboratory
(SMS demo, Dialog systemCMU, Dialog system-Cambridge