pro.pilot
Advanced Driver Assistance Systems
Enhancement of Comfort and Safety
Sensors and Systems
Local Environmental Sensing
50
Global Data
 Lane segments
 Traffic signs
 …
Local Data
Internal Data
 Lane recognition  Steering angle
 Object detection  Wheel speed
 …
 ….
Driver
 Destination
 Action
 Dynamic etc…
Local environmental sensing is the missing link between vehicle,
digital map and real world !
© Siemens VDO Automotive | SV C RS DA
21.02.2006
3
Advanced Driver Assistance Systems
Key Sensors
Radar


24 GHz UWB near range
24 GHz NB mid range
Lidar


GPS & Map

Localization by GPS
and map
© Siemens VDO Automotive | SV C RS DA
Laser Range Detection
SIT 3D Camera
Ultrasonic

Short Range Low Cost
Distance Sensor
Video


Monocular Vision
Stereo Vision
Communication


Car to Car
Car to Infrastructure
21.02.2006
4
pro.pilot
System Competence @ Siemens VDO
pro.pilot
© Siemens VDO Automotive | SV C RS DA
21.02.2006
5
pro.pilot Concept Car
pro.pilot
Traffic Jam Assist
pro.pilot
Traffic Sign Recognition
pro.pilot
Park Mate
pro.pilot
Night Vision (FIR)
pro.pilot
Adaptive Cruise Control
System Concept HMI
pro.pilot
Sensitive Guidance
pro.pilot
Night Vision (NIR)
Implementation in 2006
pro.pilot
Lane Departure Warning
© Siemens VDO Automotive | SV C RS DA
pro.pilot
Safe Exit Assist
pro.pilot
Blind Spot Detection /
Lane Change Assist
21.02.2006
6
Adaptive Cruise Control ACC
Function and System
Components
Lidar sensor & ECU
for distance
measurement with
5 infrared laser
beams (one main plus
2 x 2 to cover cut-ins)
Beam adjustment into curve
High sensitivity (230m detection range)
Effective water spray suppression




Vehicle Integration

Object detection and
tracking

Lane association

Control of beam
adjustment (sweep and
micro-sweep)
Driver Interface

HW Integration


Brake & throttle
control
Control via steering
arm

Warning strategy

System status via Icons
in Head Up Display or
Instrument Cluster

Acoustic signal for
driver intervention


Algorithms
Sensor Fusion (e.g.
with Digital Maps via
Electronic Horizon)
Integration of camera, rain sensor &
light sensor into Lidar package
possible
© Siemens VDO Automotive | SV C RS DA
21.02.2006
7
Lane Departure Warning
Function and System
Components

CMOS High Dynamic
Range Camera

Modular Image
Processing ECU

Electronic Steering
Actuator for steering
wheel vibration
Algorithms

Object Detection
Algorithm for lane
recognition based on
lane track markings

consideration of curves

Monitoring of vehicle
dynamics and driver
actions
Driver Interface
Vehicle Integration

Directed Vibration warning via
steering wheel
CAN-Bus
Interfaces

Variable thresholds for vibration
and steering torque
Sensor Fusion
(e.g. with Digital
Maps via
Electronic Horizon)

System Warning strategy

System status via Icons in Head
Up Display or Instrument
Cluster

HW Integration


© Siemens VDO Automotive | SV C RS DA
21.02.2006
8
Blind Spot Detection (BSD)
Function and System
Components


Dual-beam 24GHz
Radar sensor with
ECU in one package
applying a pulsed
frequency hopping
UWB mode (SV
patented)
Electronic Steering
Actuator for HMI
Vehicle Integration

Integration of radar
sensors invisibly
behind fascia

CAN-Bus Interfaces

Sensor Fusion (e.g.
with Digital Maps via
Electronic Horizon)
© Siemens VDO Automotive | SV C RS DA
Algorithms
8
6 5beam-shape
4 3 2 1 0
II
beam-shape I
 Detection of
relevant objects
within the detection
zone
 Classification of
detected objects
Warning Zone
 Issue warning
Driver Interface

Red LED in door frame
close to wing mirror

Vibrating steering
wheel in combination
with turn signal

warning strategy
21.02.2006
9
Night Vision
Function and System
Components





NIR-sensitive
camera (0,9μm)
(same HDR CMOS
camera as for LDW)
ECU
NIR headlights
Alternatively:
FIR-Camera
Head Up Display
Vehicle Integration
Pedestrians ahead!
Algorithms

HW Integration

HUD visualization
strategy with other
functions

Filtering

Image analysis

Object detection
Driver Interface

Visualization via
head up display

Integration of
navigation info

Integration of lane
markings in FIRimage
Pedestrians ahead!
© Siemens VDO Automotive | SV C RS DA
21.02.2006
10
Traffic Sign Recognition
Function and System
Components



Algorithms
Digital maps via
eHorizon
HDR CMOS Camera
with ECU
Head Up Display
(HMI)
Vehicle Integration

HW Integration

ECU

CAN-Bus
Interfaces

Sensor Fusion
© Siemens VDO Automotive | SV C RS DA

eHorizon: provides
GPS & map data for
ADAS applications

Data fusion of
sensors and digital
maps

Object Detection
(e.g. traffic signs)
with probability
calculation
Driver Interface

Head-up Display or
Instrument Cluster

Reject button on
steering wheel

warning strategy
21.02.2006
11
Traffic Jam Assist
Function and System
Components

CMOS High
Dynamic Range
Camera

Modular Image
Processing ECU
Vehicle Integration
Algorithms

Object Detection
Algorithm for
vehicle
recognition

Monitoring of
vehicle dynamics
and driver actions
Driver Interface

HW Integration

System Warning strategy

CAN-Bus
Interfaces


Sensor Fusion
(e.g. with LIDAR)
System status via Icons in
Head Up Display or
Instrument Cluster
© Siemens VDO Automotive | SV C RS DA
21.02.2006
12
Park Mate
Function and System
Components

ultrasonic sensors

steering actuator
Vehicle Integration

HW Integration

ECU

CAN-Bus
Interfaces
© Siemens VDO Automotive | SV C RS DA
Algorithms

calculation of
trajectory for
semiautonomous
parking
maneuver
Driver Interface

Display in Instrument
Cluster

warning strategy
21.02.2006
13
Sensitive Guidance
Function and System
Components
 Digital maps
 Multiple sensors
(Radar, Lidar,
Camera)
 GPS Information
Vehicle Integration

HW Integration

ECU

CAN-Bus Interfaces

Sensor Fusion
© Siemens VDO Automotive | SV C RS DA
Algorithms

Integration of
environmental
sensors data into
navigation
process
Driver Interface
 Enhanced road
information on
(navigation) display
(e.g. lane position)
 Situation adapted
driving instructions
21.02.2006
14
ADAS
Safety and Comfort
Scope
Integrated Passive and Active Safety Systems
Reduction of accident
probability
Vehicle
Dynamics
pro.pilot
System
Situation


Pre-Crash
system
ABS
Anti Slip
Control
(e.g. ESP)
Normal
Driving
Critical
Condition
Accident avoidance
© Siemens VDO Automotive | SV C RS DA
Mitigation of accident impact
for passengers
Restraint
System
Airbag
Airbag
Pre-Crash
Post-Crash
system
 Front

 Side

Crash
Blind Spot
Detection
 Lane Departure
Warning
 Night Vision
 Adaptive Cruise
Control
 Driver
Monitoring

Get ready for
the accident
In-Crash
GSM
Telemetrics
Rescue
Post-Crash
Accident happens
21.02.2006
16
Types of accidents in Germany
in the year 2004
... runs in or stands
... drives in front or w aits
7%
11%
6%
... drives side by side in the
same direction
16%
9%
4%
... is driving in opposite
direction
... turns or crosses
1%
8%
9%
29%
Collision betw een vehicle
and pedestrian
Collision w ith an obstacle on
the road
Lane Departure to the right
Europe
29 % Turns or Crosses -> BSD
16 % drives in front -> ACC
15 % Lane Departure -> LDW
Lane Departure to the left
Other
(Source: Statistisches Bundesamt, 2005)
© Siemens VDO Automotive | SV C RS DA
21.02.2006
17
pro.pilot
Market Drivers
16000
14000
Trend
12000
Fatalities
 Regular bodies (EU commission,
NHTSA) require a substantial
reduction of accident fatalities
 Increasing traffic density leads to
more complex traffic situations and
an increased workload of the
driver
 Ageing society requires cars taking
physical deficiencies of the driver
into account
 Legislation: e.g. pedestrian
protection, new regulations e.g. for
mirrors
 Stringent fuel consumption and
emission legislations may demand
new driving strategies
10000
fatalities
8000
6000
EU demand
4000
2000
0
1980
1985
1990
1995
2000
2010
Year
1.000 km
800.000.000
10.000 Vehicles/km
1,0
700.000.000
0,9
600.000.000
0,8
500.000.000
400.000.000
0,7
300.000.000
0,6
200.000.000
0,5
100.000.000
0
0,4
1970
1980
1985
1990
Number of Vehicles
© Siemens VDO Automotive | SV C RS DA
1995
2000
2002
Kilometer Traveled
2003
2004
Traffic Density
21.02.2006
18
pro.pilot
Market Drivers
 Regular bodies (EU commission,
NHTSA) require a substantial
reduction of accident fatalities
 Increasing traffic density leads to
more complex traffic situations and
an increased workload of the
driver
 Ageing society requires cars
taking physical deficiencies of the
driver into account
 Legislation: e.g. pedestrian
protection, new regulations e.g. for
mirrors
 Stringent fuel consumption and
emission legislations may demand
new driving strategies
(%)
40
35
30
27,97
25
Japan
23,07
20,65
20
UK
15
USA
10
5
0
1900
© Siemens VDO Automotive | SV C RS DA
1920
1940
1960
1980
2000
21.02.2006
2020
2030
19
Collision free driving
Benefits for different interest groups
Vision "Collision Free Driving"
OEMs
Supplier
Driver





Safety
Comfort
Fun &
Pleasure
Orientation &
Overview
Costs



Sales
Profit
Branding and
differentiation
Society



Safety of all
road users
Environmental
Protection
Economics
Advanced Driver Assistance Systems
© Siemens VDO Automotive | SV C RS DA
21.02.2006
20
Philosophy of Siemens VDO
pro.pilot (Advanced Driver Assistance Systems)
pro.pilot uses environmental sensing in order to assist the driver
in his driving task to increase safety and comfort
pro.pilot
Assist but not patronize the driver!
© Siemens VDO Automotive | SV C RS DA
21.02.2006
21
public name recognition of ADAS functions
(Source: SV Consumer Survey)
Traffic Sign Recognition
Traffic Jam Assist
Park Mate
Night Vision
Lane Departure Warning
Blind Spot Detection
Adaptive Cruise Control
0
known
unknown
© Siemens VDO Automotive | SV C RS DA
10
20
30
40
50
60
70
80
number of persons in %
90
n = 290
21.02.2006
22
Advantages of different ADAS
(Source: SV Consumer Survey)
Adaptive
Cruise
Control
Blind
Lane
Spot
Departure
Detection Warning
Night
Vision
Park
Mate
Traffic
Sign
Recognition
Traffic
Jam
Assist
higher
safety
56 %
68 %
70 %
66 %
23 %
27 %
36 %
higher
comfort
31 %
15 %
14 %
12 %
56 %
35 %
43 %
more
orientation
7%
14 %
7%
20 %
9%
21 %
5%
no
advantage
5%
3%
9%
2%
11 %
17 %
16 %
n = 290
=> ADAS can't be separated in Comfort-Systems and Safety-Systems
© Siemens VDO Automotive | SV C RS DA
21.02.2006
23
Summary
pro.pilot Profile @ SV
Comfort /
Relax
Driving
Pleasure & Fun
Enjoy driving, but
never leave
the limit
Driving without stress
e.g. LDW, ACC
Driver
Driving
with less fuel
consumption, less cost
e.g. ACC Stop&Go
Economic
Driving
© Siemens VDO Automotive | SV C RS DA
Driving like
on the home course
e.g. Sensitive Guidance, Night
Vision, Object Detection
Orientation &
Overview
21.02.2006
25