Key Performance
Indicators
Market consultation information meeting
September 10th, 2012
KPI determination in an all-roads GNSS environment
•
Purpose
•
•
•
Determine performance of the system and SSP to be able to determine compensation
and penalties for Service providers
Challenge
•
All roads
•
No enforcement equipment on all roads
•
Fraudulent intents
•
Malfunctioning equipment
Solution
•
Data mining
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
2
KPI determination in an all-roads GNSS environment
•
•
KPIs
•
Performance of kilometer registration
•
Performance of enforcement equipment
•
Performance of (in a timely manner) reporting
non-regulatory vehicles
•
Incorrect reporting of non-regulatory vehicles
Based on the performance level,
penalties may be imposed
Performance requirements
•
Customer care
•
Availability service points
•
Availability stock of OBUs
•
Reliability
•
Etc.
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
3
KPI determination in an all-roads GNSS environment
All vehicles liable to
the charge
98%
2%
Non-registered
vehicles
Registered vehicles
98%
Correctly
functioning
OBUs
99%
Registered
kilometres
1%
Malfunctioning
OBUs
1%
Fraudulent
Users
1%
Non-registered
kilometres
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
4
Kilometre registration KPIs
1. Accuracy*
2. Overcharging*
3. Undercharging*
The total number of registered kilometres on routes, to be decided
later, of vehicles with a correctly functioning OBU, shall deviate by
no more than 2% of the actual number of kilometres driven
The number of vehicles with a correctly functioning OBU whose
registered kilometres deviate by more than +1% compared to the
actual number of kilometres driven shall be less than 0.1%
The number of vehicles with a correctly functioning OBU whose
registered kilometres deviate by more than -2% compared to the
actual number of kilometres driven shall be less than 2%
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
* Values are working assumptions subject to evaluation
5
Enforcement equipment KPIs
1. Detections
Of the vehicles detected by DSRC using enforcement equipment, at
least 99% shall have been detected by the equipment's other functions
2. Classification
Of the vehicles detected by DSRC using enforcement equipment, at
least 80% shall be correctly classified as a vehicle liable for the
kilometre charge
3. ANPR
Of the vehicles detected by DSRC using enforcement equipment, at
least 95-98% shall be correctly identified by ANPR
4. DSRC link
Of the vehicles identified by ANPR using enforcement equipment, the
journey of which is recorded in the BO (through direct communication
from the OBU), at least 99.99% shall be correctly identified through the
DRSC link
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
6
Reporting non-regulatory vehicles KPIs
1. No registration
2. Non-functioning
3. Fraudulent intent
Of all the vehicles liable for the kilometre charge that are detected
as they pass the enforcement equipment and were not registered
with the SSP, at least 99% shall be reported to the enforcement
centre within 1 hour
Of all the detected vehicles registered with the SSP that pass the
enforcement equipment and are no longer entitled to drive due to
lack of payment methods or defective OBU, at least 99% shall be
reported to the enforcement centre within 1 hour
Of all the detected and defrauding vehicles (OBU removed / blocked
/ disrupted) that pass the enforcement equipment, at least 99% shall
be reported to the enforcement centre within 1 hour
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
7
Incorrect reporting of non-regulatory vehicles KPIs
1. No registration
Of all the vehicles reported as ‘liable for the kilometre charge and
not registered', this report shall be incorrect in no more than 1% of
the cases
2. Non-functioning
Of the vehicles reported as 'non-functioning OBUs', this report shall
be incorrect in no more than 1% of the cases
3. Fraudulent intent
Of all the vehicles reported as 'defrauding', this report shall be
incorrect in no more than 10% of cases
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
8
SSP reporting on KPIs
The SSP reports to the interregional entity, monthly and commutatively annually, in
digital form and according to a predefined format and channels (through table,
graphs and notes) about the agreed KPIs and performance requirements.
The KPIs are reported to the interregional entity every month within 20 working
days of the end of the month
Should it appear that a tolerance defined for a KPI is going to be exceeded, the
SSP shall provide an interim report of this within 24 hours
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
9
Key performance indicators
•
Vehicles detected on OBU id or license plate
•
Results render performance of:
Measured (average)
Real
• Recorded kilometre registration
• Performance enforcement equipment
A-E
D
C
B
E
< –2%
A
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
-0.7%
0%
> +1%
F
10
Enforcement stations to be used for KPI measurement
20
3
17
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
11
Data mining
Data mining
User data
Registration data
Usage data
License plates
OBU data
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
12
Kilometer registration accuracy
KPI 1: inaccuracy wrt average deviation)
KPI 3: onder-registratie
(max 2%)
< -2%
KPI 2: over-registratie
(max 1%)
- 0,8 %
0%
registratie werkelijk
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
> +1%
kilometer afwijking
13
Enforcement equipment performance
A
1-ABC-123
B
ANPR
?-???-???
DSRC
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
C
ANPR
DSRC
1-ABC-123
ANPR
DSRC
14
Completeness indicator
all kilometers driven by vehicles liable to the charge
•
Completeness =
•
SSP field of influence is limited to:
all kilometers collected by vehicles liable to the charge
•
Accurate and reliable kilometre registration
•
Detection of offenders (collection of evidence)
•
Reporting of offenders
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
15
Completeness indicator
All vehicles liable to
the charge
98%
2%
Non-registered
vehicles
Registered vehicles
98%
Correctly
functioning
OBUs
99%
Registered
kilometres
1%
Malfunctioning
OBUs
1%
Fraudulent
Users
1%
Non-registered
kilometres
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
16
Summary
Kilometre registration
Enforcement performance
Het Fairway consortium bestaat uit KPMG Advisory burg. CVBA , Eubelius burg. CVBA en Collis BV
Reporting of non-regulatory vehicles
17