Introduction of Quality Indicators
of the project
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
How will we know if the project works?
How will we know if the project has been successful?
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
Evaluation toolkit
templates for questionnaires
evaluation plan
quality indicators
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
Questionnaires
 Are created templates and applied questionnaires for:
- the evaluation of the project meetings (3)
- the evaluation of the project workshops (1)
The results of these questionnaires are shared with the
partners and are uploaded on Redbooth.
 After the 1st year it’s published a monthly short analysis
on participation to the partners to the project activities
during the first year
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
Evaluation
Evaluation methods: once evaluation questions have been formulated and
indicators specified, it is possible to specify the way in which data will be collected
for the evaluation. Methods must be specified for each evaluation question.
Quantitative methods include:
Questionnaires – closed or open-ended questionnaires were
used to ask opinions of participants or target groups in a
systematic way. Questionnaires were sent by email.
Records – Records of project activities contain important
information about the way the participants react to the project
content. Analysing these records allows to identify trends and
patterns.
Website logs – Analysing the use of the project website must
inform us about users interest.
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
Evaluation
Qualitative methods include:
Observation – Observing specific components of the project can be a powerful
way to learn about the participants’ responses and uptake of the project.
Expert opinions – The opinion of experts on specific components of the project
can yield objective information on whether the project meets quality criteria.
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
Indicators
Clear - clear, precise and unambiguous
Relevant - relevant, appropriate subject matter
Economic - Economic available at reasonable prices
Adequate - adequate enough to evaluate the performance
Monitorable - monitor, responsible for independent validation
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
Indicators
Selection and description of indicators is done in 4 steps:
 Indicator definition
 Setting quality
 Setting quantity
 Setting time
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
Indicators
performance
indicators
process indicators
Measure the progress of
the project - verify the
accuracy and timeliness of
the steps foreseen for the
project implementation
Measure the project
outputs - relate to the
level of participation on the
project, user satisfaction,
efficiency, take-up
effect
indicators,
Measure the
project outcomes relate to the
achievement of the
objectives.
Ideally, evaluation indicators are simple metrics
that are easy to measure, and should be
objective, valid, reliable and repeatable
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
Indicators
The indicator must be specific to the objective
whose achievement should measure
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
QUALITY INDICATORS
Objective
Indicator
Measuring Tools
-to give further information to VET
promoters about clear and
measurable goals and objectives
at each of the four stages in the
VET quality assurance process
projective
documents
brochure: 1
-to utilize the different experience
on quality assurance and ECVET
in partner countries
Accesibile
information
Web site
-to encourage VET promoters the
use of ECVET to support the
geographical mobility of learners
in a partnership framework
The existence of
the local
partnerships
workshops: 1
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
QUALITY INDICATORS
Objective
-to contribute the better
understanding of quality
assurance and ECVET’s
technical specifications
Indicator
The project promotion
Measuring
Tools
leaflet: 1,
newsletter: 1
-to have quality and relevant The set of evaluation survey After each
actions
meeting: 3
After each
workshop: 1
-to improve the quality of the The review of the evaluation 4 documents
project activities
results
uploaded on
Redbooth
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
QUALITY INDICATORS
Objective
Indicator
Measuring Tools
communication
RedBooth activity
-to improve the communication system at internal at
between project partners
external level
-to implement the project at
high quality standards
management system RedBooth activity
for recording,
analysis and using
of dates
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014
Quality assurance in ECVET mobility,
Foligno, 26-27 September 2014