Guidance on internal verification of N/SVQs

advertisement
Guidance on internal verification
of N/SVQs
www.cityandguilds.com
December 2006
Version 4.0
About City & Guilds
City & Guilds is the UK’s leading provider of vocational qualifications, offering over
500 qualifications across a wide range of industries, and progressing from entry level to
the highest levels of professional achievement. With over 8500 centres in 100
countries, City & Guilds is recognised by employers worldwide for providing
qualifications that offer proof of the skills they need to get the job done.
City & Guilds Group
The City & Guilds Group includes City & Guilds, ILM (the Institute of Leadership & Management)
which provides management qualifications, learning materials and membership services,
NPTC which offers land-based qualifications and membership services, and HAB (the Hospitality
Awarding Body). City & Guilds also manages the Engineering Council Examinations on behalf of
the Engineering Council.
Equal opportunities
City & Guilds fully supports the principle of equal opportunities and we are
committed to satisfying this principle in all our activities and published material.
A copy of our equal opportunities policy statement Access to assessment and qualifications is
available on the City & Guilds website.
Copyright
The content of this document is, unless otherwise indicated, © The City and
Guilds of London Institute 2006 and may not be copied, reproduced or distributed
without prior written consent.
However, approved City & Guilds centres and learners studying for City & Guilds
qualifications may photocopy this document free of charge and/or include a locked PDF
version of it on centre intranets on the following conditions:
• centre staff may copy the material only for the purpose of teaching learners
working towards a City & Guilds qualification, or for internal administration purposes
• learners may copy the material only for their own use when working towards a City & Guilds
qualification
• the Standard Copying Conditions on the City & Guilds website.
Please note: National Occupational Standards are not © The City and Guilds of
London Institute. Please check the conditions upon which they may be copied with
the relevant Sector Skills Council.
Publications
City & Guilds publications are available on the City & Guilds website or from our Publications Sales
department at the address below or by telephoning +44 (0)20 7294 2850 or faxing +44 (0)20 7294
3387.
Every effort has been made to ensure that the information contained in this publication
is true and correct at the time of going to press. However, City & Guilds’ products and
services are subject to continuous development and improvement and the right is
reserved to change products and services from time to time. City & Guilds cannot
accept liability for loss or damage arising from the use of information in this publication.
City & Guilds
1 Giltspur Street
London EC1A 9DD
T +44 (0)20 7294 2800
F +44 (0)20 7294 2400
www.cityandguilds.com
enquiry@cityandguilds.com
Guidance on internal verification
of N/SVQs
www.cityandguilds.com
December 2006
Version 4.0
Guidance on internal verification of N/SVQs
1
This page is intentionally blank
2
Guidance on internal verification of N/SVQs
Contents
1
Introduction
5
2
The role of the internal verifier
7
3
Operate and evaluate internal assessment and quality systems
9
4
Supporting assessors
13
5
Monitoring quality of assessor performance
17
6
Meet external quality assurance requirements
23
Appendix 1
N/SVQ internal verifier induction checklist
25
Appendix 2
N/SVQ unit or qualification achievement sheet and certification request
27
Appendix 3
N/SVQ internal verifier concerns form
29
Appendix 4
N/SVQ internal verifier report form and guidance
31
Appendix 5
N/SVQ internal verifier final portfolio/ qualification report form
37
Appendix 6
N/SVQ assessor induction agreement
39
Appendix 7
N/SVQ assessor induction checklist
41
Appendix 8
N/SVQ countersigning report form
43
Appendix 9
N/SVQ continuing professional development record
45
Appendix 10 N/SVQ internal verifier observation and questioning checklist
47
Appendix 11 N/SVQ internal verification sampling plan and record
49
Appendix 12 N/SVQ internal verification candidate interview record
51
Appendix 13 Exemplar internal verifier sampling strategies and plans
53
Guidance on internal verification of N/SVQs
3
This page is intentionally blank
4
Guidance on internal verification of N/SVQs
1
Introduction
The aim of this guidance document is to specify City & Guilds’ requirements for the management
and delivery of internal verification by centre staff without being overly prescriptive. This guidance
is linked to the V1 standards Conduct internal verification of the assessment process and should be
read in conjunction with other guidance from standard setting bodies and regulatory bodies.
City & Guilds is committed to ensuring that N/SVQs retain value and credibility. The key to this is
valid and reliable assessment. Effective internal verification plays a vitally important role in achieving
and maintaining reliable assessment practice. These requirements apply irrespective of the medium
through which centres provide access to N/SVQs.
This document includes pro formas for use as part of an internal verification process. They are not
intended to provide a comprehensive system but rather to provide examples of key documentation.
Centres may wish to adapt some or all of these forms to suit their particular needs, or simply to
benchmark against their existing documentation.
Internal verifiers who hold the D34 qualification may find this document useful as a CPD exercise to
update themselves on requirements of V1.
NB D34 holders do not have to also achieve V1. They must however ensure that their internal
verifier practice meets the requirements of Unit V1. (Appendix 1 – N/SVQ internal verifier induction
checklist.)
Guidance on internal verification of N/SVQs
5
This page is intentionally blank
6
Guidance on internal verification of N/SVQs
2
The role of the internal verifier
The internal verifier is at the heart of quality assurance in N/SVQs, both within the national
framework and within the quality and management systems of each approved centre. The role, in
terms of managing assessment so that it consistently meets national standards*, is central to
maintaining public confidence in each and every N/SVQ issued. Therefore internal verification is a
key factor in managing ‘risk’ and ensuring that when certificates are claimed for candidates the
requirements of the national standards have been reliably met. (Appendix 2 – N/SVQ unit and/or
qualification achievement sheet and certification request.)
There are four main aspects of the internal verifier role:
• operate and evaluate internal assessment and quality assurance systems
• supporting assessors
• monitor the quality of assessor performance
• meet external quality assurance requirements
Each of these key areas are discussed in this document with examples of issues/concerns and
ideas/guidance on accepted best practice.
* Where standards are mentioned, this refers to National Occupational Standards contained within
the N/SVQs.
Guidance on internal verification of N/SVQs
7
This page is intentionally blank
8
Guidance on internal verification of N/SVQs
3
Operate and evaluate internal assessment and quality
systems
This is a primary focus for the internal verifier which entails ensuring that the centre’s internal
processes demonstrably meet external regulators’ requirements. This includes having plans in place
that identify criteria for:
• selecting assessors
• comprehensive internal auditing and recording processes
• coherent internal verification sampling strategy development
• management of accessible candidate appeals and complaints systems
• sampling assessments
• standardising assessment judgements (Appendix 3 – N/SVQ internal verifier concerns form)
• implementation and evaluation of continuous improvement.
Issues/concerns identified in the past as a result of these plans not being developed have included:
Selecting assessors
• inappropriate individuals selected
• shortage of assessors across all required locations
• unequal candidate access to assessment.
Internal auditing
• lack of a clearly documented system which is understood by all internal verifiers and assessors
• little understanding of the requirements of an audit trail
• appeals/complaints procedures which are inaccessible or unknown to candidates.
Recording processes
• lack of feedback to assessors on assessment practice
• unsatisfactory records/reports
• no monitoring of assessors in action
• senior management uninformed of any developments, issues or problems requiring their
intervention.
Coherent internal verification sampling strategy development
• lack of standardisation across the centre
• assessors not receiving timely support
• candidates being reassessed by the internal verifier
• no clear end to the assessment process
• poor assessment practice going unnoticed.
Management of accessible candidate appeals and complaints systems
• unfair treatment of candidates
• candidates going elsewhere to appeal/complain eg awarding body, regulators, press etc.
Sampling assessments
• inappropriate assessor practice
Guidance on internal verification of N/SVQs
9
•
•
•
•
•
•
•
•
•
unequal candidate access to assessment
over/under-evidencing by candidates
problem units not being addressed
‘end loaded’ sampling
fixed date sampling (regardless of throughput)
flat rate (%) sampling (regardless of circumstances)
no sampling strategy or rationale in place
second assessing
unsatisfactory/inadequate records/reports.
Standardising assessment judgements
• no standardisation between assessors
• no standardisation across programmes (Appendix 4 – N/SVQ internal verifier report form and
guidance and Appendix 5 – N/SVQ internal verifier final portfolio/qualification report form)
• unequal candidate access to assessment.
In many centres there is insufficient time allocated to the internal verifier to properly manage
assessment resources. These include equipment, training facilities, candidate support, learning
materials and assessors. Too often they are expected to juggle resources on a day to day basis
rather than plan ahead. As a result assessors’ workloads are poorly judged and often allocated on
an ad hoc basis. It is good practice to ensure that there is a formal system in place for allocating
assessors to candidates and to set out performance requirements for assessors eg frequency of
review, assessment reports, attendance at team meetings.
Management of resources should also include forward planning to ensure that candidates will
continue to have access to assessment, verification and appropriate materials/equipment/facilities
for a specified period, identified at the outset. This has budgetary and staffing implications and it is
clear that in many centres, the internal verifier is not regarded as sufficiently ‘senior’ within their
organisation to influence financial and personnel planning. The internal verifier should be in a
position to report directly to the senior management of the organisation on all aspects of the
centre’s N/SVQ programmes. Centres should ensure that, when seeking approval to deliver N/SVQs
they provide scope for appropriate input from the internal verifier into management systems so that
continuing candidate access is assured and appropriate decisions concerning resources are made.
The internal verifier should have a full and accountable role in managing the assessment team
and process. To do this effectively the internal verifier must have accurate and meaningful
information on a number of key points – candidate needs, location and current workloads of
assessors. An essential part of this should be a systematic evaluation on entry of candidate
additional or special learning/development needs, including technical aids or physical adaptations
(eg large print materials, IT equipment) extra support, assessment in ‘unsocial’ hours etc.
Thereafter, the internal verifier should have up-to-date information on individual candidate progress
as well as an overall picture of potential new candidates, average timescales for the achievement of
different qualifications, and assessor availability (both current and projected).
The internal verifier should monitor candidate progress against the initial equal opportunities
information. Where it is found that candidates are not progressing as expected, a record of actions
taken to support the candidates should be made.
The internal verifier should be able to call meetings of the assessment team, and have the support
of management to require attendance.
The internal verifier clearly has a key role in assuring and ensuring quality standards in the
delivery and assessment of N/SVQs. As such, their duties and responsibilities should be included as
an integral part of the organisation’s quality procedures and manuals. The internal verifier should
also have explicit responsibility for carrying out self-assessment of the centre’s performance against
10
Guidance on internal verification of N/SVQs
the requirements of the NVQ Code of Practice and/or SVQ Criteria and Guidance, current guidance
and requirements on a regular basis.
The internal verifier must ensure that they have up-to-date information and guidance issued by
relevant bodies – awarding body, standard setting bodies, industry and professional bodies – and
that this information is passed on to all assessors. It is good practice to record pertinent points in
minutes of meetings.
Guidance on internal verification of N/SVQs
11
This page is intentionally blank
12
Guidance on internal verification of N/SVQs
4
Supporting assessors
The second duty for the internal verifier is to guide, support and ensure the continuing professional
development (including occupational updating in line with relevant NTO/SSC requirements) of the
team of assessors. This is likely to be critical at certain stages:
• when assessors are new – to the team, to the centre, to N/SVQs
• when standards change or guidance is revised
• following external verifier visits or other inspections.
Issues/concerns
The following issues/concerns have been identified:
• unstructured induction
• standard materials not held or seen by many assessors
• little or no development of assessors – professionally or vocationally
• few development plans in place
• lack of information, guidance or feedback from the internal verifier
• little or no mentoring of new assessors.
New assessors should receive an appropriate level of induction. This depends on their previous
experience, both of N/SVQs generally and/or a particular suite of qualifications. As with candidate
induction the process is more effective if it is coherent and structured and it may help to have a
checklist or pack.
Sample induction packs for candidates, expert witnesses, assessors, internal verifiers and quality
assurance co-ordinators are available via the City & Guilds centre toolkit and the website
www.cityandguilds.com
The internal verifier must ensure that all assessors in the centre have access to:
• copies of national standards (each assessor should have copies of all the national standards
they assess)
• City & Guilds’ N/SVQ Centre guide
• NVQ Code of Practice and/or SVQ Criteria and Guidance
• QCA’s Guidance on Assessing NVQs (March 1998)
• City & Guilds’ Ensuring quality
• directory pages of relevant qualifications
• copies of News (relating to individual qualifications)
• a set of all assessment tools eg observation records, underpinning knowledge questions, report
forms, guidance notes used by the centre
• copies of the centre’s appeals procedures, equal opportunities policy and other relevant
organisational procedures eg quality manual, health and safety policy, emergency evacuation
procedures
• information about available candidate and assessor support resources, equipment and facilities
eg video, interview room, library
• information about the awarding body and the external verifier
• information about their candidates including:
- existing achievement/accreditation
- special learning or assessment needs, adaptations etc
Guidance on internal verification of N/SVQs
13
-
workplace/contact details for supervisors/managers
contact point for advice from internal verifier or another (named) assessor. (Appendix 6 –
N/SVQ assessor induction agreement and Appendix 7 – N/SVQ assessor induction checklist.)
The internal verifier must also check and hold on file the following information for assessors:
• personal profiles or CVs demonstrating occupational competence at an appropriate level and
current/recent relevant industrial or commercial experience
• original assessor certificates (D32 and/or D33 or A1 or A2) initially and after authentication, the
external verifier validated copies
• CPD records for all assessment personnel in line with the relevant assessment strategies.
It is good practice to maintain a centre file containing this information.
If assessors have not yet achieved A1 or A2 it is important that the internal verifier identifies agreed
realistic target dates for them to achieve certification (which should be within 18 months of
commencement of their role) and draws up personal action plans. In the interim period,
unqualified assessor decisions must be checked, authenticated and countersigned by a
qualified assessor/internal verifier. The counter signatory, if an internal verifier, must not
be the internal verifier who undertakes the verification activity.
The internal verifier must also increase the levels of sampling and monitoring assessment practice
for newly appointed assessors – whether qualified or not. This ensures that new assessors
have additional access to support and enables the internal verifier to identify any training and
development needs. If a newly appointed assessor has experience, this period of additional
sampling may be quite short. Whatever the level of experience, the incoming assessors will value
additional support whilst they become familiar with the centre’s systems. Similarly there should be a
mentoring process for newly appointed internal verifiers. (Appendix 8 – N/SVQ Countersigning
report form)
The external verifier will expect to see evidence that the internal verifier has identified and
addressed learning and development needs for all assessors. To do this a system of continuing
professional development must be in place and be maintained. This may include specific training eg
guided discussion techniques, alternative assessment methods, updating on awarding
body/standard setting body requirements. It may also include opportunities to update vocational
knowledge or even secondment into industry. (Appendix 9 – N/SVQ continuing professional
development record.)
Where the centre has a large team, including a number of internal verifiers, it is beneficial to appoint
an internal verifier co-ordinator (IVC). With this model, the IVC would monitor internal verification
plans (to ensure standardisation), internal verifier performance and also maintain development
plans for the other internal verifiers.
Standardising assessment judgements is another way in which the internal verifier supports
assessors. This is to ensure that:
• assessors consistently make valid decisions
• all assessors make the same decisions on the same evidence base
• all candidates are assessed fairly.
Issues/concerns:
• negligible use of standardisation exercises within centres
• poorly constructed standardisation.
Standardisation (sometimes referred to as benchmarking or moderating) is an important part of the
internal verifier’s duties. In some centres, this aspect of the internal verifier role has been
substantially underdeveloped, often relying on informal contact between the internal verifier and
14
Guidance on internal verification of N/SVQs
the assessment team to ensure a common standard of decision making. Also, although team
meetings may be held, these can be frequently poorly attended and focus on relaying information
and/or tracking candidate progress. These issues are clearly important but it is crucial, particularly
for centres with a number of dispersed, peripatetic or inexperienced assessors that
standardisation exercises are undertaken with all assessors on a regular basis. All standardisation
activities should be included on relevant agendas and minuted accordingly.
The simplest means of completing a standardisation review is to collate copies of evidence
presented for unit accreditation and ask each assessor to make a decision based on the evidence
presented. It is also helpful to ask them to note any queries they may have eg further information
needed or authentication of a piece of evidence. This enables the internal verifier to check that
assessors are asking the right questions, as well as arriving at the correct decision, ie that the
process as well as the judgement is sound.
The frequency and appropriateness of standardisation activities is dictated by issues arising from:
• EV/IV sampling and monitoring of IV/assessor performance
• the introduction of new standards or changes to existing standards
• changes within the assessor/IV team
• results/outcomes of external audits
• previous standardisation activities
• the need for continuous improvement.
Guidance on internal verification of N/SVQs
15
This page is intentionally blank
16
Guidance on internal verification of N/SVQs
5
Monitoring quality of assessor performance
The third responsibility of the internal verifier is to monitor the quality of assessor performance. The
internal verifier is responsible for safeguarding the validity of assessment. This includes observing
assessment practice, and ensuring the reliability of assessment judgements. (Appendix 10 – N/SVQ
internal verifier observation and questioning checklist.)
Aims:
• to ensure that the national standards of assessment (currently defined in A1/A2) are adhered to
by all assessors
• to identify problems or areas where assessors require advice or development
• to ensure that candidates are aware of, and satisfied with, the assessment process.
Monitoring assessment involves the internal verifier literally observing assessors in action, looking
at how they conduct the assessment process and giving them feedback on their performance. It
also includes reviewing the internal verification records completed with all assessors and evaluating
every aspect of their performance as recorded in the internal verification records.
Issues/concerns:
• significant lack of monitoring assessment
• poor recording of monitoring
• little or no use made of the results of monitoring to improve standard of assessment.
Monitoring assessment
The internal verifier should aim to monitor all assessors within a given period of 6 -12 months
depending on the size and level of activity of the assessment team. They also need to select
different assessment methods to monitor, the most obvious being observation of candidate
performance, professional discussion and simulated exercises. When selecting the monitoring
sample the internal verifier must be aware of safety, confidentiality, security and any additional
organisational requirements which could be affected by their presence. Any issues should be
discussed with assessors before arranging to monitor them.
The quality and accuracy of assessment plans (review and feedback) as well as assessor records
should be included in the review. The internal verifier should observe the individual assessor’s
assessment and interpersonal skills, with a view to noting any areas which would benefit from
advice or further development. The internal verifier must also note any problematic areas (eg within
the N/SVQ) which could create difficulties for other assessors.
Following the monitoring exercise, it is important that constructive and positive feedback is given to
enable assessors to develop. The discussion should be held in private and should not be relayed to
the candidates or other assessors. The internal verifier should keep a record of this and ensure that
it forms part of the assessor’s individual development plan.
Monitoring also creates an opportunity to liaise with candidates to ensure that their assessment
needs are being properly met. More information is given in Appendix 12 – N/SVQ Internal
verification candidate interview record. However, in particular the internal verifier should check that
candidates:
• know which N/SVQ they are working towards, and have a copy of the standards
• understand the assessment process
Guidance on internal verification of N/SVQs
17
•
•
•
•
•
•
•
know who besides the assessor contributes towards the assessment process, eg witnesses
know what progress they have made towards achievement
are aware of their rights to access unit certification
understand their role in evidence generation, collection and cross referencing
have confidence in their assessor
understand the appeals process
have no current unmet learning needs.
Candidate portfolio evidence
All evidence of candidates’ competence does not have to be contained in their portfolios. Over
recent years, often driven by a desire to reduce the amount of paper involved, or because of issues
around confidentiality, there has been increasing use of alternative ways to present evidence. These
include electronic portfolios, video/audio taped interviews, ‘walk and talk’ assessment and
confidential items being left in situ. Again, the key to effective internal verification is to ensure firstly
that assessment records clearly link the evidence to the standards and to secondly demonstrate
that assessors have considered the rules of evidence. What checks have they made on the discbased or online evidence to ensure authenticity? Does the record of the ‘walk and talk’ assessment
clearly note the source and location of evidence seen, so that it can be verified? The internal verifier
must support assessors to ensure that they involve candidates in appropriate planning, review and
feedback activities in order that candidates receive information on their performance and progress.
By this process candidates will actively participate in the assessment process rather than having
assessment ‘done to them’.
Verification sampling strategy
The internal verifier must record and report on all sampling undertaken in sufficient detail to justify
their decisions. Underpinning all internal verifier activity is the validity of the verification sample. It is
not a good use of internal verifier resources to maintain 100% checks on assessment decisions: it
implies a lack of confidence in both assessment practice and the verification strategy.
The assessment process must be left to assessors following feedback by the internal verifier. Quite
often, centres maintaining 100% checks are simply adding a second signature to each and every
portfolio at the summative stage rather than carrying out effective verification.
Poor practice is where sampling is interpreted as exclusively reviewing summative assessment
decisions on portfolio evidence. Too often this is left until candidates have completed most if not all
of the qualification. This ‘end-loaded’ sampling often constitutes little more than adding a second
signatory to a sign-off sheet ‘for the records’, or a reassessment of the evidence. This is not an
appropriate use of internal verification resources and often happens too late in the evidence
gathering process to rectify poor assessment practice.
It is not satisfactory to guess, or assume, an aspect of the rules of evidence. The process must be
transparent to anyone with appropriate expertise who looks at the evidence and assessment
records. Relying on personal knowledge of assessors to assume they ‘must have seen everything’ or
‘will have asked candidates the appropriate questions to test knowledge’ is not good practice.
Similarly where candidates have relied on witness testimony or work-generated products, it must be
clear to the internal verifier that assessors have taken steps to satisfy themselves regarding
authenticity. This should include validating signatures of witnesses as well as evidence of witnesses’
occupational competence and contact details.
Clearly, the critical factor here is the quality of assessment records and reports. This has been
identified as a significant weakness in some centres. Typically, both observation of assessment
(when used) and assessment of other evidence sources are rendered almost meaningless as
evidence if poorly recorded. Vague, generalised comments such as ‘worked well’ or ‘satisfactory’ or
‘met the standards’ lack the detail required to establish an audit trail to the standards. This is poor
use of assessor time and is impossible to verify. It is important that assessment records, whatever
the format, address these points. Examples of suggested assessor recording documents can be
18
Guidance on internal verification of N/SVQs
found in the City & Guilds Standards and Assessment Requirements (SAR) and the N/SVQ recording
forms documents. These documents can be downloaded from www.cityandguilds.com
A lack of adequate evidence referencing is also a cause for concern since it raises queries in the
external verifier’s mind as to firstly how well assessors and internal verifiers understand the
standards, and secondly the validity of the internal verification process undertaken. The best
approach to evidence referencing is to ‘keep it simple’ and there are a number of pro formas widely
available. Exemplars are provided in the City & Guilds SAR document.
Whilst it is imperative that candidates should not be prevented from achieving N/SVQ accreditation
simply because they cannot reference evidence (however presented), there is a balance to be
struck. Both assessors and the internal verifier must also consider whether the N/SVQ being claimed
includes competences relating to referencing or organising evidence (eg Customer Service or
Administration N/SVQs demand the ability to file and retrieve information; Management N/SVQ
candidates need to gather and present information to aid decision making). It may therefore show a
significant lack of competence if portfolios are badly organised. However, if there is no such skill
described in the N/SVQ then candidates should not be disadvantaged because they struggle to
cross-reference. In this case, assessor records and reports must clearly indicate the basis for their
decision, ie where the evidence is to support each unit. It is not acceptable for the internal
verifier (and then the external verifier) to have to search extensively to find evidence
which supports assessor decision(s).
An internal verifier sampling strategy which involves reviewing the quality of assessor judgements
at both interim and summative stages is a key part of this process.
Interim sampling
It is vital that the internal verifier participates in the assessment process undertaken with candidates
at different stages in that process. This includes reviewing candidate work perhaps (a) before
decisions have been made on any unit and (b) looking at portfolios when one or two units are
completed. It will entail checking the progress review reports given to candidates by assessors. This
will enable the internal verifier to evaluate the quality of formative guidance on assessment and the
effectiveness of candidate assessment planning, review and feedback.
Interim verification will also enable the internal verifier to pick up problems at an early stage and so
avoid the situation of disagreeing with assessment judgements. It will also highlight individual
assessor needs for support or training which in turn may be used to develop the assessment team
as a whole. Similarly it provides an opportunity to identify and share good practice within the
centre, particularly where one or more of the assessors has wider experience.
Summative sampling
Correct summative sampling should entail reviewing the quality of the assessment judgement by
evaluating how assessors have reached those decisions. The internal verifier must be able to follow
an audit trail which clearly demonstrates that assessors have checked that the evidence presented
– whatever its format – meets the rules of evidence. This includes evidence collated via portfolio,
computer-aided compilation, video/audio tape or evidence identified via an alternative assessment.
Evidence must be confirmed by assessors as:
• valid
– relevant to the standards for which competence is claimed
• authentic – produced by the candidates
• current
– sufficiently recent for assessors to be confident that the same level of skills,
understanding or knowledge exists at the time of claim
• sufficient – meets in full all the requirements of the standards.
The sampling strategy for each centre will vary according to the needs of the centre and the
particular N/SVQ programme, but in all cases must be agreed with the external verifier. In defining
the strategy all the following should be taken into account.
Guidance on internal verification of N/SVQs
19
Factors
You need to consider
Candidates
Ethnic origin, age, gender, other factors, special needs etc
Assessors
Experience and qualifications, workload, occupational experience
Methods of assessment
Questioning, observation, testimony, APL, use of simulation,
product evidence, assignments, projects and tests
Elements within the NVQ
Problem areas, special requirements
Records
Reports from assessors, correct assessment practices, IV records,
candidate portfolios and files
Assessment locations
Workplace assessments, college and off-the-job training, other
assessment locations
Sampling plan
To help monitor the overall sampling strategy it is strongly recommended that the centre produces
and maintains an overall sampling plan which will be implemented by the internal verifier. (See
Appendix 11 – N/SVQ Internal verification sampling plan and record, which has a dual function in
that it allows centres to record their overall sampling plan and the internal verifier to comment on its
implementation and any variations).
This section gives guidance about verification strategies or rationales. Deciding on the most
appropriate size of verification sample can be difficult, especially if the centre assessment team is
new to N/SVQ delivery. Ultimately, the sample must represent a sufficiently accurate picture of the
quality of assessment for the centre to be confident that those decisions not sampled also meet
national standards.
It is important that the internal verifier looks at the decisions of the entire assessment team in any
given period (possibly on a calendar basis, or by candidate cohort). Once the other sampling factors
are taken into account, the sample size will almost decide itself. It is essential that the process
follows this route rather than deciding on a set sample size and trying to fit a strategy to it. The
sampling process must not be determined by any rule of thumb such as 10% or a square root.
The internal verifier must sample the full range of assessment methods used for any one N/SVQ
eg direct observation of performance, witness testimony, professional discussion, questioning,
assessment of portfolio evidence – products, APL, personal reports and assessment of simulated
exercises.
The range and frequency of use of particular assessment methods may vary depending on the level
of N/SVQ and the skills involved. For example, a level 2 in Sports Activity Leadership or Health and
Social Care may draw heavily on observation of candidates’ performance, whereas a level 4 in
Administration may primarily use products from the workplace and witness testimony. It is likely
that most portfolios will contain a mixture of evidence, and therefore assessment activity and
decisions. The internal verification sample must take this into account, and it is clearly imperative
that the internal verifier knows the N/SVQ thoroughly and the likely range of assessment
methods and evidence sources that could be used.
All assessors should be included in the sample, but a number of other factors must be considered:
Experience
If assessors are qualified and experienced it may not be necessary to look at more than one or two
decisions per candidate and in some sectors, not all candidates. If assessors have less than 12
months’ experience, are new to either the centre or a particular N/SVQ or out of practice, the
internal verifier will need to sample substantially more of their decisions for the first 6 – 12
20
Guidance on internal verification of N/SVQs
months. This ensures that the internal verifier reviews assessor decisions on all units in any N/SVQ.
This is particularly important where there are ‘problem’ units where evidence specifications require
very particular evidence or the standards are often misinterpreted.
Workload
The internal verifier needs to look at the workload of each assessor so that the total sample also
fairly reflects the number of decisions being made by individual assessors. Increasing ratios of
candidates to assessors may also indicate assessment problems. This requires the attention of the
internal verifier as it can result in diminishing the quality of assessment. In these cases, sampling
should be increased.
Specialist assessors
Some assessors may only assess certain units in an N/SVQ such as specialist units on first aid or
energy management. In some centres there is a division of assessor duties with some assessors
carrying out observations, whilst others look at all types of evidence (as reflected in the assessor
units D32/33 or A1/A2). This can be a highly effective use of assessment time and expertise. In these
cases, once the internal verifier is satisfied that assessor judgements are consistent, it is reasonable
to reduce the number of their decisions included in the overall sample.
Location
The location and type of assessor is also a factor in deciding the sampling strategy. In some centres,
assessment is widely dispersed, both in terms of geographical location and type of employer at
which the candidates are based. Some centres have satellite centres (organisations which link to the
main centre to facilitate access to certain N/SVQs, but who may have varying approaches to
assessment). Other centres are linked through franchise agreements to organisations which may
have highly varied functions.
The internal verification sample must capture a picture of assessment across the whole centre. In
effect the strategy should be repeated for all assessment sites. If these arrangements are complex,
then the strategy needs to be carefully thought through. It is a good idea to discuss it with the
external verifier who can offer advice about the frequency of sampling across the assessment sites.
Some assessors, often in training providers, are peripatetic and visit across a number of
assessment sites. Other assessors may be workplace-based. The internal verifier must look at the
pattern of assessment and take this into account in their sample.
Standards
The sample also needs to take into account the standards themselves. In some qualifications, there
is a lack of clarity – most frequently in the criteria or the evidence specifications – which, unless fully
discussed by the assessment team, inevitably leads to confusion and differing assessment
decisions. Clearly, therefore, it is imperative that both assessors and internal verifiers know the
standards well, and also agree their interpretation of aspects such as evidence specifications, range
and knowledge and understanding requirements through standardisation activities.
Equally, there may be changes to assessment requirements when standards are revised. This can
be particularly difficult for assessors during the transitional phase, since they may be assessing
candidates on both sets of standards simultaneously. It is important that the internal verifier is fully
aware of these areas of potential confusion and includes these in the sample. Equally, it is important
for the internal verifier to be aware of the last registration and certification dates for each set of
standards.
Access and other assessment problems
Some N/SVQs contain units which describe competences which are difficult to assess. This may be
for confidentiality reasons (counselling, patient care), safety considerations (using hazardous
machinery, appliances and materials) or infrequent occurrence (emergency evacuations, injuries).
This can lead to poor practice in that assessors faced with the pressure to ‘sign off’ candidates may
Guidance on internal verification of N/SVQs
21
be tempted to compromise the evidence requirements or to use assessment methods which are
less than satisfactory. The internal verifier must specifically ensure that they sample any problem
units, across all assessors, so that standards are complied with for all candidates. The internal
verifier should also ensure that issues such as these are discussed fully with the assessment team at
an early stage.
22
Guidance on internal verification of N/SVQs
6
Meet external quality assurance requirements
The internal verifier also has a wider management role, which is to provide a link between their
organisation, the awarding body and regulatory bodies.
The external verifier’s first port of call is the internal verifier, who will be expected to have the
following range of information to hand:
• numbers of current registered candidates per N/SVQ and level
• candidate centre enrolment and awarding body registration details
• assessor details – specifically CVs, CPD records, assessor qualifications (D or A or V units),
development plans and workloads
• candidate progress reviews and achievements, special assessment requirements and equal
opportunities monitoring information
• details for assessment records, plans, reviews and tracking sheets
• available candidate support resources
• details of assessment sites
• details of satellite, franchise arrangements
• the internal verification sampling strategy
• internal verifier records including feedback to assessors, discussions with candidates
• records of claims for certification
• candidate portfolios
• minutes of internal verification/standardisation meetings
• procedures for storage and retention of centre records.
Creating and maintaining good information channels is particularly important following an external
verifier visit. In some centres any action points are agreed with a programme co-ordinator or
qualification manager, often the internal verifier or IVC takes this role. Individual internal verifiers
may well have the responsibility of ensuring that they communicate pertinent parts of the external
verifier’s report to those assessors for whom they are responsible. It is important that action points
raised by the external verifier are acted upon within the timescales specified. Failure to do so
may result in recourse to the tariff of sanctions as specified in the NVQ Code of Practice. Because of
the security implications, it is extremely important that no claims for certification are made without
the clearance of the internal verifier for the qualification. It is not acceptable for any claim for
certification to be made by an internal verifier who does not hold the appropriate qualification.
Of equal importance is the need to maintain security of candidate files and their assessment
records. Portfolios for candidates who have been certificated in between external verifier visits
must be kept intact until the next visit so that they can be examined or produced for inspection
purposes if needed. Original assessor records must be retained for at least three years and be
made available for external verification and to allow for any appeals or complaints to be progressed
and resolved.
Guidance on internal verification of N/SVQs
23
This page is intentionally blank
24
Guidance on internal verification of N/SVQs
Appendix 1
N/SVQ internal verifier induction checklist
Internal verifier name
Date of commencement at centre
Signed by internal
verifier
1
Provided: CV and qualification certificates to prove
required occupational competence at the
appropriate level
2
Provided: original D34 or V1 certificate which was
checked and photocopied. Original returned and
EV-validated photocopy kept in centre records
3
Received: the centre organisation chart
4
Received: the centre equality of access policy
5
Received: centre internal verification policy,
procedures and recording documentation
6
Received: NVQ Code of Practice and/ or SVQ
Criteria and Guidance
7
Received: City & Guilds Guidance on Internal
Verification of N/SVQs
8
Received or know where to access: relevant
qualification updates
9
Received or know where to access: City & Guilds’
Ensuring quality
10
Received: information about allocated assessors
and their candidates
11
Received: a copy of the N/SVQ internal verifier,
assessor and candidate induction programmes and
packs
12
Received: information on the processing of records
for registration and certification of candidates
13
Received: list of compulsory standardisation
meetings/activities
Signed by new internal verifier
Date
Date
Signed (countersigning IVC/internal verifier)
Guidance on internal verification of N/SVQs
25
This page is intentionally blank
26
Guidance on internal verification of N/SVQs
Appendix 2
N/SVQ unit or qualification achievement sheet and certification request
This should only be completed when positive unit/qualification verification has taken place for N/SVQs and the result is to be processed to either update the
centre database or for certification purposes. Original unit and qualification achievement summary sheets should be attached as appropriate.
N/SVQ candidate name
City & Guilds
enrolment
number
Site
Assessor
Qualification
Level
Units achieved
Full
qualification
achieved?
(YES / NO)
Centre administrator: Please enter results for the above candidate(s) onto the centre candidate database and apply to City & Guilds for certification.
Internal verifier signature
Date
Countersigning internal verifier signature
(if necessary)
Date
Guidance on internal verification of N/SVQs
27
This page is intentionally blank
28
Guidance on internal verification of N/SVQs
Appendix 3
N/SVQ internal verifier concerns form
Feedback to internal verifier co-ordinator (IVC) or quality assurance co-ordinator (QAC)
The Areas of concern should be completed by the internal verifier and handed to the internal verifier
co-ordinator or QAC as appropriate.
Areas of concern:
Agreed action and target date:
Internal verifier signature
Countersigning internal verifier signature
(if necessary)
Date
Date
IVC/QAC signature
Date
Action taken:
IV/IVC/QAC signatures
Guidance on internal verification of N/SVQs
Date
29
This page is intentionally blank
30
Guidance on internal verification of N/SVQs
Appendix 4
guidance
N/SVQ internal verifier report form and
This form must be completed for every internal verifier activity. A copy of the report should be given
to each assessor and the appropriate IVC/QAC. Candidates should not be given copies of internal
verifier report forms as they are written to address assessor practice and may therefore contain
comments that might undermine candidate confidence in assessors.
•
The internal verifier must ensure that their written feedback to assessors is recorded on the
internal verifier report form. The feedback must be directed to each assessor and should
address their assessment practice. The internal verifier should avoid generalised statements
such as ‘Well done to both of you. Lots of hard work undertaken’.
•
Precise, focused comments on the assessment undertaken support assessor development and
evidence the rigour of verification activity.
•
The internal verifier is required to check some part of the unit(s) identified in the sampling plan.
The internal verifier should indicate the actual items of evidence sampled within the candidate
portfolios by initialling and dating the work reviewed. The use of a coloured pen will provide a
clear tracking system to audit internal verification within the candidate portfolio. EVs often use
green pens, so the internal verifier should choose another colour.
•
The internal verifier must record the unit, and elements sampled, on the report form to ensure
that an auditable system exists in the centre records.
•
Depending on the experience and qualifications of assessors, the internal verifier may be
reviewing more than one unit during a verification session, and should indicate all the units
considered on the report form.
•
In addition to the sampling of evidence the internal verifier will also record (by ticking as
appropriate) the method of assessment used, the assessment focus and whether the evidence
is valid, authentic, current and sufficient, and that there is evidence of consistent practice.
•
The internal verifier will also note whether the performance evidence records have been signed
and dated by assessors and authenticated by candidates.
•
Where necessary the internal verifier will check that assessments are countersigned and that
the appropriate records are being made on the countersigning report form.
•
If a standardisation issue is identified, the internal verifier will need to record and discuss this at
the internal verifier meeting with assessors.
•
On action plans for assessors, the internal verifier will record what action is required by when
and, at a later date, whether the action was completed.
•
The assessor N/SVQ continuing professional development record (Appendix 9) does not need to
be completed after each internal verification activity but it is essential that it is completed at
least once every 12 months, and that it complies with relevant NTO/SSC requirements.
Guidance on internal verification of N/SVQs
31
•
When observation of assessor practice is undertaken during the internal verification, the
outcomes should be recorded on the N/SVQ internal verifier observation and questioning
checklist (Appendix 10).
•
On completion of the portfolio/qualification, the N/SVQ internal verifier final
portfolio/qualification report form (Appendix 5) should be completed.
•
Occasionally the internal verifier may have, or have been acquainted with, serious concerns
which need to be brought to the attention of the Quality Assurance Co-ordinator and/or centre
management group, unsafe or incompetent practice in the workplace. The N/SVQ internal
verifier concerns form (Appendix 3) should be completed and passed on to the Quality
Assurance Co-ordinator.
•
Unit achievement should be recorded on the N/SVQ unit and/or qualification achievement sheet
and certification request (Appendix 2), and passed to the centre administrator in order that they
can update the centre candidate database.
- Where unit achievement is to be certificated, the internal verifier must ensure that the
statement at the bottom of the sheet remains undeleted.
- Full certification requests should also be recorded on this form and sent to the centre
administrator/exam secretary.
•
On completion of qualifications or periods of assessment, all original internal verifier records
must be passed to the IVC/QAC who will store them with the candidate assessment records for
the period required by the regulator.
•
Candidates who leave or withdraw from assessment, prior to the achievement of their full
qualification, are entitled to have achieved units certificated. The internal verifier must ensure
that the same process identified for unit and qualification completion is followed, to ensure
certification takes place and the necessary records are retained by the centre. The NVQ Code of
Practice requires assessors and candidates to provide a written declaration that the evidence is
authentic and that the assessment was conducted under the specified conditions or context (an
example is provided in the City & Guilds N/SVQ recording forms document. N/SVQ 11 Unit
Assessment and Verification Declaration).
•
Candidates may have their completed portfolios returned after the EV visit following the claim
but must be advised to keep them intact and safe for a period of three years.
Standardisation meetings
• The internal verifier/IVC will arrange assessor standardisation meetings to which the internal
verifier is expected to contribute. These will be held *** times per year and assessors are
expected to attend a minimum of *** meetings.
•
The IVC will arrange internal verifier standardisation meetings at which the internal verifier is
expected to attend. These will be held *** times per year and the internal verifier is expected to
attend a minimum of *** meetings.
•
The quality assurance co-ordinator will arrange IVC standardisation meetings at which the IVC is
expected to attend. These will be held *** times per year.
NB if any of these events include updating of assessor or internal verifier skills and knowledge
they may contribute to evidence of continuing professional development (CPD).
*** centres to insert their own numbers
32
Guidance on internal verification of N/SVQs
N/SVQ internal verifier report form
NB This form can be used for single or multiple assessors/candidates
It is the responsibility of the internal verifier to complete this form, make copies, send the original to the QAC/IVC and ensure a copy is given to the
assessor(s). Where a unit or qualification verification has taken place the internal verifier must complete either the unit or qualification summary sheet
ensuring that the administrator or the QAC receive the original.
Name of internal verifier
Name of countersigning internal verifier (if necessary)
Date of verification
Name of assessor(s)
(please indicate whether the assessor(s) is work based, peripatetic or independent by using WB, P or I after their name)
Name of countersigning assessor/IV(s) (if necessary)
Name of candidate(s)
and City & Guilds
enrolment number
Title and level
of qualification
Units/elements
sampled and
reference numbers
of evidence
sampled (including
standardisation
unit)
Methods of
assessment/
Evidence sources
sampled (see key
below)
Any issues re:
(i) consistency
(ii) validity
(iii) authenticity
(iv) currency
(v) sufficiency
(vi) recording/ referencing
(P or number)
Part of assessment
process checked
F – Feedback;
FC – Final Check;
J – Judgement;
P – Planning;
Rec – Records;
R – Review
Units achieved
(including date
if full
qualification)
Please continue on additional sheet(s) if necessary
Guidance on internal verification of N/SVQs
33
Name of candidate(s)
and City & Guilds
enrolment number
Title and level
of qualification
Units/elements
sampled and
reference numbers
of evidence
sampled (including
standardisation
unit)
Methods of
assessment/
Evidence sources
sampled (see key
below)
Any issues re:
(i) consistency
(ii) validity
(iii) authenticity
(iv) currency
(v) sufficiency
(vi) recording/ referencing
(P or number)
Part of assessment
process checked
F – Feedback;
FC – Final Check;
J – Judgement;
P – Planning;
Rec – Records;
R – Review
Units achieved
(including date
if full
qualification)
Please continue on additional sheet(s) if necessary
Key: DO – Direct Observation, EWT – Expert Witness Testimony, WT – Witness Testimony, WP – Work Product, S – Simulation,
APEL – APEL, APCSCRA – Assignments/Projects/Case Study/Candidate/Reflective Accounts, Q/PD – Questions/Professional Discussion
Guidance on internal verification of N/SVQs
34
NB
Where more than one assessor has been involved in this internal verification
activity, assessors should receive any individual feedback using this sheet.
Assessor name
Details of any problems regarding candidate access to the assessment process
Details of any disagreements/appeals and outcome of action taken
Summary of comments and, if necessary, an action plan for the assessor eg regarding a)
candidate evidence b) appropriate evidence gathering methods c) consistent assessment practice
d) record keeping and portfolio structure and/or tracking.
Action plan for assessor and target dates
If necessary, please continue on an additional page
Confirmation of previous identified action being achieved
All the above has been discussed (please sign as appropriate)
Internal verifier signature
Date
Countersigning internal verifier signature (if necessary)
Date
Assessor signature
Date
Countersigning assessor/IV signature (if necessary)
Date
Guidance on internal verification of N/SVQs
35
The countersigning internal verifier must check all the activities of the unqualified internal
verifier whom they are supporting.
Countersigning internal verifier feedback on the internal verification process and any
necessary action required.
The methods and processes used by the unqualified internal verifier have been checked
and verified by a qualified internal verifier.
Countersigning internal verifier signature
36
Guidance on internal verification of N/SVQs
Date
Appendix 5 N/SVQ internal verifier final portfolio/
qualification report form
Internal verifier name
Countersigning internal verifier name (if necessary)
Assessor name (please indicate whether work based or peripatetic by using WB or PA after their
name)
Countersigning assessor/IV name (if necessary)
Candidate name and City & Guilds enrolment no
Candidate assessment location
Title of qualification
Full qualification verified
¨ Yes
¨ No
Yes
Not
yet
The portfolio is clearly sectioned and easily accessed. An effective referencing
system is in place.
For assessors without D/A units the assessment decisions have been
countersigned by a qualified assessor.
The candidate resume, initial assessment contract agreement, access to appeals
and witness status and participants list are complete.
There is complete evidence of the assessor being active in the full assessment
cycle (from planning to review and feedback).
The assessor records of assessment decisions are complete and accurate.
All key documentation is dated and signed.
The qualification/unit summary achievement sheet is complete.
Assessment process documents are complete and available for storage in centre
records.
Internal verification process documents are completed and available for storage
in centre records.
Action for assessor (if any)
Plan achieved
Internal verifier signature
Date
Countersigning internal verifier signature
(if necessary)
Date
Guidance on internal verification of N/SVQs
37
This page is intentionally blank
38
Guidance on internal verification of N/SVQs
Appendix 6
N/SVQ assessor induction agreement
Assessor name
Telephone number
E-mail
The qualification title and level that I will be assessing is
Centre name and contact details
Address
Telephone
E-mail
Centre number
My countersigning assessor/IV is
Telephone
E-mail
My internal verifier is
Telephone
E-mail
The centre quality assurance co-ordinator is
Telephone
E-mail
The centre external verifier is
The awarding body is City & Guilds which can be contacted at their regional/national office
In
Telephone
I have completed the complete induction programme and am now fully familiar with my
responsibilities as an N/SVQ assessor.
I understand the procedures for checking the standard of my assessment practice and for seeking
immediate help, should either I or my candidate experience difficulty.
Signed
Guidance on internal verification of N/SVQs
Date
39
This page is intentionally blank
40
Guidance on internal verification of N/SVQs
Appendix 7
N/SVQ assessor induction checklist
Assessor name
Date of commencement at centre
Signed by assessor
1
Provided: CV and qualification certificates to prove
required occupational competence at the
appropriate level
2
Provided: original D32/33 or A1 certificate which
was checked and photocopied. Original returned
and EV-validated photocopy kept in centre records
3
Received: centre organisation chart
4
Received: centre equality of access policy
5
Received: centre assessment procedures,
recording documentation and qualification
standards
6
Received or know where to access: NVQ Code of
Practice and/or SVQ Criteria and Guidance
7
Received or know where to access: relevant
qualification updates
8
Received or know where to access: City & Guilds’
Ensuring quality
9
Received: information about allocated candidate(s)
10
Received: a copy of the N/SVQ assessor and
candidate induction programmes and packs
11
Received: information on the processing of records
for registration and certification of candidates
12
Received: list and dates of compulsory
standardisation meetings/activities
Signed by new assessor
Date
Date
Signed by internal verifier
Guidance on internal verification of N/SVQs
41
This page is intentionally blank
42
Guidance on internal verification of N/SVQs
Appendix 8
N/SVQ countersigning report form
Assessor name
Countersigning assessor/IV name
Candidate name(s)
Unit numbers/titles and level
Check and countersign assessment decisions made in each unit by the unqualified assessor
ensuring that all the assessment methods used are checked in rotation. The assessment process
should also be checked.
Method(s) of assessment and evidence sources sampled (please tick)
Direct observation ¨
Work product
Expert witness testimony ¨
¨
Witness testimony ¨
¨
Simulation
APL
Assignment/Projects/Case Study/Candidate/Reflective accounts
¨
¨
¨
Questions/Professional discussion
The evidence is (please tick or cross as appropriate):
¨
Authentic
¨
Current ¨
Sufficient
¨
Valid
Is there evidence of consistent practice?
Yes ¨
No
¨
Part of assessment process checked (please tick or cross as appropriate):
Planning
¨
Recording ¨
Reviewing/feedback
¨
Judgement
¨
Evidence is correctly (please tick or cross as appropriate):
Recorded ¨
Referenced ¨
Signed/dated by unqualified assessor and the candidate
Guidance on internal verification of N/SVQs
¨
43
Summary of advice, and if necessary, action required eg regarding a) the candidate b)
appropriate evidence gathering methods c) consistent assessment practice d) portfolio
structure and tracking.
Confirmation of identified action being achieved
The evidence, methods and process used by this unqualified assessor have been checked and
authenticated by a qualified assessor.
44
Countersigning assessor/IV signature
Date
Assessor signature
Date
Guidance on internal verification of N/SVQs
Appendix 9
record
N/SVQ continuing professional development
(NB This form can be used by assessors and verifiers, delete as appropriate)
Assessor/internal verifier name
Last IV observation date
Next IV observation date
Dates of standardisation meeting(s) attended since the last review
If the assessor/internal verifier does not hold the A and V units, on what date were they registered
with the awarding body?
Details of any CPD activities undertaken and their relevance
Training needs and/or identified CPD opportunities
Action plan for meeting training needs and CPD opportunities. Identify date for review and/or
achievement and ensure that the what, when and who of the target action required is recorded.
Evidence of achievement (attach evidence where appropriate)
All the above has been discussed and agreed
either Internal verifier signature
Date
IVC signature
Date
or Assessor signature
Date
Internal verifier signature
Date
Date of next review
Where training needs or CPD opportunities have resource implications, eg time/finance please
ensure a copy of this form is passed to the Quality Assurance Co-ordinator.
Guidance on internal verification of N/SVQs
45
This page is intentionally blank
46
Guidance on internal verification of N/SVQs
Appendix 10 N/SVQ internal verifier observation and
questioning checklist
Internal verifier name
Unit(s) reviewed
Assessor name
Candidate name(s)
Did the assessor…
Yes No
Evidence
Develop and agree an assessment plan with
the candidate(s) using appropriate
assessment methods?
Agree when assessment will take place with
candidate(s) and other people involved?
Agree arrangements with the candidate(s)
for reviewing progress against the
assessment plan?
Review and update assessment plans to take
account of candidate achievements?
Give the candidate(s) feedback at an
appropriate time and pace?
Give feedback in a constructive and
encouraging way?
Give feedback to the candidate(s) which met
their needs and was appropriate to their level
of confidence?
Clearly explain the assessment decisions?
Encourage candidate(s) to get advice on the
assessment decisions?
Can the assessor explain…
How to operate the centre standardisation
and internal quality assurance procedures?
How to access the centre appeals and access
to fair assessment policy?
What information is made available by the
awarding body and QAC?
How to identify and gain resources to
support candidates who have special
assessment needs?
Additional comments
Assessor signature
Date
Internal verifier signature
Date
Guidance on internal verification of N/SVQs
47
This page is intentionally blank
48
Guidance on internal verification of N/SVQs
Appendix 11 N/SVQ internal verification sampling plan and record
Qualification
For period
Name of internal verifier
Assessor
Assessor status
Standardisation unit
Name of countersigning internal verifier (if necessary)
Assessment
site
Assessor status
Q
Qualified
NQ Not Qualified
NSQ New Staff,
Qualified
NQS Newly
Qualified Staff
Guidance on internal verification of N/SVQs
Candidates
Units to be assessed (Units planned to be sampled and
any variation should be recorded below using an
appropriate distinguishing format eg bold, italics or
shaded box)
Method of assessment /
evidence source checked
Part of the
assessment
process
reviewed
Key
(Centres will need to devise their own key and enter
below)
Method of assessment/
evidence source checked
DO - Direct observations
WT - Witness testimony
APCSCRA - Assignment/
Project/Case study/
Candidate/Reflective Account
APEL - Accreditation of Prior
Experience/Learning
Q - Questions
PD - Professional Discussion
WP - Work Product
EWT - Expert Witness
Testimony
S - Simulation
Assessment
process
P – Planning
R – Review
F – Feedback
FC – Final
check
49
This page is intentionally blank
50
Guidance on internal verification of N/SVQs
Appendix 12 N/SVQ internal verification candidate interview
record
Candidate name
N/SVQ level
Assessor name
Internal verifier name:
When did you begin the programme?
How were you introduced to the programme?
What topics were covered in your induction?
Was any of your prior experience
considered/used towards the qualification?
Did anyone find out about any training you
needed?
Did you have any training whilst working
towards your qualification? If so, what?
Who gave you the training? Where and when
was it carried out?
Was equal opportunity law and policy explained
to you? Did you understand it?
Was the process of getting your qualification
explained to you? If so, what do you understand
this process to be?
Did you draw up a plan to achieve the
qualification with your assessor/supervisor?
Does your assessor/supervisor involve you in
planning assessments in advance?
When, where and how does assessment take
place?
Continued on next page
Guidance on internal verification of N/SVQs
51
What types of evidence have you collected so
far?
Do you understand what aspects of your NVQ
the evidence covers?
How soon after you started was your first
assessment?
Who assesses your evidence? Does anyone else
see your portfolio?
How often do you see your assessor? Do you
feel this is often enough? If not, how often would
you like him/her to visit?
Does your assessor give you feedback after
assessment? Is this feedback in written form?
What units have you completed so far? Have you
signed any documentation to confirm
completion?
What kind of help and guidance have you
received to put your portfolio together?
Do you think the qualification will help you in
your work now and in the future?
52
Guidance on internal verification of N/SVQs
Appendix 13 Exemplar internal verifier sampling strategies
and plans
This appendix describes the implementation of an appropriate sampling strategy and the resulting
plans developed for two different types of centre:
•
a small single qualification centre
•
a large, complex, multi-qualification, multi-size, multi-agency cenre
These exemplars provide a thorough approach for those sectors where each candidate is subject to
internal verification. In those sectors where it is not required that all candidates are internally
verified, an appropriate sample of candidates will be identified within the internal verifier sampling
strategy. All other sampling principles should then still apply.
Please note that this document is exemplar material only.
Introduction
In order to improve and standardise the role of the internal verifier within centres, in recent years
City & Guilds national and regional offices have run generic Internal Verification workshops, based
on the JAB guidance documentation.
A frequent comment has been that although general guidance is very useful, the provision of
specific exemplars of internal verification sampling plans and strategies would be most helpful to
centres.
This document describes internal verification sampling plans which will be appropriate for the two
types of centre described above.
Centres are advised to study both models in order to develop sampling plans which meet their
particular needs. Within both strategies the internal verifiers ensured that they implemented the
requirements of:
C
A
M
E
R
A
all candidates
all assessors
all methods of assessment
all elements of the qualification
all range requirements
all assessment locations
Exemplar centre one
Our first centre is employer-based and has two qualified internal verifiers, one of whom acts as the
quality assurance co-ordinator.
The two internal verifiers each lead a team of four work-based assessors who in turn have six
candidates, all undertaking the same qualification, but at different levels (Levels 2, 3 and 4).
• assessors A and B are A1 qualified, experienced and regarded as effective within the centre
• assessor C is A1 qualified but new to the centre
• assessor D is registered for and working towards the achievement of A1.
Guidance on internal verification of N/SVQs
53
The strategy
As all personnel are work-based, with assessment and verification forming only a minor part of their
ordinary work roles, the internal verifier strategy is designed to ensure consistent support for
assessors and candidates by regular contact. Experience has proven that an absence of internal
verifier/assessor/candidate interaction leads to inconsistent assessor practice and a real slow down
in candidate progress.
The internal verifier will undertake an internal verifier activity involving each assessor and some of
their candidates every three months. These activities will include:
• sampling the units as identified on the centre plan (Appendix 11).
• observing assessor practice at least once per year (Appendix 10).
• Interviewing candidates about their experience of assessment practice (Appendix 12).
Each internal verification plan applies to all candidates registered within an identified a 6 month
period. This plan follows them until they complete or leave.
Candidates registered after this six month period will be allocated to the next internal verification
plan.
The following plan covers January – July 2005.
The unit that will be sampled at all levels is Unit 1; a mandatory unit which covers communication.
This will form the basis of the internal verifier and assessor standardisation activity for this group of
candidates. The aim will be to identify any problems which may be common (eg appropriate
interpretation of the standards.) and then to take any required remedial actions.
The focus of the internal verifier sampling within Unit 1 will be:
• Method of assessment
Direct Observation / Expert Witness Testimony – as these form the main required assessment
methods.
•
Stage of the assessment process
Appropriateness of assessment planning – as this has proved problematic in the past with
assessors being too vague leaving candidates uncertain as to how to proceed.
•
Sampling of other units
As the centre is small, candidates will have one other unit sampled to ensure that over the
period, the internal verifier is sampling all the other units which are undertaken by the
candidate group; all the assessment methods and all stages of the assessment process.
•
Additional sampling for new or unqualified assessors
The plan also indicates additional sampling for:
- The qualified, but new, assessor until the point at which the internal verifier is confident that
the new
assessor is conversant with the procedures in this centre.
- The unqualified assessor during the period that Unit A1 is being undertaken. Then when the
assessor is qualified, until the point at which the internal verifier is confident that the newly
qualified assessor is secure within their practice.
NB The first judgement within each unit must be overseen and countersigned by a qualified
assessor until A1 is achieved.
54
Guidance on internal verification of N/SVQs
Exemplar plan
N/SVQ INTERNAL VERIFICATION SAMPLING PLAN AND RECORD
For period
Qualification
01/01/05 – 01/07/05
Name of Internal Verifier
Standardisation unit
ABC Levels 2 – 4
Unit 1 (Communication) across all levels
Name of countersigning Internal Verifier (if necessary)
IV1
n/a
Assessor
Assessor
status
Assessment
site
Candidates
Units (to be) sampled by the internal verifier
according to the centre sampling plan are shaded
(see key overleaf). Any variations from the plan are
in bold
Method of assessment /
evidence source checked
Part of the
assessment
process review
A
Q
Leeds office
L2
TS
1
2
3
4
5
6
1.DO/EWT
2.WP
P
R
AB
1
2
3
4
5
6
1.DO/EWT
3.WT
P
F
AG
1
2
3
4
5
6
7
8
1.DO/EWT
2S
P
R
BH
1
2
3
4
5
6
7
8
1.DO/EWT
3 APCS
P
F
RA
1
2
3
5
6
7
8
1.DO/EWT
2 APEL
P
R
PD
1
2
3
4
5
6
7
8
1.DO/EWT
3Q
P
F FC
L2
AX
1
2
3
4
5
6
1.DO/EWT
4 PD
P
R
L2
BX
1
2
3
4
5
6
1.DO/EWT
5
P
F
L3
CD
1
2
3
4
5
6
7
8
1.DO/EWT
4
P
R
EF
1
2
3
4
5
6
7
8
1.DO/EWT
5
P
F
GH
1
2
3
4
5
6
7
8
1.DO/EWT
4
P
R
IJ
1
2
3
4
5
6
7
8
1.DO/EWT
5
P
F
KL
1
2
3
4
5
6
1/2 DO/EWT
6
P
MN
1
2
3
4
5
6
1.DO/EWT
P
F
OP
1
2
3
4
5
6
7
8
1.DO/EWT
P
R
QR
1
2
3
4
5
6
7
8
1.DO/EWT
P
F
L3
L4
B
Q
Bradford
L4
C
NSQ
Barnsley
L2
L3
Guidance on internal verification of N/SVQs
R FC
55
Assessor
D
Assessor
status
NSNQ
Assessment
site
Huddersfield
Candidates
Units (to be) sampled by the internal verifier
according to the centre sampling plan are shaded
(see key overleaf). Any variations from the plan are in
bold
Method of assessment /
evidence source checked
Part of the
assessment
process review
L4
ST
1
2
3
4
5
6
7
8
1.DO/EWT
P
R
UW
1
2
3
4
5
6
7
8
1.DO/EWT
P
F
WX
1#
2
3
4
5
6
1.DO/EWT
P
R
YZ
1#
2
3
4
5
6
1.DO/EWT
P
F
SA
1#
2
3
4
5
6
7
8
1.DO/EWT
P
BG
1
2
3
4
5
6
7
8
1.DO/EWT
P
JS
1
2
3
4
5
6
7
8
1.DO/EWT
P
HJ
1
2
3
4
5
6
7
8
1.DO/EWT
P
Method of Assessment/
evidence source checked
DO - Direct Observations
WT - Witness Testimony
APCSCRA – Assignment /
Project / Case Study/ Candidate
/Reflective Account
APEL - Accreditation of Prior
Experience /Learning
Q - Questions
PD - Professional Discussion
WP - Work Product
EWT - Expert Witness Testimony
S – Simulation
Q – Questions
Assessment
Process
F – Feedback
FC – Final Check
J – Judgement
P – Planning
Rec – Records
R – Review
L2
L3
L4
Assessor
Status
Q - Qualified
NQ - Not
Qualified
NSQ - New
qualified
staff
NSNQ - New
staff, not
qualified
Key
¨ Base line sampling to cover:
1 unit x all assessors
All units/different assessors
Additional sampling to meet individual assessor profiles
¨
¨
Newly qualified assessor(s) gaining confidence
Unqualified assessor(s)
R FC
F
R FC
F
This part of the form will be completed on an ongoing basis.
IVs should aim to cover an appropriate mix / range of
assessment methods and parts of the assessment process.
Guidance on internal verification of N/SVQs
56
Reasons for varying from the plan:
Date
01/01/05
Assessor D qualified but will be subject to some additional sampling. ie three more units, to ensure she is confident in her new role.
Guidance on internal verification of N/SVQs
57
Exemplar centre two
There are extra layers of planning which need to be undertaken by the centre quality assurance coordinator and the team of internal verifier co-ordinators, designed to ensure that there will be
standardisation of activity across the whole centre i.e. all qualifications, all satellites or
assessment locations and all internal verifiers.
Accordingly, at the stage when the internal verifier sampling plan is in the hands of the individual
internal verifier, it will look no different to the plan agreed for the small centre as all the same
requirements need to be met, namely:
• CAMERA:
Factors
You need to consider
Candidates
Ethnic origin, age, gender, other factors, special needs etc
Assessors
Experience and qualifications, workload, occupational
experience
Methods of assessment
Questioning, observation, testimony, APL, use of simulation,
product evidence, assignments, projects and tests
Elements within the NVQ
Problem areas, special requirements
Records
Reports from assessors, correct assessment practices, IV
records, candidate portfolios and files
Assessment locations
•
•
•
Workplace assessments, college and off-the-job training, other
assessment locations
additional support / scrutiny of qualified, but new, assessors
that the first judgement in each unit assessed by an unqualified assessor is overseen and
countersigned
standardisation activities across the assessors and internal verifiers within each qualification.
QAC/IVC planning
This centre wishes to focus upon health and safety. Therefore for this year the health and safety unit
will be sampled for all candidates and all qualifications / levels.
The purpose is to:
• standardise assessment practice
• review health and safety practice and training across all assessment sites particularly as there
have been concerns that in one area or qualification assessors are either too lenient or
demanding when reaching assessment judgements.
The following policy consists of the instructions to each internal verifier, outlining responsibilities to
ensure compliance with the strategy agreed by the QAC and IVC team.
The plan
This internal verifier plan outlines the internal verification procedures and record keeping
requirements agreed by the quality assurance co-ordinator and IVCs for this N/SVQ assessment
centre.
Each internal verifier must use the centre internal verification procedures and associated recording
documentation.
IV induction:
• IVCs must ensure that the internal verifier has a copy of this document and understands the
procedures and record keeping requirements described.
58
Guidance on internal verification of N/SVQs
•
All unqualified internal verifiers will have their verification decisions overseen and countersigned
by a qualified internal verifier.
Procedure for implementing the N/SVQ internal verification procedure and sampling plan
(This should be used in conjunction with the centre candidate database)
This plan identifies the centre strategy for internal quality assurance. It is developed and monitored
by the QAC/IVC team to ensure that the verification procedure is standardised throughout the
centre. Each internal verifier is responsible for working to the agreed sampling plan.
The internal verifier must check with the IVC/QAC if unclear about the procedures and/or recording
requirements.
• The internal verifier is reminded that when using the minimum internal verification processes
allowable, the activities must be carried out throughout the period of assessment. Under no
circumstances must internal verification only take place towards, or at the end of candidate
assessment.
•
A single unit will be identified by the IVC/QAC for all internal verifiers to sample across all
assessors. This will form part of the centre standardisation process. The internal verifier must
ensure this unit is included in their sample. For this year the unit will be the health and safety
unit.
•
For assessors not qualified with A units or assessors who are qualified but new to the centre,
sampling a minimum of three units at different points in each N/SVQ candidate’s period of
assessment is required.
•
For assessors qualified with D/A units and who have current experience of assessing within the
organisation a minimum of two units will be sampled at different points in each N/SVQ
candidate’s period of assessment.
•
In both instances the internal verifier will also need to focus on all additional areas of verification
responsibility, eg monitoring assessors practice via observation.
•
The internal verifier may increase the extent of the sampling beyond the above if there are
concerns about assessment practice.
•
The sampling policy identified will be reviewed every 12 months.
•
The internal verifier must complete the internal verification sampling plan and record at the
beginning of the assessment process for all their assessors.
•
The internal verification sampling plan and record ensures that all aspects of the assessment
process, evidence gathering methods, observation requirements, a single identified unit and
the full range of units are sampled for each and all assessors and that is evidenced on the
records. This will allow the internal verifier, the second line internal verifier (where necessary),
the IVC/QAC and external verifier to ensure that the agreed process is being applied.
•
Where it is necessary to vary from the sampling plan, the reasons should be recorded and the
variations added to the internal verification sampling plan and record.
NB: The internal verifier is reminded that they must sign against the units sampled on Form N/SVQ12
Summary of Achievement and each evidence item sampled, must be signed in red. This
indicates that sampling has taken place.
Guidance on internal verification of N/SVQs
59
(Green pen should be avoided where possible, as this colour is often used by EVs to evidence
their sampling activity.)
The Summary of Achievement Sheet, Form, N/SVQ 12, for units verified but not sampled should
be signed in black/blue.
The qualified assessor supporting unqualified assessor judgements must countersign all the
relevant units on Form N/SVQ 12 – Summary of Achievement.
60
Guidance on internal verification of N/SVQs
Guidance on internal verification of N/SVQs
61
Published by City & Guilds
1 Giltspur Street
London
EC1A 9DD
T +44 (0)20 7294 2468
F +44 (0)20 7294 2400
www.cityandguilds.com
City & Guilds is a registered charity
established to promote education
and training
62
Guidance on internal verification of N/SVQs
Download