Deciding which method(s) to use in evaluation
Work through the columns A to E to decide which methods would be most useful for collecting the data you require. There are pros and cons to
using different methods and you will find that you will have to make decisions considering their overall feasibility.
A : Objectives
B : Audience
C : Sources
From Template 1, what are
the intended outcomes of this
CPD activity?
For whom is this data
intended?
Think about the primary
question you are trying to
answer.
Rephrase these as questions
you would like to answer.
In what form/level of
detail would it be
best received?
Who is best placed to
provide you with this
information? (select more than
one if required)
Participants/Students/Peers
/Staff involved in CPD/
Line managers/ Institutional
leaders
For the participants
1.
2.
3.
For students
1.
2.
3.
For the institution
1.
2.
3.
D: Nature of this
information
What would this
information look like?
E : Additional data
Consider your
responses to columns B
and C to select a
method with guidance
from Table ? below
Is there any data you could use to
explore the results obtained in more
detail? Reconsider columns B,C and
D with this in mind.
What other information would it be
useful to consider?
Prompts to consider
Is this information already available?
Is this information you can elicit from analysing material which already
exists?
Is this information fairly straightforward, which an individual could provide
quite easily by selecting from different options or responding in a few
sentences?
Is it important that you reach a large number of people for this
information?
Possible methods
Existing data sets.
 See Table 2 for examples of institutional/departmental/programme-level
data sets
Participant or student reflections, journals, assessment design, modifications
to curriculum
Questionnaires



Would you like to give individuals a chance to remain anonymous?
Is this a question that can be better answered by discussion between
individuals involved in the CPD activity – bringing together different
opinions and ideas about a subject?
Does the information necessitate detailed explanations, understanding of
thought processes, attitudes or a range of influencing factors?
Would you rather have in-depth information from a small group of people
rather than short, factual responses from a larger group?
Are you interested in seeing what people do rather than listening to what
they say they do?
Could you collect this information using other innovative methods?
Can include a mix of closed and open questions to generate both
qualitative and quantitative data
Design of the questionnaire to be considered carefully, keeping in mind
analysis.
Piloting is important
Focus groups
 Important for individuals to feel comfortable in the group
 Useful to have two facilitators - one to encourage discussion and the
other to take notes
 Recording, transcription and ethics around this
Interviews



Structured, semi-structured or unstructured.
Interview schedule
Recording, transcription and ethics around this
Observations



Role-play
Using Lego to express and explain concepts,
Expression through artefacts – paintings, sculptures .