Assessing impact of events with invited stakeholders – a short guide
Events with invited
stakeholders, not public
events
This guide is aimed at events where people have been invited in their professional capacity,
and you expect them to take something back that may change the way they do things at
their workplace. The KE office has developed a separate guide for evaluating open public
events where people attend out of personal interest. Some events may target both groups
– in which case you may want to capture in what capacity they attend in the background
info section.
It is about assessing impact
rather than the success of
an event
The questions attempt to capture impact, as opposed to views on whether the event was
successful. For the latter you may want to also include questions about the venue, lunch
etc. Evaluations show that if these basics are not in place, the event is also likely to have
less impact.
This is not a standard
template.
Any questionnaire needs to relate to the objectives and content of the event. The KE office
is very happy to discuss this further, and to read a draft/try the questionnaire before you
send it out. Please contact a.s.laegran@ed.ac.uk for further advice.
Before you design the evaluation
Clear objectives helps
evaluation
Is the purpose of the event to enlighten, increase awareness, inform, or change minds?
Would you like the audience to do something different at their work place as result of the
event? Then develop the evaluation accordingly.
Consider what background
data you need
What do you need to know about your audience? Stick to what is relevant given your
objectives. Some of this data is best collected at registration, so in the evaluation form you
should only ask for background info that you would like to correlate with responses.
Further advice
National coordinating Centre for Public Engagement, in particular the Evaluations: Practical
guidelines report. http://www.publicengagement.ac.uk/how/guides/evaluation/resources
Combining qualitative and quantitative data
Open questions vs fixed
alternatives
Using scales
In particular for large events it is useful to have quantitative data – i.e. to be able to say
that “X% said they learnt quite a lot of a lot” from the event. However, the most valuable
feedback lies in the comments on what they learnt. You can combine open questions for
comments only, with questions where you ask participants to tick alternatives to get
quantitative data. But please be aware not to ask very similar questions as this may
confuse the respondent.
When asking for quantitative data, please avoid scales from 1-5 as people often get the
scale wrong even when it is spelled out clearly what is the top vs the low mark. Instead use
□ Not at all □ A little □ Quite a lot □ A lot
Please ensure you leave space for comments where appropriate.
Assessing impact of events with invited stakeholders.
University of Edinburgh CHSS Knowledge Exchange Office March 2014
Questions to capture impact at the event
Questions suitable for
four tick boxes, e.g. Not at
all to A lot, or Not at all to
Very likely.
 Did the event provide you with new knowledge about…?
 Did the event provide you with new insights on…..?
 Did the event increase your awareness of….?
 Did the event inform your views about….?
 Did you find the event applicable to your work?
 Do you expect that the insights of the event will change aspects of your own practice?
 Have you changed your mind on X as result of the event?
Please note the nuances between knowledge, insights and awareness and choose the
wording most applicable to your event.
For small events you can
stick to open questions
 What did you learn from the event?
 Did you pick up elements of good practice at the event, if so what?
 Did you share good practice with other participants, if so what?
 What elements of good practice discussed at the event would you like to implement in
your work place?
The last question can be followed up after the event to see what they have been able to
implement.
Questions to capture change in behaviour a while after the event
You can use the same
questions as above if you
did not evaluate on the
day.
Additional questions
suitable for tick-boxes
Open questions
 Have you discussed the event with other people /colleagues? (Yes/No) If so – how many
have you discussed with?
 Have you looked up more information about…. ? (Yes/No)
 To what extent has the event changed the way you consider/view…..
 To what extent has the event changed the way you do….. (or use verb suitable)
For the latter two use the scale above, and don’t forget to allow space for comments.
 Looking back at the time after the event, have you noticed any changes to your own
thinking and practice around…?
 What about your colleagues/organisation’s thinking and practices around…..?
Other questions to capture views about the event and how to follow-up:






Please describe the event in three words: (these can be put into www.wordle.net)
What did you like the most about the event?
What could we improve next time?
Do you have further ideas on how the event organisers can take this topic further?
Is there anything you would like to do to help take this agenda further?
We would like to follow up some of the participants with a telephone survey in a few weeks’ time. If you are happy
with us contacting you please leave a number we can reach you on.
Alternatively, if you have their details: If you don’t want to be contacted please tick this box □
Please contact the KE office if you like to discuss or see examples of questionnaires. We are also grateful if
you share your forms with us, and let us know how you get on with your evaluation.
Assessing impact of events with invited stakeholders.
University of Edinburgh CHSS Knowledge Exchange Office March 2014