Prog ramEva l ua t i on S ummar y November2009thoughMay2011
ToevaluateworkshopeffectivenessofthePREPaREcurriculum,collectionofparticipant
satisfactionandpre‐andpost‐workshopdataisastandardelementofallworkshop
offerings.Thisdocumentsummarizestheprogramevaluationdatacollectedfrom
November2009thoughMay2011.Thesedataprovidecontinuedinsightintoparticipant
workshopsatisfactionandprovideguidanceregardingtheextenttowhichthePREPaRE
curriculuminfluencesparticipantschoolcrisispreventionandinterventionattitudesand
knowledge.Thesedataexpandonpastevaluationsthroughtheexplorationoftheinfluence
ofdemographicsonchangesinknowledgeandattitudes.
WORKSHOP1
WorkshopSatisfaction
Fromtheavailable515WorkshopEvaluationforms,itisconcludedthatparticipantshada
highdegreeofsatisfactionwiththeirworkshopexperience(M=3.55outof4;SD=.60).
SpecificquestionsandparticipantresponsesaresummarizedinTable1.
Table1.ParticipantWorkshopSatisfaction.RatingsfortheWorkshop1:Crisis
PreventionandPreparedness.
Question
N
Mean
SD
1.Theobjectiveswereclearlystated.
514
3.65
.65
2.Thecontentwasclearandunderstandable.
513
3.60
.65
3.Workshopmaterialswerewellorganized.
511
3.61
.66
4.Thetrainer(s)was/werewellorganized.
508
3.65
.66
5.Workshopmaterialsfacilitatedparticipation
513
3.37
.76
amongparticipants.
6.Thetrainer(s)facilitatedparticipationamong
512
3.47
.74
participants.
7.Thisworkshopincreasedmyknowledge.
510
3.55
.71
8.Iwillbeabletoapplytheinformation/skills
510
3.53
.66
learnedtomyprofessionalduties.
9.Irecommendthisworkshop.
509
3.53
.72
10.Irecommendthis/thesetrainer(s).
495
3.56
.75
*Allitemsona1‐4scale,with1meaningstronglydisagreeand4meaningstronglyagree.
WorkshopEffectonParticipants’AttitudesTowardSchoolCrisisWork
Table2offersdescriptivestatisticsforthepre‐andpost‐workshopquestionsaskedof
participantstoassesstheirattitudestowardcrisispreventionandpreparedness.The
overallmeanattitudetowardcrisispreventionandpreparednessincreasedsignificantly
(t(742)=20.45,p=.000)fromthepre‐test(M=3.32outof5;SD=.57)tothepost‐test(M=
3.79;SD=.65).Anexplorationoftheassociationofdemographicfactorswithchangesin
attitudefoundasignificantdifferencebetweenparticipantsreportingdifferentoccupations
(F(4,729)=4.97,p=.001).Specifically,healthprofessionals(nurses)reportedsignificantly
greaterimprovementsinattitudestowardcrisispreventionandpreparednessthanmental
healthprofessionals.Althoughtherewerenosignificantdifferencesbetweenthegroupsin
attitudetowardcrisisinterventionandpreventionatthepre‐test(F(4,740)=1.48,ns),this
couldbebecausenursesreportedlowerpre‐testattitudesthanallotherprofessionals.
Therewerenosignificantdifferencesbetweenparticipantsinattitudetowardcrisis
preventionandpreparednessasafunctionofyearsspentintheircurrentprofession
(F(3,735)=1.34,ns),numberofpreviousschoolcrisistraininghours(F(3,733)=2.00,ns),or
betweengraduatestudentsandotherparticipants(t(687)=1.37,ns).
Table2.Workshop#1Participants’AttitudesTowardPreventionandPreparedness.
Pretest
Posttest
Question
N Mean* SD Mean*
SD
1.Howknowledgeableareyouaboutschoolcrisis 748
2.44
.81
3.37
.80
preventionandpreparedness?
2.Howconfidentareyouinyourabilityto
748
2.84 1.01 3.49
.92
collaboratewithotherstodevelopa
comprehensiveschoolcrisisresponse
managementplan?
3.Howenthusiasticareyoutocollaboratewith
748
3.44
.90
3.76
.87
otherstodevelopacomprehensiveschoolcrisis
responsemanagementplan?
4.Howimportantdoyoufeelschoolcrisis
747
4.56
.67
4.52
.79
preventionandpreparednessknowledgeand
skillsareintoday’sschools?
*Allitemsona5‐pointscale,withhigherscoresindicatingmorepositiveattitudes.
WorkshopEffectonSchoolCrisisPreventionandPreparednessKnowledge
Workshop1participantresponsesacrosspre‐testsandpost‐testsindicatedsignificant
increasesinknowledge(t(759)=‐33.10,p=.000;Pre‐testM=5.32outof10;SD=1.69;
Post‐testM=8.26outof10;SD=2.09).Therewerenosignificantdifferencesfound
betweenparticipantsinknowledgegainedofcrisisinterventionandpreventionasa
functionofyearsspentintheircurrentprofession(F(3,749)=1.54,ns),oramountof
previousschoolcrisistraining(F(3,747)=1.60,ns).Furthermore,therewerenosignificant
effectsfoundfortheamountofknowledgegainedbasedontheparticipantsreported
professions(F(4,742)=.826,ns). Interestingly, thereweresignificantdifferencesfoundin
theamountofknowledgegainedbetweengraduatestudentsandworkingprofessionals
(t(704)=‐2.94,p=.003),withworkingprofessionalsgainingsignificantlymoreknowledge
thanstudents.
WORKSHOP2
WorkshopSatisfaction
Fromtheavailable761completeWorkshopEvaluationforms,itisconcludedthatoverall
participantsatisfactionforworkshop2washigh(M=3.63outof4;SD=.65).Specific
questionsandparticipantresponsesaresummarizedinTable3.
Table3.ParticipantSatisfaction.Workshop2:CrisisInterventionandRecovery.
Workshop#2
Question
N
Mean*
SD
1.Theobjectiveswereclearlystated.
794
3.66
.71
2.Thecontentwasclearandunderstandable.
793
3.61
.70
3.Workshopmaterialswerewellorganized.
793
3.62
.72
4.Thetrainer(s)was/werewellorganized.
793
3.63
.73
5.Workshopmaterialsfacilitatedparticipation
amongparticipants.
6.Thetrainer(s)facilitatedparticipationamong
participants.
7.Thisworkshopincreasedmyknowledge.
794
3.58
.75
792
3.64
.72
791
3.67
.70
8.Iwillbeabletoapplytheinformation/skills
learnedtomyprofessionalduties.
790
3.63
.72
9.Irecommendthisworkshop.
10.Irecommendthis/thesetrainer(s).
787
3.61
.75
770
3.59
.77
*Allitemsona1‐4scale,with1meaningstronglydisagreeand4meaningstronglyagree.
WorkshopEffectonParticipants’AttitudesTowardSchoolCrisisWork
Table4offersdescriptivestatisticsforthepre‐andpost‐workshopquestionsaskedof
participantstoassesstheirattitudestowardcrisispreventionandpreparedness.The
overallmeanattitudetowardcrisisinterventionandpreventionworkincreased
significantly(becamemorefavorable,t(1017)=34.68,p<.000fromthepre‐test(M=2.99
outof4,SD=.77)tothepost‐test(M=3.70outof4;SD=.49).Anexplorationofthe
associationofdemographicfactorswithchangesinattitudefoundasignificantrelationship
betweentheamountoftimespentinthecurrentprofessionandgainsinattitude
(F(3,1004)=37.73,p=.000),withthosereportingfeweryearsintheprofessionmaking
significantlylargergainsinattitudetowardcrisispreventionandinterventionthanthose
withmoreyears.Similarly,graduatestudentsreportedsignificantlylargerpositivechanges
thanotherparticipants(t(925)=7.44,p=.000).Furthermore,thereweresignificant
differencesfoundforgainsinattitudes(F(3,994)24.06,p=.000)accordingtotheirprevious
experiencewithschoolcrisistraining.Onaverage,thosewith11ormorepriorhourswere
significantlylesslikelytoexperiencegainsinattitudesthanotherparticipants.Therewere
nosignificanteffectsfoundindifferenceofattitudechangebasedontheparticipant’s
reportedoccupation(F(4,997)=1.64,ns).
Table4.Workshop#2Participants’AttitudesTowardCrisisInterventionona1–5
Scale,WithHigherScoresIndicatingMorePositiveAttitudes
N
Pretest
Posttest
Question
Mean SD Mean SD
1.Howanxiouswouldyoufeelifyouwere
1052 3.13 .94 3.80 .56
requiredtoconductaschoolcrisisintervention?
2.Howconfidentareyouinyourabilitytoknow
1040 3.24 .91 3.88 .52
whattodoifyouwererequiredtorespondaspart
ofaschoolcrisisresponseteam?
3.Howfearfulareyouthatyoumightmakea
1054 2.65 .86 3.45 .70
mistakeduringaschoolcrisisintervention?
*Allitemsona5‐pointscale,withhigherscoresindicatingmorepositiveattitudes.
WorkshopEffectonParticipantSchoolCrisisWorkKnowledge
Workshop2participantresponsesindicatedsignificantincreasesinknowledge(t(1087)=
42.88,p=.000)frompre‐test(M=7.29outof13;SD=1.99)topost‐test(M=10.53outof
13;SD=2.03).Resultsindicatedthattherelationshipbetweentheamountoftimespentin
thecurrentprofessionandgainsinknowledge(F(3,1072)=4.01,p=.007)wassignificant.
Onesignificantdifferencewasfoundbetweengroupsinchangeinknowledge;thosewith0
yearsintheircurrentprofessionweremorelikelytoexperienceasmallergainin
knowledgethanthosewith1‐5years(Meandifference=.77,p=.013).Therewereno
significantdifferencesbetweenparticipantsbasedonoccupation[F(4,1064)=1.93,ns],
amountofpreviousschoolcrisistraining(F(3,1062)=1.54,ns),orstudentstatus
(t(987)=1.39,ns)inknowledgegainsincrisisintervention.
SummaryofFindings
Insummary,bothworkshop1andworkshop2wereassociatedwithasignificant
improvementinattitudesandknowledgetowardcrisisprevention,preparedness,and
intervention.Similarly,bothworkshop1and2participantsreportedahighlevelof
satisfactionwithworkshopcontent,achievementofobjectives,trainerpreparedness,
materials,knowledgegained,andapplicationoftheinformation.