Evaluation of WNEP Educational Programs at WIC Clinics—

advertisement
Evaluation of WNEP Educational Programs at WIC Clinics—
WNEP Statewide Evaluation Project for FY06
September 2005
Situation
Common characteristics of WNEP educational programming at WIC:
 8% of WNEP educational contacts during FY05 were at WIC. Thirty-three of our 40 WNEP county




projects stated that they plan to offer educational programming at WIC sites during FY06.
Learn-while-you-wait educational displays are most often the educational method used—80% of
educational contacts used this method. 15% of educational contacts were through one-time groups.
WNEP nutrition educator interacts with individual WIC participants using the display as a teaching
tool; teaching contact time per learner ranges from 5 to 15 minutes; a related, reinforcing handout or
fact sheet is usually given to the learner during the lesson
Learners are primarily women with infants or young children, or pregnant women; occasionally
fathers and grandparents.
WIC staff vary greatly in their willingness/ability to work collaboratively with WNEP or to actively
encourage learners to participate in WNEP education at the clinic
Assumptions about WNEP educational programming at WIC:





Learners are seen at the same location over time for repeated educational contacts (ie when WIC
client returns for draft pick-up and recertification) and WNEP nutrition educators usually get to know
the learners over time
A well designed interactive educational display along with an enthusiastic skilled educator can lead to
learning by the participant (a gain in knowledge and/or a change in attitude)
The teaching environment is often not conducive to effective education (many distractions,
noisy/crowded, conflicting demands on learner’s attention)
WNEP nutrition educators can play a key role in reinforcing educational messages that the WIC
nutritionist has communicated to the client
WIC staff are aware of, and form opinions about the effectiveness of, the WNEP educational
programming that occurs at their clinic sites; and WIC staff vary in how much they value the work of
WNEP educators and the relationship between WNEP and WIC
Selection of the Topics and Development of Tools
Impact Evaluation tools have been developed for selected teaching topics. Three of the Topics were
selected based on the teaching tips and strategies accompanying the new MyPyramid food guidance
system. These 3 topics were selected because of the evidence that many Americans diets are most in need
of improvement in these areas: whole grain, vegetables and fruit consumption. In addition, since a
significant amount of teaching at WIC focuses on helping participants learn to use the foods they receive
from WIC, this was also included as a topic of interest for this Project.
Tools and methods were developed to assess both the short-term (“Did the participants learn something?”
and medium-term (“Are the participants doing something differently?”) outcomes.
 Short-term outcomes will be assessed by orally asking the participants one or two short, quick
questions at the end of the brief lesson.
 Medium-term outcomes will be assessed by asking the staff at WIC to complete a brief
questionnaire about what they have observed or noticed as a result of WNEP instruction.
Human Subjects Protection—Informed Consent to Participate
The end of session evaluation questions that are designed for this evaluation project are intended to be
asked of all willing adults who participated in the lesson being evaluated.
Before asking the end of session evaluation questions, say the following to the learners:
“I am going to ask you a question that will help us see what you have learned today. You do
not have to answer the question if you don’t want to. All of your answers will be private.”
Do not record individual learner’s names on evaluation forms or questions. Do not share individual
answers or comments made by the learners with other teachers or staff.
Choosing an Evaluation Tool for use with Learners at WIC
Topic #1: Make half your grains whole
If . . . . .
The lesson included information about Reading food labels to
find whole grains (based on content such as MyPyramid tips at:
http://mypyramid.gov/pyramid/grains_tips.html)
Then . . . .
Use Whole Grains question #1 Before and After the lesson
If . . . . .
The lesson included information about Why eating whole
grain is important (based on content such as MyPyramid
tips at: http://mypyramid.gov/pyramid/grains_why.html)
Then . . . . .
Use Whole Grains question #2 after teaching the lesson
If . . . . .
The lesson included information about Tips for using whole grains in
meals and snacks (based on content such as MyPyramid tips at:
http://mypyramid.gov/pyramid/grains_tips.html)
Then . . . . .
Use Whole Grains question #3 after teaching the lesson
Topic #2: Vary your veggies
If . . . . .
The lesson included information about Why eating a variety of
vegetables is important (based on content such as MyPyramid tips
at: http://mypyramid.gov/pyramid/vegetables_why.html)
Then . . . . .
Use Vegetables question #1 after teaching the lesson
If . . . . .
The lesson included information about How many vegetables
should we eat each day? (based on content such as MyPyramid tips
at: http://mypyramid.gov/pyramid/vegetables.html and
http://mypyramid.gov/pyramid/vegetables_amount.aspx
and http://mypyramid.gov/pyramid/vegetables_counts.html)
Then . . . . .
Use Vegetables question #2 after teaching the lesson
If . . . . .
The lesson included information about Tips for using vegetables in
meals and snacks (based on content such as MyPyramid tips at:
http://mypyramid.gov/pyramid/vegetables_tips.html)
Then . . . . .
Use Vegetables question #2 after teaching the lesson
Topic #3: Focus on fruit
If . . . . .
The lesson included information about Why eating a fruit
is important (based on content such as MyPyramid tips at:
http://mypyramid.gov/pyramid/fruits_why.html)
Then . . . . .
Use Fruit question #1 after teaching the lesson
If . . . . .
The lesson included information about How many fruits
should we eat each day? (based on content such as MyPyramid
tips at: http://mypyramid.gov/pyramid/fruits.html and
http://mypyramid.gov/pyramid/fruits_amount.aspx and
http://mypyramid.gov/pyramid/fruits_counts.html)
Then . . . . .
Use Fruit question #2 after teaching the lesson
If . . . . .
The lesson included information about Tips for using fruit
in meals and snacks (based on content such as MyPyramid
tips at: http://mypyramid.gov/pyramid/fruits_tips.html)
Then . . . . .
Use Fruit question #2 after teaching the lesson
Topic #4: Using WIC foods
If . . . . .
The lesson is about Using WIC foods in meals and snacks
Then . . . . .
Use the Use of WIC Foods question after teaching the lesson
Evaluation Questions for Use with Learners at WIC
Whole Grains #1
Which of these foods are Whole Grains?
Wheat Thins Crackers
Graham Crackers
Ingredients: ENRICHED
FLOUR, SOYBEAN OIL,
DEFATTED WHEAT GERM,
SUGAR, CORNSTARCH,
HIGH FRUCTOSE CORN
SYRUP, SALT, CORN
SYRUP, LEAVENING,
VEGETABLE COLORS,
MALTED BARLEY FLOUR
Corn Chex Cereal
Ingredients: ENRICHED FLOUR,
SUGAR, SOYBEAN OIL,
GRAHAM FLOUR, HONEY, HIGH
FRUCTOSE CORN SYRUP,
LEAVENING, SALT, ARTIFICIAL
FLAVOR, MALTED BARLEY
FLOUR
Triscuit Crackers
Ingredients: MILLED YELLOW
CORN, SUGAR, SALT, MALT
SYRUP, SODIUM
BICARBONATE, VITAMINS &
MINERALS
Toasted O’s Cereal
Ingredients: WHOLE
WHEAT, PARTIALLY
HYDROGENATED
SOYBEAN OIL, SALT,
GUAR GUM
Ingredients: WHOLE GRAIN OAT
FLOUR, WHEAT STARCH,
SUGAR, OAT FIBER, SALT, OAT
EXTRACT, CALCIUM
CARBONATE, CARAMEL COLOR,
VITAMINS & MINERALS
--------------------------------------------------------------------------------------------------------------------Agreement number ________
Teaching event number ________
Learner Question for Education at WIC—FY06
Whole Grains #1
County/Project __________________________
Date(s) of Educational Event:
Nutrition Educator _________________________
_______________________________________________
Location of Event: ____________________________________________
Whole Grains #1
Number
answering 2
correctly*
Before the Lesson: Which of these foods
are Whole Grains?
After the Lesson: Which of these foods
are Whole Grains?
* Correct answers: Triscuit Crackers and Toasted O’s Cereal
Comments from Participants:
Number
answering 1
correctly
Number
answering 0
correctly
Total
Number of
learners
Agreement number ________
Teaching event number ________
Learner Question for Education at WIC—FY06
Whole Grains #2
County/Project __________________________
Date(s) of Educational Event:
Nutrition Educator _________________________
_______________________________________________
Location of Event: ____________________________________________
Number able to
give a correct
or acceptable
answer*
Whole Grains #2
Number unable
to give a correct
or acceptable
answer
Total Number
of learners
What do you think is one good reason why you
(and your family) need Whole Grains each day?
* Correct or acceptable answers should be based on information at MyPyramid.gov and include: reduced
risk of coronary heart disease; reduced constipation and/or helps keep bowels regular; provides nutrients
needed for health and maintenance of body
Comments from Participants:
-----------------------------------------------------------------------------------------------------------Agreement number ________
Teaching event number ________
Learner Question for Education at WIC—FY06
Whole Grains #3
County/Project __________________________
Date(s) of Educational Event:
Nutrition Educator _________________________
_______________________________________________
Location of Event: ____________________________________________
Whole Grains #3
After what you have learned today, are you more likely
to try to eat Whole Grains?
Comments from Participants:
Number
saying
“YES”
Number
saying
“NO”
Number
saying
“unsure”
Total
Number of
learners
Agreement number ________
Teaching event number ________
Learner Question for Education at WIC—FY06
Vegetables #1
County/Project __________________________
Date(s) of Educational Event:
Nutrition Educator _________________________
_______________________________________________
Location of Event: ____________________________________________
Number able to
give a correct
or acceptable
answer*
Vegetables #1
Number unable
to give a correct
or acceptable
answer
Total Number
of learners
What do you think is one good reason why you
(and your family) need to eat a variety of
vegetables each day?
* Correct or acceptable answers should be based on information at MyPyramid.gov include: reduced risk
for strokes and other cardiovascular diseases; reduced risk for type 2 diabetes; reduced risk for certain
cancers; healthy bones and kidneys.
Comments from Participants:
-----------------------------------------------------------------------------------------------------------Agreement number ________
Teaching event number ________
Learner Question for Education at WIC—FY06
Vegetables #2
County/Project __________________________
Date(s) of Educational Event:
Nutrition Educator _________________________
_______________________________________________
Location of Event: ____________________________________________
Vegetables #2
After what you have learned today, are you going to try
to eat more vegetables each day?
Comments from Participants:
Number
saying
“YES”
Number
saying
“NO”
Number
saying
“unsure”
Total
Number of
learners
Agreement number ________
Teaching event number ________
Learner Question for Education at WIC—FY06
Fruit #1
County/Project __________________________
Date(s) of Educational Event:
Nutrition Educator _________________________
_______________________________________________
Location of Event: ____________________________________________
Number able to
give a correct
or acceptable
answer*
Fruit #1
Number unable
to give a correct
or acceptable
answer
Total Number
of learners
What do you think is one good reason why you
(and your family) need to eat a variety of fruit each
day?
* Correct or acceptable answers should be based on information at MyPyramid.gov include: reduced risk
for strokes and other cardiovascular diseases; reduced risk for type 2 diabetes; reduced risk for certain
cancers; healthy bones and kidneys.
Comments from Participants:
-----------------------------------------------------------------------------------------------------------Agreement number ________
Teaching event number ________
Learner Question for Education at WIC—FY06
Fruit #2
County/Project __________________________
Date(s) of Educational Event:
Nutrition Educator _________________________
_______________________________________________
Location of Event: ____________________________________________
Fruit #2
After what you have learned today, are you going to try
to eat more fruit each day?
Comments from Participants:
Number
saying
“YES”
Number
saying
“NO”
Number
saying
“unsure”
Total
Number of
learners
Agreement number ________
Teaching event number ________
Learner Question for Education at WIC—FY06
Use of WIC Foods
County/Project __________________________
Date(s) of Educational Event:
Nutrition Educator _________________________
_______________________________________________
Location of Event: ____________________________________________
Use of WIC Foods
Have you learned something today that will make it
easier to use WIC foods in your family’s meals and
snacks?
Comments from Participants:
Number
saying
“YES”
Number
saying
“NO”
Number
saying
“unsure”
Total
Number of
learners
County/Project ________________
Agency number__________
Agreement number __________
Date _________________
Evaluation tool for use with WIC staff
I have noticed or heard comments indicating that . . . . . .
As a result of lessons that WNEP has
provided for WIC participants at WIC
clinics . . . . . .
Strongly
Agree
Agree
Disagree
Strongly
Disagree
Don’t
Know
WIC participants are eating more Whole
Grains
WIC participants are eating more
Vegetables overall
WIC participants are eating a greater
variety of different kinds of Vegetables
WIC participants are eating more Fruit
overall
WIC participants are eating a greater
variety of different kinds of Fruit
WIC participants are using their WIC
foods more in family meals and snacks
WIC participants are using recipes for
WIC foods that were provided as part of
the WNEP lessons
Use the space below to provide us with any specific comments or observations related to what
WIC participants have learned from WNEP lessons:
Thank you for your answers and comments.
Download