Inkster Family Literacy Movement Evaluation
Status Report from the Wayne State University Evaluation Team
Progress from May 2012 through March 2013
The first five months (May through September 2012) of the Inkster Family Literacy Movement
evaluation were spent developing the evaluation plan for review and feedback from the
Corporation for National and Community Service (CNCS). Once the plan was reviewed and
subsequently approved, we began working with the Inkster Community Coalition to gain a better
understanding of their work and their activities. We attended the majority of the Coalition
meetings and provided logic model and evaluation training to Coalition members as well as
collaborating with them on the development of logic models and evaluation strategies for
Reading Rallies and Book Nooks. In addition, we collaborated with the Community Coalition to
develop a template to facilitate fidelity related information gathering collected at each event.
The first Reading Rally took place November 2012, and a reaction survey was developed and
distributed by program staff. The evaluation team processed the data quickly and the findings
were presented in December to the Coalition Members. Subsequent events took place in
January, February and March and reports were generated from each.
Development of the KABBs (knowledge, attitudes, beliefs and behaviors) survey was undertaken
in November concomitantly with the Starfish staff and the Community Coalition. In addition,
identification of viable venues for conducting intercept surveys was discussed. No surveys were
collected during the development phase in the first quarter. In January, a community forum was
convened where items from the proposed survey were presented and discussed with community
leaders and stakeholders. Based on the feedback we received, the instrument was modified in
February. Subsequently, the survey and distribution plan was finalized.
The application to administer the KABBS survey was submitted to the Wayne State University
IRB in February and we were granted approval to conduct the survey in March. We have since
collected data at one venue in March and have plans for additional survey administration at
various venues in April. Recruiting community organizations to allow the evaluation team
access to administer the survey to their respective constituents has proven more challenging than
anticipated. We are currently in the process of considering alternative venues for KABBs survey
administration, including an online and/or mailed survey.
We continue to work with Starfish staff to review registration information for participants in
each of the program components as outlined in the evaluation work plan. Analysis will begin in
June.
Below is an outline of progress related to the proposed evaluation plan.
Page 1 of 3
YEAR ONE PLAN
Activity/Milestone
Collect baseline data on KABBs from
Community Coalition members,
community members at large, and
parents
Present baseline information to Starfish
and Community Partners
Collaborate with the Community
Coalition to develop a template for
collection of process measures for every
event
Training with Starfish and CC partners
about logic modeling and evaluation
In collaboration with program staff,
develop evaluation plans for components
and provide coaching for internal
evaluation
IRB application and approval
Establish processes for data sharing with
YEAR ONE PROGRESS
6/12- 9/12- 12/12- 3/13Q1 Q2 Q3 Q4 Progress through March 2013
8/12 11/12 2/13 5/13
Development of the evaluation plan and
X
X
receipt of approval from CNCS
This did not happen as early in the
process as we would have liked.
Development of the survey and plans for
X
collection took more negotiating than we
X
had anticipated. We have collected
baseline at one venue and are planning
for additional venues in April.
We are waiting to collect additional data
X
before presentation to partners.
This was developed in the Fall 2012 and
has been used to collect process
information about all Reading Rallies.
X
X
This will be expanded for use with the
other activities (e.g., Book Nooks,
Literacy Chats, etc.)
Training took place Fall 2012 and a logic
model and evaluation plan were
X X
X
X
developed for the Reading Rallies and
Book Nooks.
This has been developed and Starfish
staff members are conducting internal
X X
X
X
X
evaluations for the Reading Rallies and
Book Nooks.
IRB application was developed in
February 2013 and approval for the
X X
X
X
KABBs survey was received March
2013
X X X This is ongoing with Starfish staff. At
X
X
Page 2 of 3
YEAR ONE PLAN
Activity/Milestone
the Starfish and CC partners
After each event, generate brief report on
that event for program staff
Quarterly evaluation report presented to
Starfish and CC partners
YEAR ONE PROGRESS
6/12- 9/12- 12/12- 3/13Q1 Q2 Q3 Q4 Progress through March 2013
8/12 11/12 2/13 5/13
present, we do not anticipate collecting
data from community coalition partners
other than through an interview each
year
Brief reports are presented to the
X X X
X
X
Coalition after each event.
We did not prepare quarterly reports.
X X X X
X
X
We are now doing so.
Page 3 of 3