Best Practices in Reading: A Study of 16 Texas Reading... Candice Knight, PhD Daryl Michel, PhD 2010

advertisement
Best Practices in Reading: A Study of 16 Texas Reading First Campuses
Candice Knight, PhD
Daryl Michel, PhD
2010
Institute for Public School Initiatives
5316 Highway 290 West, Suite 510
Austin, Texas, 78735-8931
ipsi.utexas.edu
1
Texas Reading First Demonstration Site Project Report
Texas Education Agency
Institute for Public School Initiatives, University of Texas at Austin
Vaughn Gross Center for Reading and Language Arts at The University of Texas at Austin
Children’s Learning Institute, University of Texas-Health Science Center, Houston
Texas Institute of Measurement, Evaluation, and Statistics, University of Houston
Acknowledgments
The Texas Reading First Study-Demonstration project was implemented with funding from the Texas Education
Agency. The authors of this report acknowledge many individuals who contributed, provided guidance, and
offered support throughout the various phases of this project.
Project Coordinators and Report Authors:
Candice Knight, Vaughn Gross Center for Reading and Language Arts at The University of Texas at Austin
Daryl Michel, Institute for Public School Initiatives, University of Texas System
Project structure, development of data collection tools, and data analysis:
Coleen Carlson, Texas Institute for Measurement, Evaluation, and Statistics, University of Houston
Greg Roberts, University of Texas, Vaughn Gross Center for Reading and Language Arts
Heather Zavadsky, University of Texas System, Institute for Public School Initiatives
Data collection and transcribing:
Griselda Hernandez, Texas Institute for Measurement, Evaluation, and Statistics, University of Houston
Teresa Tipton, University of Texas System, Institute for Public School Initiatives
Mary White, Children’s Learning Institute, University of Texas, Health Science Center
Interview and observation schedules, product design guidance:
Kathy Balch, Linda Cranmer, Leslie Harris, Becki Krsnak, Darlene McAlister, and Stacy Pineda;
University of Texas System, Institute for Public School Initiatives
Angie Durand, Ken Nieser
Texas Institute for Measurement, Evaluation, and Statistics, University of Houston
We recognize the participating campuses for sharing insights on their best practices used to increase reading
achievement scores. We also thank each site for producing educational products so that others may learn from
their best practices.
Burrus Elementary, Houston ISD
Cromack Elementary, Brownsville ISD
D’Hanis Elementary, D’Hanis ISD
Driscoll Elementary, Driscoll ISD
Hughes Springs Elementary, Hughes Springs ISD
La Vega Elementary, La Vega ISD
Maple Lawn Elementary, Dallas ISD
Parsons Elementary, Lubbock ISD
Preston Hollow Elementary, Dallas ISD
Price Elementary, Beaumont ISD
Ramirez Charter School, Lubbock ISD
Shallowater Elementary, Shallowater ISD
Southmayd Elementary, Houston ISD
Tijerina Elementary, Houston ISD
Troup Elementary, Troup ISD
Vanguard Academy Charter
2
Abstract
Reflection is an essential part of the learning process (Schon, 1987). After implementing new practices, it
is important for practitioners to look back in an effort to continually improve educational experiences for
students. As Texas Reading First neared the end of implementation, a self-study was initiated focusing on
effective instructional practices that had been implemented over the course of the grant period. What worked
well? What can others learn from us? What can we do better? The Study/Demonstration Site Project sought to
first identify effective practices, and then to study those practices in an effort to learn from practitioners and
share their success with others at the local and state levels.
Purpose and Objectives
This study examined effective practices at successful elementary schools in Texas. We looked at 16 schools
that made significant progress over time in outcome measures in reading. The project goals were to highlight
successful school sites as models of effective practice, identify effective practices at each site, and demonstrate
effective practices for others. This paper discusses the common themes that were identified and is designed to
inform practitioners about what these schools accomplished and how they did so.
Theoretical Background
Large-scale school improvement is often measured in terms of student achievement. If the goal is to improve
student learning, we must improve the schools in which that learning takes place (Darling-Hammond, 1996).
School improvement often relies on several integrated dimensions of practice among varying stakeholder
groups. This could mean building capacity at different levels in developing the knowledge and skills of
individuals, creating a professional community, aligning programs, providing resources, or sharing leadership
(Newmann, King, & Youngs, 2000). To improve schools, these various dimensions must also continually evolve
and change. Fullan (2008) notes that schools that effectively implement change value their employees, connect
peers with purpose, build capacity, continue learning, function transparently, and have evolving systems. In
addition to the individual dimensions that are related to school improvement, relationships within the overall
system may have an impact as well. As such, general systems theory was used as one guiding principle for this
study. When examining effective practices at successful schools, it is possible that both successful subsystems
within specific dimensions and an overall smoothly functioning unit will exist (Cummings & Worley, 2005;
Fullan, 2008).
In order to provide structure for the scope and direction of the study, a guiding framework was theorized to
contain important dimensions of successful schools that allowed us to examine their relationships (see Figure
1). The Conceptual Framework was developed by drawing from existing models for examining effective school
practices, such as the National Center for Educational Achievement, The Broad Foundation, and Baldridge
National Quality Program. This original Conceptual Framework guided all data collection activities, including
the development of data collection instruments.
3
Figure 1: Conceptual Framework
Methods
We used a qualitative, comparative case study approach to guide this study, carefully examining each case,
including activities and functions (Stake, 2006). With the use of this approach, we collected, organized, and
analyzed data specific to each case and, later, used this data for comparison purposes (Patton, 2002).
Site Selection
The 16 schools were selected as potential study sites based on K-3 student performance on outcome
assessments in reading. The 2004-2008 outcome measures included in this model were the percentage of
students scoring proficient at each campus on: 1) Texas Primary Reading Inventory (TPRI) graphophonemic
knowledge scores and, if applicable, Tejas LEE graphophonemic knowledge scores in kindergarten; 2) Stanford
Achievement Test-10 or Iowa Test of Basic Skills total reading in grades 1 and 2, and, if applicable, APRENDA
or Logramos total reading in grades 1 and 2; and 3) Texas Assessment of Knowledge and Skills (TAKS) English,
and, if applicable, Spanish, in grade 3. Method of selection was as follows: Standard scores (z-scores) were
calculated for both change over time, from 2004-2008 (slope) and reading performance in 2008 (intercept).
Campuses with the largest growth in reading outcomes during years participating in Reading First and
campuses at the highest level of performance in reading in 2008 were identified. Campuses were rank ordered
according to both slope and intercept values. Campuses were identified using multi-level, unconditional
models of student performance, nesting students within campuses. In addition to overall performance,
representation of study sites across districts of varying size was also considered as part of the selection
process. This criterion was based on the need to include study sites that would be representative of as many
campuses across the state as possible, as pertaining to district type.
4
Participant Selection
After selecting the 16 sites, a sample of representative participants from each district and campus were
asked to participate. Data were collected from district leaders, campus leaders, classroom teachers and
interventionists, and Reading First technical assistance personnel assigned to the schools (see Table 1).
Subjects
Title
Reading Technical Assistance Specialist
Superintendent
Reading First Director
Principal
Literacy Coach
Teacher
Interventionist
Special Education Teacher
Interview
X
X
X
X
X
X
X
Data Sources
Observation
Focus Group
X
X
X
X
X
Table 1. Data Collection by Subject
Data Sources
Interview and observation protocols were developed based on the Conceptual Framework, as well as
from existing instruments used to measure effective practices. We drew from interview and observation
instruments used by the Broad Foundation, National Reading First Technical Assistance Center, Texas Institute
for Measurement, Evaluation and Statistics, Vaughn Gross Center for Reading and Language Arts, and the
Center on Instruction. Taking into consideration existing protocols, we then adapted and developed original
instruments that were tailored to the needs of this study.
We created separate interview protocols for state, district, and campus level leaders, as well as for teacher
focus groups. Additionally, we created separate observation and follow-up interview protocols for teachers and
interventionists. The interview and observation instruments were piloted at one school and adjustments made
to ensure clarity in participant responses.
Data Collection
Each site was visited during the 2009-2010 school year to collect data and identify areas most related to
each campus’ success. These areas were then highlighted for demonstration. The project team spent at least
one school day at each of the sites conducting individual and focus group interviews and observing core and
intervention instruction.
We used a structured process for the interviews. We used a pre-established set of questions, inclusive of our
framework categories: teaching and learning, processes, leadership, and systems. Additionally, we had preestablished prompts and clarifications in order to obtain as much information as possible from each participant
about best practices and to expand on effective practices that may not be included in our framework.
Observations of best practices in reading during classroom instruction were also a focus of this study. Our
goal was to observe instruction in search of best practices used. During classroom observations, we used a
structured instrument to systematically collect data about best practices in reading related to the elements
from our framework. Following these observations, structured interviews took place with those teachers
observed. The purpose for interviewing after the observations was to collect additional data from teachers on
practices used during the lesson. We used guiding questions and prompts to attain additional information and
insights from each teacher.
5
Data Analysis
The analysis of data continued throughout the study as we identified themes emerging from the data. Merriam
(1998) stated that the “right way to analyze data in a qualitative study is to do it simultaneously with data
collection” (p. 62). After each data collection point, digitally recorded interview data were transcribed and
identifying markers were removed. We recorded our thoughts and captured responses from each participant
or group specific to each case noting emerging themes, key phrases or patterns, thoughts and feelings,
commonalities, and differences. By immediately reflecting on the data, we were able to begin to organize the
data and generate additional categories and themes (Marshall & Rossman, 2006).
After all interviews were transcribed, we coded and then summarized each case by campus, with 16 cases
in all. For the coding process, the original categories in the Conceptual Framework were condensed to 7
categories. These condensed were communication, instructional practices, assessment, support, professional
development, leadership, and vision and values. Each case analysis was then summarized in a site summary
table.
After each case was summarized, we performed a cross-case analysis. We wanted to understand the
commonalities that existed among the 16 campuses studied. We analyzed responses from each district
and campus level interview. In addition, we examined random teacher interviews and focus groups to gain
additional insight into our findings across the 16 campuses.
We summarized the cross-case analysis by looking at distributions. The series of three distribution charts
represents the campus highlights (drawn from the Conceptual Framework) that were identified by the project
team during the onsite visits (see Figure 2). The second distribution, represented in Table 2, is the frequency of
references to themes stated in the district and campus level interviews. This produced two documents, which
were compared to each other, combined, and used to formulate an overall summary of findings, found in
Figure 3.
As of yet, teacher and interventionist observation data have not been formally analyzed, although observations
of instructional practices by the project team were taken into consideration when identifying campus
highlights. Our hope is that this data will be formally analyzed in the future to offer additional insight into
effective practices at the classroom level.
Results
The data used to reach conclusions for this study included both self-reflections from the participants
(interviews) and observations from the project team (highlights identified from site visits). The determination
was made to use both of these data sources because, upon examining the final data, we noticed that the
topics participants spoke about and the way they spoke about them were largely limited to the more concrete
dimensions from the Conceptual Framework. For example, participants spoke of their core programs often but
did not mention sustainability very often at all. We hypothesize that this is because some of the dimensions
are more concrete and easily observed while others are more abstract. It seems logical that practitioners
would be more aware of their everyday practices and perhaps less aware of the underlying values and
processes that influence those practices. The project team was in a unique position to look specifically for
these underlying factors and as such noted them more often. In addition, we noticed that the practices we
observed on campuses and participants’ awareness of their own practices were sometimes different. For these
reasons, both the direct input from the participants and the observations of the project team were given equal
weight when analyzing the data. The results represent the combination of both of these data sources. We are
confident that this creates a more well-rounded and accurate picture of the actual factors, both concrete and
abstract, that are influential at each site.
6
The results indicate that there are several dimensions from the Conceptual Framework that work together to
influence outcomes at these sites. We will begin by reporting the most important individual dimensions and
conclude with how these dimensions work together in an overall system.
Table 2 represents the distribution of themes from the coded interview data, or the number of times that
certain themes were referenced by participants in each interview question. The most frequent themes
referenced were instruction (200) and support (198). Professional development (PD) had many references
(160) but it became apparent that there was overlap between the categories of PD and support, as many
of the participants spoke of PD as a type of support or visa versa. Therefore, PD was not included as a
distinct important dimension but can be assumed to be embedded in support to some extent. Likewise,
communication (148) was found to overlap with support as a type of support and was not reported as a
separate important dimension. In addition, assessment had many references (158) but this category was
noticed to overlap with instruction in that many references to grouping or differentiated instruction could
be included as either instruction or assessment. Thus, assessment is represented in instruction and was not
included as a separate important dimension. Overall, instruction and support appear to be the most important
dimensions to stakeholders when reporting their own effective practices.
7
Figure 2: Distribution of Campus Highlights (from the Conceptual Framework)
Figure 2 represents the distribution of campus highlights from the Conceptual Framework, or the number of
times each dimension was identified as a campus strength by the project team. These campus highlights were
identified based on a day-long visit to each campus, which included interviews with various stakeholders and
classroom observations. The most frequent dimensions highlighted were instruction (9), support (7), campus
leadership (7), and implementation (11). In addition, there were 4 categories that were highlighted frequently
but not quite as often: vision and values (6), district leadership (5), collaboration (6), and communication (5).
Combining the results from both Table 2 and Figure 2, the most important dimensions appear to be
implementation, instruction, support, and campus leadership. Additional influential dimensions appear to be
communication, collaboration, district leadership, and vision and values.
Instruction and Implementation
Within the dimension of instruction, the components that appear to be of particular importance are high
quality Tier 1 instruction, including small–group instruction, high-quality workstations, differentiated
instruction based on student needs, and general grouping practices using data. Within the dimension of
implementation, the components that appear to be of particular importance are having the 3-Tier Reading
Model framework in place, effective scheduling, and fidelity to the core reading program (consistency
and alignment). In addition, many participants stated that the overall, state-level infrastructure of Texas
Reading First (such as funding levels, employment of coaches, professional development, and communicated
expectations) was beneficial to them. As an example of the importance of both instruction and implementation
and how they are related to each other, when asked how Reading First affected instructional practices, one
participant responded:
“… before Reading First we really didn’t teach reading very well at all… No one had ever taught us how to teach
reading. We were very fragmented… we might have been doing… a little bit of that program, a little bit of
something we developed ourselves, but… we now realize that… you create gaps and holes in your instruction
and in their learning… I think we caused children to be Tier II students through our own misguided attempts
at instruction. But learning how to use explicit instruction and the core with fidelity, that all changed and our
reading instruction became… very focused, very tight… very driven by what the children were needed [sic].”
8
Our analysis suggests that the implementation (structure) and instruction (practice) dimensions appear
to consistently influence one another. Implementing clearly understood structures (i.e. 3-Tier Reading
Model), often results in strengthened delivery of instructional practices (i.e. fidelity to core, targeted smallgroup instruction), whereas the delivery of instructional practices continually informs the refinement of
implementation structures. This ongoing improvement cycle of refining organizational structures ultimately
affects the practices necessary to increase student learning.
Support
Within the dimension of support, one of the components that appears to be the most important is having
onsite coaching support. Most of the participants referred to their coach as being a key factor to their success.
Coaching activities referenced most often include modeling, providing PD, conducting collaborative grade
level meetings, regular data meetings, and providing positive feedback. Creating an “open-door policy” where
teachers felt free to ask questions and share concerns seemed to be important as this appeared to build
trust and allowed the coach to provide nonthreatening and constructive feedback. In fact, communication
and collaboration were both found to be important factors, with the bulk of the communication being
informational and the bulk of the collaborating being between the teachers themselves or the coach and the
teachers.
Thus, the coach’s ability to build relationships appears to be key. Our analysis suggests that the extent to which
the coach was able to build positive and trusting relationships with the teachers greatly influenced the quality
and quantity of their implementation. Likewise, the relationship between the coach and leadership appears
to be instrumental to success. When state, district, and campus leadership work collaboratively and support
and empower the coach this appears to impact instruction in a positive way. In addition, many participants
referred to the support of the principal and the Reading Technical Assistance Specialists (RTAs) in particular as
influencing factors. Overall, there appears to be a network of supportive relationships that allows for successful
problem solving for implementation.
Monitoring and accountability appear to play important roles. Classroom observations by the coach and the
principal were common, along with clear communication about expectations. However, it is worth noting
that participants made sure to tell us that this monitoring and accountability was always paired with the
encouragement and support to implement. Such instructional engagement on the part of campus leadership
(principal and coach) led many teachers to feel supported rather than evaluated. One participant stated “… she
was in my classroom a lot, you know, helping. Not, you know, in a bad way… just there giving a lot of support,
and it makes you feel more confident and comfortable. “
Leadership
While all dimensions of the Conceptual Framework appear to be important, leadership in particular seems to
have the highest impact on effective instructional practices and, ultimately, on student outcomes. Our analysis
revealed that the presence and active participation of multiple leaders who are interacting with one another is
important. Although leadership styles varied, it was evident from interviews that effective leaders maintained
and communicated a clear vision and organized improvement efforts around what is best for students within
the various populations.
Campus principals were found to be especially influential in the functioning of the overall system. Much of
this influence appears to be through the articulation and implementation of a successful campus culture,
manifested through the leaders’ vision and values. While the type of campus cultures varied, having a clear
and consistent vision for the direction of the campus and implementing a student-centered set of values that
drive decision-making appear to be instrumental to success. Strong, principal-led vision and values seem to
influence daily practices in multiple dimensions at these campuses and, by extension, student outcomes as
well.
9
Analysis of transcripts indicated that effective implementation is cultivated by the knowledge and skills of the
local campus coach. The local campus coach is instrumental in supporting implementation, yet also plays a key
leadership role when acting as a liaison between state, district, and campus stakeholder groups and ensuring
that expectations at the various levels are implemented. While our findings suggest the need for strong
campus leaders, the local campus coach seems equally important in maintaining a focus on the common vision
and communicating a clear sense of campus-wide expectations.
Some campuses identified district leadership as an important factor. Participants mentioned aligning district
and campus structures and practices, and securing funding for material and personnel resources as most
important. The analysis also suggests that the communication and support structure within small, rural
districts appears more closely connected and/or aligned.
Our analysis suggests that leadership appears to be one of the main determinants to success at the studied
sites. When reflecting on leadership from a systems perspective, it is becoming more and more apparent that
the success of the larger system can be shown by the extent to which parts of the system are guided by a
strong leader.
Figure 3
Overall System
Recall that both participant feedback from interviews and the project team’s observations were used to
analyze these data. Figure 3 combines these findings into our overall results, with the various dimensions from
the Conceptual Framework in Figure 1 (Teaching and Learning, Leadership, Processes, and System) working
together in an overall system. This system graphic illustrates the relative importance of the dimensions that
were found to be influential.
Within the dimension of Teaching and Learning, instruction and support were both found to be important.
Within the dimension of Leadership, campus leadership (principal and coach), district leadership, and vision
and values were found to be important. Within the dimension of Processes, implementation, communication,
and collaboration were found to be important.
10
The important factors within each of the 3 dimensions have been reorganized in Figure 3 to represent how
they functioned at the 16 schools. Some of the factors have been used in this context differently to reflect
how there were used and discussed by participants. For example, implementation was originally under the
dimension of Processes but during the analysis it became apparent that participants spoke of implementation
as being very closely related to instruction. That is, implementation was thought of as a practice rather than a
process. Therefore, implementation will be discussed along with instruction as part of Teaching and Learning
(box on the right-hand side).
In addition, support was originally included as part of the Teaching and Learning dimension but will be
discussed here as part of Processes. This change was made to reflect what participants stated, namely that
ongoing support was a process that impacted instructional practices. Communication and collaboration are 2
additional processes that were influential and all 3 can be found in the small box in the center of Figure 3.
Finally, “vision and values” was originally included as part of the dimension of Leadership and it is still
represented as part of the principal’s influence (Principal and Literacy Coach circles). The principal does seem
to be the driving force behind communicating a clear vision and implementing student-centered values schoolwide. However, it was also discovered that the vision and values of the principal influenced every other aspect
of how the campus functioned as a system. Therefore, “vision and values” was added at the campus system
level (inside large square) as a determinant of how the various dimensions worked as a whole.
The alignment of various dimensions appears to be another determining factor to success. We looked at 3
main categories of dimensions (Teaching and Learning, Leadership, and Processes) and found that in most
cases multiple dimensions were found to be strengths at these campuses. In fact, 11 out of the 16 schools
were determined to be strong in some way in all 3 dimensions. While the site-specific strengths varied, it
appears that multiple dimensions working well simultaneously in a system may contribute to success. It seems
that the presence of these larger district- and state-level successful operating systems (outside large square)
plays a key role, influencing the way in which the individual dimensions operate.
Indeed, the presence or relative success of individual dimensions does not appear to be as important as
the whole picture, or how well the different dimensions work together. This is supported by Cummings and
Worley’s (2005) findings, which state that “a system’s overall effectiveness is partly determined by the extent
to which the different subsystems are aligned with each other” (p. 88). Successful schools appear to be doing
many things well at the same time. Further, the things that they are doing well seem to be related to each
other as part of an overall system.
In sum, campus leadership (principal and coach) appear to influence teaching and learning (implementation
and instruction) through effective processes (support, communication, and collaboration). These relationships
operate within an effective larger system, which includes campus level vision and values as well as district and
state support. Furthermore, effective practices at each of these levels appear to positively impact student
outcomes.
11
Recommendations
These recommendations are based on our analysis of the factors contributing to success at these sites, as
well as the barriers to success that the sites identified and their solutions for overcoming them. In other
words, the following recommendations represent what worked well and also what might be considered when
implementing future initiatives.
State Education Agency (SEA)
State-level support appears to be instrumental to Local Education Agency (LEA) success. Based on our
analysis, it is recommended that state-level practice include providing sufficient funding for implementation;
participants noted repeatedly the importance of adequate funding to support their local implementation
efforts. It is recommended that funding be sufficient to allow for the hiring of highly qualified, key support
personnel (coaches and interventionists) and that hiring these personnel be part of a clear structure of nonnegotiable expectations for implementation, communicated consistently.
Additionally, many of the sites noted that the long-term implementation period of the grant initiative (5-6
years) contributed to their success. They faced obstacles, which led to an implementation dip in the first few
years of the initiative. However, having sufficient time to address and overcome these obstacles and refine
practice proved key. Full implementation that was differentiated to local needs took time but did occur later in
the implementation process, impacting teacher practice and student outcomes. Therefore, it is recommended
that future initiatives similarly allow ample time for full implementation to occur.
In addition, Texas Reading First’s structure of providing support through technical assistance (TA) to LEAs
proved quite successful and this structure is recommended for future practice. This structure included having
highly qualified content and instructional experts provide support at the state, regional, and campus level and
regularly assist with implementation. In particular, the state-level regional TA provider and the local campus
coach had an important impact on success and it is recommended that these positions be included in future
initiatives. Clear and consistent communication and frequent collaboration with these support personnel also
contributed to success and is recommended for future initiatives.
To summarize, recommendations to State Education Agencies for future initiatives include the following:
• Provide adequate funding;
• Allow ample time for implementation to occur;
• Set clear and consistent expectations in the form of non-negotiables; and
• Provide highly qualified local support personnel and technical assistance that is targeted to meet local
needs.
Local Education Agency (LEA)
While state-level support is critical, it is the LEA that appears to be the driving force behind success at these
sites. Thus, the bulk of recommendations are for strong local implementation efforts. This section will be divided into district-level, campus-level, and classroom-level recommendations.
District level
It is recommended that district-level administration of the grant be in a manner consistent, not overlapping,
but in alignment with other initiatives or programs, with clear expectations communicated regularly.
The district should support the initiative by setting up clear structures and expectations, monitoring the
implementation of those expectations, and providing support as needed. One important way to provide
such support is through the funding of key, campus-level personnel. It is important that the district create
a structure of support for campus leaders (principals and coaches), which includes removing barriers to
implementation.
12
In addition, the extent to which district-level leadership took ownership in the implementation of the initiative
and made it a priority often determined the extent to which full implementation occurred. Therefore,
consistent district engagement in the implementation process, from state to campus level, is recommended.
To summarize, recommendations to LEAs for future initiatives include the following:
• Provide adequate funding for personnel and resources;
• Communicate clear expectations;
• Align and collaborating with other initiatives; and
• Make implementation a priority.
Providing support for campus expectations is also highly recommended, including monitoring implementation.
Campus level
Effective campus leadership appears to be one of the strongest determinants of success. This section will
provide attributes of and recommendations for effective principals and coaches.
One recommendation is the presence of a strongly engaged campus principal. Based on the analysis of
transcripts, participants at many of the schools identified the following attributes of a strong leader:
• The principal demonstrated support by being actively engaged as a participant in learning and as an
ongoing motivator.
• The principal maintained and communicated a clear vision, established short and long term goals,
conveyed expectations, and monitored and supported implementation.
• The principal set aside time for common planning with the expectation that teachers communicate and
collaborate with one another, with colleagues in other grade levels, or with the local campus coach.
• The principal appropriately used funds to hire qualified key personnel (i.e. instructional coach or
interventionist) or acquired material resources when needed.
This suggests to us that future initiatives should clearly establish the role for the campus principal, noting
the importance of being highly visible, knowledgeable, participatory, and supportive throughout the various
implementation phases. As described by one campus leader, “….ownership is big. And when you’re trying to
get a staff on board who’s fairly reluctant, it’s not easy to do so. We had to really walk hand in hand”.
In addition to the campus principal, the individual assuming the role of the instructional coach appears to be
another strong indicator of success. As mentioned by many participants in our study, the instructional coach
provided differentiated support. This included modeling in classrooms and demonstrating best practices. The
instructional coach led professional development sessions that were relevant to the teachers, prioritized based
on need, and presented information systematically and in a manageable way. The information or strategies
presented were closely monitored and teachers were engaged in reflective feedback sessions to discuss their
delivery and how students responded. In addition, the coach played an instrumental role in communicating
and maintaining a focus on the vision.
This suggests to us that the selection of an instructional coach is extremely important. We suggest instructional
coaches be part of future initiatives, yet we suggest that careful consideration be placed on how they are
selected. We learned from this study that they must be individuals that are highly competent in their assigned
content area, have the ability to build trusting and supportive relationships, understand what their coaching
role is, and can collaborate and communicate with individuals at varying levels (district and campus).
13
It is important that the campus principal and instructional coach work closely to ensure that the needs of the
teachers are met and that the vision remains a focus in the decision-making process. The principal and coach
remain in constant communication with one another, collaborating with the teachers to ensure that they feel
supported. The principal appears to play a key role in setting appropriate and consistent vision and values,
while the coach plays a key role in communicating and supporting them. The vision and values appear to
influence all aspects of campus practice by creating a campus culture, so it is recommended that the principal
be reflective about his/her expectations (short and long term). While individual campuses may have different
needs, it is recommended that the vision and values be as student-centered as possible. The most successful
sites had a collective sense of responsibility for student needs and had a “whatever it takes” attitude. This
emphasis on student needs guided decision-making and expectations at every level.
Classroom level
Overall results indicate that instructional practices and implementation are separate dimensions but are
equally important. Implementation reflects the structured expectations (3-Tier Reading Model, scheduling,
etc.) and instruction is the daily practice of teaching. It is recommended that these dimensions be addressed
and supported individually but continually inform each other. Recommendations for classroom-level practice
will include both Tier I instruction and also intervention instruction, although it is worth noting that many of
the participants emphasized the importance of high quality Tier I instruction as key to their success.
What was consistent across the successful sites in this study is that teachers felt supported in their profession.
It is recommended that this environment of perceived and actual support be fostered by establishing systems
that allow for regular communication and collaboration. Participants noted time and again the importance
of the coach in this role, providing ongoing classroom support and PD that was prioritized, manageable, and
relevant. Teachers felt that their needs were met primarily through the coach. As stated in the previous section
on leadership, the coaching role seems critical to success and it is recommended that it be utilized in future
initiatives.
In addition, the principle of buy-in for implementation was heard throughout the interviews, with participants
noting that teacher ownership in the initiative was an initial barrier in the adoption process but eventually
became the key to their success. The key to overcoming this barrier appears to be teachers feeling supported
and “heard.” Therefore, it is recommended that during the initial phase of adoption and throughout
implementation a forum for teacher input be established and a support system put into place based on their
feedback.
Consistency at the classroom level also appears to be important and is highly recommended. Vertical and
horizontal alignment in practice, materials, and vocabulary was achieved through regular collaboration and
communication between and among grade level teachers. In addition, differentiated instruction appeared to
be key. The most successful sites had a deep understanding of how to monitor student progress and tailor
their instruction accordingly, including strategic grouping practices and providing small group instruction.
In addition, our analysis suggests that participants perceive high quality Tier I instruction as critical to their
success. Our recommendation for future initiatives is to ensure structured collaboration time is made available
to carefully plan the alignment of intervention instruction with Tier I instruction.
Overall Recommendations
Recommendations for future initiatives include the recommendations listed above, along with establishing a
clear, long-term plan in place at inception, communicating this plan clearly, and monitoring and supporting the
implementation of this plan throughout.
14
One of the barriers noted repeatedly by participants was a feeling of being overwhelmed at the beginning of
implementation. These successful sites overcame that barrier by prioritizing their implementation and focusing
on a few key things at a time. Their ability to slow down the implementation and customize what they chose to
focus on first in order to meet their local needs contributed greatly to their success. Thus, it is recommended
that LEAs be allowed and indeed encouraged to differentiate in this way for future initiatives, prioritizing their
implementation sequence and pace.
In addition, the support structures in place for Texas Reading First appeared to have made a big difference and
future initiatives can learn from that success. In particular, the local support personnel (coach, RTA) were able
to provide targeted, grade level or in-classroom PD that met the needs of each campus and teacher. Support
through professional development was noted by participants as a factor that contributed to their success.
However, it is worth noting that they referred to non-traditional types of PD as the most beneficial. Local,
targeted, campus-based, and classroom-based ongoing professional learning made the difference at these
schools and that structure is recommended for future initiatives.
Finally, the most successful sites in this study had in common an additional, unexpected dimension. They
were all very reflective about their decision-making and put a lot of thought into how they implemented the
initiative based on their local needs. They also formatively evaluated their progress along the way, by analyzing
data and talking among stakeholders, and either celebrated their successes or modified appropriately. This
reflection appears to have helped them stay the course for implementation and also stay true to their own
vision and values. One noted “when we began to see some of the data it became very evident to all of us, and
it gives me chills just thinking about that, that what we were doing was truly benefitting children and it would
benefit them for a lifetime.” In fact, the experience of participating in this study appears to have been a type of
professional development in itself, with schools becoming more aware of what they were doing and why. Such
reflection appears to be both motivating and a useful tool for course-correction if necessary. Therefore, putting
a structure into place for strategic reflection, at all levels, is recommended for future initiatives.
Although these recommendations have been reported by state, district, and campus level, we want to
emphasize how important it is for all parts of the system to be working together through communication and
collaboration. The extent to which the larger system functioned cohesively caused participants to feel more
informed, valued, and supported, which increased the amount and quality of implementation.
Conclusion
The significance of this study reaches beyond the research realm and represents a move forward in the study
of school improvement. Understandably in a system that needs support, the traditional research model in
education has been to look for problems and then problem-solve for solutions. This study took the perspective
of looking for successes, cataloging them in detail, and sharing them with others to be replicated in other
contexts. In many ways, this study allowed us at the state level to self-reflect and our hope is that what we
learned from our successes can positively impact future practice.
15
References
Cummings, T. & Worley, C. (2005). Diagnosing organizations. In Organization development and change (8th edition, pp. 83-99). Mason, OH: South-Western.
Darling-Hammond, L. (1996). The right to learn and the advancement of teaching: Research, policy, and
democratic education. Educational Researcher, 25(6), 5-17.
Fullan, M. (2001) Leading in a culture of change. San Francisco: Jossey-Bass.
Fullan, M. (2008). The six secrets of change. San Francisco: Jossey-Bass.
Marshall, C., & Rossman, G. B. (2006). Designing qualitative research. Thousand Oaks, CA: Sage Publications,
Inc.
Merriam, S. (1998). Qualitative research and case study applications in education. San Francisco: Jossey-Bass.
Newmann, King, B., & Youngs, P. (2000). Professional development that addresses school capacity. Paper
presented at the annual meeting of the American Education Research Association, New Orleans.
Patton, M. Q. (2002). Qualitative research and evaluation methods (3rd ed.). Thousand Oaks: Sage.
Schon, D. (1987). Educating the reflective practitioner: Toward a new design for teaching and learning in the
professions. San Francisco: Jossey-Bass.
Stake, R. (2006). Multiple case study analysis. New York: The Guilford Press.
16
About the Authors
Dr. Daryl Michel is an Assistant Director at The University of Texas at Austin’s Institute for Public
Initiatives (IPSI). Daryl came to IPSI in 2005 and served as a Project Manager for the Texas Reading First
Initiative. He has national experience in providing support to educators and school and district leaders
in areas such as instructional leadership and effective teaching practices. Currently, he co-­‐leads the
Texas Literacy Initiative, leading multiple teams in developing facilitated course modules, providing
face-­‐to-­‐face and online professional development and technical assistance, and supporting Texas
schools and districts in literacy education and using data to guide instruction. Dr. Michel received his
Ph.D. from Texas State University with an emphasis in Education: School Improvement. His research
interests include learning communities, leading effective meetings, and teacher and administrator
development.
Institute for Public School Initiatives
5316 Highway 290 West, Suite 510
Austin, Texas, 78735-8931
ipsi.utexas.edu
IPSI brings decades of experience supporting schools and districts, developing leaders and teachers, building
technological solutions and tools, and building strategic partnerships with agencies, foundations, business
leaders, and associations.
17
Download