2015 Preliminary Findings

advertisement
2015 TELL MNPS Survey
Research Brief
Preliminary Findings
(Spring, 2015)
To do their best work with students, teachers need supportive school environments that
maximize their opportunity to be effective. In a continuing effort to assess school teaching and
learning conditions, Metropolitan Nashville Public Schools (MNPS) partnered with the New
Teacher Center (NTC) in their annual administration of the MNPS Teaching, Empowering,
Leading, and Learning Survey (TELL MNPS) Survey.
About the Survey
The TELL MNPS Survey is a statistically valid and reliable instrument that assesses eight
research-based teaching and learning conditions standards.1 The following eight teaching and
learning condition constructs are empirically linked to student achievement and teacher
retention: Time, Facilities and Resources, Community Support and Involvement, Managing
Student Conduct, Teacher Leadership, School Leadership, Professional Development, and
Instructional Practices and Support.2 See Table 1 for descriptions of each construct. Response
options for the survey’s core, positively oriented questions use a Likert scale and range from
strongly disagree to strongly agree. This brief summarizes results using a rate of agreement that
combines the strongly agree and agree categories.
Table 1:
2015 TELL MNPS Survey Areas
Time: Available time to plan, collaborate, provide instruction, and eliminate barriers to
maximize instructional time during the school day
Facilities and Resources: Availability of instructional, technology, office, communication, and
school resources to teachers
Community Support and Involvement: Community and parent/guardian communication and
influence in the school
Managing Student Conduct: Policies and practices to address student conduct issues and
ensure a safe school environment
Teacher Leadership: Teacher involvement in decisions that impact classroom and school
practices
1
Swanlund, A. (2012). Identifying working conditions that enhance teacher effectiveness: The psychometric
evaluation of the Teacher Working Conditions Survey. Chicago, IL: American Institutes for Research.
2
See endnotes for research.
2|Page
School Leadership: The ability of school leadership to create trusting, supportive environments
and address teacher concerns
Professional Development: Availability and quality of learning opportunities for educators to
enhance their teaching
Instructional Practices and Support: Data and support available to teachers to improve
instruction and student learning
Response Rate
The NTC administered the anonymous, full-population survey to all school-based licensed
educators in February 2015. Over 5,000 educators (81 percent) in the district responded (Table
2). This is a similar response rate from the 79 percent responding the previous year. As Table 2
demonstrates, 88 percent of elementary school educators participated in the survey, 74 percent of
middle school educators responded, and 74 percent of high school educators responded.
Additionally, all educators assigned to schools such as alternative education settings (designated
as “Special” in Table 2) responded.
Table 2:
2015 Survey Response Rate by School Type
Percent
School Type
Headcount Responded
Responded
Elementary
3,250
2,870
88.3
Middle
1,577
1,161
73.6
High
1,567
1,157
73.8
Special
5
5
100.0
Total
6,399
5,193
81.2
Approximately 96 percent of surveyed schools (152 of 158) met or exceeded the 50 percent
response rate threshold required to receive an individual school-level data report. All results may
be viewed online at www.tellmnps.org.
Preliminary Findings
The rates of agreement by item and survey area were reviewed, and results were compared
between 2015 and 2014. Preliminary findings identify items across constructs with relatively
high or low levels of agreement. Items and rates of agreement are reported below within select
survey areas.
3|Page
Overall, MNPS educators’ are slightly more positive about their teaching and learning
conditions. In an overall composite measure of teaching conditions, the district average
agreement rate in 2015 increased 1.4 percentage points from the previous year to 82.7 percent.
At the construct composite level, more educators agree in 2015 that they have the conditions
necessary to produce their best work in every area assessed by the TELL survey than they did in
2014 (See Table 3).

The School Leadership construct, on average, exhibited the greatest growth of all
constructs from 2014 to 85 percent agreement.

Instructional Practices and Support is the most positively viewed construct in MNPS at
87 percent agreement.

Despite a one percentage point gain from 2014, Time remains the least positively viewed
constuct area measured by the TELL survey at 72 percent agreement.
Table 3:
Construct Average Agreement
Agreement
Construct Composite Area
2015
2014
School Leadership
84.8
82.5
Teacher Leadership
82.6
80.7
Community Support & Involvement
84.3
82.5
Facilities & Resources
86.3
84.6
Time
72.4
71.1
Professional Development
81.9
80.7
Managing Student Conduct
83.0
82.2
Instructional Practices & Support
86.7
86.3
Difference
2.3
2.0
1.8
1.7
1.3
1.2
0.7
0.4
Note: The displayed calculated difference may vary by .1 due to rounding.
School Leadership conditions are improving. More MNPS educators agree in 2015 that
teaching conditions critical to internal trust and decision making are in place at their schools than
one year ago (See Table 4).

More than four out of five respondents (85 percent) report that the school improvement
team provides effective leadership at their school compared to 82 percent in 2014.

Seven out of 10 participants (70 percent) now agree that teachers have an appropriate
level of influence on decision making in their schools, a three percentage point gain from
2014.
4|Page

Three quarters of educators agree that teachers feel comfortable raising issues and
concerns that are important to them, up from 72 percent one year ago.

More than three quarters of educators (77 percent) report that there is an atmosphere of
trust and mutual respect, an increase of 3 percentage points from 2014 (74 percent).
Table 4:
Conditions Related to Internal Trust and Decision Making
2015
2014
Select School Leadership Questions
Difference
Agreement Agreement
The school improvement team provides effective leadership at
this school.
Teachers have an appropriate level of influence on decision
making in this school.
Teachers feel comfortable raising issues and concerns that are
important to them.
There is an atmosphere of trust and mutual respect.
85.2
81.6
3.6
70.4
67.1
3.3
74.8
71.6
3.2
77.4
74.7
2.7
Note: The displayed calculated difference may vary by .1 due to rounding.
Educators were also asked a series of questions regarding whether their school leadership makes
a sustained effort to address teacher concerns about each of the construct areas assessed on the
survey. Each of these areas also showed improvement (See Table 5).

Eighty-three percent of educators agree that their school leadership makes a sustained
effort to address teacher concerns in the area of new teacher support compared to 78
percent one year ago. This represents the largest percentage point gain in the area of
school leadership effort (5 percentage points).

At least four out of five respondents (80 percent) agree that sustained efforts to address
teacher concerns are occurring in every area measured.

Educators are most in agreement about the sustained efforts made in the area of
community support and involvement (90 percent).
Table 5
School Leadership Makes a Sustained Effort to Address Teacher Concerns
2015
2014
Area of Sustained Effort
Difference
Agreement Agreement
New teacher support
82.6
78.2
4.5
Leadership issues
81.8
78.2
3.6
5|Page
Facilities and resources
Teacher leadership
Community support and involvement
The use of time in my school
Managing student conduct
Professional development
Instructional practices and support
89.3
86.5
89.5
79.9
82.3
86.2
88.8
86.5
83.9
87.0
77.5
79.9
84.5
87.8
2.8
2.6
2.5
2.4
2.4
1.7
1.1
Note: The displayed calculated difference may vary by .1 due to rounding.
Time Remains Challenging For Many Educators Across the District
Despite small gains across the district on conditions related to the amount of time educators have
to do their best work, the area of Time remains the least positively viewed construct area
assessed on the survey.

Fewer than seven out of 10 participants (68 percent) agree that the non-instructional time
provided for teachers in their school is sufficient.

About the same proportion (68 percent) agrees that teachers have sufficient instructional
time to meet the needs of all students.

Seven out of 10 educators (70 percent) report that class sizes are reasonable such that
teachers have time available to meet the needs of all students.
Table 6
Survey Questions About Time
2015
Survey Question
Agreement
Efforts are made to minimize the amount of routine
71.6
administrative paperwork teachers are required to do.
The non-instructional time provided for teachers in my
67.7
school is sufficient.
Class sizes are reasonable such that teachers have the
70.3
time available to meet the needs of all students.
Teachers are allowed to focus on educating students with
72.5
minimal interruptions.
Teachers are protected from duties that interfere with
77.2
their essential role of educating students.
Teachers have time available to collaborate with
79.4
6|Page
2014
Difference
Agreement
68.9
2.7
65.8
1.9
68.5
1.8
71.1
1.4
76.2
1.0
78.6
.8
colleagues.
Teachers have sufficient instructional time to meet the
needs of all students.
68.2
68.5
-.3
Note: The displayed calculated difference may vary by .1 due to rounding.
Nearly all educators report use of assessments, and alignment of their curriculum with
Common Core, but many do not have timely access to assessment data. More than nine out
of 10 educators agree that teachers use assessment data to inform their instruction (95 percent)
and that the curriculum taught in their school is aligned with Common Core Standards (93
percent). While these agreement rates are some of the most positively viewed on the survey, far
fewer agree that they are getting access to assessment results quickly enough to impact their
instructional practices (See Table 5).
•
Fewer than two thirds of respondents (62 percent) now agree that state assessment data
are available in time to impact instructional practices. This is a 6 percentage point decline
from the previous year (68 percent).
•
About four out of five respondents (82 percent) report that local assessment data are
available in time to impact instructional practices compared to 87 percent in 2014.
•
These are the greatest declines observed from 2014 to 2015 in MNPS.
Table 5:
Assess to Assessment Results in a Timely Manner
2015
2014
Select Data Assessment Questions
Difference
Agreement Agreement
State assessment data are available in time to impact
instructional practices.
Local assessment data are available in time to impact
instructional practices.
62.1
67.9
-5.7
82.2
87.2
-5.0
Note: The displayed calculated difference may vary by .1 due to rounding.
Summary
This administration of the TELL MNPS survey captured the voices of more than five thousand
metro Nashville educators, providing a unique and comprehensive perspective for guiding school
improvement planning. Preliminary analyses suggest that educators are slightly more positive
about their teaching and learning conditions than one year ago. In particular, school leadership
7|Page
and their efforts to address teacher concerns are more positively perceived. Small gains are
reported in the amount, and use, of time available to educators, leaving room for continued
improvement. While the use of assessment data to inform instruction is widely practiced and
improving, more timely access to that data will further support educators in effectively
differentiating their instruction.
Going forward, NTC will continue to partner with MNPS to help support disseminating survey
results and their importance as one of multiple measures in school improvement planning.
All resources and reporting will be available electronically at www.tellmnps.org.
8|Page
Endnotes
Borman, G., & Dowling, N. (2008). Teacher attrition and retention: A meta-analytic
and narrative review of the research. Review of Educational Research, 78(3), 367–409.
Buckley, J., Schneider, M., & Shang, Y. (2004). The effects of school facility quality on teacher
retention in urban school districts. Chestnut Hill, MA: National Clearinghouse for
Educational Facilities.
Johnson, S., Kraft, M., & Papay, J. (2012). How context matters in high-need schools: The
effects of teachers’ working conditions on their professional satisfaction and their
students’ achievement. Teachers College Record, 114(10), 1–39.
Kraft, M. A., & Papay, J. P. (2014). Can professional environments in schools promote teacher
development? Explaining heterogeneity in returns to teaching experience. Educational
Evaluation and Policy Analysis (36)4, 476–500.
Ladd, H. (2009). Teachers’ perceptions of their working conditions: How predictive of policy
relevant outcomes? CALDER Working Paper 33. Washington, D.C.: National Center for
Analysis of Longitudinal Data in Education.
Loeb, S., Darling-Hammond, L., & Luczak, J. (2005). How teaching conditions predict teacher
turnover in California schools. Peabody Journal of Education, 80(3), 44–70.
Pogodzinski, B., Youngs, P., Frank, K., & Belman, D. (2012). Administrative climate and
novices’ intent to remain teaching. The Elementary School Journal, 113(2), 252–275.
9|Page
Download