Lessons Learned on Val Ed Performance Evaluation Advisory Council Dr. Erika Hunt Center for the Study of Education Policy My Background • Director of Illinois State Action for Education Leadership Initiative (IL-SAELP) – http://www.centereducationpolicy.ilstu.edu • Funded by The Wallace Foundation since 2001 Background of Val Ed • Developed by a 3-year grant from The Wallace Foundation ($1.5 million) • Validation grant by Institute of Education Sciences ($1.5 million) • Primary resources/attention by IL-SAELP to Val Ed = Development of Principal Evaluation IAI Use of Val Ed for Principal Prep Study • To compare skills/behaviors of new principals coming out of old Type 75 programs to new principals coming out of new Principal Endorsement programs • Goal -- To recruit a sample of 100 – New principals who completed a Type 75 program within last five years – Out of 193 potential participants, were able to recruit 21 • 21 participants – 2 backed out • 6 participants could not meet teacher feedback threshold of 50% Why Val Ed? • Measures principals’ effectiveness using 360º feedback from teachers, supervisors, and principal • Is the only 360º principal evaluation tool aligned with new 2008 ISLLC standards • Field tested in a nationally representative sample • Best measurement of leadership attributes and behaviors associated with student achievement results • Rated highest in terms of validity and reliability What Is Val Ed? Val Ed Conceptual Model Val Ed Framework Sample VAL-ED Form VAL-ED Performance Level Descriptors Below Basic Basic Proficient Distinguished Leadership behaviors of core components and key processes of insufficient quality that over time are unlikely to bring the school to produce acceptable value added to student achievement and social learning. Leadership behaviors of core components and key processes of a quality that over time are likely to bring the school to produce acceptable value-added to student achievement and social learning for some sub groups of students but not all. Leadership behaviors of core components and key processes of sufficient quality that over time are likely to bring the school to produce acceptable value-added to student achievement and social learning for all students. Leadership behaviors of core components and key processes at levels of excellence that over time are virtually certain to bring the school to a point that produces strong value-added to student achievement and social learning for all students. Feedback for Professional Growth Val Ed Process • District or school commits – Provide number of teachers and name of supervisor – Provide name of person in building to distribute survey codes (e.g., union building rep) • Discovery Education generates codes – Codes include access codes for principal and supervisor • Survey is distributed and completed by teachers, principal and supervisor – Teacher Institute Day/Not as Thorough – Time on Own/Partially Completed or Low Response Best Uses of Val Ed • “The VAL-ED is best used as part of a comprehensive assessment of the effectiveness of a leader's behaviors” – Joe Murphy and Ellen Goldring • VAL-ED can be used annually or more frequently to: – Facilitate a data-based performance evaluation – Measure performance growth – Guide professional development • VAL-ED is best tied to a plan for continuous improvement Val Ed = Continuous Improvement 1) Principal evaluation Illinois Administrator Academy 2) Principal support/coaching • SAMs initiative and Time Change Coaching • New Principal Mentoring (esp. two-year programs) 3) Aligned with other data tools • LPPW tool • School Conditions surveys (www.TellIllinois.org) 4) Aligned district framework • Charlotte Danielson Framework 5) Plan for district-wide prof. dev./communities of practice Lessons Learned • Takes a district/school commitment and understanding – Appoint district coordinator • Educate teachers and principals about Val Ed • Assure completion thresholds are met • Coordinate into plan for professional growth – Need teacher buy-in to make meaningful – Need to carefully time distribution of survey • Utilize mechanisms to monitor response rate • Tie Val Ed assessment into a continuous improvement process Val Ed Resources Val Ed Site - http://peabody.vanderbilt.edu/x8451.xml • User Manual • Conceptual Framework and Research Basis Discovery Education http://www.discoveryeducation.com/products/assessm ent/val_ed.cfm