OCTEO Fall Conference Insights from Ohio’s edTPA Field Test (2011-12) October 25, 2012 Donna Hanby, PhD The Ohio edTPA Journey To Date 2011-2012 • 1652 Portfolios were submitted by Ohio’s Preservice Teachers for the 2012 Spring Field Test • Ohio had 183 Scorers involved in the Spring Field Test (university/school faculty) • 1800 Portfolios to be submitted 2012 fall term + 7000 during this academic year (all 51 IHEs) • Field Test Data being analyzed at state & national levels What was learned last year? • Survey Monkey utilization for gathering insights • Two Surveys: (1) faculty and (2) teacher candidates participating in the spring field test • URLs sent via the TPA Contacts for each of the 51 IHEs Collected Insights • Faculty Survey Monkey • Teacher Candidates • TPA Contacts ~ Annual Reports Faculty Feedback: 2011-12 Field Test (n-114) • • • # of Candidates Assisted University Faculty ~ n-46 (39% State & 59% Private) University Supervisor ~ n-30 (53% State & 47% Private) Cooperating Teachers ~ n-38 (79% State & 16% Private) 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% U. Faculty U. Supervisor C. Teacher 1 to 5 6 to 13 to 21+ 12 20 Teacher Candidate Survey (n-220) • 52% represented Private Institutions • 46% from State Institutions • did not respond 2% edTPA Supported Areas (Faculty/T. Candidate Surveys) EC Ele Lit Ele Math MC Eng. MC HSS MC Math MC Science Perf. Arts PE Sec. Eng. Sec. HSS Sec. Math Sec. Science SPED (Inc) SPED (Non) Visual Arts World Lang. U. Faculty U. Supervisor Coop. Teacher T. Candidate 28% 17% 13% 8% 30% 13% 18% 9% 24% 10% 24% 5% 24% 6% 5% 10% 20% 17% 11% 6% 22% 17% 0% 11% 26% 13% 5% 13% 6% 3% 5% 1% 9% 3% 13% 0.50% 26% 3% 11% 5% 26% 10% 7% 5% 22% 6% 2% 11% 17% 3% 5% 5% 9% 13% 7% 8% 2% 10% 7% 2% 4% 0% 0% 0% 4% 0% 0% 0.50% Positives Noted re: edTPA? • What aspects might the teacher candidates have noted as positives regarding the edTPA? • What do you predict faculty (Univ. faculty/supervisors/cooperating teachers) may have indicated as positives? Positive Insights Re: the edTPA (Faculty/T. Candidate Surveys) Faculty Teacher Noted Positives Candidates 32% 22% 6% 30% 22% 29% 7% 12% Self-Reflection of the Teacher Candidate Emphasis on Ind. Student Learning Candidate Evaluation/Professional Development Videotaping Beneficial Supports for edTPA Faculty • TPA Contacts • TPA Materials • Training • OnLine Resources Teacher Candidates • Faculty (Supvsr, CT & Seminar Leaders) • TPA Materials • Training/Seminars • Technical Support • Prior Experience Satisfaction Level with edTPA Handbook & Templates (Faculty/TC Surveys) • University Faculty = 70% • University Supervisors = 60% • Cooperating Teachers = 45% • Teacher Candidates = 74% ______ (Unclear Directions/Poor Structure were noted areas of dissatisfaction) Educational Process Perspective (Faculty/T. Candidates) Faculty Teacher Response Candidate 53% 51% Yes (promotes teacher preparation, self-reflection) 16% 28% No (time consuming, too many requirements) 31% 21% No Response Noted Challenges (T Candidates) • Videotaping 29% • Time Limitations 14% • Excessive Requirements 10% • Unclear/Vague Instructions 7% • Redundancy of Task 7% __________ No Response 33% Noted Challenges (Faculty) Univ. Faculty Univ. Supervisor Coop. Teacher Videotaping 15% 17% 13% Lack of Training 22% 27% 7% Missing/Vague Instructions 35% 13% 16% 2% 3% 2% Limited Candidate Preparation Suggested Modifications for the edTPA (Faculty Surveys) • Clearer Instructions/Examples of Completed Samples (7%) • Additional Training (7%) • More Time Needed to Complete (5%) Anything Else to Share? • edTPA is a Rigorous Assessment – “I was heavily involved with NBPTS for a long time as a NBCT, district support person, and a trainer for over 7 years. There are many aspects of the TPA process that mirrors what NBPTS candidates do as well.” • edTPA promotes Professional Development – “While it seems to students to be a monumental task, and one they do not necessarily want to do, it gives them the framework of processes for what they will need to continue to do at all stages of their career in order to fully develop as a professional teacher – students eventually will see how TPA promotes their own professionalism and it will become a professional “way of life” for them.” • More Training is Needed – “I would like to be able to go through the evaluation process so I can better understand how to help my candidates.” Strengths of the edTPA (conveyed by the Ohio TPA Coordinators) • “The TPA covers important needs of new teachers: it provides the needed emphasis on using data analysis to determine the extent of student learning, helps new teachers to reflect on their planning, implementation, flexibility to change plans during a lesson, communication and collaboration.” • “The TPA has caused us to add academic language to our curriculum along with more systematic, in-depth inclusion of theory and research.” • “It is a comprehensive and performance-based assessment. It is based on theory and requires candidates to really think critically and be intentional about their teaching practices.” • “The possibility of the standardization of licensure across states was cited as a potential benefit of a national TPA structure.” National Participation Update National edTPA Participation Development • 120+ • 200+ • 120 • 10 Subject specific team members Content Validation reviewers Benchmarkers and Trainers of Scorers Bias Review Members Validation 2012 • 26 • 160+ • 7200 • 500+ States Teacher Preparation Programs Portfolios of Teacher Candidates Scorers (IHE and K-12) edTPA Participation: Ohio Pilot Test 2011 • 32 Teacher Preparation Programs Validation 2012 • • • • • • 51 Teacher Preparation Programs 1652 Portfolios of teacher candidates (23% of total) 183 University/K-12 school scorers (37% of all scorers) 1800 Portfolios to be submitted 2012 fall term edTPA is included as a metric (Assurance measurement) Validation data being analyzed at state & national levels Now What? • Getting … Re: Data Results Candidate Results • During the Field Test, candidate results are only sent to their designated IHE. • Therefore, distribution would need to be facilitated through the IHE to the candidate, if desired. edTPA Online Resources • http://edTPA.AACTE.org (public site) • http://tpafieldtest.nesinc.com (Pearson fall 2012 OH field test site) • edTPA.com (Pearson 2013 operational site) • http://tpaconline.ning.com (SCALE online educator community) • http://ohiotpa.org (Ohio site) Questions/Comments? Donna.Hanby@Pearson.com