NCATE 2.b1 What are the processes and timelines used by the unit to collect, compile, aggregate, summarize, and analyze data on candidate performance, unit operations, and program quality? Overview There is a systematic ongoing process for collecting and reviewing data. The processes and timeline used by the unit to collect, summarize and analyze data are displayed in the assessment timeline table. The unit collects multiple assessments from candidates, graduates, faculty and practitioners. These data are used to make decisions regarding the candidate’s progression through the program, the quality of the program and the unit operations. An assessment system has been established with assessment tools, responsible persons, frequency, and review process. Data are collected according to a timeline defined by the unit faculty, supervising teachers and administrators, and stored in a centralized database system operated primarily by the unit chair, director of field experience, office manager and the institutional researcher. Data are analyzed at three levels: teacher candidate performance; K-12 student outcomes; and course and program performance. All major program changes are recorded in the History of Change document. Use of surveys to collect data: Various surveys are collected internally and externally to determine the performance of the candidates, faculty and unit program: Freshman candidates participate in a Motivation survey during the third week of class via Survey Monkey. The Retention Committee is responsible for analyzing, interpreting and sharing the data to develop interventions to assist with persistence. Teacher candidates participate in Professional Development surveys after each Education Seminar. The surveys are administered, scored and shared with the unit program director to determine the effectiveness of the speaker and the topic presented, and ideas for future topics. Teacher candidates evaluate each instructor at the end of each course via the Student Instructor Rating Instrument to determine the effectiveness of instruction. Course evaluations are scored, monitored and stored electronically by the Office of Academic Support who provides the results to the unit faculty and unit director. Faculty members are able to reflect and make necessary adjustments based on feedback. Effective academic year 2012 instructor course evaluations will be collected and processed through the college database system, EMPOWER 8 Pro. Cooperating teachers complete a program evaluation survey at the end of the student teaching experience. Cooperating teachers provide overall feedback on the preparedness of the teacher candidates and the overall professionalism of the unit. The surveys are collected and scored by the Director of Field Experience. Data are aggregated and stored by the unit office manager using Microsoft Excel and Access. The Director of Field Experience discusses feedback with student teaching supervisors and makes appropriate recommendations for improvement. Three graduate surveys are administered on an annual basis. The institution administers a Graduate Exit survey to graduating seniors to determine overall satisfaction with the college. The Retention Committee administers an alumni survey to candidates who have been out of school for at least two years via Survey Monkey to determine success of graduates, employment and perception of preparation. The unit also administers an alumni survey, specifically to the unit graduates, to determine success in the K-12 classroom, preparedness and overall perception of preparation. All three surveys assist the unit in making improvements. Use of interviews to collect data: Interviews are used to assess candidates’ ability to perform in the unit program and student teaching. Prospective MAT candidates are interviewed by three external evaluators via a designed rubric. Prospective candidates are assessed on their knowledge, use of technology, overall disposition and commitment to teaching. Interviews are scored by external evaluators, approved by the unit director and stored in the EMPOWER 8 Pro database system. Interviews for student teaching are conducted at the beginning of the semester prior to student teaching by members of the Education Committee. The Student Teaching Interview Assessment Rubric is aligned to professional teaching standards. The Director of Field Experience is responsible for the collection and monitoring of the evaluations. The office manager stores information in both the EMPOWER 8 Pro and Microsoft Access database system. To eliminate bias, all interviews are conducted by a team of internal and or external evaluators using a specifically designed rubric. The team collaborates on scoring and submits only one evaluation per candidate. Faculty data: Unit faculty members are evaluated annually. Faculty members are provided feedback through Student Instructor Rating Instrument and by participating in a Faculty Annual Evaluation review process in which the faculty member details his/her performance in three areas: teaching, scholarship and service. The unit program director is responsible for making recommendations. The final recommendation comes from the Vice President of Academic Affairs and President and is stored in the office of Academic Affairs. Candidate key assessment data: Candidates’ key assessments are scored via rubrics aligned to state and national professional teacher standards. Candidates are assessed by faculty, external evaluators, clinical faculty and cooperating teachers. The following assessments are implemented at various transition points to assess the candidates’ knowledge, disposition and performance. Candidates’ scores are managed through Blackboard, Microsoft Access and/or EMPOWER database system by the unit office manager: Portfolio artifacts are evaluated by unit faculty Course assignments, projects and student work samples aligned to rubrics are collected, graded and stored by unit faculty. Candidates’ clinical experiences are evaluated by both the unit and clinical site faculty using a rubric aligned to state and national teacher standards. Student teachers are evaluated on content knowledge, the ability to teach effectively, and the use of technology to improve student learning. Student teachers are evaluated separately by the cooperating teaching via a Student Teaching Assessment Inventory and the unit supervisor via Student Teaching Assessment Book, lesson plan rubric and guidelines for journal, video/reflections and case studies. Data are collected via Blackboard and stored via Microsoft Access. Candidate disposition and ability to communicate are formally assessed at three benchmarks by unit faculty and via self-evaluations. Candidates receiving a disposition deficiency are counseled accordingly. Database systems: An EMPOWER database is managed by the unit office manager and the institutional researcher. EMPOWER stores and secures the following data: Acceptance Praxis I and II Courses Grades Instructors Microsoft Access and Excel databases are managed by the unit office manager and store the following data: Praxis I and II scores Portfolio artifacts Disposition scores Communication scores Grade point averages Student teaching evaluations Survey Monkey databases are managed by Academic Support and the unit director, and store the following data: Motivation Survey Alumni Survey Cooperating Teacher Survey Student Teacher Survey Administrator (Principal) Survey Graduate Survey