Graduate Program Data Analysis Report Program Name: Ed Leadership - District Date: May 19, 2015 Contact Person: Dr. Andrew Pushchak Directions: 1. Review the program assessment data located in D2L. 2. List the 6 to 8 assessments for each program in the box provided for Program Assessments. Examine the data collection for each program. Be sure to review both the fall and spring data collection. Answer the following questions for each program assessment placing the information in the appropriate column: o What does the data indicate for your program? o What areas of concern if any do you have regarding this assessment? o What recommendations do have regarding any revisions for this assessment? o What program changes if any does this data suggest? 3. Save the template as a Word document and submit it to the NCATE Assessment Committee via a D2L dropbox provided in the Accreditation-NCATE link by April 9th. Graduate Unit Data Program Assessment School Superintendent Assessment (SSA) PRAXIS 6021 Data Analysis 09/01/13 to 08/31/14 PRAXIS 6021 scores reflect 87.5% first time passage rate (n= 10; 1 out of 10 interns did not pass the first time) which is below the state first time pass rate of 96.33%. Program faculty further analyzed results of the individual test categories. The performance on the Integrated Knowledge and Understanding (case study) section was below the state and national averages: Institution (64%); State (66%); and National (65%). For all other sections, the institution scored above the state and/or national averages. Recommendations The one student who did not pass was remediated by the program advisor and the student achieved the cut-off score taking the test the second time. Program faculty reviewed the sample case study prompts provided by ETS and accompanying test taking information. Action Item Implemented – program faculty have highlighted the following information regarding case study questions for students prior to taking the PRAXIS: 1. Answer the question accurately 2. Answer the questions completely 3. Answer the question that is asked 4. Give a thorough and detailed response 5. Reread your response Personal Leadership Vision Essay Course Grades Contract Reviews Internship Final Assessment Program faculty observed a strong majority of all candidates scoring within the Target Expectations and Meets Expectations performance levels for all rubric scoring areas. Program faculty observed students continue to perform at a high level with regard to course grades assigned to each of the courses within the program. Program faculty observed that although most students understood contracts as per Standard 2F knowledge of regulations and policies, they needed to continue to evaluate this area Program faculty continue to observe the high scores for all standards, with Standard 5 reflecting acting with integrity, fairness, and in an ethical manner receiving the highest scores. (from: SLS Study Companion, page 16) Action Item Implemented – Program Faculty requires that students continue to go back and review Leadership Essay and revise as they continue to grow within their program classes. Note: Rubric for course assessment will reflect new ELCC standards. Results from Fall 2014 and Spring 2015 will be analyzed for purposes of the new ELCC report which will be submitted Fall 2016. Action Item Implemented – Course grades continue to be analyzed to ensure the alignment between what is taught related to each ELCC standard element. Note: Grades from Summer 2015, Fall 2015 and Spring 2016 will be analyzed for purposes of the new ELCC report which will be submitted Fall 2016. Action Item Implemented – Program faculty required that students have additional assignments in contract interpretation and implementation. Note: Rubric for course assessment will reflect new ELCC standards. Results from Spring 2015 and Spring 2016 will be analyzed for purposes of the new ELCC report which will be submitted Fall 2016. Action Item Implemented – Faculty members supervising interns updated the Internship Final Assessment to reflect the new ELCC standards. Note: The Internship Final Assessment will reflect new ELCC standards. The form will also change to a five point Likert Scale. Results Focus Project on Student Achievement Facilities Project District-based Comprehensive Plan from Summer 2015 and Fall 2015 will be analyzed for purposes of the new ELCC report which will be submitted Fall 2016. Program faculty observed Action Item Implemented – Program 100% of the interns scored faculty did provide opportunities for target or meets expectations on interns to analyze data in greater all areas within the rubric. depth and to have an increased There were no interns that impact on student achievement. received a score ‘does not meet Program faculty’s effort in this regard expectations’ for any standards is once again reflected in all students for this assessment. scoring at the target level. Program faculty observed that most students understood budget development but needed to strengthen their understanding of facilities and budget support. Program faculty observed that a majority of students reached the target level but needed to strengthen their implementation and writing of policies based upon Standard 2G providing consistent and effective management of policies Note: Rubric for course assessment will reflect new ELCC standards. Results from Summer 2015 and Fall 2015 will be analyzed for purposes of the new ELCC report which will be submitted Fall 2016. Action Item Implemented – Program faculty developed supportive activities to review facilities plans and how to develop long range budget needs. Note: Rubric for course assessment will reflect new ELCC standards. Results from Summer 2014 and Summer 2015 will be analyzed for purposes of the new ELCC report which will be submitted Fall 2016. Action Item Implemented – Program faculty developed additional activities to assist students in the development and writing of policies and how to implement policies appropriately. Note: Rubric for course assessment will reflect new ELCC standards. Results from Summer 2014 and Summer 2015 will be analyzed for purposes of the new ELCC report which will be submitted Fall 2016.