Graduate Education Department Assessment Report Spring 2015 UNH Graduate Education Department Assessment Report -­‐ Spring 2015 Table of Contents INTRODUCTION ................................................................................................................................... 3 PRAXIS II® TESTS ................................................................................................................................... 4 PRAXIS II® ELEMENTARY SUBTESTS .................................................................................................................. 4 PRAXIS II® TEST -­‐ SECONDARY ENGLISH ............................................................................................................ 6 CT FOUNDATIONS OF READING TEST ................................................................................................... 7 Index of Figures Figure 1 – Assessment Transition Points…………………………………………………………………………………………………..3 Index of Tables Table 1 -­‐ Praxis II Elementary Education Subtests, AY 2013 -­‐2014 .............................................................................. 5 ®
Table 2 -­‐ Praxis II Elementary Education: READING & LANGUAGE ARTS SUBTEST, SUBSCORE DATA, Code: 5032 ... 5 ®
Table 3 -­‐ Praxis II Elementary Education: MATHEMATICS SUBTEST, SUBSCORE DATA, Code: 5033 ......................... 5 ®
Table 4 -­‐ Praxis II Elementary Education: SOCIAL STUDIES SUBTEST, SUBSCORE DATA, Code: 5034 ........................ 6 ®
Table 5 -­‐ Praxis II Elementary Education: SCIENCE SUBTEST, SUBSCORE DATA, Code: 5035 .................................... 6 ®
Table 6 -­‐ Praxis II English, AY 2013 – 2014 .................................................................................................................. 6 ®
Table 7 – Praxis II English Language, Literature, and Composition: Content and Analysis, SUBSCORE DATA, AY 2013 -­‐ 2014 ............................................................................................................................................................................ 7 ®
Table 8 – Praxis II English Language, Literature, and Composition: Content and Analysis, SUBSCORE DATA, AY 2013 – 2014 ........................................................................................................................................................................... 7 Table 9 -­‐ CT Foundations of Reading, AY 2013-­‐2014 .................................................................................................... 8 Table 10 -­‐ CT Foundations of Reading, Sub-­‐Area Performance Data, AY 2013-­‐2014 ................................................... 8 ®
2 UNH Graduate Education Department Assessment Report -­‐ Spring 2015 Introduction This assessment report presents and describes selected data as part of the UNH Graduate Education Department’s assessment system. The assessment system employs multiple measures of assessment to monitor candidates’ progress at various key points of their educational progress. The assessment system is designed to address five transition points in the program as illustrated in Figure 1. The transition points represent the progression of candidates based on key assessments associated with each transition point. The purpose of the reports is to examine the quality of the program based on a review and evaluation of selected key assessment data associated with the various transition points. 1. Program Entry 2. Entry to Student Teaching 3. Exit from Student Teaching 4. Exit from the Program Given the number of key assessments, each report will focus on a select number of key assessments, with the intent of addressing assessments associated with each of 5. Follow-­‐up the five transition points in subsequent reports. The focus of this report is a review and evaluation of selected data associated with Transition Point 1 -­‐ Program Entry, and Transition Point 2 – Entry to Student Figure 1 -­‐ Assessment Transition P oints Teaching. Entry into the program requires potential candidates to meet or exceed the minimum requirements as specified by the Department’s admission standards. One of the requirements for admission to the program is to be registered to take a Praxis II® test in the subject area in which the candidate plans to teach in K -­‐ 12. One of the requirements for entry to student teaching is evidence that the candidate has passed the Praxis II® test in the subject area in which they plan to teach. Another requirement, which is unique to candidates in the Elementary Education Program, is to take and pass the Connecticut Foundations of Reading Test. This report describes the performance of candidates on Praxis II® and the Connecticut Foundations of Reading Tests during the 2013 through 2014 academic year. 3 UNH Graduate Education Department Assessment Report -­‐ Spring 2015 Praxis II® tests The Praxis II® tests are standardized tests that are owned, maintained, and administered by Educational Testing Service (ETS). The Praxis II® tests are designed to assess specific subject matter that candidates intend to teach in K -­‐ 12. The tests are required by many states for teacher certification. The State of Connecticut requires candidates to pass the tests to be eligible for certification as K – 12 teachers. The UNH Graduate Education Department requires candidates to register to take the test at admission. If a candidate fails the test, they must retake the examination prior to student teaching. All candidates must pass the test to be eligible for student teaching. The test performance presented in this report is based on candidates who sat for the tests during the academic year (AY) of 2013 -­‐ 2014 (i.e., from September 1, 2013 through August 31, 2014). The data presented are candidates’ best attempts, or highest score earned. It is important to note that the candidates who sat for the tests during this time period were in various stages of the program, as some candidates may have taken the test at the time that they were admitted to the program (i.e., Fall 2013 or Spring 2014), and others may have taken the test prior to student teaching. Candidates may have also taken tests in which they are seeking cross-­‐endorsement (e.g., an additional subject area in which they are seeking teacher certification). Therefore, the data do not necessarily reflect the test performance of candidates who have completed the program (i.e., earned the Master’s degree and completed student teaching). This report describes performance on tests in which five or more candidates have taken the tests during AY 2013 – 2014. ETS does not produce certain test performance data; for example, pass rates and sub-­‐
score data if there are fewer than five candidates taking a test. Therefore, this section of the report describes performance on the Praxis II® Elementary Subtests and the Secondary English Test. Since the number of candidates at the institution level is significantly smaller than the number of candidates at state and national levels, inferences about the performance of candidates are limited. Praxis II® Elementary Subtests The Praxis II® Elementary Education Subtests: Reading and Language Arts (#5032), Mathematics (#5033), Social Studies (#5034), and Science (#5035) required by the State of Connecticut for certification elementary education (K-­‐6) endorsement. These subtests are relatively new, as they became effective in September 2012. The subtests consist of multiple-­‐choice questions. The Reading and Language Arts subtest consists of 65 test questions. The Mathematics subtest (#5032) consists of 40 test questions. The Social Studies subtest (#5034) consists of 55 test questions. The Science subtest consists of 50 test questions. For additional information about the tests, refer to: http://www.ets.org/s/praxis/pdf/5031.pdf Table 1 shows the test performance of UNH candidates and all candidates statewide. The statistics displayed include: the number of exams taken, the number of candidates (N), the mean score (M), the number (N) and percent (%) passing the exam, and the median score (Md). The pass points for the subtests are indicated on Table 1. The difference between the UNH candidates’ mean scores of the subtests compared to the statewide mean scores ranged from a 1.93 point difference for the Reading Language Arts subtest to a 5.08 point difference for the Mathematics subtest, with the statewide mean scores being higher than the UNH mean scores. Overall, the pass rates of UNH candidates on all four 4 UNH Graduate Education Department Assessment Report -­‐ Spring 2015 subtests are lower than the pass rates statewide. However, it should be noted that the number of UNH candidates taking the subtests ranged from 29 to 49 and the number of all candidates in the state taking the subtests ranged from 786 to 986. The department has been monitoring the candidates’ performance, and as more candidates take the tests, the data will be reviewed for trends. ®
Table 1 -­‐ Praxis II Elementary Education Subtests, AY 2013 -­‐2014 Praxis II Elementary Education Subtests, AY 2013 -­‐ 2014 ®
University of New Haven Test Code and Name Passing Score 5032 Elem Ed: MS Reading Lang Arts Subtest 5033 Elem Ed: MS Mathematics Subtest 5034 Elem Ed: MS Social Studies Subtest 5035 Elem Ed: MS Science Subtest # Exams Taken N M Pass Rate N % State-­‐Wide Md # Exams Taken N M Pass Rate N % Md 174 77 64 178.92 49 76.56% 180 965 786 180.85 658 83.72% 181 175 95 66 166.50 29 43.94% 170 1,790 986 171.58 576 58.42% 176 166 87 67 163.93 32 47.76% 162 1,478 917 167.36 590 64.34% 168 170 89 65 167.06 35 53.85% 170 1,549 944 170.70 631 66.84% 173 Tables 2 – 5 show test performance of UNH candidates, all candidates in CT, and candidates on a national level on the content categories that comprise each subtest. As indicated in Table 2, the average percentage correct on the two categories that comprise the Reading and Language Arts subtest are a few points higher for UNH and statewide candidates in comparison to the national average. The same is true of the performance on the Mathematics subtest as shown in Table 3. The performance of UNH candidates is comparable to the national average on the Social Studies subtest (see Table 4) and the Science subtest (see Table 5). Since the test categories consist of a small number of points, inferences about candidate performance are limited. ®
Table 2 -­‐ Praxis II Elementary Education: READING & LANGUAGE ARTS SUBTEST, SUBSCORE DATA, Code: 5032 Praxis II Elementary Education: READING & LANGUAGE ARTS SUBTEST, SUBSCORE DATA, Code: 5032, N = 64, 2013 -­‐ 2014 Points Institution State-­‐Wide Average % National Average Test Category Available Average % Correct Correct % Correct Range I. Reading 31-­‐32 79% 81% 76% II. Language, Writing, and Communication 32-­‐33 80% 80% 78% ®
®
Table 3 -­‐ Praxis II Elementary Education: MATHEMATICS SUBTEST, SUBSCORE DATA, Code: 5033 Praxis II Elementary Education: MATHEMATICS SUBTEST, SUBSCORE DATA, Code: 5033, N = 65, 2013 -­‐ 2014 Institution State-­‐Wide Test Category Points Available Range Average % Average % Correct Correct I. Number, Operations, and Algebraic Thinking 26 75% 78% II. Geometry, Measurement, Data, and Interpretation 14 67% 71% ®
National Average % Correct 73% 66% 5 UNH Graduate Education Department Assessment Report -­‐ Spring 2015 ®
Table 4 -­‐ Praxis II Elementary Education: SOCIAL STUDIES SUBTEST, SUBSCORE DATA, Code: 5034 Praxis II Elementary Education: SOCIAL STUDIES SUBTEST, SUBSCORE DATA, Code: 5034, N = 66, 2013 -­‐ 2014 ®
Points Available Range Test Category I. United States History, Government, and Citizenship II. Geography, Anthropology, and Sociology III. World History and Economics National Average % Correct Institution Average % Correct State-­‐Wide Average % Correct 25 65% 68% 64% 14-­‐16 14-­‐16 74% 62% 75% 65% 72% 62% ®
Table 5 -­‐ Praxis II Elementary Education: SCIENCE SUBTEST, SUBSCORE DATA, Code: 5035 Praxis II Elementary Education: SCIENCE SUBTEST, SUBSCORE DATA, Code: 5035, N = 64, 2013 -­‐ 2014 Points Available Institution Average % State-­‐Wide Average % National Average % Test Category Range Correct Correct Correct I. Earth Science 16 65% 68% 64% II. Life Science 17 79% 78% 75% III. Physical Science 17 54% 58% 56% ®
Praxis II® Test -­‐ Secondary English The Praxis II® Secondary English test is described in this section of the report. Table 6 shows the test performance of UNH candidates and all candidates statewide. The statistics displayed include: the number of exams taken, the number of candidates (N), the mean score (M), the number (N) and percent (%) passing the exam, and the median score (Md). The pass point for the test is indicated in Table 8. The pass rate of UNH candidates is lower than the pass rate of candidates who tested statewide. However, the comparison is based on thirteen (13) UNH candidates in comparison to 230 candidates who tested statewide. As more candidates take the tests, the data will be reviewed for trends ®
Table 6 -­‐ Praxis II English, AY 2013 – 2014 Praxis II Secondary English, AY 2013-­‐2014, Passing Score = 172 ®
University of New Haven Test Code and Name 0044 English LLC: Content and Analysis (paper) 5044 English LLC: Content and Analysis (computer) 9044 English LLC: Content and Analysis (cmbd frmt) # Exams Taken N M Pass Rate N % Statewide Md # Exams Taken N M Pass Rate N % Md 6 6 174.33 4 66.67% 173.5 43 41 172.71 22 53.66% 173 10 10 172.50 4 40.00% 170.0 266 204 177.95 157 76.96% 178 16 13 174.69 8 61.54% 174.0 307 230 177.99 178 77.39% 178 Tables 7 and 8 show the average percent correct of UNH candidates, all candidates in CT, and candidates on a national level on the content categories that comprise the test. The test consists of the following categories: 1) Literature and Understanding Text, 2) Language and Linguistics, 3) Composition and Rhetoric, and 4) Analysis (Constructed Response). As indicated in Tables 7 and 8, UNH candidates’ average percent correct on the first three categories that comprise the test are comparable to statewide and national levels. However, the performance of UNH candidates on the Analysis (Constructed 6 UNH Graduate Education Department Assessment Report -­‐ Spring 2015 Response) category exceeded statewide and national averages on the paper version of the test, whereas, the performance of UNH candidates on the test administered via computer was below statewide and national averages. Since the test categories consist of a small number of points, and there are a small number of candidates taking the tests, inferences about performance are limited. ®
Table 7 – Praxis II English Language, Literature, and Composition: Content and Analysis, SUBSCORE DATA, AY 2013 -­‐ 2014 Praxis II English Language, Literature, and Composition: Content and Analysis, SUBSCORE DATA, Code: 0044 (Paper), N = 6, 2013 -­‐ 2014 Points Available Institution Average % State-­‐Wide Average % National Average % Test Category Range Correct Correct Correct I. Literature and Understanding 45 74% 75% 75% Text II. Language and Linguistics 18 70% 67% 69% III. Composition and Rhetoric 27 76% 79% 78% IV. Analysis (Constructed 12 72% 66% 63% Response) ®
®
Table 8 – Praxis II English Language, Literature, and Composition: Content and Analysis, SUBSCORE DATA, AY 2013 – 2014 Praxis II English Language, Literature, and Composition: Content and Analysis, SUBSCORE DATA, Code: 5044 (Computer), N = 9, 2013 -­‐ 2014 Points Available Institution Average % State-­‐Wide Average % National Average % Test Category Range Correct Correct Correct I. Literature and Understanding 45 77% 80% 78% Text II. Language and Linguistics 18 68% 70% 70% III. Composition and Rhetoric 27 87% 84% 83% IV. Analysis (Constructed 12 58% 70% 65% Response) ®
CT Foundations of Reading Test This section of the report describes the performance of candidates on the CT Foundations of Reading Examination. The State of Connecticut requires the passing of the Connecticut Foundations of Reading test for certification elementary education (K-­‐6) endorsement. The test is designed to assess reading instruction knowledge and skills. It consists of 100 multiple-­‐choice questions and 2 open-­‐ended response questions. The passing score is 240. For more information about the test, refer to: http://www.ct.nesinc.com/index.asp As a graduate teacher education program, the department recognizes that candidates enter the program having taken undergraduate course work in elementary content areas, and acquire pedagogical content knowledge and foundational knowledge in the graduate teacher education program. Therefore, candidates are encouraged to take the CT Foundations of Reading examination after they have taken the relevant professional coursework. Specifically, the department recommends that Elementary education candidates take the CT Foundations of Reading Test after they have taken a two-­‐course sequence in reading and language arts: Early Literacy and Reading/Language Arts in the elementary grades. 7 UNH Graduate Education Department Assessment Report -­‐ Spring 2015 As shown in Table 9, the pass rate of 50 UNH candidates taking the exam in AY 2013 – 2014 was 90% and the pass rate of all candidates in CT taking the exam during this time period was 86%. The mean total scaled score for UNH candidates was 258.4 and for statewide was 256.4. Table 9 -­‐ CT Foundations of Reading, AY 2013-­‐2014 CT Foundations of Reading AY 2013-­‐2014 Pass Rate N UNH 50 Mean Total Scaled Score Statewide N % N % 45 90% 1,462 86% UNH Statewide 258.4 256.4 The examination is comprised of the following four subareas: 1) Foundations of Reading Development, 2) Development of Reading Comprehension, 3) Reading Assessment and Instruction, and 4) Integration of Knowledge and Understanding. The subarea performance data, as shown in Table 10, indicates that the mean subarea performance index of UNH candidates meets or exceeds the mean subarea performance index of candidates statewide. Table 10 -­‐ CT Foundations of Reading, Sub-­‐Area Performance Data, AY 2013-­‐2014 CT Foundations of Reading, Sub-­‐Area Performance Data, AY 2013-­‐2014 Subarea # 01 02 03 04 Type M/C M/C M/C C/R Name Foundations of Reading Development Development of Reading Comprehension Reading Assessment and Instruction Integration of Knowledge and Understanding N 50 50 50 50 UNH Mean Subarea Performance Index 3.3 3.4 3.4 2.7 N 1,462 1,462 1,462 1,462 Statewide Mean Subarea Performance Index 3.2 3.3 3.3 2.7 8