Assessment 1 - College of Education and Human Development

advertisement
Assessment 1: Praxis II test (English Language, Literature, and Composition: Content Knowledge Test—0041)
Licensure Assessment
Narrative
(a) Description and Program Use of the Assessment: NCATE requires the inclusion on state licensure assessment, or other contentbased assessment, as Assessment 1. The State of Virginia requires that candidates pass the Praxis II English Language, Literature, and
Composition: Content Knowledge Test 0041 for licensure in English, grades 6-12. Further, all teacher-preparation programs within our unit,
Radford University College of Education and Human Development, use Praxis II as Assessment 1. In keeping with this practice, we include
PRAXIS II as Assessment 1. This assessment is used within our program, and within all teacher-preparation programs at Radford University, as a
requirement for student teaching. To qualify for student teaching in Secondary English, teacher candidates must score at least 172, the Virginia
cut score for the English Content Knowledge Test 0041. The average cut score from a sample of 29 states that require this test is 155.72
(http://www.saipantribune.com/newsstory.aspx?newsID=89848&cat=1) , with Virginia’s score exceeding this average by 16.28 points. This high
cut score means that our teacher candidates have mastered content knowledge as addressed within the test.
(b) Alignment of Assessment with NCTE Standards: Our English Education faculty recognize that in 2001 the Praxis II test aligned only
partially with NCTE standards 3.1-3.7. NCTE’s Research Project on the Assessment of Preparation of Teachers of English Language Arts (January
2001) recognizes these partial alignments of items within given categories with NCTE standards: items in the category Literature and
Understanding text align partially with NCTE standards 3.5.1-3.5.4; items within the test category Language and Linguistics align partially with
NCTE standards 3.1.1-3.1.7; and items within the test category Composition and Rhetoric align partially with NCTE standards 3.2.1-3.2.5 and
3.4.1-3.4.2. The aforementioned NCTE report notes limitations in the areas of technology, research theory, and literature by YA authors, authors
of color and women’s authors, as well as in oral and visual literacy. The policy statement “Program Assessment in English Education: Belief
Statements and Recommendations,” issued in 2008 by NCTE’s Council on English Education, calls for cooperative actions between NCTE and ETS
to revise the content knowledge tests, a position that underscores questions about the use of PRAXIS II as a valid measure of candidates’
knowledge, dispositions, and abilities. We agree with NCTE’s position and acknowledge that the limitations of PRAXIS II prevent its being used as
the sole measure of candidates’ content knowledge. Therefore, we have carefully designed other assessments that measure NCTE standards. In
particular, standards related to knowledge of technology, research theory in English language arts, a range of literary works, and oral and visual
literacy are assessed in teacher candidates’ student teaching evaluations (Assessment 4) and in their Teaching English Portfolio (Assessment 6).
(c) Interpretation of Data as Evidence for Meeting Standards: Program completers in the English Education Program meet NCTE
standards 3.1-3.7, as they are reflected in the Praxis II content knowledge test 0041. Our English Education Program achieves a 100% pass rate
on PRAXIS II, with teacher candidates achieving Virginia cut score before student teaching. Examination of data on Praxis II scores for English
Education teacher candidates reveals:
 86.66%-87.5% of all program examinees across two administrations of the assessment met the Virginia cut score of 172.






100% of program completers during these years met the Virginia cut score of 172.
In 2009-2010 93.33% of all English Education teacher candidates scored within or above the national average performance range in the
category Literature and Understanding Texts. In 2008-2009 100% of all teacher candidates in our program scored within this range.
These two administrations of the assessment indicate strong content knowledge as specified by NCTE Standards 3.3 and 3.5.
In 2009-2010 93.33% of all of our teacher candidates scored within or above the national average range in the category Language and
Linguistics; in 2009-2009 100% scored within the national average performance range. Scores indicate strong content knowledge in
areas covered by NCTE standard 3.1.
In 2009-2010 93.33% of all of our teacher candidates scored within or above national average range in the category of Composition and
Rhetoric; in 2008-2009 85.7% scored within or above this range for this third category. Scores indicate strong content knowledge in
areas covered by NCTE standards 3.2, 3.4, and 3.6.
Approximately 1/3 of our candidates are scoring within the highest quartile on at least one of the content areas. For example, in 20092010 46.66% of our teacher candidates scored at the highest quartile in Literature and Understanding Text; 40% scored at the highest
quartile in Language and Linguistics; and 26.22% scored in the highest quartile in Composition and Rhetoric.
Mean and median scores, which were available on rGrade for all program examinees across 2 years, indicate that our program
examinees are scoring at the upper end of the national average performance range, another indicator that our candidates have strong
content knowledge as measured by the Praxis II English Language, Literature, and Composition: Content Knowledge Test 0041.
Assessment Documentation
(d) Description of the Assessment Tool: The ETS website describes the English Language, Literature, and Composition: Content
Knowledge test as an assessment designed to determine “whether an examinee has the broad base of knowledge and competencies necessary
to be licensed as a beginning teacher of English in a secondary school,” noting that the “120 multiple-choice questions are based on the material
typically covered in a bachelor’s degree program in English and English education.” (http://www.ets.org/Media/Tests/PRAXIS/pdf/0041.pdf
The list of topics covered by the test, also included at the above URL, is extensive. ETS mentions within this list and under the category
Literature and Understanding Text the following items: “Identifying major works and authors of American, British, World (including nonWestern), and young adult literature from various cultures, genres, and periods”; “situating authors and texts within historical, cultural, and
critical contexts to aid interpretation”; and “recognizing and applying various strategic approaches to teaching reading, e.g. applying cueing
systems, … constructing meaning through context….” Under the Composition and Rhetoric category, among others, these items appear: “using
electronic and print media” and “strategies for organization, development, and presentation of print, electronic, and visual media.”
(e) Scoring Guide for the Assessment: The ETS website provides the following scoring information for test 0041:
Name of test
Possible Score
Range
Score Interval
Number of
Examinees
Median
English
Language,
Literature, and
Composition:
Content
Knowledge
(0041)
100-200
1
35590
177
Average
Performance
Range
166-187
Standard Error of
Measurement
4.7
Standard
Error of
Scoring
0
(f) Candidate data derived from the assessment:
Table 1.1:
Pass Rates of Teacher Candidates in English Education Program
Number of Passing
Pass-rate among all
Scores/Total Number of
English Education
Program Test-Takers
Program test-takers
2009-2010
13/15
86.6%
administration of Test
0041: English Language,
Literature, and
Composition: Content
Knowledge
2008-2009
7/8
87.5%
administration of Test
0041: English Language,
Literature, and
Composition: Content
Knowledge
Table 1.2
Raw Scores by Test Category of All Program Examinees
Number of Passing
Scores/Number of
Program Completers
Pass-rate among
Program completers
13/13
100%
7/7
100%
Test Category
Range of
Scores
Among All
Program
Examinees
Range of
Scores
Among
Program
Completers
National
Average
Performance
Total number
scoring
within
national
average
performance
range/ Total
number of
Program
Examinees
Percentage of
all examinees
scoring within
national
average
performance
range
2009-2010
Administration
Literature and
39-61
52-61
43-54
7/15
46.66%
Understanding
Text
Language and
6-15
10-15
10-14
8/15
53.33%
Linguistics
Composition and
18-33
27-33
23-31
10/15
66.66%
Rhetoric
2008-2009
Administration*
Literature and
46-54
46-54
44-58
7/7
100%
Understanding
Text
Language and
11-17
11-17
11-17
7/7
100%
Linguistics
Composition and
24-30
3/7
42.85%
Rhetoric
Please note that scores by category were not available for one examinee in 2008-2009.
Total number
scoring
below
national
average
performance
range/ Total
number of
Program
Examinees
Percentage
of all
examinees
scoring
below
national
average
performance
range
Total
number
scoring
above
national
average
performanc
e range/
Total
number of
Program
Examinees
Percentage of
all examinees
scoring above
national
average
performance
range
1/15
6.66%
7/15
46.66%
1/15
6.66%
6/15
40%
1/15
6.66%
4/15
26.22%
0/7
0%
0/7
0%
0/7
0%
0/7
0%
1/7
14.28%
3/7
42.85%
Table 1.2
Mean/Median Raw Scores by Test Category for All Program Examinees 2008-2010
Test Category
Mean Score of all
program examinees
Median Score of all
program examinees
National Average
performance range
across 2 years
Literature and Understanding Text
Language and Linguistics
Composition and Rhetoric
53.045
13.318
29.09
53
14
30
43-54 and 44-59
10-14 and 11-17
23-31 and 24-30
Download