Emerging Trends in Performance Assessment Emerging Trends in Performance Assessment: Implications for Teacher Educators CarieLyn Palmer and Kelly Crain ACE-DHH Conference Best Practices in Deaf Education San Diego, CA February 22nd-February 25th, 2001 Emerging Trends in Performance Assessment 1 Introduction: Assessment courses in teacher-education programs have traditionally focused on the psychometric aspects of testing: examining issues of reliability and validity of indirect or standardized tests. Education majors and pre-service teachers have been taught the history of psycho-educational assessment, testing protocols, and interpretations of test results. A review of the recent literature related to educational assessment shows a shift of attention from traditional tests to more direct, classroom-based assessments for the purpose of improving teaching and student learning (Messick, 1995). More attention is being paid to the consequences of the assessments and the appropriate interpretation and specific uses of assessment results. Professionals in the field of teacher preparation have the opportunity to incorporate these latest discussions into their courses at the college level. In the remainder of this paper, we will highlight and summarize recent discussions of performance assessment by professionals in the areas of: program development; educational measurement and evaluation; and psychometrics. Following each topic of discussion, we will suggest implications for those who work to prepare future teachers for careers in education. What is assessment and what is a test? Assessment is one of those ubiquitous educational terms. Presumably, everyone is familiar with the word, and can quickly conjure notions of what an assessment looks like. For years, we (as a society) have so closely married ‘assessment’ to ‘test’ that the two have become synonymous. Emerging Trends in Performance Assessment 2 For the purpose of our discussion, we view assessment as an educational construct. It is the process that a teacher goes through to judge what a student has learned or can do. In observing the student during such an assessment, the teacher can see how a student performs, gaining insight into how the student best learns. The result of that assessment guides the teacher to ever-more effective and useful teaching practices. The goal of those improved teaching strategies, the true goal of assessment, is a more competent and capable student. Traditionally, assessment has taken the form of summative tests. The term ‘summative’ refers to the type of test used to evaluate a student’s learning at the end of a unit, when the teaching of that information has ceased. For the purpose of our discussion, the word test will be used to refer to a paper document upon which a student must indicate answers to printed questions. Those questions are commonly presented in multiple choice or short answer formats, but other forms exist. Common tests include end-of-chapter textbook reviews, teacher-made unit reviews, the Stanford Achievement Test-9, the Scholastic Aptitude Test (SAT), the Graduate Record Examination (GRE), and the Iowa Test of Basic Skills (ITBS). Implication: Assessment courses in teacher preparation programs can and should include discussions of the nature and purpose of assessment and the use of alternative assessments, not to the exclusion of the more traditional topics of psychometrics and testing. What is the nature of assessment? In recent years, we have seen a paradigm shift in the role of assessment in the classroom. Rather than viewing assessment as the end of instruction and learning, Emerging Trends in Performance Assessment 3 professionals in education are now viewing assessment as an integral part of the process of student learning and teacher instruction. The nature of assessment is to create a relationship between the students’ learning and the teachers’ instruction (Tierney, Readence, & Dishner, 1995). Students’ learning can be viewed as a non-linear process, which requires the reorganizing and restructuring of information to capture the changing salience of concepts over time (Shepard, 1991). Therefore, if the nature of assessment is to inform teachers of this dynamic process, the assessment must also be dynamic and ongoing. Implication: Future teachers who can conceptualize assessment as an integral component of the learning process will be more capable of on-going assessment, more confident in educational decision-making and therefore more effective teachers. What is nature of performance assessment? The nature of performance assessment is not solely to communicate what the student has learned, but also how the student is able to explain, demonstrate, model, apply and/or reflect upon what she has learned. Rather than a “snapshot” of student learning, a performance assessment serves as a “scrapbook” illustrating the direction and steps a student has taken in her learning (Afflerbach, 2000). Inherent in performance assessment is the ability to establish specific criteria and track the progress toward those criteria. Performance assessment becomes a communication tool between teacher and student, as well as a self-monitoring tool for the student (McTighe, 1997). This communication process provides a context to help students become familiar with the culture of assessment and learning (Afflerbach, 2000). Emerging Trends in Performance Assessment 4 Implication: If future teachers see their role in assessment as that of an advisor and mentor as opposed to the unquestionable authority and giver of grades, students will still be learning after the “teaching” has ended and “testing” has begun. How are performance assessments used? Performance assessments are comprised of three basic components: the performance, the established criteria, and the observers’ judgments and feedback to be communicated. The power of performance assessment as a learning tool lies in its ability to incorporate these three components into a dynamic learning and teaching process. The performance may take the form of a presentation, an art project, a student interview, or any situation in which the student has an opportunity to demonstrate her understanding of the concept in question. Student performances are not limited to artistic creations or dramatic presentations. The assessment of written works, such as reports, essays or letters can be used throughout the writing process. Standard criteria for what is acceptable are agreed upon by all participants and are clearly communicated prior to the performance. A rubric is a common tool used in performance assessment to communicate gradations of quality in a given performance. Each participant (the student herself, other students, the teacher…) has an opportunity to judge the performance against the criteria, and to communicate that judgment. This process benefits all participants, whether they are providing feedback, receiving feedback, or learning from the comments of others. Implication: Future teachers must be aware of the relationship between performance assessment as an educational construct and common performance assessment tools. Teachers who are familiar with this relationship will understand the difference between Emerging Trends in Performance Assessment 5 the assessment tool and its role in the assessment process, and thus be able to use those assessment tools more effectively. Conclusion: The field of educational assessment has seen a recent shift from discussions of traditional approaches in the measurement of student learning to discussions of alternative assessment methods. Such methods are viewed as a means to provide more immediate and formative feedback for the purpose improving instruction and enhancing student learning. Teacher educators are now in a position to incorporate these recent dialogues into their course content. We have identified four major topics of discussion related to performance assessment and suggested their direct implications for professionals in the field of teacher preparation. We discussed the difference between the construct of assessment and the forms it has traditionally taken: paper-and-pencil tests. We then identified the nature of assessment as a relationship between students’ learning and teachers’ instruction. Next, we focused on the nature and purpose of performance assessment. Finally, we described the three major components of a performance assessment. We have purposefully avoided mentioning any given group of students in our discussion of assessment. Although we are educators of Deaf and hard of hearing students specifically, we believe that the current discussions of the relationship between assessment and learning are applicable to the education of all learners. The view of assessment and it’s relationship to learning holds true regardless of whether a student is Deaf or hearing, child or adult. Emerging Trends in Performance Assessment 6 References Afflerbach, P. (personal communication, November 14, 2000). Afflerbach, P. (in press). Teaching reading self-assessment strategies. In C. Block & M. Pressley (Eds.), Reading comprehension strategies for successful readers. Messick, S. (1995). Standards of validity and the validity of standards in performance assessment. Educational Measurement: Issues and Practice 14, (4), 5-8. McTighe, J. (1997). What happens between assessments? Educational Leadership, 54, 612. Shepard, L. (1991). Psychometricians’ beliefs about learning. Educational Researcher, 20, 2-16. Tierney, R.J., Readence, J., & Dishner, E. (1995). Reading strategies and practices. Needham, Heights. MA: Allyn & Bacon.