Continuous Assessment for Evaluating and Guiding Student Learning Rita Chan Centre for Learning, Teaching and Supervision Hong Kong Institute of Education 26 February 2004 1 Assessment can serve different purposes Assign grades, certify mastery Determine progress Identify strengths and weaknesses Motivate students to study Create learning activity Give feedback to students Give feedback to teachers Judgment Learning Use assessment to foster learning, learn about learning and improve learning. 2 Assessment assesses the extent to which programme objectives are achieved General and subject objectives Process and product objectives Knowledge and skills objectives Match assessment tasks to objectives. Make criteria explicit and clear. 3 Different methods are appropriate for different assessment purposes and for different programme objectives Quiz Examination Essay Multiple choice Report Dissertation / thesis Project Composition Performance Journal Portfolio Self assessment Peer assessment Group assessment Concept maps Heuristics Use a mix of methods. 4 Continuous assessment Sept Jan A1 A2 A3 A4 A5 5 Characteristics of CASS Uses a variety of tasks Measures a range of attributes Takes place over a period of time Creates regular teacher-student interaction Makes reference to past, present and future Synthesises information about learners 6 CASS commonly found in course outlines One essay (2000 words) Examination (3 hrs) 30% 70% Dec Jan 5 lab reports Mid-term test Group project 30% 20% 50% Nov Jan 7 Issues The ‘backwash’ effect of assessment Modularisation and over-assessment Larger classes and less feedback Achievements, not numbers Unused data 8 Challenges Aligning objectives, learning and assessment Engaging students Providing frequent and useful feedback Managing assessment workload Using assessment results to evaluate and improve teaching and programme effectiveness 9 Ideas (1) Constructive alignment – Programme-course mapping (examples from Alverno College) Engaging students – Clear links between task and course objectives – Clear instructions and criteria – Reasonable time and effort – Choice – Challenge 10 Major General Communication Analysis Problem solving Valuing in decision making Social interaction Global perspectives Effective citizenship Aesthetic responsiveness Analyzes behavior within a theoretical framework supported by appropriate methodology and data interpretation Explains behavior through an integration of psychology and specialized areas of study in the liberal arts Demonstrates an awareness of the contributions and limitations of psychology in the world Acts in ways that reflect the tenets of psychology, including tolerance of ambiguity, sensitivity to ethics, appreciation of individual differences, respect for ongoing inquiry, and the assumptions of the complexity of human behavior PSY 101 General Psychology Alverno College, Milwaukee Course To observe and make appropriate inferences about human behavior through experience in observing behavior and in studying the major concepts, methods and theories of psychology To use what psychology has learned about problem solving to (1) self assess your own problem solving style and (2) identify methods for researching questions pertinent to psychology To apply the knowledge and abilities acquired in the course to issues confronted by individuals and groups in today’s society 11 Assessment Stimulus Choose a behavior (habit) you would like to increase or a behavior you would like to decrease. Record and graph this behavior for approximately one week. Also record any antecedents and consequences of the target behavior. Formulate a hypothesis as to why this behavior is maintained at its present rate. Design a program either to increase a behavior (applying the principles of Reinforcement) or to decrease a behavior (applying either “controlling antecedents” and/or punishment and/or reinforcement of reduced behavior. Implement your program for about two weeks. Record the rate of your behavior during this time. In a report for the class (written or oral), summarize the results. Interpret them by applying the principles of operant conditioning. Evaluate what factors contributed to the success or failure of your program. PSY 101 General Psychology Alverno College, Milwaukee Criteria Accurately distinguishes between behaviour and inferences about behavior Demonstrates accurate application of the principles of operant conditioning (behavior modification) for the purpose of increasing target behaviors or decreasing target behaviors Presents data and results accurately and clearly Formulates acceptable hypothesis Designs and implements a workable program Makes accurate inferences re: effectiveness of program 12 Ideas (2) Effective feedback – No marks, comments only – Focus on learning and improvement – Comments linked to criteria and student goals – Peer comments – Positive, direct, timely 13 14 Ideas (3) Workload – Peer and self assessment – Group work – Group feedback – Use assessment and feedback form – Email, e-discussion Using assessment results – Student self evaluation – Error analysis – Exam item analysis – Audit programme achievement 15 Examples LOAP Peer feedback Mini-viva Unannounced open-book tests FAST Peer assessment 16 Peer Feedback Aim To promote independent research and enquiry To encourage mutual support in learning Context Educational Psychology Case Study as final assessment Group presentation on selfselected topic – not marked Technique At the end of a presentation, each student writes: – One thing of value learnt – One thing to know more about – One commendation – One suggestion Comments are collated and circulated to group Presentation is copied to all Evaluation Adds interest to subject Broadens and deepens learning Provides practice in research, analysis and explaining Promotes reflection Fosters positive and constructive responding Generates a large number of ideas for improvement Provides a window to students’ learning 17 Unannounced Open-book Tests Aim To assess student progress To enhance learning through attending to identified learning issues Context Statistics Technique Inform students about the possibility of two unannounced tests at the beginning of term Evaluation Keeps students alert Has objective data on students’ progress Helps review and adjust teaching Improves final assessment results Allow students to work with books and reference materials Give written feedback but no marks Highlight common issues to the group in class 18 Mini-viva Aim: To engage students in dialogue and reflection on a summative assignment Context English group assignment Technique Students submit group assignment Lecturer makes swift provisional assessment Groups attend a 15 minute viva, where they receive feedback and answer questions about their assignment After the viva, lecturer finalises the grade and returns assignment to students in the normal way Evaluation Students are more responsive to feedback without marks Students get a chance to clarify muddy points in their assignment Assessment results may improve as a result 19 Peer assessment From a LOAP workshop by Graham Gibbs at HKIEd (11 February 2004): Context Engineering Weekly lectures, problem sheets and classes Student numbers >170 Students stopped doing problems Exam marks dropped from 50% to 45% Strategy Course requirement to complete 50 problems Peer assessed in six ‘lecture’ slots Marks do not count Lectures, problems, classes, exams unchanged Exam marks increased from 45% to 85% 20 Conditions under which assessment supports student learning Graham Gibbs, Institute for the Advancement of University Learning, University of Oxford Assessed tasks capture sufficient student time and effort These tasks distribute student effort evenly across topics and weeks These tasks engage students in productive learning activity Assessment communicates clear and high expectations to students Sufficient feedback is provided, both often enough and in enough detail The feedback is provided quickly enough to be useful to students Feedback focuses on learning rather than on marks or students themselves Feedback is linked to the purpose of the assignment and to criteria Feedback is understandable to students, given their sophistication Feedback is received by students and attended to Feedback is acted upon by students to improve their work 21 or their learning Resources Learning Oriented Assessment Project (LOAP) http://www.ied.edu.hk/loap/ Learning and Teaching Support Network (LTSN) http://www.ltsn.ac.uk/application.asp?app=resources.asp& section=generic&process=filter_fields&type=all&id=1&histo ry= Alverno College: Assessment-as-Learning http://depts.alverno.edu/saal/ Formative Assessment in Science Teaching (FAST) http://www.open.ac.uk/science/fdtl/index.htm Qualifications and Curriculum Authority (QCA): Key skill standards http://www.qca.org.uk/qualifications/types/6507.html 22 Contact information Dr. Rita Chan Centre for Learning, Teaching and Supervision (CeLTS) Hong Kong Institute of Education Email: rypchan@ied.edu.hk CeLTS website: http://iediis4.ied.edu.hk/celts/index.asp 23