Topic 5 Planning Classroom Test and Assessments 8 basic steps of testing and assessment The objective of testing and assessment is to obtain valid, reliable, and useful information concerning student achievement. 1) Determine the purpose of measurement 2) Developing specifications 3) Selecting appropriate assessment tasks 4) Preparing relevant assessment tasks 5) Assembling the assessment 6) Administering the assessment 7) Appraising the assessment 8) Using the results PURPOSE Pre-testing • Tests and assessment given at the beginning of an instructional segment to determine two key components a. Whether students have the prerequisite skills needed for the instruction (determine readiness). b. What extent students have already achieved the objectives of the planned instruction (placement or modification of instruction). During Instruction • Tests and assessments given during instruction provide the basis for formative assessment. a. They are used to monitor learning progress, detect misconceptions, encourage students to study, and provide feedback to students and teachers. b. Using a different types of test items and complex performance assessment needs to ensure that the full comprehension of objectives is assessed (meaning choose questions carefully to have understanding in the classroom.) End-of-Instruction • The main interest is in measuring the extent to which the intended learning outcomes and performance standards have been achieved. • Although these end-of-instruction test and assessments are used primarily for summative assessment they can serve as other functions, such as: 1) Feedback to students 2) Encouraging students to undertake advanced work 3) Assigning of remedial work 4) Assessing instruction as well as for grading purposes 5) Function as both formative and summative 6) Pre-test for the following unit 7) Evaluating instructional effectiveness Selecting Appropriately • It is common to make a distinction between classroom test that consist of objective test items and performance assessment that require students to construct responses or perform a particular task. • Objective test require students to supply a word or two or to select the correct answer from a number of alternatives. • They are called objective because they have a single right answer or best answer that can be determined in advance. • There are five components to an objective test, such as: SHORT ANSWER What is the name of the author of Moby Dick? COMPLETION In the equation 2X+5=9, X=____ MATCHING Color of the sky Color of the dirt Color of the trees A) Brown B) Blue C) Green TRUE-FALSE OR ALTERNATIVE RESPONSE T F An atom is the smallest particle of matter Yes No Acid turns litmus paper red. MULTIPLE CHOICE In the equation 2X+5=9, 2X means A)2 plus X B)2 multiplied by X C)2 minus X • To obtain the correct answer, students must demonstrate the specific knowledge, understanding, or skill. They are not free to redefine the problem or to organize and present the answer in their own words. • This type of method contributes to scoring that is quick, easy, and accurate. • Negative side: inappropriate for measuring the ability to formulate problems and choose an approach to solving them or the ability to select, organize, and integrate ideas. Performance Test • Permit the student to organize and construct the answer. • Other types of performance may require the student to use equipment, generate hypotheses, make observations, construct a model, or perform to an audience. • For the most performance assessments do not have a single right or best response- there may be a variety of responses. Performance Test • Performance assessment tasks are needed to measure a student’s ability to engage in hands-on activities, such as conducting an experiment, designing and conducting a survey, or essay. • Since essay is the most common, there are two types of essay questions: extended-response and restricted-response. Extend-Response • Permit students to decide which facts they think are most pertinent, to select their own method of organization, and write as much as seems necessary for a comprehensive answer. • Tends to reveal the ability to evaluate ideas, to relate them coherently, and to express them succinctly. • They are valuable for measuring complex skills and understanding of concepts and principles, they have three weaknesses: a) Inefficient for measuring knowledge of factual material b) Scoring criteria are not as apparent to the student c) Scoring is difficult and unreliable due to the various responses, include array of factual material, organization, legibility, and conciseness. Restricted-Response • These questions minimize some of the weaknesses of extended, for three reasons: 1. Easier to measure knowledge of factual material. 2. Scoring more clear to the student. 3. Reduces the difficulty of the scoring. • The negative side- less effective as a measure of the ability to select, organize, and integrate ideas. • In addition, if the restrictions become too tight, the questions reduce to nothing more than a objective type test. Most Appropriate Types for Restricted Response • Multiple-Choice Questions • Will measure the learning outcome directly. • True- False Questions • Most valuable in those special instances where there are only two possible answers. • Matching Questions • Used only where a series of homogeneous things are to be related. Representative Test Number of Questions • Of course this is important factor when deciding area of achievement. • There are a set of specifications that depend on such factors: • • • • Purpose of measurement: The type of test or assessment Age of the students Level of reliability needed for effective use of the test/ assessment results. Eliminating Barriers • Have questions that would contain these situations: • • • • • • • Ambiguous Statements Excessive wordiness Difficult vocabulary Complex sentence structure Unclear instructions Unclear illustrative material Racial, ethnic, or gender bias Suggestions for tests/ assessment 1. 2. 3. 4. 5. 6. 7. 8. Use your test and assessment specifications as a guide. Write more items and tasks than needed. Write the items and tasks well in advance of the testing date. Write each test item and assessment task so that the task to be performed is clearly defined and it calls forth the performance described in the intended learning outcome. Write each item or task at an appropriate reading level. Write each item or task so that it does not provide help in responding to other items or tasks. Write each item so that the answer is one that would be agreed on by experts or in the case of assessment, responses judged excellent would be agreed on by experts. Whenever a test or assessment is revised, recheck its relevance. Improving Learning • As you construct classroom tests and assessments, keep in mind the extent to which is likely to contribute directly or indirectly. • Well constructed classroom tests and assessments should increase both the quality and quantity of student learning.