Uploaded by Glenn Cueva

module-14-what-why-and-how-to-evaluate-a-curriculum compress (1)

advertisement
The Teacher and the School Curriculum │ Module 14. What, Why and How to Evaluate a Curriculum │Page 1 of 7
What, Why and How to Evaluate a Curriculum
OVERVIEW
This module is all about curriculum evaluation in the context of its definition and the role of the teacher as an
evaluator. It will present the ways of evaluating the curriculum as written, planned or implemented. It will reference
popular curriculum models currently used in educational programs here and abroad.
Curriculum evaluation is a component of curriculum development that responds to public accountability. It looks
into educational reforms or innovations that happen in the teacher’s classrooms, the school, district, division or the
whole educational system as well. It is establishing the merit and worth of a curriculum. Merit refers to the value and
worth of the curriculum. Test results will only be used as one of the pieces of evidence of evaluation. For in the end,
the purpose of evaluation is to improve and not to prove.
Curriculum evaluation is premised on the concept of alignment of planned, written and implemented curriculum. It is
an attempt to answer two big questions as:
1. Do planned courses, programs, activities as written and implemented produce desired outcomes?
2. How can these school curricula be improved?
LEARNING OUTCOMES
At the end of this module, you are expected to:
1. Acquire clear understanding of what curriculum evaluation is;
2. Explain the need to evaluate the curriculum and how it’s being done;
3. Expand knowledge about different curriculum evaluation models.
LEARNING EXPERIENCES & SELF-ASSESSMENT ACTIVITIES (SAA)
ABSTRACTION
Curriculum evaluation is a new idea for many teachers, not knowing that every day, the teacher is involved in
several components of evaluation. There are two ways of looking at curriculum evaluation:
1. Curriculum Program Evaluation. Refers to the overall aspects of a curriculum as a subject, degree program,
curriculum reform program and the like. Some examples are: The Curriculum Development as a Subject,
Bachelor of Education as a degree, K to 12 as a curricular reform, Outcomes-Based Education as a Process,
Mother Tongue Based Multilingual Education as a program.
Program evaluation will be using program evaluation models like Bradely Effectiveness Model, Tyler’s
Objective Centered Model, Stufflebeam’s CIPP Model, and Scriven’s Consumer-Oriented Model among
others.
2. Components of a Curricular Program. This will cover separate evaluation for a curriculum component such as
(1) Achieved Learning Outcomes, (2) Teaching Learning Process, (3) Instruction Materials, (4) Assessment
of Learning Outcomes.
Module prepared by: R.R. L. Fernandez, LPT, MAEd (CAR)
OSMEÑA COLLEGES
3
0
The Teacher and the School Curriculum │ Module 14. What, Why and How to Evaluate a Curriculum │Page 2 of 7
Curricular program component evaluation refers directly to the assessment of curriculum contents and
processes as implemented every day in view of the learning outcomes as either formative or summative.
Curriculum Evaluation: A Process and a Tool
Do you have a clear understanding of what curriculum evaluation is all about? Is it synonymous to assessment
of learning? An analysis of the various definitions reveals that evaluation is both a process and a tool. As a process it
follows a procedure based on models and frameworks to get the desired results. As a tool, it will help teachers and
program implementers to judge the worth and merit of the program and innovation or curricular change. For both
process and a tool, the results of evaluation will be the basis to IMPROVE curriculum.
Let’s look at how curricularists define curriculum evaluation. Read what each of them say.
Persons
Ornstein, A. &
Hunkins, F., (1998)
McNeil, J. (1977)
Gay, L. (1985)
Oliva, P. (1988)
Definition
Curriculum evaluation is a process done in order to gather data that enables one to decide
whether to accepts, change, eliminate the whole curriculum of a textbook.
Evaluation answers two question: 1. Do planned learning opportunities, programs,
courses and activities as developed and organized actually produce desired results? 2.
How can a curriculum best be improved?
Evaluation is to identify the weaknesses and strengths as well as problems encountered
in the implementation, to improve the curriculum development process. It is to determine
the effectiveness of and the returns on allocated finance.
It is a process of delineating, obtaining and providing useful information for judging
alternatives for purposes of modifying, or eliminating the curriculum.
Reasons for Curriculum Evaluation
Why is there a need to evaluate a curriculum? The curriculum processes presented by Tyler, Taba and others
at the end of the line or cycle undergo and evaluation. All of them agree that planning, designing and implementing
are less useful unless there is evaluation. Here are some of the specific reasons.
•
•
•
•
Curriculum evaluation identifies the strengths and weaknesses of an existing curriculum that will be the basis
of the intended plan, design or implementation. This is referred to as the needs assessment.
When evaluation is done in the middle of the curriculum development, it will tell if the designed or
implemented curriculum can produce or is producing the desired results. This is related to monitoring.
Based on some standards, curriculum evaluation will guide whether the results have equaled or exceeded the
standards, thus can be labelled as success. This sometimes called terminal assessment.
Curriculum evaluation provides information necessary for teachers, school managers, curriculum specialist for
policy recommendations that will enhance achieved learning outcomes. This is the basis of decision making.
In curriculum evaluation, important processes were evolved such as (a) needs assessment, (b) monitoring, (c)
terminal assessment and (d) decision making.
Curriculum Evaluation Models
Curriculum models by Ralph Tyler and Hilda Taba end with evaluation. Evaluation is a big idea that
collectively tells about the value or worth of something that was done.
How can a merit or worth of an aspect of a curriculum be determined? Curriculum specialists have proposed
an array of models which are useful for classroom teachers and practitioners. Let us look at some of these.
1. Bradley Effectiveness Model
Module prepared by: R.R. L. Fernandez, LPT, MAEd (CAR)
OSMEÑA COLLEGES
3
0
The Teacher and the School Curriculum │ Module 14. What, Why and How to Evaluate a Curriculum │Page 3 of 7
In 1985, L.H. Bradley wrote a hand book on Curriculum Leadership and Development. This book
provides indicators that can help measure the effectiveness of a developed or written curriculum. For purposes
of the classroom teachers, some of the statements were simplified.
First, you have to identify what curriculum you will evaluate. Example: Elementary Science
Curriculum, Teacher Education Curriculum, Student Teaching Curriculum, Field Study Curriculum. Then find
out if the curriculum you are evaluating answers Yes or No. Answering Yes to all the questions means, good
curriculum as described by Bradley.
Bradley’s Effectiveness Model for Curriculum Development Indicators
Indicators
Descriptive Questions
Vertical Curriculum
Does the curriculum reflect the format (i.e K to 12, OBE, Inquiry,
Continuity
etc.) that enables teachers to quickly access what is being taught in
the grade/ year levels below or above the current level?
(Example: If you are looking at Science 5, below means Science 4
and above means Science 6)
Horizontal Curriculum
Does the curriculum provide content and objectives that are common
Continuity
to all classes of the same grade level?
(Example: All English 101 for all 1st year college students)
Instruction Based on
Are all lesson plans/ syllabi/ course design derived from the
Curriculum
curriculum and strategies? Are materials used correlated with the
content, objectives and activities?
Broad Involvement
Is there evidence of involvement of the different curriculum
stakeholders in the planning, designing, and implementation and
review of the curriculum?
Long Range Planning
Is review cycle followed with the period of planning and
implementation of the curriculum?
Positive Human Relations
Did the initial thoughts about the curriculum come from teachers,
principals, curriculum leaders and other stakeholders?
Theory-Into Practice
Is there clarity of vision, mission, graduation outcomes, program
philosophy, learning outcomes in the curriculum?
Planned Change
Are there tangible evidence to show that the internal and external
publics accept the development program?
If any of the indicators is answered with a <No=, actions should be made to make it Yes.
Yes or No
2. Tylers Objectives-Centered Model
Ralph Tyler in 1950 proposed a curriculum evaluation model which until now continues to influence many
curricula assessment processes. His monograph was entitled Basic Principles in Curriculum and Instruction.
In using the Tyler’s model, the following curriculum components and processes are identified in curriculum
evaluation.
Curriculum Elements
1. Objectives/ Intended
Learning Outcomes
2. Situation or Context
3. Evaluation Instruments/
tools
4. Utilization of Tool
Evaluation Process
Action Taken:
Yes or No
1. Pre-determine intended learning outcomes or objectives
2. Identify the situation/context that gives opportunity to
develop behavior or achieve objective
3. Select, modify and construct evaluation instruments or
tools. Check its objectivity, reliability and validity.
4. Utilize the tools to obtain results
Module prepared by: R.R. L. Fernandez, LPT, MAEd (CAR)
OSMEÑA COLLEGES
3
0
The Teacher and the School Curriculum │ Module 14. What, Why and How to Evaluate a Curriculum │Page 4 of 7
5. Analysis of Results
6. Utilization of Results
5. Compare the results obtained from several instruments
before and after to determine the change.
6. Analyze the results obtained to determine strength and
weaknesses. Identify possible explanation about the
reasons for the particular pattern.
7. Use the results to make the necessary modifications
Using all the steps to evaluate the curriculum and obtaining all YES answer would mean the curriculum has
PASSED the standards. Tyler’s model of evaluating the curriculum is relatively easy to understand which many
teachers can follow.
3. Daniel Stufflebeam’s Context, Input, Process, Product Model (CIPP)
The CIPP Model of Curriculum Evaluation was produce of the Phi Delta Kappa committee chaired by Daniel
Stufflebeam. The model emphasized that the result of evaluation should provide data for decision making. There are
four stages of program operation. These include (1) Context Evaluation, (2) Input Evaluation, (3) Process Evaluation.
(4) Product Evaluation. However, any evaluator can take only any of the four stages as the focus of evaluation.
•
•
•
•
Context Evaluation – assesses needs and problems in the context for decision makers to determine the
goals and objectives of the program/ curriculum.
Input Evaluation – assesses alternative means based on the inputs for the achievement of objectives to
help decision makers to choose options for optimal means.
Process Evaluation – monitors the processes both to ensure that the means are actually being
implemented and make necessary modifications.
Product Evaluation – compares actual ends with intended ends and leads to a series of recycling
decisions.
For all the four stages, the six steps are suggested:
Stages of the CIPP Model
1. Context Evaluation
2. Input Evaluation
3. Process Evaluation
4. Product Evaluation
Steps Taken in All the Stages
Step 1: Identify the kind of decision to be made.
Step 2: Identify the kinds of data to make that decision.
Step 3: Collect the data needed.
Step 4: Establish the criteria to determine quality of data.
Step 5: Analyze data based on the criteria.
Step 6. Organize needed information needed for decision makers.
4. Stake Responsive Model.
Responsive model is oriented more directly to program activities than program intents. Evaluation focuses
more on the activities rather than intent or purposes.
Robert Stake (1975) recommends the following steps to the curriculum evaluator.
The curriculum evaluator follows the steps below.
Step 1
Meets with stakeholders to identify their perspectives and intentions regarding curriculum evaluation.
Step 2
Draws from Step 1 documents to determine the scope of the evaluation.
Step 3
Observes the curriculum closely to identify the unintended sense of implementation and any deviations
from announced intents.
Step 4
Identifies the stated real purposes of the program and the various audiences.
Module prepared by: R.R. L. Fernandez, LPT, MAEd (CAR)
OSMEÑA COLLEGES
3
0
The Teacher and the School Curriculum │ Module 14. What, Why and How to Evaluate a Curriculum │Page 5 of 7
Step 5
Step 6
Step 7
Step 8
Step 9
Identifies the problems of the curriculum evaluation at hand and identifies an evaluation design with
data or information.
Selects the means needed to collect data or information.
Implements the data collection procedure
Organizes the information into themes.
Decides with stakeholders the most appropriate formats for the report
5. Scriven Consumer Oriented Evaluation.
Michael Scriven, in 1967 introduced this evaluation among many others when education products flooded the
market. Consumers of educational products which are needed to support an implemented curriculum often use
consumer-oriented evaluation. These products are used in schools which require a purchasing decision. These products
include textbooks, modules, educational technology like software and other instructional materials. Even teachers and
schools themselves nowadays write and produce these materials for their own purposes.
Consumer-oriented evaluation uses criteria and checklist as a tool of either formative or summative evaluation
purposes. The use of criteria and checklist was proposed by Scriven for adoption by educational evaluators.
An example of an Instructional Material Review Form by Marvin Patterson of Florida State University adapted
for better understanding.
Instructional Materials Review Form
Adapted from Patterson, Marvin, FSU, USA
Preliminary Information
Title:
Author(s):
Publisher:
Copyright date:
Material evaluator:
Recommendation
___Retain for further review
___Reject
(Comments)
Use the following codes to rate the material
+ means yes or good quality
- means no or poor quality
o means all right but not of good quality
NA means not applicable
+
yes or good
Criteria
o
all right but not
so good
no or poor
NA
not applicable
1. Content covers a significant portion of the
course competencies
2. Contents are up-to-date
3. Reading level is appropriate for most
students who will use the material
4. Intended learning outcomes, competencies
are stated.
5. Formative and summative assessments are
included.
6. Activities are varied to meet the needs of
students.
Module prepared by: R.R. L. Fernandez, LPT, MAEd (CAR)
OSMEÑA COLLEGES
3
0
The Teacher and the School Curriculum │ Module 14. What, Why and How to Evaluate a Curriculum │Page 6 of 7
7. Teacher’s guide is included with
management suggestion
8. Materials are presented in logical order
9. Learning outcomes, competencies and/or
tasks
10. Degree of match between learning
activities and intended learning outcomes
11. Quality of test items and degree of match
with intended learning outcomes
12. Quality of direction on how students will
process through the materials
13. Quality of drawings, photographs, and /or
other materials.
14. Overall design of the learning activities
for individual instruction
15. Quality of management procedures for
teachers (TGs)
16. Optional (List course map competencies
covered by the instructional material)
Using the checklist for instructional material review or evaluation may help any curricularist make a decision
as to which textbook, modules, or any instructional support material will be used, revised, modified or rejected.
A Simple Way of Curriculum Evaluation Process
For a very simple and practical way of curriculum evaluation, responding to the following questions will
provide an evaluation data for curriculum decision. Just ask the following questions and any NO answer to an item
will indicate a need for a serious curriculum evaluation process.
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
Does the curriculum emphasize learning outcomes?
Does the implemented curriculum require less demands?
Can this curriculum be applied to any particular level? (Kindergarten, elementary, secondary, tertiary levels)
Can the curriculum aspects be assessed as (a) written, (b) taught, (c) supported, (d) tested, and (e) learned?
Does the curriculum include formative assessment?
Does the curriculum include summative assessment?
Does the curriculum provide quantitative methods of assessment?
Does the curriculum provide for the qualitative methods of assessment?
Can the curriculum provide the data needed for decision making?
Are the findings of evaluation available to stakeholders?
In summary, whatever models of curriculum evaluation to be used, ASCD, 1983 suggests the following steps.
Steps in Conducting Curriculum Evaluation
Steps
1. Identifying primary
audiences
2. Identifying critical issues/
problems
What to Consider
Curriculum Program Sponsors, Managers and Administrators, School
Heads, Participants (Teachers and Students) Content Specialist; other
Stakeholders
Outcomes (expected, desired, intended) Process (Implementation)
Resources (Inputs)
Module prepared by: R.R. L. Fernandez, LPT, MAEd (CAR)
OSMEÑA COLLEGES
3
0
The Teacher and the School Curriculum │ Module 14. What, Why and How to Evaluate a Curriculum │Page 7 of 7
3. Identifying data source
4.
5.
6.
7.
8.
People (teachers, students, parents, curriculum developers) Existing
documents; Available records; Evaluation Studies.
Identifying techniques for
Standardized Test, Informal tests; Samples of Students Work; Interviews;
collecting data
Participant Observations, Checklist, Anecdotal records
Identifying established
Standards previously set by agency (DepEd, CHED, Professional
standards and criteria
Organization)
Identifying techniques in
Content Analysis, Process Analysis, Statistics, Comparison, Evaluation
data analysis
Process
Preparing evaluation report Written; Oral; Progress; Final; Summary: Descriptive, Graphic, Evaluative,
and Judgmental; List of Recommendations
Preparing models of display Case studies; Test Scores Summary; Testimonies; Multimedia
representation; Product Display (exhibits); Technical Report
These steps are easy to follow. Begin thinking of how curriculum evaluators will proceed in finding out if
there is a need to modify, enhance or continue with the implementation of the curriculum. After all, the main purpose
of evaluation is to improve the existing condition, so that it would benefit the students.
ACTIVITY
(14.1) Making a Simple Rapid Curriculum Evaluation
LOOKING AHEAD
Congratulations for making it till the end of this module! If you aced the assessments, I am happy for you. If you
have not reached your desired level of competence, just keep going! Remember that an expert was once a beginner.
The next topic will be Curriculum Evaluation Through Learning Assessment. Happy learning!
REFERENCES
Bilbao, Purita P. Ed.D., Dayagbil, Filomena, Ed.D., Corpuz, Brenda B. Ph.D., (2020). The Teacher and The School
Curriculum. What, Why and How to Evaluate a Curriculum, 111-123. Manila: Lorimar Publishing Inc.
END OF MODULE ASSESEMENT
(14.2) What Can I Remember?
(14.3) Self-Reflect
Module prepared by: R.R. L. Fernandez, LPT, MAEd (CAR)
OSMEÑA COLLEGES
3
0
Download