What Would it Mean to Be “Internationally Competitive?”

advertisement
Assessment for Learning around the World:
What Would it Mean to Be “Internationally Competitive?”
Linda Darling-Hammond & Laura McCloskey
Stanford University
Since the release of A Nation at Risk twenty five years ago, a set of wide-ranging
reforms has been launched with the intention of better preparing all children for the
higher educational demands of life and work in the 21st century. All 50 states have
developed standards for learning and tests to evaluate student progress. The emphasis on
using test-based accountability to raise achievement was reinforced by the requirements
of the No Child Left Behind Act, passed in 2001, yet the United States has fallen further
behind on international assessments of student learning since the law was passed.
On the Program in International Student Assessment (PISA) tests in 2006, the
U.S. ranked 35th among the top 40 countries in mathematics and 31st in science, a decline
in both raw scores and rankings from 3 years earlier.1 (Reading scores were not reported,
because of editing problems with the U.S. test.) Furthermore, in each disciplinary area
tested, U.S. students scored lowest on the problem-solving items. The U.S. also had a
much wider achievement gap than the most highly-ranked jurisdictions, such as Finland,
Canada, Australia, New Zealand, Hong Kong, Korea, and Japan.
Current policy discussions in Washington often refer to these rankings in
emphasizing the need to create more “internationally competitive” standards by
benchmarking expectations in the U.S. to those in high-performing nations abroad.
Typically, this means looking at the topics that are taught at various grade levels in
various countries. These analyses reveal that higher-achieving countries teach fewer
1
topics more deeply each year; focus more on reasoning skills and applications of
knowledge, rather than mere coverage; and have a more thoughtful sequence of
expectations based on developmental learning progressions within and across domains.2
It is also important that we examine how these topics are taught and assessed – so
that we understand how other countries’ education systems shape what students actually
learn and can do. European and Asian nations that have steeply improved student
learning have focused explicitly on creating curriculum guidance and assessments that
focus on the so-called 21st century skills: the abilities to find and organize information to
solve problems, frame and conduct investigations, analyze and synthesize data, apply
learning to new situations, self-monitor and improve one’s own learning and
performance, communicate well in multiple forms, work in teams, and learn
independently.
Curriculum differences are reinforced by sharp divergence between the forms of
testing used in the United States and those used in higher-achieving countries. Whereas
U.S. tests rely primarily on multiple choice items that evaluate recall and recognition of
discrete facts, most high-achieving countries rely largely on open-ended items that
require students to analyze, apply knowledge, and write extensively. Furthermore, their
growing emphasis on project-based, inquiry-oriented learning has led to an increasing
prominence for school-based tasks, which include research projects, science
investigations, development of products, and reports or presentations about these efforts.
These influence the day to day work of teaching and learning, focusing it on the
development of higher order skills and use of knowledge to solve problems.
2
Smaller countries often have a system of national standards which are sometimes
– although not always – accompanied by national tests. Top-ranking Finland, for
example, uses local assessments to evaluate its national standards and manages a
voluntary national assessment at only one grade level. Larger nations -- like Canada,
Australia, and China – have state- or provincial-level standards, and their assessment
systems are typically a blend of state and local assessments. Managing assessment at the
state level where it remains relatively close to the schools turns out to be an important
way of enabling strong teacher participation and ensuring high-quality local assessments
that can be moderated to ensure consistency in scoring.
In many cases, these local assessments are designed to complement centralized
“on-demand” assessments, comprising up to 50% of the final examination score. The
tasks are mapped to the standards or syllabus for the subject and are selected because
they represent critical skills, topics, and concepts. They are often outlined in the
curriculum guide, but they are generally designed, administered and scored locally, based
on common specifications and evaluation criteria. Whether locally or centrally
developed, decisions about when to undertake these tasks are made at the classroom
level, so they are used when appropriate for students’ learning process and teachers can
get information and provide feedback when it is needed, something that traditional
standardized tests cannot do. In addition, as teachers use and evaluate these tasks, they
become more knowledgeable about both the standards and how to teach to them and
about what their students’ learning needs are. Thus, the process improves the quality of
teaching and learning.
3
Like the behind-the-wheel test given for all new drivers in the United States, these
performance assessments evaluate what students can actually do, not just what they
know. The road test not only reveals some important things about potential drivers’
skills, it also helps improve those skills as potential drivers practice to get better. In the
same way, performance assessments set a standard toward which everyone must work.
The task and the standards are not secret: they are transparent, so that people know what
skills they need to develop and how they will need to be demonstrated.
Finally, the examination systems in these countries are not used to rank or punish
schools, nor are they used to deny diplomas to students. Following the problems that
resulted from the Thatcher government’s use of test-based school rankings, which caused
a narrowing of the curriculum and widespread exclusions of students from school,3
several countries even enacted legislation precluding the use of test results for school
rankings. High school examinations are used to provide information for higher
education, vocational training, and employment, and students often choose the areas in
which they will be examined, as a means of providing evidence of their qualifications.
Because the systems are focused on using information for curriculum improvement rather
than sanctions, governments can set higher standards and work with schools to achieve
them, rather than having to devise tests and set cut-scores at a minimal level to avoid
dysfunctional side-effects.
Many states in the U.S. – including Connecticut, Kentucky, Maine, Nebraska,
New Hampshire, New Jersey, New York, Rhode Island, Vermont, and Wyoming – have
developed and used state and local performance assessments as part of their testing
systems. Indeed, the National Science Foundation provided millions of dollars for states
4
to develop such hands-on science and math assessments as part of its Systemic Initiative
in the 1990s, and prototypes exist all over the country. Studies have found that the use of
such assessments has improved teaching quality and increased student achievement,
especially in areas requiring complex reasoning and problem solving.4 However, these
assessments have been difficult to sustain, especially in recent years under the annual
testing requirements of No Child Left Behind, and there is little widespread
understanding in the policy community about how systems of assessment for learning
might be constructed and managed at scale.
Here we describe the assessment systems of several high-achieving education
systems: two of the highest-achieving Scandinavian nations – Finland and Sweden – and
a group of English-speaking jurisdictions that have some shared approaches to
assessment, as well as some interesting variations: Australia, Hong Kong, and the United
Kingdom (whose approaches, we note, are similar to those in Singapore, New Zealand
and Canada, though space does not allow us to treat them here). We discuss in particular
how assessments are linked to curriculum and integrated into the instructional process, so
that they can shape and improve learning for students and teachers alike.
Finland and Sweden
Finland has been a poster child for school improvement since it rapidly climbed to
the top of the international rankings after it emerged from the Soviet Union’s shadow. It
now ranks first among all the OECD nations on the PISA assessments in mathematics,
science, and reading. Leaders in Finland attribute these gains to their intensive
investments in teacher education – all teachers receive three years of high-quality
graduate level preparation completely at state expense – plus major overhaul of the
5
curriculum and assessment system. Most teachers now hold master’s degrees in both
their content and in education, and their preparation is aimed at learning to teach diverse
learners – including special needs students – for deep understanding, with a strong focus
on how to use formative performance assessments in the service of student learning.5
Sweden also invests heavily in graduate level teacher education for all teachers, and relies
on a highly trained teaching force to implement its curriculum and assessment system.
Over the past 40 years, Both Finland and Sweden have shifted from highly
centralized systems emphasizing external testing to more localized systems using
multiple forms of assessments. Around 1970, Sweden abolished its nationally
administered exit exam that ranked Upper Secondary students and placed them in higher
education programs.6 Finland followed suit, overhauling its curriculum system in two
stages between the 1970s and 1990s, and both nations eliminated the practice of tracking
students into different streams by their test scores, offering a common core curriculum to
all students. These changes were intended to equalize educational outcomes and provide
more open-access to higher education.7
Although it may seem counterintuitive to those accustomed to external testing as a
means of accountability, Finland’s use of school-based, student-centered, open-ended
tasks embedded in the curriculum is touted by its leaders as an important reason for the
nation’s extraordinary success on the international exams.8 Policymakers decided that if
they invested in very skillful teachers, they could allow local schools more autonomy to
make decisions about what and how to teach — a reaction against the highly centralized
system they sought to overhaul. The current national core curriculum is a much leaner
document, reduced from hundreds of pages of highly specific prescriptions to
6
descriptions of a small number of skills and core concepts each year. (About 10 pages
describe the full set of math standards for all grades, for example.) This guides teachers
in collectively developing local curriculum and assessments that encourage students to be
active learners who can find, analyze, and use information to solve problems in novel
situations.
There are no external standardized tests used to rank students or schools. Schoollevel samples of student performance are evaluated periodically by the Finnish education
authorities, generally at the end of the 2nd and 9th grades, to inform curriculum decisions
and school investments. All other assessments are designed and managed locally. The
national core curriculum provides teachers with recommended assessment criteria for
specific grades in each subject and in the overall final assessment of student progress
each year.9 Schools then use those guidelines to craft a more detailed set of learning
outcomes and curriculum at each school, along with approaches to assessing the
curriculum benchmarks.
The national standards emphasize that the main purpose of assessing students is to
guide and encourage students’ own reflection and self-assessment. Consequently, ongoing feedback from the teacher is very important. Teachers give students formative and
summative reports both through verbal feedback and on a numerical scale reflecting the
students’ level of performance in relation to the objectives of the curriculum. The
teachers’ reports must be based on multiple forms of assessment, not only exams.
Assessment is used in Finland to cultivate students’ active learning skills by
asking open-ended questions and helping students address these problems. In a Finnish
classroom, it is rare to see a teacher standing at the front of a classroom lecturing students
7
for fifty minutes. Instead, students are generally engaged in independent or group
projects, often choosing the tasks they will work on and setting their own targets with
teachers in specific subject areas, who serve as coaches.10 The cultivation of
independence and active learning encourages students to develop analytical thinking,
problem solving, and meta-cognitive skills.
Most Finnish students take a voluntary matriculation exam which asks students to
apply problem solving, analytic and writing skills prior to attending university.11
Teachers use official guidelines to grade the matriculation exams locally, and samples of
the grades are re-examined by professional raters hired by the Matriculation Exam
Board.12
Similarly, Sweden implements its nationally outlined and locally implemented
curriculum with multiple assessments managed at the school level. A national
curriculum and subject matter syllabi are adapted by each school to local conditions.13
Teachers design and score school-based assessments based on the objectives outlined in
each syllabus, and they assign grades based on syllabus goals and national assessment
criteria. They are expected to conduct meetings during each school term with every
student and parent(s) to discuss the student’s learning and social development, and they
use a number of diagnostic materials to assess students’ learning in Swedish, Swedish as
a Second Language, English, and Mathematics in relation to the goals set by the syllabi.14
Schools offer nationally approved examinations in year 9 and in the Upper
Secondary years in these same subjects.15 Teachers work with university faculty to help
design the tasks and questions, and they weight information from these exams, their own
assessments, and classroom work to assign a grade reflecting how well students have met
8
the objectives of the syllabus.16 Regional education officials and schools provide time for
teachers to calibrate their grading practices to minimize variation across the schools and
across the region.17 Towards the end of their Upper Secondary schooling, Swedish
students receive a final grade or “learning certificate” in each area that acts as a
compilation of all of these sources of evidence, including projects completed by the
student as well as grades awarded for courses.
Swedish assessments use open-ended, authentic tasks asking students to
demonstrate content knowledge and analytic skills in grappling with real world problems.
This sample question from a grade 5 exam asks students (aged 11-12) to think through a
problem that they might have in their own lives:
Carl bikes home from school at four o’clock. It takes about a quarter of an
hour. In the evening he’s going back to school because the class is having
a party. The party starts at 6 o’clock. Before the class party starts, Carl has
to eat dinner. When he comes home, his grandmother calls, who is also his
neighbor. She wants him to bring in her post before he bikes over to the
class party. She also wants him to take her dog for a walk, then to come in
and have a chat. What does Carl have time to do before the party begins?
Write and describe below how you have reasoned.18
Upper Secondary exams also frame challenging questions in real world terms,
with the expectation that students will show their work and reasoning. For example:
In 1976 Lena had a monthly salary of 6,000 kr. By 1984 her salary had risen to
9,000 kr. In current prices, her salary had risen by 50%. How large was the
percent change in fixed prices? In 1976 the Consumer Price Index (CPI) was 382;
in 1984 it was 818.19
Students who experience a steady diet of such challenging tasks requiring
thoughtful reasoning and the ability to communicate their thinking are well-prepared for
the kinds of problem-solving required in the real world.
Australia, the United Kingdom, and Hong Kong
9
Whereas smaller countries like Finland and Sweden have national curriculum
guidance, in much-larger Australia, each state has its own curriculum and assessment
program. At the national level in Australia, the only assessment is a periodic matrix
sample-based assessment, rather like the National Assessment of Educational Progress in
the U.S. In most states, local school-based performance assessment is a well-developed
part of the system. In some cases, states have also developed centralized assessment with
performance components. The two highest-achieving states, Queensland and A.C.T.,
have the most highly developed systems of local performance assessment. Victoria,
which uses a blended model of centralized and school-based assessment, also generally
performs well on national and international tests.
In Queensland, there has been no assessment system external to schools for 40
years. Until the early 1970s, a traditional “post-colonial” examination system controlled
the curriculum. When it was eliminated, about the same time as in Finland and Sweden,
all assessments became school-based. School-based assessments are developed,
administered and scored by teachers in relation to the national curriculum guidelines and
state syllabi (also developed by teachers), and are moderated by panels that include
teachers from other schools as well as professors from the university system.
The syllabi spell out a small number of key concepts and/or skills to be learned in
each course, and what kinds of projects or activities (including minimum assessment
requirements) students should be engaged in. Each school designs its program to fit the
needs and experiences of its own students, choosing specific texts and topics with this in
mind. At the end of the year, teachers collect a portfolio of each student’s work, which
includes the specific assessment tasks, and grade it on a 5-point grading scale. To
10
calibrate these grades, teachers put together a selection of portfolios from each grade
level – one from each of the 5 score levels, plus borderline cases – and send these to a
regional panel for moderation. A panel of five teachers re-scores the portfolios and
confers about whether the grade is warranted, making a judgment on the spread. A state
panel also looks at portfolios across schools. Based on these moderation processes, the
school is given instructions to adjust grades so that they are comparable to others.
Queensland’s “New Basics” and “Rich Tasks” approach to assessment, which
began in 2003, also offers extended, multi-disciplinary tasks that are developed centrally
and used locally when teachers determine the time is right and they can be integrated
with locally-oriented curriculum. They are "specific activities that students undertake that
have real-world value and use, and through which students are able to display their grasp
and use of important ideas and skills.”20 Rich Tasks are defined as:
…a culminating performance or demonstration or product that is purposeful and
models a life role. It presents substantive, real problems to solve and engages
learners in forms of pragmatic social action that have real value in the world. The
problems require identification, analysis and resolution, and require students to
analyze, theorize and engage intellectually with the world. As well as having this
connectedness to the world beyond the classroom, the tasks are also rich in their
application: they represent an educational outcome of demonstrable and
substantial intellectual and educational value. And, to be truly rich, a task must
be transdisciplinary. Transdisciplinary learnings draw upon practices and skills
across disciplines while retaining the integrity of each individual discipline.
The Science and Ethics task summarized below illustrates these traits.
Science and Ethics Confer
Students must identify, explore and make judgments on a biotechnological
process to which there are ethical dimensions. Students identify scientific
techniques used as well as significant recent contributions to the field. They will
also research frameworks of ethical principles for coming to terms with an
identified ethical issue or question. Using this information they prepare preconference materials for an international conference that will feature selected
speakers who are leading lights in their respective fields.
11
In order to do this students must choose and explore an area of biotechnology
where there are ethical issues under consideration and undertake laboratory
activities that help them understand some of the laboratory practices. This
enables them to:
A) Provide a written explanation of the fundamental technological differences in
some of the techniques used, or of potential use, in this area (included in the
pre-conference package for delegates who are not necessarily experts in this
area).
B) Consider the range of ethical issues raised in regard to this area’s purposes
and actions, and scientific techniques and principles and present a deep
analysis of an ethical issue about which there is a debate in terms of an ethical
framework.
C) Select six real-life people who have made relevant contributions to this area
and write a 150-200 word précis about each one indicating his/her
contribution, as well as a letter of invitation to one of them.
This assessment measures research and analytic skills; laboratory practices;
understanding biological and chemical structures and systems, nomenclature and
notations; organizing, arranging, sifting through, and making sense of ideas;
communicating using formal correspondence; précis writing with a purpose;
understanding ethical issues and principles; time management, and much more.
A bank of these tasks now exists across grade levels, along with scoring rubrics,
and moderation processes by which the quality of the tasks, the student work, and the
scoring can be evaluated. Research indicates that the system has offered a successful tool
for school improvement. Studies have found stronger student engagement in learning in
schools using the Rich Tasks. On traditional tests, New Basics students scored about the
same as students in the traditional program, but they performed notably better on
assessments designed to gauge higher order thinking. The Singapore government has
employed the developers of the Queensland system to focus the new school improvement
strategies upon performance assessments. High-scoring Hong Kong has also begun a
process of expanding its already-ambitious school-based assessment system in
collaboration with Queensland assessment developers.
12
In Victoria, a mixed system of centralized and decentralized assessment
combines these kinds of school-based assessment practices with a set of state exams.
Guided by the Victoria Essential Learning Standards, the AIM assessment program
provides an indication of how well the literacy and numeracy skills of students are
developing at years 3, 5, 7, and 9. The results provide information used to plan new
programs and a useful source of feedback and guidance to students, parents and teachers.
Assessment tasks include extended open-ended writing tasks, as well as some multiplechoice responses.
The Victoria Curriculum and Assessment Authority establishes courses in a wide
range of studies, develops the external examinations and ensures the quality of the
school-assessed component of the VCE. VCAA conceptualizes assessment as “of,”
“for,” and “as” learning. Teachers are involved in developing assessments, along with
university faculty in the subject area, and all prior year assessments are public, in an
attempt to make the standards and means of measuring them as transparent as possible.
Before the external examinations are given to students, teachers and academics sit and
take the exams themselves, as if they were students. The external subject-specific
examinations, given in grades 11 and 12, include written, oral, and performance elements
scored by classroom teachers.
In addition, at least 50% of the total examination score is comprised of classroombased tasks that are given throughout the school year. These required assignments and
assessments – lab experiments and investigations on central topics as well as research
papers and presentations – are designed by teachers in response to syllabus expectations.
These required classroom tasks ensure that students are getting the kind of learning
13
opportunities which prepare them for the assessments they will later take, that they are
getting feedback they need to improve, and that they will be prepared to succeed not only
on these very challenging tests but in college and in life, where they will have to apply
knowledge in these ways.
An example of how this blended assessment system works can be seen in the
interplay between an item from the Victoria, Australia biology test, and the classroombased tasks also evaluated for the examination score. The open-ended item describes a
particular virus and how it operates, then asks students to design a drug to kill the virus
and explain how the drug operates (the written answer is to include diagrams), and then
to design and describe an experiment to test the drug. In preparation for this on-demand
test, students taking Biology will have been assessed on six pieces of work during the
school year covering specific outcomes in the syllabus. For example, they will have
conducted “practical tasks” like using a microscope to study plant and animal cells by
preparing slides of cells, staining them, and comparing them in a variety of ways,
resulting in a written product with visual elements. They also will have completed and
presented a research report on characteristics of pathogenic organisms and mechanisms
by which organisms can defend against disease. These tasks link directly to the
expectations that students will encounter on the external examination, but go well beyond
what that examination can measure in terms of how students can apply their knowledge.
The tasks are graded according to criteria set out in the syllabus. The quality of
the tasks assigned by teachers, the work done by students, and the appropriateness of the
grades and feedback given to students are audited through an inspection system, and
schools are given feedback on all of these elements. In addition, the VCAA uses
14
statistical moderation to ensure that the same assessment standards are applied to students
across schools. The external exams are used as the basis for this moderation, which
adjusts the level and spread of each school’s assessments of its students to match the
level and spread of the same students’ scores on the common external test score. The
result is a rich curriculum for students with extensive teacher participation and a
comparable means for examining student learning.
United Kingdom. As in Victoria, assessments in Great Britain use a combination
of external and school-based tasks based on the national curriculum and course syllabi.
Throughout the school years, classroom-based tasks scored by teachers are used to
evaluate student achievement of curriculum goals. A mandatory set of assessments at
year 9 (age 14) includes both teacher-created and administered assessments and, for
students who have reached a certain level of achievement, national exams and tasks.21
While not mandatory, most students take a set of exams at year 11 (age 16) to
achieve their General Certificate of Secondary Education (GCSE). Students may take as
many single-subject or combined-subject assessments as they like, and they choose which
ones they will take based on their interests and areas of expertise. Most GCSE items are
essay questions. The math exam includes questions that ask students to show their
reasoning behind their answers and foreign language exams require oral presentations.
About 25 to 30% of the final examination score is based on class work coursework and
assessments developed and graded by teachers. In many subjects, students also complete
a project worked on in class that is specified in the syllabus.
Wales and Northern Ireland allow students to participate in the GCSE exams at
the high school level on a voluntary basis, but both broke from the more centralized
15
system introduced in England under the Thatcher administration (later modified during
the Blair administration as described above) and opted to abolish national exams.22 Much
like Finland and Sweden, during the primary years, Welsh schools have a national school
curriculum supported by teacher-created, administered, and scored assessments.23
Northern Ireland, which has recently climbed significantly in international rankings,
especially in literacy, is implementing an approach called “Assessment for Learning.”
This approach emphasizes locally developed, administered and scored assessments and
focuses, as in Finland, on students and teachers setting goals and success criteria together,
teachers asking open-ended questions and students explaining their reasoning, teachers
providing feedback during formative assessment sessions, and students engaging in selfassessment and reflection on their learning. Optional externally graded assessments also
focus on how students reason, think, and problem solve.24
Hong Kong. In collaboration with educators from Australia, the UK, and other
nations, Hong Kong’s assessment system is evolving from a highly centralized
examination system to one that increasingly emphasizes school-based, formative
assessments that expect students to analyze issues and solve problems. The government
has decided gradually to replace the Hong Kong Certificate of Education Examinations,
which most students sit for at the end of their 5-year secondary education, with a new
Hong Kong Diploma of Secondary Education that will feature school-based assessments.
In addition, the Hong Kong Territory-wide System Assessment (TSA), which provides
assesses lower-grade student performance, in Chinese, English, and mathematics, is
developing an on-line bank of assessment tasks to enable schools to assess their students
and receive feedback on their performance on their own timeframes. The formal TSA
16
assessments, which include both written and oral components, occur at Primary Grades 3
and 6 and Secondary Grade 3 (the equivalent of grade 9 in the U.S.).
As outlined in Hong Kong’s “Learning to learn” reform plan, the goal of the
reforms is to shape curriculum and instruction around critical thinking, problem-solving,
self-management skills, and collaboration. A particular concern is to develop metacognitive thinking skills, so students may identify their strengths and areas needing
additional work.25 By 2007, Curriculum and Assessment Guides were published for four
core subjects and 20 elective subjects, and assessments in the first two subjects – Chinese
Language and English Language – were revised. These became criterion-referenced,
performance-based assessments featuring not only the kinds of essays previously used on
the exams, but also new speaking and listening components, the composition of written
papers testing integrated skills, and a school-based component that factors into the
examination score. Although the existing assessments already use open-ended responses
(see the example of a Physics examination in Appendix A), the proportion of such
responses will increase in the revised assessments.
Like the existing assessments, the new assessments are developed by teachers
with the participation of higher education faculty, and they are scored by teachers who
are trained as assessors. Tests are allocated randomly to scorers, and essay responses are
typically rated by two independent scorers.26 Results of the new school-based
assessments are statistically moderated to ensure comparability within the province. The
assessments are internationally benchmarked, through the evaluation of sample student
papers, to peg the results to those in other countries. Many of the new assessments are
17
also to be scored on-line, which the Examinations Authority notes is now the common
practice in 20 of China’s mainland provinces, as well as in the UK.
To guide the process of assessment reform, the Education Bureau has
implemented a School Development and Accountability Framework which emphasizes
school self-evaluation, plus external peer evaluation, using a set of performance
indicators. The Bureau promotes the use of multiple forms of assessment in schools
including projects, portfolios, observations, and examinations, and looks for the variety
of assessments in the performance indicators used for school evaluation.27 For example,
the performance indicators ask: “Is the school able to adopt varied modes of assessment
and effectively assess students’ performance in respect of knowledge, skills, and
attitude?” and “How does the school make use of curriculum evaluation data to inform
curriculum planning?”28 This practice of examining school practices and the quality of
assessments through an inspection or peer review process is also used in Australia and
Great Britain to improve teaching by using standards as a tool for sharing knowledge and
reflecting on practice.
Conclusion
The design and use of standards, curricula, and assessments in high-achieving
nations around the world is significantly different from the way tests are designed and
used in the United States. Most testing in the U.S. emphasizes externally-developed,
machine-scored instruments that enter and leave the school in secret, offering little
opportunity for teacher engagement with the evaluation of standards and little
opportunity for student production of analyses, solutions, or ideas.
18
By contrast, assessment abroad involves teachers in developing and scoring
intellectually challenging performance tasks that are embedded in and guide instruction,
providing grist for feedback, student self-evaluation, and learning. The integration of
curriculum, assessment, and instruction in a well-developed teaching and learning system
creates the foundation for much more equitable and productive outcomes. Teachers and
students come to understand the standards deeply, and they work continuously on
activities and projects that develop skills as they are applied in the real world, as well as
on the examinations themselves.
The tasks common in these assessment systems reflect what people increasingly
need to know to succeed in today’s knowledge-based economy: the abilities to find,
analyze, and use information to solve real problems; to write and speak clearly and
persuasively; to defend ideas; and to design and manage projects. While the U.S.
accountability efforts have focused attention on achieving higher test scores, they has not
yet developed the kind of teaching and learning systems that could develop widespread
capacity for significantly greater learning. A new vision for assessment will be critical
to this goal – and to the possibilities of success for our children in today’s and
tomorrow’s world.
19
Hong Kong High School Physics Test
20
1
Institute for Education Sciences (2007). Highlights from PISA 2006: Performance of U.S. 15-year-old students in
science and mathematics literacy in an international context. Washington, DC: U.S. Department of Education.
Retrieved on 4/1/08 from http://nces.ed.gov/surveys/pisa/index.asp.
2
See for example, W.H. Schmidt, H. C. Wang, and C.McKnight (2005). Curriculum coherence: An examination of
US mathematics and science content standards from an international perspective, Journal of Curriculum Studes, 37
(5), 525-559; G.A. Valverde & W. H. Schmidt (2000). Greater expectations: Learning from other nations in the
quest for ‘world-class standards’ in US chool mathematics and science, Journal of Curriculum Studies, 32 (5): 651687; P. Fensham (1994). Progression in school science curriculum: A rational prospect or a chimera? Research in
Science Education, 24 (1), 76-82.
3
Rustique-Forrester, E. (2005). Accountability and the pressures to exclude: A cautionary tale from England.
Education Policy Analysis Archives, http://epaa.edu/epaa/v13n26/
21
4
For a summary see L. Darling-Hammond and E. Rustique-Forrester (2005). The Consequences of Student Testing
for Teaching and Teacher Quality. In Joan Herman and Edward Haertel (eds.) The Uses and Misuses of Data in
Accountability Testing, pp. 289-319. Malden, MA: Blackwell Publishing.
5
R. Laukkanen (2008). Finnish strategy for high-level education for all. In N. C. Soguel and P. Jaccard (eds.).
Governance and Performance of Education Systems. 305–324. Springer, at p. 319. See also F. Buchberger & I.
Buchberger, Problem solving capacity of a teacher education system as a condition of success? An analysis of the
“Finnish case,” In F. Buchberger and S. Berghammer (eds.): Education Policy Analysis in a Comparative
Perspective, pp. 222-237. Linz: Trauner.
6
European Commission. (2006/2007). “Eurybase, The Information Database on Education Systems in Europe, The
Education System in Sweden.”
7
M.A. Eckstein & H.J. Noah. (1993). Secondary School Examinations: International Perspectives on Policies and
Practice. New Haven: Yale University Press, p. 84.
8
Finnish National Board of Education. (November 12th, 2007). “Background for Finnish PISA Success.” Retrieved
on September 8th, 2008 from http://www.oph.fi/english/SubPage.asp?path=447,65535,77331; Lavonen, J. (2008).
“Reasons behind Finnish Students’ Success in the PISA Scientific Literacy Assessment.” University of Helsinki,
Finland. Retrieved on September 8th, 2008 from
http://www.oph.fi/info/finlandinpisastudies/conference2008/science_results_and_reasons.pdf.
9
Finnish National Board of Education. (June 10th, 2008). “Basic Education.” Retrieved on September 11th, 2008
from http://www.oph.fi/english/page.asp?path=447,4699,4847.
10
Korpela, Salla. (December 2004). “The Finnish school – a source of skills and well-being: A day at Stromberg
Lower Comprehensive School.” Retrieved on September 11th, 2008 from
http://virtual.finland.fi/netcomm/news/showarticle.asp?intNWSAID=30625
11
The Finnish Matriculation Examination. (2008). Retrieved on September 8th, 2008 from
http://www.ylioppilastutkinto.fi/en/index.html
12
Kaftandjieva, F. & Takala, S. (2002). “Relating the Finnish Matriculation Examination English Test Results to the
CEF Scales.”
13
Swedish National Agency for Education. (2005). “The Swedish School System: Compulsory School.” Retrieved
on May 31st, 2008 from http://www.skolverket.se/sb/d/354/a/959
14
Eckstein and Noah, 1993, p. 83-84; Qualifications and Curriculum Authority (2008). “Sweden: Assessment
arrangements.” Retrieved on September 11th, 2008 from http://www.inca.org.uk/690.html. O’Donnell (December,
2004). International Review of Curriculum and Assessment Frameworks. Comparative tables and factual summaries
– 2004. Qualifications and Curriculum Authority and National Foundation for Educational Research, p. 23.
Retrieved on 9/11/08 from http://www.inca.org.uk/pdf/comparative.pdf.
15
Swedish National Agency for Education (2005).
16
Eckstein and Noah, 1993; O’Donnell, 2004).
17
Eckstein and Noah, 1993, p. 230.
18
Petterson, A. (2008). The National Tests and National Assessment in Sweden. Stockholm, Sweden. Stockholm
Institute for Education. PRIM gruppen. Retrieved on May 31st, 2008 from
http://www.prim.su.se/artiklar/pdf/Sw_test_ICME.pdf
19
Eckstein & Noah, 1993, pp. 270-272.
20
Queensland Government (2001). “New Basics: The Why, What, How and When of Rich Tasks.” Retrieved on
September 12th, 2008 from http://education.qld.gov.au/corporate/newbasics/pdfs/richtasksbklet.pdf
21
Qualifications and Curriculum Authority. (2008). “England: Assessment arrangements.” Retrieved on May 27th,
2008 from http://www.inca.org.uk/1315.
http://education.qld.gov.au/corporate/newbasics/html/richtasks/richtasks.html
22
Archer, J. (December 19th, 2006). “Wales Eliminates National Exams for Many Students.” Education Week.
Retrieved on 9/11/08 from http://www.edweek.org/ew/articles/2006/12/20/16wales.h26.html?qs=Wales
23
Welsh Assembly Government. (2008). “Primary (3-11).” Retrieved on September 12th, 2008 from
http://old.accac.org.uk/eng/content.php?cID=5; Welsh Assembly Government. (2008b). “Secondary (11-16).”
Retrieved on September 12th, 2008 from http://old.accac.org.uk/eng/content.php?cID=6
24
Council for the Curriculum Examinations and Assessment. (2008). “Curriculum, Key Stage 3, Post-Primary
Assessment.” Retrieved on September 12th, 2008 from http://www.ccea.org.uk/;
Council for the Curriculum Examinations and Assessment. (2008). “Qualifications.” Retrieved on September 12th,
2008 from http://www.ccea.org.uk/.
22
25
Chan, J.K., K.J. Kennedy, F.W. Yu, P. Fok. (2008). “Assessment Policy in Hong Kong: Implementation Issues for
New Forms of Assessment.” The Hong Kong Institute of Education. Retrieved on September 12th, 2008 from
http://www.iaea.info/papers.aspx?id=68
26
Dowling, M. (undated). Examining the Exams. Retrieved on Sept. 14, 2008 from
http://www.hkeaa.edu.hk/files/pdf/markdowling_e.pdf.
27
Chan, et al., 2008; Quality Assurance Division of the Education Bureau, 2008).
28
Quality Assurance Division of the Education Bureau. (2008). “Performance Indicators for Hong Kong Schools,
2008 with Evidence of Performance.” Retrieved on September 12th, 2008 from
http://www.edb.gov.hk/FileManager/EN/Content_6456/pi2008%20eng%205_5.pdf
23
Download