English language assessment practices in ASEAN

advertisement
English language assessment
practices in ASEAN
Richard Watson Todd
King Mongkut’s University of Technology Thonburi
http://arts.kmutt.ac.th/crs/workshop.htm
English in ASEAN
• English as an Official
Language (EOL)
–
–
–
–
Brunei
Malaysia
Philippines
Singapore
• English as a Foreign
Language (EFL)
–
–
–
–
–
–
Cambodia
Indonesia
Laos
Myanmar
Thailand
Vietnam
English in ASEAN
• English as an Official
Language (EOL)
– High average scores on
TOEFL (e.g. Singapore:
99)
– High ratings for general
English (e.g. on EF EPI,
Malaysia is ‘High’)
– Widespread use of English
– Some English-as-L1
speakers
• English as a Foreign
Language (EFL)
– Low average scores on
TOEFL (e.g. Vietnam: 70)
– Low ratings for general
English (e.g. on EF EPI,
Indonesia is ‘Very Low’)
– Little use of English outside
major cities and academic
and international business
environments
English and education
• How do the different roles and different
general proficiency levels of English in
EOL and EFL countries affect English
language education?
– Observe classrooms
– Examine policies
– Investigate assessment practices (reflective of
educational philosophies)
Assessment in EOL countries
• Case 1: Singapore
– Test-centric system
– Promoting meritocracy and social mobility?
Assessment in EOL countries
• Case 1: Singapore
– High-stakes tests using variety of item types
– E.g. reading comprehension measured
through short-answer questions and summary
writing
Assessment in EOL countries
• Case 1: Singapore
– Increase in open-ended assessment
– Introduction of holistic assessment
– “The ongoing gathering of information on
different facets of a child from various
sources, with the aim of providing quantitative
and qualitative feedback to support and guide
the child’s development”
– E.g. drama, role-plays, show-and-tell activities
– Teacher, self- and peer- assessment
Assessment in EOL countries
• Case 2: Malaysia
– Similar to Singapore: test-centric, variety of
item types
Assessment in EFL countries
• Case 1: Thailand
– National Education Act
– “Education institutions shall assess learners’
performance through observation of their
development; personal conduct; learning
behaviour; participation in activities and
results of the tests accompanying the
teaching-learning process commensurate with
the different levels and types of education.”
Assessment in EFL countries
• Case 1: Thailand
– Influence of university entrance exam
• Secondary school teachers rate the influence of
the university entrance exam as their most serious
problem
• School exams are based on the university
entrance exam (e.g. 2006)
• Only multiple-choice items
• Multiple-choice accounts for about half of
secondary school scores
Assessment in EFL countries
• Case 1: Thailand
– The effects of multiple-choice testing
•
•
•
•
•
Practicality
Reliability
Content validity
Predictive validity
Washback
Assessment in EFL countries
• Case 1: Thailand: Washback effects of
multiple-choice testing
– Restricting what to learn
– Less higher-order thinking
– Promoting rote learning
– Ignoring productive skills
Assessment in EFL countries
• Cases 2 and 3: Indonesia and Vietnam
– Similar test-centric education systems
– Similar dominance of multiple-choice testing
– Single major exception is Vietnamese B-level
exam
Comparing assessment in EOL and
EFL countries
• Nearly all ASEAN countries have testcentric education systems
• Regular national-level exams with major
impact on students’ future
• EOL countries: mix of item types
• EFL countries: heavy reliance on multiplechoice testing
Comparing assessment in EOL and
EFL countries: Testing speaking
•
Malaysia
– Individual presentation
– Situation: Your class has organised a
forum to discuss the topic ‘Stress
among teenagers’. Each member of
the team is to focus on one aspect of
life which is stressful.
– Task: You are to focus on the stress
arising from relationships with your
peers. You may want to talk about peer
pressure and girl-boy relationships.
•
Thailand
– Situation: A secretary is talking to a
caller.
– Caller: This is Jim Smith. Can I talk to
Mr. Johnson please?
– Secretary: __A__
– Caller: __B__
– Secretary: I’ll tell him as soon as I see
him.
– A.1. Pardon me. I don’t know him.
–
2. Can you talk to him now?
–
3. I’m afraid he’s just gone out.
–
4. Sorry. He doesn’t want to speak to
you.
– B.1. Could I hold on?
–
2. Can you call me later?
–
3. Can you ask him to return my call?
–
4. Could I return his call later?
Comparing assessment in EOL and
EFL countries: Testing writing
• Malaysia
– Read the following
passage carefully. Based
on the information given,
summarise the passage
about dangers in the
home in about 100 words
• Thailand
– In most countries around the world,
__A__ to school __B__.
– A.1. children having to go
– 2. children must go
– 3. every child has been
– 4. every child must have been
– B.1. when they reach a certain age
– 2. as they are growing old enough
– 3. since they reached a certain age
– 4. if they are too old to learn
Comparing assessment in EOL and
EFL countries
• EOL countries
– Prioritise validity over
reliability
– Focus on language
use
– English is a living
language to be used in
the future
• EFL countries
– Prioritise reliability
over validity
– Focus on language
knowledge
– English is an
academic subject to
be studied
English in ASEAN
• With the ASEAN economic community coming
into effect in 2015 and with English the de facto
language of ASEAN, EOL countries will have an
advantage over EFL countries
• Need to change view of English in EFL countries
from an academic subject to a living language
• Changing assessment practices (to include
more open-ended items) may help to change
view of English
• EOL countries can help EFL countries by acting
as model and mentor
Download