English 418 Second Language Acquisition Session Twenty Five

advertisement
English 418
Second Language Acquisition
Session Twenty Five Notes
Goals/Objectives:
1) To gain an understanding of the Purposes of language testing
2) To gain an understanding of which directions (back, right now, into the future) a test can look
3) To gain an understanding of the Methodologies of language tests
Questions/Main Ideas (Please Notes:
write these down as you think
 Testing/Assessment
of them)
 Purposes of testing in Second Language Acquisition
 Aptitude: Intended to predict future language learning success
 Is concerned with predicting future achievement, not in language for any specific purpose,
but in language for its own sake
 Testing/Assessment
 Design is problematic since there is no body of skill or knowledge on which to draw
 Typically, aptitude tests draw on such abilities as first-language verbal knowledge, ability
to codify unfamiliar phonemic features, and motivation
 Testing/Assessment
 Examples:
 GRE (verbal part)
 Modern Language Aptitude Test (MLAT)
 Testing/Assessment
 Placement Tests:
 A placement test is designed to sort new students into teaching groups, so that they can
start a course at approximately the same level as the other students in the class
 It is concerned with the student’s present standing, so it relates to general ability rather
than specific points of learning
 Testing/Assessment
 As a rule, the results are needed quickly so that teaching can begin, which puts a constraint
upon the type of test that may be given
 At the same time, a variety of tests is necessary because a range of different activities is


























more likely to give an accurate overall picture of the student’s ability
Testing/Assessment
Usually all four skill areas are tested:
Listening
Speaking
Reading
Writing
Sometimes Grammar
Testing/Assessment
The language of the test will usually consist of a variety of everyday vocabulary and
structures
Subjects:
Student’s own experience
Common human experience that attempts to avoid cultural bias
Testing/Assessment
They should be relatively formal, yet presented in a relaxed way
Often advisable for one member of the staff to see each student individually, even if only
for a few minutes, before the final class allocation is made
Can gauge the student’s personality, character, etc.
Testing/Assessment
Achievement Tests:
Refers back to previous learning and is concerned only with that
Achievement tests are typically used at the end of a period of learning, such as a school
year or a whole school or college career
The content is a sample of what has been in the syllabus during the time period under
scrutiny
Testing/Assessment
It is intended to show the standard which the students have now reached in relation to
other students at the same stage
This standard may be worldwide (such as TOEIC) or countrywide (like in China) or it may
simply relate to a school (GWAR) or program (such as an intensive English program)
Testing/Assessment
The important point about an achievement test is that the standard remains consistent as far























as possible from course to course and from year to year
Relates to long-term rather than short-term objectives and covers a wide range of materials
Testing/Assessment
This brings up a problem of sampling, since all that has been learned in a year (for example)
cannot be assessed in one day, yet the test must reflect the content of the whole course (a
problem of validity)
Reliability is also important here, especially if the student has been taught by more than
one teacher during the time period
Testing/Assessment
Proficiency Tests:
The aim of the proficiency test is to assess the student’s ability to apply in actual situations
what s/he has learned
It seeks to answer the question:
“Having learned this much, what can the student do with it?”
Testing/Assessment
It is not, however, generally related to any particular course because it is concerned with the
student’s current standing in relation to future needs
The TOEFL test is an example of a proficiency test
The proficiency test is also interested in what has been learned, but in a much more vague
way
Testing/Assessment
Unlike the achievement test, the proficiency test exhibits no control over previous learning
Instead, it establishes generalizations on the basis of typical syllabuses leading to entry
Is more directly related to what it attempts to predict, namely performance in the language
under test on some future activity
Testing/Assessment
Validity is important:
Are you actually testing what a student needs to know? Such as taking notes, listening to
lectures, writing papers, etc.
Testing/Assessment
Diagnostic Tests:
The diagnostic test is the reverse side of achievement tests in the sense that while the
interest in the achievement test is in success, the interest in the diagnostic test is in failure,






















what has gone wrong, in order to develop remedies
Testing/Assessment
The content of a diagnostic test is quite specific, referring back to recent class work
It is intended to have positive results for the student by encouraging him or her with success
or pointing out exactly what he or she needs to do to improve
Testing/Assessment
Validity is fairly easy to establish, since there is a direct link with known content
In general, diagnostic tests should look like extensions of teaching materials
In this sense, it relates to short-term objectives
Testing/Assessment
Methodology of testing in Second Language Acquisition
Discrete Point Testing: constructed on the assumption that language can be broken down
into its component parts and those parts can be adequately tested
Testing/Assessment
Those components are basically the “four skills” – (listening, speaking, reading, and
writing) or the various hierarchical units of language (phonology, morphology, lexicon,
syntax), etc.
The assumption of discrete point testing is that adequate sampling of these units will
achieve validity
Testing/Assessment
This has met with criticism, primarily by John Oller (1976, 1979)
Oller argued that language competence is a unified set of interacting abilities that cannot
be separated apart and tested adequately
Testing/Assessment
The claim is that communicative competence is so global and requires such integration of
skills that it cannot be captured in additive tests of grammar and reading and vocabulary and
other discrete points of language
Thus, he called for integrative testing: integrative tests attempt to assess a learner’s
capacity to use many bits of language all at the same time
Testing/Assessment
Two types of tests have been held up as prime examples of integrative tests:
First is called a cloze test: a reading passage (often between 150 and 300 words) where
every nth word (usually every sixth or seventh) has been deleted





















The testee is required to supply words that fit into those blanks
Testing/Assessment
Here is an example:
A thesaurus is another useful reference (1) ________ people interested in words. It’s what
(2) _______ reach for when you’re writing and (3) _______ can’t think of the right word.
Thesauruses (4)_______ synonyms (words with similar meanings), antonyms ((5)_______
with opposite meanings), and other related (6)_______.
Testing/Assessment
Do not use your thesaurus for definitions, pronunciation, (7)_______ other information that
requires dictionary reference. (8)_______, like dictionaries, thesauruses are available in
(9)_______ or paperback as well as on (10)_______ Internet or on CD or other word
processing software.
Testing/Assessment
Oller claims that close tests results are good measures of overall proficiency
According to theoretical constructs underlying this claim, the ability to supply appropriate
words in blanks requires a number of abilities that lie at the very heart of competence in a
language:
Testing/Assessment
Knowledge of vocabulary, grammatical structure, and discourse structure
Reading skills and strategies
An internalized “expectancy grammar” (IOW, the ability to predict what should come
next)
It is argued that successful completion of a cloze test taps into all of those abilities, which
are the center of language proficiency
Testing/Assessment
The second is called a dictation test: a relatively short passage (100 to 200 words) is read
by the teacher to the students
Usually read three times
The first time is at normal speed while students just listen
The second time the passage is broken up into chunks or phrases long enough to challenge
the listener
Testing/Assessment
At this point, the students should be writing down what they hear

























The third time the passage is read at normal speed again
At this point, students should check their renditions for accuracy
The argument, again, is that it taps into certain grammatical and discourse competencies
Testing/Assessment
Successful completion requires careful listening, reproduction in writing of what is heard,
efficient short term memory, and some expectancy rules to aid the short-term memory
In the last 15 years or so, there has been a strong move toward communicative testing:
tests for grammatical, discourse, and sociolinguistic competence
Testing/Assessment
It has to be pragmatic in that it requires the learner to use language naturally for genuine
communication and to relate to thoughts and feelings
In short, it puts authentic language to use within a context
And it should test the learner in a variety of language functions
Testing/Assessment
Essentially you do this by creating an “information gap” that the student has to fill
Communicative tests require students to process complementary information through the
use of multiple sources of input
They build off of content from earlier sections of the test
Testing/Assessment
Attempts to measure a much broader range of language abilities than did earlier tests, which
focus on the formal aspects of language (that is, language as a system)
Testing/Assessment
One final thing to think about:
Tests have “washback” or “backwash”
IOW, tests have effects on teaching and learning in the classroom
We should not teach toward the test, but tests can be used as teaching tools
Testing/Assessment
Tests become feedback devices where a student perceives elements of communicative
performance that need to be improved
Formal tests must therefore be learning devices through which students can receive
diagnosis or areas of strength and weakness
Summary/Minute Paper:
Download