Description of “CTCS.sav” dataset:
This dataset is based on data collected as part of the Cambridge-TOEFL comparability study conducted at
the University of Cambridge, University of Illinois, Urbana-Champaign and the University of California, Los
Angeles in 1988 and 1989. The purpose of the study was to investigate the similarities in test content, test
takers, test performance and test use in the First Certificate in English (FCE), 1998 version, administered by
the University of Cambridge Local Examinations Syndicate (University of Cambridge Local Examinations
Syndicate, 2001) and the Test of English as a Foreign Language (TOEFL) administered by the Educational
Testing Service, Princeton (Educational Testing Service, 1997). Data for this study were collected from
1,448 participants who were English language learners from eight sites in eight countries (Bangkok,
Thailand; Cairo, Egypt; Osaka, Japan; Hong Kong, China; Madrid, Spain; Sao Paulo, Brazil; Toulouse,
France; and Zürich, Switzerland). The instruments used for the study were the FCE (1988 version), the
TOEFL (1987 version), the Speaking Proficiency English Assessment Kit (SPEAK, 1988 version)
(Educational Testing Service, 2001), and the Test English Writing as well as a background questionnaire
developed for the study. For detail descriptions of this study, see (Bachman, Davidson, Ryan, & Choi, 1995)
and (Kunnan, 1995).
I.
Description of the Tests
1. The Test of English as a Foreign Language (1987 version): This version of the TOEFL
consisted of three sections.
Section 1 entitled “Listening Comprehension” consisted of tape-recorded statements and passages that test
takers listened to in order to answer 50 multiple-choice items. The tape-recorded parts included 20 single
sentence statements, 15 items on short dialogues and 15 items on short monologues.
Section 2 entitled “Structure and Written Expression” consisted of 40 multiple-choice items on structure and
written expression in English. There were two types of items in this section: the first was 15 items on single
sentences with a gap each that had to be filled by choosing from four choices, one of which was
grammatically acceptable; the second was 25 single sentences that had an grammatical error that had to be
identified from a choice of four highlighted phrases or words.
Section 3 entitled “Vocabulary and Reading Comprehension” consisted of 60 multiple-choice items. The
first 30 items were based on single sentence statements and test takers had to choose the closest meaning
from four words; the second set of 30 items were based on for reading passages.
2. Speaking Proficiency English Assessment Kit (SPEAK, 1988 version)
This test was a tape-mediated oral proficiency test based on seven sections that varied in tasks: from reading
a paragraph aloud, to completing partial sentences, to responding to single photographs and a sequence of
photographs, current topics, and an imaginary organizational meeting.
3. Test of English Writing
This test was a timed writing test (30 minutes) that assessed writing ability in English on a general topic.
This test was modeled after the Test of English Writing, which is a writing test developed by ETS.
4. First Certificate in English (FCE, 1988 version): This version of the FCE consisted of five parts, or
“papers” as they are called.
Paper 1 entitled “Reading Comprehension” consisted of 40 4-choice multiple-choice items assessing
grammar, vocabulary and reading comprehension. The first 25 items are stand-alone, while the last 15 items
are based on two reading passages.
Paper 2 entitled “Composition” consisted of five writing prompts, from which test takers chose two to
answer.
Paper 3 entitled “Use of English” included items that tested various aspects of lexicon, register, and other
elements of English usage. A variety of formats is used, ranging from gap-filling o short completion to
paragraph writing.
Paper 4 entitled “Listening Comprehension” consisted of tape-recorded passages that test takers listened to
in order to answer several items. This paper included several parts each following a different format, ranging
from single sentences to charts.
Paper 5 consisted of a face-to-face oral interview that varied in terms of the number of test takers and
examiners. The topics for the interview varied and included holidays, sports, food and drink.
“CTCS.sav” dataset
The following variables are included in the CTCS.sav dataset. You should refer to this list of
variables and explanations before beginning all your analyses.
Variable
Variable name
Number
used in dataset
1
site
SITE
2
id
SUBJECT ID NUMBER
3
tlcstd
TOEFL 1: LISTENING STANDARD SCORE
4
tswstd
TOEFL 2: STRUCT & WRITING STANDARD SCORE
5
tvrstd
TOEFL 3: VOCAB & READING STANDARD SCORE
6
tstdtot
TOEFL STANDARD SCORE TOTAL
7
tew
TEST OF ENGLISH WRITING RATING
8
spgram
SPEAK: GRAMMAR RATING
9
sppron
SPEAK: PRONUNCIATION RATING
10
spflcy
SPEAK: FLUENCY RATING
11
spcomp
SPEAK: COMPREHENSIBILITY RATING
12
f1scald
FCE PAPER 1: CAMB. SCALED SCORE TOTAL
13
f1grad
FCE PAPER 1: GRADE
14
f2scald
FCE PAPER 2: CAMB. SCALED SCORE TOTAL
15
f2grad
Explanation of variable
FCE PAPER 2: GRADE
16
f3scald
FCE PAPER 3: CAMB. SCALED SCORE TOTAL
17
f3grad
FCE PAPER 3: GRADE
18
f4scald
FCE PAPER 4: CAMB. SCALED SCORE
TOTAL
19
f4grad
FCE PAPER 4: GRADE
20
fluency
FCE PAPER 5: FLUENCY RATING
21
grammar
FCE PAPER 5: GRAMMAR RATING
22
pros
FCE PAPER 5: PRONUNCIATIONSENTENCES RATING
23
proi
FCE PAPER 5: PRONUNCIATIONINDIVIDUAL SOUNDS RATING
24
intcom
FCE PAPER 5: INTERACT. COMMUNIC.
RATING
25
vocres
FCE PAPER 5: VOCAB. RESOURCE
RATING
26
f5scald
FCE PAPER 5: CAMB. SCALED SCORE
TOTAL
27
f5grad
FCE PAPER 5: GRADE
28
fcescald
FCE SCALED SCORE TOTAL
29
fcegrade
FCE GRADE
30
srspk
SELF-RATING: SPEAKING
31
srpron
SELF-RATING: PRONUNCIATION
32
srgram
33
srvocab
SELF-RATING: VOCABULARY
34
srcohes
SELF-RATING: COHESION
35
srregist
36
srwrite
SELF-RATING: WRITING
37
srdont
SELF-RATING: DO NOT KNOW METHOD
38
srmist
SELF-RATING: MAKE MISTAKES METHOD
SELF-RATING: GRAMMAR
SELF-RATING: REGISTER
39
srrecog
SELF-RATING: RECOGNIZE MISTAKES METHOD
40
srtotal
SELF-RATING: TOTAL
41
edstatus
CURRENT EDUCATIONAL STATUS
42
toflprep
TOEFL PREP COURSE?
43
fceprep
FCE PREP COURSE?
44
cpeprep
CPE PREP COURSE?
45
toftimes
TIMES PREVIOUSLY TAKEN TOEFL
46
dob
DATE OF BIRTH
47
sex
SEX
48
langroup
Language background
References:
Bachman, L. F., Davidson, F., Ryan, K., & Choi, I.-C. (1995). An investigation into the comparability of two
tests of English as a foreign language: the Cambridge-TOEFL comparability study. Cambridge:
University of Cambridge Local Examinations Syndicate and Cambridge University Press.
Educational Testing Service. (1997). TOEFL Test and Score Manual. Princeton, NJ: Educational Testing
Service.
Educational Testing Service. (2001). TSE and SPEAK Score User Guide: 2001-2002 Edition: Educational
Testing Service.
Kunnan, A. J. (1995). Test taker characteristics and test performance: a structural modeling approach.
Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University
Press.
University of Cambridge Local Examinations Syndicate. (2001). First Certificate in English Handbook.
Cambridge: University of Cambridge.