CETT ELTE BUDAPEST TOLC 2004-2007 TEST OF LANGUAGE COMPETENCE SPECIFICATIONS & CRITERIA 1.1. Introduction This booklet is intended to help you prepare for the ELTE CETT Test of Language Competence (TOLC 1 and TOLC 2). The introduction provides answers to some general questions about TOLC; the rest of the booklet consists of detailed descriptions of the different part of the exam. 1.1.1. What is TOLC? The whole TOLC exam consists of six separate tests which evaluate various aspects of your English. The exam is divided into two phases: TOLC 1 (normally taken at the end of the first year of the CETT B.Ed programme) and TOLC 2 (normally taken at the end of the second year), as follows: TOLC 1 (AT-107) Use of English General Conversation Composition TOLC 2 (AT-291) Listening Comprehension Professional Conversation & Reading Aloud Composition 1.1.2. Waivers The requirement for first year students to take TOLC 1 is waived for those who present a Cambridge Proficiency English (CPE) certificate grade A or B to the head of CETT. A grade C certificate cannot be used as a waiver. There are no waivers for TOLC 2. 1.1.3. What is TOLC for? There are two principal reasons for TOLC. The first is that a degree from the ELTE School of English and American Studies implies a very high level of English indeed. Like the AN-199 and AN-299 exams taken by students on the M.A, programme, TOLC is intended to guarantee that the reputation of SEAS graduates is justified. The second reason concerns CETT's responsibility towards the schools where, in the third year of their B.Ed. programme, CETT students spend a full semester teaching English to a group of primary or secondary pupils. TOLC guarantees that these pupils are exposed to an adequate model of English from their teachers. 1.1.4. How to sign up for TOLC 1. By signing up for the test, students accept the regulations presented in this booklet. 2. Students officially sign up for the whole exam by signing up for the TOLC Oral since it is the first test component to be administered. The sign-up sheets appear about a month before the exam is scheduled to take place. The sheets also specify a deadline by which students must sign up. 3. About a week before the orals, signing up ends and the sheets are taken off for further work. The names on the sign-up sheets are checked against the lists sent by the Tanulmányi Osztály. Should any students have forgotten to include TOLC as one of the subjects in their Index books, they will have to obtain an Egyéni Vizsgalap from the TO. 4. Students have to sign up for the TOLC Oral exams in trios. They should choose fellow students from the same year. These students should ideally be those with whom the students can easily carry on good conversation in other formal (but not testing) situations. 5. Naturally, some trios are always incomplete. In these cases ‘helpers’ need to be found who will do the test, but will not be scored. The helper should have the right attitude in helping to carry on conversation as if he/she was being examined too and in taking the exam seriously. Such ‘helpers’ should preferably be fellow students with comparable levels of English. 6. Note that it is not possible to hold these exams at any other time, so students are strongly advised not to plan holidays for the relevant days. 7. CETT will try to ensure, as far as it is possible, that students will not be examined by their current or recent teachers. 8. Video: some of the oral exams will be video-recorded in order to help examiners train and to maintain the quality of the examination. Every effort is made to make the recording as unobtrusive as possible. A technician will be sitting in the back of the room, monitoring the recording: students will hardly notice anything else. 9. By signing up for TOLC, students accept the regulations presented in this booklet. 1.1.5. How is TOLC constructed? Each of the six tests which make up TOLC is the special responsibility of two or more CETT tutors, who write and revise the test specifications, make up individual test tasks or questions ("items"), have these items checked and "pre-tested" by colleagues, put items together to construct complete tests, and oversee the administration and marking of the tests. All test items are checked statistically to find out how difficult they are, compared to the general TOLC level (which is approximately equivalent to the Cambridge Certificate of Proficiency in English). Once these "difficulty levels" have been calculated, items can be added to the TOLC "item bank" for use in future examinations. TOLC exams usually include a mixture of "old" and "new" items, which makes it possible to ensure that TOLC stays at the same standard, and does not get harder or easier from year to year. 1.1.6. How is TOLC marked? This depends on whether the test is "objective" or "subjective". Objective components of TOLC (the Use of English and Listening tests) are designed so that each item has only one correct answer. Each candidate's answers are coded and fed into a computer, which checks them against the "key" and automatically produces scores. Subjective components (the oral and composition tests) do not have simple "right or wrong" answers - markers have to evaluate your written or spoken English according to standard criteria which specify which aspects of language are to be judged (e.g. "FLUENCY", "ACCURACY", "RANGE OF STRUCTURES/VOCABULARY" etc.) In order to ensure that all the markers involved interpret the criteria in the same way and judge by the same standards, they meet in formal "marker-training" sessions before and during exams. During these sessions they discuss the criteria and to practise using them on videoed oral tests and photocopied compositions from past exams. All oral and written tests are double-marked, 3 using standard scoring sheets. Marks are then coded and fed into the computer so that overall scores and final grades can be calculated. 1.1.7. How are final grades calculated? TOLC grades depend on OVERALL EXAM SCORES, which are the AVERAGE of results in the three parts of each exam, each scaled to a maximum of 100 points. In calculating these results, we follow three basic principles: The different skills are equally important, and must be "worth" the same in the final result. The standard required for TOLC must remain constant from year to year. Results in the "subjective" sections of the exam must not depend on luck (e.g. on a particularly easy or difficult task, or an especially "lenient" or "strict" examiner). Because of this, your average is NOT based on your RAW SCORES, but on "LOGITS". RAW SCORES are the marks that you get in each component of the exam, for example the number of correct answers in the Use of English or Listening section, or the points given by markers in the Oral section. There are several reasons why we do NOT simply calculate the average of these raw scores. The most obvious one is that each section has a different number of maximum points (about 70 for Use of English, compared with only 20 in Year1 Oral). If we used raw scores, your Use of English result would be much more important than your Oral or Written result. LOGITS are raw scores which have been statistically converted, so as to make the results of the three sections comparable with each other AND with the results of previous years' exams. The factors that have to be evened out include the following: The number of items/points in each test The number of "dud" items that provide no useful information about the students’ competence need to be deleted from the "objective" components. These do not count for anyone. The "severity" or "leniency" of individual markers. The difficulty of individual test items and tasks, as compared with previous years' exams All the statistical procedures that we use to make these calculations are recognised and used by international testing bodies, but they are pretty complicated. It is impossible to reproduce these computerized calculations by hand for the students. For example, if 100 students take TOLC 1 and the tests contain about a 100 opportunities for the students to get points (max. 65 for use of English, 20 for the oral, etc.) and the computer software repeats its calculations 300 times (as it typically does to refine its calculations) the final number of calculations (100 by 100 by 300) comes to 3 million for a single exam! This is why results are reliable and, obviously, why it would take ages to reproduce the calculations by hand. It is possible, however, to illustrate some of the principles behind the way the computer software works, and how it adjusts scores in relation to the severity/ leniency of the examiners and the difficulty/ easiness of the tasks: 4 Severity or leniency of Difficulty of items and Result of adjustment examiner tasks Student x Average (as previous tests) in Average (as previous tests) in No adjustment necessary Student y higher than average higher than average (severe examiner) (difficult tests) Compensates by raising the logit score Student z below average (lenient below average examiner) (easy tests) Compensates by lowering the logit score Student u below average (lenient higher than average examiner) (difficult tests) Little or necessary no adjustment The adjustment is made in relation to the DEGREE to which the examiner, items or tasks may be above or below the expected average level. If you want to find out more about these methods, consult Dávid Gergely or Major Éva. 1.1.8. How can students prepare for TOLC? Each component of TOLC is linked to one of the CETT language improvement seminar courses, and the tutor responsible for that course will help you to prepare for that component. However, you cannot expect him or her to cover every task or item that you might meet in the exam. Like most advanced language exams, TOLC is a broadly-based "proficiency" exam, which is not (and cannot be) limited by the content of particular courses or course books. Therefore, it is largely your own responsibility to prepare for TOLC. Broadly speaking, this means two things. First, with the help of your tutors, you need to identify your own personal strengths and weaknesses and find ways of working on the latter. The library, and especially the self-access centre, provide large quantities of self-study material, as well as practice tests for TOLC and other similar exams. Secondly, you need to do everything possible to raise the general standard of your English. You can "absorb" an enormous amount by deliberately exposing yourself to English - reading, listening to the radio, watching films etc. This is particularly effective if you do it regularly and systematically, keeping notes of new expressions that you come across, or of difficulties that you can later look up or consult a tutor about. You should also take every opportunity to use the language actively. This does not necessarily mean hanging around in pubs in the hope of meeting native-speakers - you and your fellow ELTE-SEAS students can help each other by making a principled decision to use English outside seminars too - for example at certain fixed times or for a certain period each day. It may feel "unnatural" to start with, but it is an excellent way of getting practice. 5 1.2. SPECIFICATIONS 1.2.1. The Use of English Component The Use of English Paper, consisting of objectively marked items, is the most "traditional" component of TOLC. This reflects the consensus among CETT tutors that future teachers of EFL need to demonstrate a more precise and conscious awareness of acceptable grammar and usage than can be assessed by means of the relatively communicative tests that make up the rest of the TOLC battery. The paper also corresponds to the expectations and preferences expressed by CETT students. In its present form, this component relies heavily on recognition of "the correct form or usage": the creative element is, deliberately, circumscribed and directed as far as possible, on the assumption that productive skills will be adequately covered in other parts of TOLC. Some of the item-types described below, (but not all of them) will be included. a) Coverage Successful candidates will demonstrate the ability to use English grammatical structures and lexical items with both formal accuracy and semantic/pragmatic appropriacy. Items are chosen to provide a reasonably wide sample of the language, with particular (but not exclusive)attention to areas known to cause difficulty to Hungarian learners. b) Tasks and Timing The paper usually contains 70-80 items, representing 6-8 different item types (see below). Each item is worth one point in the final "raw score". Candidates have a maximum time of 90 minutes to complete the paper. c) Possible Item-types NB: Some items consist of single sentences; others are inserted into continuous text. In the latter case item types will not be mixed within the same text. 1. Text based Multiple Choice Insertion Three incorrect distractors and one correct "key" provided for each question, e.g.: - To suggest that a creative writer, in a time of conflict, must split his life into two compartments, may seem defeatist or frivolous; ..1.. I do not see ..2 .. . To lock yourself up in the ..3 .. is impossible and undesirable. 1.(a) (b) (c) (d) but in the reality yet in practice however by fact nevertheless in the actuality 2.(a) (b) (c) (d) another thing he may do what else is to do what else he can do another thing he should do 3. (a) (b) (c) (d) fine place upstairs room castle in Spain ivory tower 6 ANSWER 1: b ANSWER 2: c ANSWER 3: d 2. Multiple Choice Matching Single sentences, each to be matched; three incorrect distractors and one correct key provided for each sentence, e.g.: (a) I'm sure it'll rain (b) I'm sure it won't rain It's bound to rain (c) I hope it'll rain (d) I'm afraid it may rain ANSWER: a 3. Transformation Sentences to be reformulated: "correct" answers prescribed as far as possible by context and beginning and/or end of new sentences, but some variation accepted, e.g.: - I am sorry that I couldn't meet him (last week) - I wish ________________________________________ ANSWER.... I could have met him / I had been able to meet him. 4. "Sore Finger Items" (!) Sentences with four words or short phrases underlined, one of which may be wrong. Students must indicate which word or phrase, if any, is wrong, e.g.: - My attempt for bribing the policeman was a total failure. a b c d e = No error ANSWER: b 5. "Spot the error 1" Sentences each containing one gap. Multiple choice answers, with three correct "distractors" and one incorrect "key", e.g.: - "Do you think he _________ come next week? (a) will (b) can (c) must (d) has ANSWER: d 6. "Spot the Error 2" Sentences containing one error to be identified and corrected, e.g.: - * He offered helping with my suitcase. - ANSWER: He offered to help me with my suitcase. 7. "Spot the Error 3" Groups of three sentences, one of which may contain an error. Decision as to which one, if any of the three is correct, e.g.: (a) I have a drop of whisky from time to time. (b) I find him rather boring on times. (c) There was a bar here at one time. (d) No error ANSWER: b 8. "Spot the Error 4" Continuous text containing a specified number of errors to be identified and corrected, e.g. 1 There were five of us at the bus stop that morning and I had no idea which one of 7 2 3 4 5 6 7 8 9 10 the other four were going to hand me the package. My boss has given me a brief description of the person it would probably be, but unfortunately she had not had time for going into details. As I glanced at each of my companions in turn, I tried to recall my boss's exact words. "A tall man," she had said (they were all tall men), "with a weather-beaten face and pale eyes." One of the men was wearing a hat which covered the half of his face, including his eyes. Since none of the others fitted the description, I presumed, that he was the one. ANSWERS (5 errors line 2: were going to >> was going to line 2: has given >> had given line 4: for going >> to go line 8: covered the half >> covered half line 9: I presumed, that >> I presumed that 9. Modified Cloze Sentences containing gaps to be filled with one suitable word, e.g.: - I can't be sure, of course, but given his enormous popularity, I'd say he was very ________ to win the election. ANSWER: .... likely .... 10. Re-ordering Jumbled phrases within sentences to be put in order, e.g.: - There are some old beautiful paintings Dutch in her house. ANSWER: ..... beautiful old Dutch paintings... 11. Phrase-substitution One phrase in a sentence to be replaced by a single word from a choice of four, e.g.: - The meeting is postponed until a date which has not yet been fixed. (a) infinitely (b) indefinitely (c) indefensibly (d) indefinably ANSWER: b 12. Pronunciation 1 "odd men out" Selection of item or items that display the same phonological features, e.g.: Which two words are the odd ones out? (Consider the sound indicated by the underlined letters.) a. textile b. asylum c. climate d. olive e. liquid ANSWER: d e (NB two words per item) 13. Pronunciation 2 (stress) Matching words with similar stress patterns. e.g.: reliable a, gratify b, mechanics c, intellect d, observation ANSWER: b 8 14. Morphological changes In the following text words have been numbered and highlighted. Most (but not all!) of them are in the WRONG form for their context. Your task is to write the CORRECT form in the space beside the text. If the word is already correct, simply copy it into the space. ANSWER There is a long tradition of car sharing in Lincoln, both by private (0) arrange and by means of hitch-hiking. Anecdotal (1) evident suggests that such practices are (2) current on the wane, even though (3) fact such as the cost of transport, and the University's ever- (4) bad parking crisis suggests that more car sharing would be a good thing. LUCI, the Lincoln University Car-sharing Initiative, has recently been formed (5) act as a lobby for those in favour of car-sharing. We are (6) depend from the University (7) author and aim to represent the interests both of drivers and would be (8) pass (not necessarily distinct groups!) The practice of hitch-hiking to and from the University is (9) fair widespread, and not (10) confine to students or non-drivers. (0) arrangement (1) evidence (2) currently (3) factors (4) ever-worsening (5) to act (6) independent (7) authorities (8) passengers (9) fairly (10) confined 15. Cloze Filling in the missing word or words in a text. e.g.: The essence of chemistry consists of making new substances, and a chemical change is defined ..............(1) the changing of one substance .............(2) another. Many ...........(3) chemical changes have been performed by man ............. (4) very early times, probably the .........(5) being the heating of clay to make pottery, which has been known for 10,000 years. ANSWER: (1) as (2) to (3) of these (4) since (5) the first 1.2.2. Writing Component 1. This paper will test first-year CETT students' ability to produce accurate, coherent, and appropriate written texts. a) Timing And Tasks The Writing Paper will last 120 minutes. It will consist of a guided composition (approximately 300 words). Students will be allowed to bring in dictionaries and thesauruses for use during the Writing Exam. However, other types of references -- such as grammar books -- will not be allowed. 9 b) TEXT type A guided composition with argumentative, narrative and/or descriptive elements. c) Evaluation of Writing tasks Students' writing will be evaluated using the TOLC Writing Criteria. Descriptors for the criteria can be found on page 16. The four criteria are given equal weighting in the marking. A sample of paper can be found below. d) Writing component sample task: Use your own experience and ideas to complete the missing parts of this letter to an imaginary friend who has just started university in England. Write approximately 100 words in each of the three spaces - you should add between 270 and 330 words in all. Dear Pat, Thanks for your letter - it's great to hear that you are getting on so well at university. It sounds as if the teachers make you work pretty hard - it's the same here, believe me! For example …. ……………… ……………… You say that your university campus has its own shops, banks, sporting facilities and so on - it sounds too good to be true! Our campus in Ajtósi Dürer sor isn't like that at all ….. …………….. …………….. Obviously, there are lots of things I'd like to change about our campus. If I were in charge, the first thing I'd do would be …… …………….. ……………. Oh well - it's easy to dream! Anyway, I'd better stop writing to you and get on with an essay. Keep in touch, and don't work too hard, will you? All the best, Gabi 1.2.3. The Oral Component The Oral Examination consists of two main parts. a) Part one Interactive Part (First and Second Year Students!) This part of the exam is intended to test your ability to engage in semi-planned and unplanned spoken interaction. Groups of 3 examinees will talk to each other in front of two examiners for about 15-20 minutes. You can choose your own group in advance and sign up for an exam slot on a prepared form. Before the beginning of the exam, candidates will wait for their partners in a ‘waiting room’. All three will then be invited into the examination room for Part One. 10 Phase 1 First, you will each be given a task sheet with written instructions and 5 minutes to think about what you want to say. The tasks will typically draw upon your individual experiences, opinions or preferences around a general topic. Each candidate will have the opportunity to speak to the others about the topic at some length. However, the task is not to provide individual monologues unrelated to each other, but extended stretches of talk by each in the trio, related in a conversation. You are therefore expected to listen to each others' contributions actively; you may also comment on or ask about each others' contributions. Phase 2 This part picks up on the theme of Phase One but involves the group in decision-making, problem-solving or agreement reaching tasks. For Second Year students these tasks will have a more professional or 'teacherly' focus. The task will be given orally by an assessor, and there will be no preparation time. A further oral task/prompt (following on from Phase 2) may be given by one of the assessors if both tasks have been completed without producing enough data for the assessors to complete their evaluation of one or more candidates. Evaluation: The two assessors will be marking according to five evaluation criteria (see p. 22). b) Part two: Reading aloud (Second Year Students Only!) This part of the oral exam is to assess your ability to read an English text to an audience. This is an important part of a teacher's linguistic competence as you will have to demonstrate your detailed understanding and effective presentation of connected speech. First, after completing the interactive part of the exam (Part One), the three candidates will be ushered to the waiting room and later to a 'preparation room'. Here they will be given either a short story, a description or a report. They will have 5 minutes to read and 'rehearse' the text. There will be dictionaries available in the preparation room so that candidates can look up words or their pronunciation, if necessary. The text will be given a context, an audience and a reason for reading, e.g.: 'You haven't got a tape-recorder but you want to use the listening activity in the course book (see below) with your beginner class of 20 nine-yearolds. Read the tapescript aloud so that your pupils can do the task.' For the Reading aloud, the usher will then take each candidate individually to the exam room. Evaluation The assessors will be looking at three criteria in this section (see p. 22). 11 1.2.4. The listening component Length of the listening exam: about 45 minutes Test focus: – – – – – – – – – – – – – a) – – – – – – – – – – b) – * The examinee should be able to extract factual information,* recognise the main points of a chain of thoughts, work out the meaning of unfamiliar lexical items that can be deduced from the context, recognise the relationship between the speakers, if this is clearly indicated by words, tone of voice or intonation, recognise the emotions of the speakers, if these are clearly indicated by words, tone of voice or intonation, understand clearly expressed thoughts, recognise key words that characterise the viewpoints of the speakers, follow complex and abstract chains of thought, lectures, arguments or discussions, understand and extract arguments for and against a given point of view, recognise and interpret stylistic characteristics (e.g.: humour, irony), recognise ambiguities, understand important cultural and social references, evaluate utterances and draw inferences Recordings The length of an individual recording: not more than five minutes. Text types: authentic (recordings from the radio, television, or real-life interviews) or semi-authentic (scripted or partly scripted authentic sounding studio recordings). Accents: all the main varieties of (educated) English. No broad regional varieties. Genres: radio/television news reports and commentaries public and media announcements (airport, etc. announcements, weather forecasts, programme guides, commercials, etc.) book and media reviews monologues excerpts from novels, short stories conversations/discussions involving two or more people dialogues plays factual information (on the phone) lectures on topics of public interest and education Quality of the recordings: technically superb, FM quality recordings (with good dynamic features and no significant tape noise). Real life background noise is acceptable if it does not hinder comprehension. Test tasks Task types: giving short answers The underlined items are somewhat more likely variants than the others. 12 – – – – – – – – – – – – – – – c) selecting multiple choice statements, including modified multiple choice, where more than one good answers are possible filling in grids completing texts, including information transfer tasks, where the applicant is supposed to complete a text with information from a (different) listening passage selecting true or false statements identifying pictures matching texts and pictures ordering pictures following instructions on a map spotting errors rearranging a list filling in forms identifying order of events choosing the best ending for a text choosing the most appropriate summary collecting arguments for and against something Number of tasks (subtests): 4-6 tasks depending on the length of the individual recordings. Number of times the recordings are played: one (with gist tasks only), two or three. Time allowed to accomplish tasks: there should be sufficient time provided for writing down the answers after a task, or, in the case of more demanding or lengthy texts, there should be pauses in the recording at the appropriate places to allow students to write down their answers while listening. Item types: there should be at least 3 different test methods in any exam, but one subtest should consist of only one particular item type. Number of items: 30 — 40 Rubrics Language of Instructions: English. All instructions should be given on the tape, and the wording should be the same as that on the test paper. Content of the instructions: The instructions – should contain some reference to the nature of the recording; – should state how many times the recording is to be played; – should contain the time available for -reading the questions -writing down the answers -checking he answers, etc.; – should contain what the students are expected to do and when; Model Answer: each subtest should include an example. d) – – Tapes The whole exam should be recorded, including an introduction to the exam in English, instructions to the subtests, 13 – – – – e) – – – – – f) reference to what the students are expected to do and when (e.g. “You should read the questions now“, “You should listen to the recording now”, “Listen to the recording again”.), each playing of the recordings, breaks and pauses (the time allowed for reading and checking), music separating the subtests. Test booklet The booklet should contain: a front page containing the introduction to the listening component (also recorded) instructions to the subtests (also recorded), reference to what the students are expected to do and when (also recorded), the questions and possible illustrations, sufficient space to write down the answers (dotted lines, boxes, grids etc.) The questions should be numbered. There should be different fonts used for the instructions and the questions. The different subtests should be printed on separate pages. Should a subtest be longer than a single page, the task should be printed on two facing pages. Scoring The test should preferably contain item types that are objectively markable. Short answers are acceptable as long as they are really short and obvious. (The key should offer all the possible alternatives.) The only criterion when judging the acceptability of an answer is whether it contains the information that is required by the question in a way that is comprehensible and unambiguous for the marker. In other words no points are deducted for spelling or grammatical mistakes as long as the answer is comprehensible and unambiguous. All items are weighted equally. Samples an mock tests are available in the Self Access Centre. 1.2.5. Writing Component 2. This paper is specifically designed to test second-year CETT students’ ability to use their advanced writing skills in producing the text types they need mastery of in their professional lives as university students and as teachers, the latter including providing appropriate classroom models. Candidates will be required to write a relevant, accurate, coherent, wellorganised and stylistically appropriate piece of text in two different task types. a) Timing and tasks The paper will last 180 minutes and will consist of two writing tasks related to a novice teachers’ outlined professional needs in writing. The topics of the tasks may be related to language learning and teaching. It will include an essay task, in which the candidate is offered a choice of three topics, one of which should be chosen. A reading passage may be used to provide the context and stimulus for the writing task, and the reason for writing and the audience (who to write for) will be explicitly stated. Students will be allowed to bring in 14 dictionaries and thesauruses for use during the Writing exam. However, other types of references – such as grammar books, handouts, or notes – will not be allowed. b) c) Possible writing task types essays with a variety of functions, and for a variety of specified audiences formal letters of various kinds other text types related to a teacher’s or student’s professional life (e.g. CVs, recommendations, or giving instructions). Evaluation of writing tasks Students will be evaluated using the TOLC Writing Criteria. Descriptors for the criteria can be found on page 16. The four criteria are given equal weighting in marking. Samples of previously-marked papers using these criteria can be found on page 17. 15 WRITING CRITERIA Accuracy 2 = Few or no problems with grammar, spelling and punctuation: problems do not obscure meaning. Problems never hinder efficacy and appropriateness for audience and purpose. 1 = Occasional problems with grammar, spelling and/ or punctuation which tend not to obscure meaning. Problems occasionally hinder efficacy and/or appropriateness for audience and/or purpose. 0 = Serious and/or frequent grammatical, spelling and/or punctuation problems. Meaning sometimes obscured. Provides a bad model for teaching. Breadth 2 = Range and selection of words, phrases and structures is entirely appropriate and effective in terms of style and register for the audience and purpose. Choices enhance meaning. 1 = Range and selection of words, phrases and structures is usually appropriate and effective in terms of style and register for the audience and purpose. Choices adequately convey meaning. 0 = Range and selection of words, phrases and structures is not appropriate or effective in terms of style and register for the audience and purpose. Choices may confuse or fail to convey meaning. Content 2 = Content is relevant, appropriately detailed and completely effective and appropriate for audience and purpose. 1 = Content is usually appropriate and effective for audience and purpose but may have irrelevant, insufficient or otherwise inappropriate parts. 0 = Insufficient, irrelevant or otherwise inappropriate selection of content considering audience and purpose. Blatant plagiarism. Discourse structure 2 = Format completely appropriate for audience and purpose. understandable sequencing, never ambiguous or confused: shows cohesion. 1 = Format more or less appropriate for audience and purpose. Understandable sequencing: occasionally ambiguous or confused: very occasionally lacks cohesion. 0 = Format not appropriate for audience and purpose. Sequencing shows little or no guiding idea: frequently ambiguous or confused: does not hang together. 16 MARKED WRITING SAMPLES, YEAR TWO PAPERS THE TASK PROMPT: Contrastive analysis involves examining two languages to determine their similarities and differences. Some linguists earn a living doing contrastive analyses, but all individuals who learn a foreign language are amateur contrastive analysts--even if they don't realise it--because they use knowledge of their mother tongue in order to learn the foreign language. Usually this process helps in language learning, but sometimes it actually interferes with learning. TASK: Think about a time that a difference between English and your mother tongue caused you difficulty. What caused the problem? How were you able to overcome the difficulties? Use these questions to help you write a short (two-to-three paragraph) essay entitled, "When My Mother Tongue was a Hindrance" Do not write more than 300 words. You hope to publish your essay in the local English teachers' newsletter. Although you should use mostly standard English, you can include less formal English to set the right tone for your essay. SAMPLE 1: THE SUCCESSFUL WRITER (Small numbers refer to markers’ notes below.) I have learnt English for quite a number of years. When I was younger I was not interested in language at all. I felt that I was obliged to learn, and I hated memorising words and phrases. My learning was unconscious, automatic 1. Then I got involved in learning more because I acquired a certain2 vocabulary, my skills improved all the time, and I started to compare my mother tongue and English by translating everything.3 Actually,4 this made me puzzled, and I concluded that English is an illogical and stupid5 language which does not make any sense. Being frustrated, 6 I kept asking my teachers: "Why do we say:7'I know it by heart' and not 'without a book'?" Years later8 I realised that English is neither illogical nor stupid 9 but incredibly interesting. Learning the differences is fun, because you are not only learning another language but another culture where people think differently. I accepted this idea of mine and I went on studying in this manner, but I must say that my situation did not become easier. I still had to concentrate on the differences and memorise everything. Years have passed since and now10 my English is very good,11 I can speak fluently. Last year I had the opportunity to speak with an English native speaker who had been studying Hungarian for a couple of years. He was at an intermediate level--still translating a lot of things into his own language. We were just having a little chat about poets in general, and I asked him about a particular poem. He replied: "Ezt en tudom szívből." I was shocked and happy at the same time. I remembered my experience I had had with "by heart" and I started laughing hard. I saw the embarrassment on his face--he knew he had made a mistake--and to cheer him up I told him my story, which is basically the way I'd learnt my second language. MARKERS’ NOTES Accuracy = 2 The writer has a few minor accuracy errors (1, 2, 6, 7, 11). However, these errors are not particularly disturbing to the reader, nor do they cause a breakdown in the writer's communication.. In addition, the writer's grammar is quite complex (3), and slightly more accuracy mistakes can be expected when a writer "risks" more through the use of complex structures. This writer's level of accuracy is generally a good model for teaching. Breadth = 2 The range and selection of the words, phrases and structures in this essay are both effective and appropriate for the audience and purpose. The writer uses words which are neither too formal nor too informal for the purpose, and the range and selection stay consistent throughout the essay. Words such as "unconscious", "acquired", and "incredibly" enrich the writing, and there is only one instance where an inappropriate word is used (5). In all instances word/phrase choice helps the writer communicate effectively. Content = 2 The content in this essay is very appropriate for the audience and purpose: publication in the local English teachers' newsletter. It is personal and chatty, but not insignificant. The content would most likely appeal to local teachers of English. The writer includes all the information the reader needs to understand "the point" of the essay and does not include details which are not related to the topic. The length of the essays is within the required word range. Discourse = 2 There is a clear introduction, body and conclusion in this essay, and ideas are tied together in such a way that the reader has no difficulty following the writer's development of the 17 topic. There are strong linking devices (4, 8, 10) that help the writer achieve cohesion throughout the essay. The conclusion is particularly effective because the writer uses a similar example of someone learning Hungarian and making the same mistake the author had made while learning English, and this story brings the essay back to the "problem" originally stated in the introduction to the essay. SAMPLE 2: THE UNSUCCESSFUL WRITER When My Mother Tongue Got in the Way As a matter of fact, I did have a problem which, in my view, is quite typical for foreign learners of English. For a certain period in my language learning time, I had serious struggles with "accepting" the Present Perfect tense. Like somebody with his/her mother-in-law, I needed a certain time to acknowledge this tense as something which can be relevant for me--in fact, even profitable in some way. Seriously, I believe that the problem this tense causes to Hungarian learners of English (including myself) is the actual deficiency of a similar tense in the Hungarian language. Hungarian language, on one hand, does not actually possess this way of expression at all. Instead of using the Present Perfect tense or something similar to this, we could only apply either the present or the past tense to express what is meant by the Present Perfect. On the other hand, with the Present Perfect tense the English language is able to express something which can be a "Bridge" in-between these former two tenses. An additional feature of the P.P.T. is that this tense is not restricted merely to a denotation of time. It can stand in itself while indicating, for instance, the circumstance, result or failure of an action properly. In contrast, when translating or simply using English, the Hungarian language has to add certain linguistic elements while searching for something corresponding to the PPT. These elements can be, for instance, words of place or those referring to circumstances of context. I firmly believe that the only way to eliminate these difficulties is--practice, practice and...time, above all! This is the only way through which, at the end, we may forget about calling the Present Perfect tense--a "necessary evil"... MARKERS’ NOTES Accuracy = 0 There are serious and frequent accuracy mistakes. These include: Link words--meaningless and/or inappropriate (e.g., as a matter of fact, seriously, on one hand) "Certain"--consistently used inappropriately "Present Perfect"--capitalised throughout, but it is not a proper noun Structure problems--e.g.: Hungarian language>the Hungarian language; we could only apply either>we can apply either; with the Present Perfect tense the English language is able to express>people can express something using the English present perfect tense; stand in itself>stand by itself; when translating or using English, the Hungarian language>when translating or using English, Hungarian speakers Vague references--e.g.: like somebody with his/her mother-in-law; in some way; this way; Breadth = 0 This writer's choice of words and phrases is both immature and inappropriate, and there is a rotation of "tone" throughout. For example, consider the sentence, "I firmly believe that the only way to eliminate these difficulties--practice, practice and...time, above all!" "Firmly" is a word used when an essay has a serious tone, but the ending of this sentence is decidedly informal, so much so that it is grammatically incorrect. Other instances of a deficiency in range and selection of words and phrases include the following: in my language learning time>e.g., while learning English serious struggles>e.g., serious difficulties deficiency of a similar tense>e.g., lack of a similar tense something similar to this>e.g., or its equivalent to express what is meant by the Present Perfect>e.g., to serve the same function as the present perfect Content = 1 The writer develops the essay as a comparison and contrast of the present perfect in Hungarian and English. The task, however, was to develop an essay that describes a situation in which 18 the writer's native language caused interference in learning English and which answers the questions, "What caused the problem?" and "How were you able to overcome the difficulties?" Despite being "off topic", the writer was given a score of 1 because the topic that was developed had enough supporting detail and the length of the essay was within the required word range. Discourse = 0 The discourse structure is perhaps the weakest aspect of this piece of writing. The format is very inappropriate for the audience and purpose: publication in the local English teachers' newsletter. In addition, the essay lacks cohesion, making it difficult for the reader to follow the writer's train of thought. The writer tried to use transitional devices, but the devices were both ineffective and inaccurate(as described in the Accuracy criteria); i.e., they did not provide smooth transition from one idea to another. Other problems with discourse include the following: * The writer begins the essay with a linking device ("as a matter of fact") that should be used to intensify the preceding statement. However, there was no preceding statement; as a matter of fact, the author literally "jumped into" the topic with no introduction to the essay at all. There may have been a mistaken notion on the writer's part that the title could substitute for an introduction. * Whereas the body of the paper is a fair presentation of comparisons and contrasts between the present perfect in Hungarian and English, the paper concludes in such a way that it appears that the author has been presenting an argument in the body of the paper. * The conclusion appears to be unrelated to both the introduction and the body of the paper. 19 TOLC ORAL INTERACTIVE TASK First year Phase 1: Do you remember a birthday, either your own or somebody else's, that you really enjoyed? When was it and what happened? How did you feel? When the test begins, describe your experience and listen to your partners' accounts. Remember that you should not merely produce three independent monologues; carry on conversation in which you need to get a chance to speak at length about your memories. Phase 2 by the interlocutor: Think of a fourth person all three of you know and appreciate. Imagine that this person has his or her birthday in two weeks' time. Plan a birthday party for him or her and agree on ways, tricks and features to make it really special. Rescue question: How do you feel about parties in general? Give reasons for your opinion. TOLC ORAL INTERACTIVE TASK Second year Phase 1: Think back to a teacher who took a personal interest in your life other than in their role as a teacher. When the test begins, tell your partners about this teacher and listen to their accounts, too. Phase 2 by the interlocutor: Decide between you on three situations that the caring and reflective teacher should definitely not get involved in. Rescue question: Describe the kind of involvement you aim for as a teacher. TOLC ORAL EXAMINATION CRITERIA: PART 1 - THE INTERACTIVE TASK 1. FLUENCY 2 CONTENT & SIZE OF CONTRIBUTION 3. RANGE PASS PLUS - 2 PASS PLUS - 2 PASS PLUS - 2 The candidate is able to converse at length The content provided by the candidate The candidate displays a wide range of appropriate without displaying signs of fatigue. When is both wholly appropriate to the inter- vocabulary; and the ability, when appropriate, to occasionally rephrasing and circumlocuting, action and adds new dimensions. The produce complex grammatical structures. The candidate the candidate appears to be searching for a candidate provides sizeable chunks of is able to tackle any unpredictable areas of better way of expressing their meaning rather coherent language, when appropriate, discussion; there is no risk involved. than groping for words. The listener derives giving ample evidence for rating. pleasure from the manner and speed at which the information is conveyed. PASS - 1 PASS - 1 PASS - 1 The candidate is able to converse at length The content provided by the candidate is The candidate displays a wide range of appropriate with minimal hesitation. Very occasional wholly appropriate to the interaction. vocabulary, and the ability, when appropriate, to groping, rephrasing and/or circumlocutions Sizeable appropriate coherent produce complex grammatical structures. No very obvious do not noticeably interrupt the flow of contributions. avoidance strategies. The candidate is willing to enter speech. The listeners are comfortable with unpredictable areas of discussion. the even manner and speed at which the information is conveyed. FAIL - 0 FAIL - 0 FAIL - 0 The candidate does not sustain conversation Inappropriate content for the interaction. The candidate plays safe. Fails to display a wide enough at length; hesitation, groping and rephrasing Information may be `off-task' (possibly range of appropriate vocabulary/grammatical structures. noticeably impede the flow, and may even a result of `rehearsal'.) Minimal There is evidence of avoidance strategies, the candidate increase as the examination progresses. The contributions. Just enough evidence to be appearing to opt for easier ways of expression. Rather listener grows uncomfortable with the manner rated. unwilling to enter unpredictable areas of discussion. and speed at which the information is conveyed. (Not enough evidence = disqualification) 22 TOLC ORAL EXAMINATION CRITERIA: PART 1 - THE INTERACTIVE TASK 4. ACCURACY 5. INTERACTIVE SKILLS PASS PLUS - 2 PASS PLUS -2 `Eloquently' accurate speaker. The standard: of This candidate can be considered a good conversationist and discoursal, grammatical, and phonological a sensitive speaker. He/she displays consistent evidence of accuracy is very high. No Hunglish. Very minor the ability to initiate a conversation and to take turns imperfections and production slips, more sensitively, without being domineering. When the need arises, characteristic of spoken language than the candidate even facilitates others in the expression of true errors, are acceptable.. their meaning. He/she is fast and versatile/inventive in picking up new topics or changes of direction within a topic. PASS - 1 PASS - 1 The standard of discoursal, grammatical and phonological The candidate displays verbal and non-verbal evidence accuracy is high, though very occasional errors which do of the ability to initiate and take turns. He or she can adapt not impede communication and which do not make the assessor `twitch' (Hunglish), are acceptable. The candidate is capable of monitoring their speech. to new topics or changes of direction without much effort. On the whole, he or she is aware of his or her own share in the conversation and sensitive to the other interactants. FAIL - 0 FAIL - 0 Discoursal, grammatical and phonological The candidate adapts to new topics, changes of direction errors are serious enough to impede and other speakers’ initiatives with considerable effort. communication or are of the kind that make He/she displays no evidence of the ability to initiate an interaction the assessor `twitch'. The standard of and takes turns generally only by invitation. accuracy is too low for a desirable. The candidate repeatedly obstructs others or prevents them classroom model. The candidate does not, from participating equably through dominance or apparent disinterest. appear to monitor their speech. 23 TOLC ORAL EXAMINATION CRITERIA: PART 2 - THE READING ALOUD TASK 6. SENSE OF AUDIENCE PASS PLUS - 2 7. SUPRASEGMENTAL PHONOLOGY PASS PLUS - 2 8. PHONOLOGY (Including word stress) PASS PLUS - 2 The candidate speaks with appropriate projection of voice, variation of speed (pace), and pausing. Eye-contact and body-language reflect a sense of audience. The candidate has managed to internalise the message, and, partly through ease of production, seems intent on conveying that message to the audience. The candidate can cope with the inevitably simulated nature of an exam. The candidate's use of intonation, stress and pauses is highly appropriate to meaning at the sense group, sentence and text level. Appropriate breathing and `elegant` phrasing make ideas really `connect into each other`. Flowing speech, Expressive. The candidate's pronunciation is consistently and highly accurate, almost faultless. No traces of typically Hungarian features. Listening to it, `pleases the ear', as if one was listening to a native speaker. PASS - 1 PASS - 1 The candidate speaks with appropriate projection of voice, variation of speed (pace), and pausing. Eye-contact and posture reflect a sense of audience. Some allowance may be made for the unnatural simulated nature of the task. The candidate's use of intonation, stress and pausing is largely appropriate to meaning at the sense group, sentence and text level. Appropriate phrasing facilitates the assessor's understanding of the message which is not severely hindered by occasional slips. FAIL - 0 FAIL - 0 The candidate fails to speak with appropriate projection of voice, variation of speed, and pausing. Their production is too quiet, too fast or monotonous. The candidate is so preoccupied with the effort to produce, that the sense of audience is lost. The candidate's use of intonation, stress and pausing is largely inappropriate to meaning at the sense group, sentence and text level. Ill-timed breathing and incorrect cohesive intonation interfere with the assessor's understanding and compels undue effort. PASS - 1 The candidate's pronunciation is generally accurate. Although a few Hungarian features may remain, this in no way makes the assessors `’twitch’, or hinders easy understanding. Key words are pronounced consistently correctly. Word stress is generally accurate although a a slip or two on very uncommon words are acceptable. FAIL - 0 The candidate's pronunciation is rather inaccurate. A number of `twitch-making' Hungarian features hinder easy understanding. Key words may be pronounced incorrectly. Even common words are stressed inaccurately. 24 Student self-study material for TOLC: practice books with key TOLC Use of English Awareness-raising task types in: Bolitho, R./ Tomlinson, B. (1980) Discover English. Heinemann. Bowers, R. et al (1987) Talking about Grammar. Longman. Hall, N. and J. Shepheard (1991) The Anti - Grammar Grammar Book Other task types: Alexander, L. G. (1990) Longman English Grammar Practice. Longman. Thomson, A. and A. Martinet (1980) A Practical English Grammar and Exercises. OUP. Millington Ward, J. (1980) Practice in the Use of English. Longman. Graver, B. D. (1990) Advanced English Practice. OUP. Broughton, G. (1990) Penguin English Grammar A - Z Exercise Advanced Students. Penguin. Jones, L. (1989) Use of English. CUP. Gethin, H. (1991) Grammar in Context. Collins. Shaw, K. (1991) Collins Cobuild. English Grammar Exercises. Collins. Collins Cobuild English Guide to Confusable Words (1993) Harper Collins Publishers. U.C.L.E.S. (1990) Cambridge Proficiency Exam Practice 3. (Use of English Part) TOLC Listening Rixon, (1988) Listening Advanced. Oxford Supplementary Skills series. OUP. Blundell and- Stokes (1983) Task Listening. CUP. Fredrickson, T. (1980) Meeting People. Longman. O”Neill and Scott (1985) Viewpoints. Longman. Underwood, M. (1986) Have you heard? Longman. 1994 TOLC Listening Exam TOLC Pronunciation “Proficiency Test” books or booklets May, P. (1990) The Complete Proficiency Practice Test. Heinemann. U.C.L.E.S. (1990) Cambridge Proficiency Exam Practice 3. CUP. TOLC Writing Jolly, D. (1984) Writing Tasks CUP. Hedge, T. Writing. (1988) Resource Books for Teachers OUP. Raimes, A. (1983) Techniques in Teaching Writing. OUP. White, R. and V. Arndt. (1991) Process Writing. Longman. Bander, R.G.: American English Rhetoric (Harcourt Brace Jovanovich, 1983). Brookes, A. and P. Grundy: Writing for Study Purposes. (Cambridge, 1990). Coe, N., R. Rycroft and P. Ernest: Writing Skills: A problemsolving approach (Cambridge, 1983). Csomay, E. and J. Szerdahelyi: Writing: A Process Approach Composition Book. (Nemzeti Tankönyvkiadó, 1997). Jolly, D. Writing Tasks (Cambridge 1984). Leki, I.: Academic Writing: techniques and Tasks. (St. Martin’s Press, 1989). Reid, J.M.: The Process of Composition. (Prentice Hall, 1988). Stephens, M. Practice Advanced Writing (Longman 1992). Strunk, W. and E.B.White: The Elements of Style. (MacMillan 1979). 26