ACII administration HOA - The Insurance Institute of Ireland

advertisement
Transitional Arrangements
New Marking Scheme
www.iii.ie
New Marking Scheme
The Insurance Institute of Ireland introduction of
new marking scheme from May 2011 exam session
From the May 2011 examinations, the Insurance Institute of Ireland is introducing a new
marking scheme in its Multiple-Choice Question (MCQ) examinations in order to ensure
compliance with the requirements of University College Dublin and the Institute of Bankers’
School of Professional Finance.
Basically this means that in its MCQ exams, each correct answer will be awarded 3 marks (+3),
each incorrect answer will be awarded a minus 1 mark (-1) and each blank answer (answer
sheets will allow students to mark ‘don’t know’ as their answer) will be awarded a zero mark (0).
The Institute appreciates that negative marking creates certain fears and preconceptions in
students which can cause worry and be distracting at a time when the student should be
focussing on their studies. Below, in an attempt to dispel these fears, the logic of the
introduction of this system of scoring is outlined, its application is explained and some advice to
bear in mind when taking negatively marked MCQ exams is given.
The objective of the introduction of the new marking scheme is to remove a bias that favours
guessing and, thereby, to make the test a more accurate measurement of the students’ actual
knowledge. In a multiple choice test, it is possible to get a totally correct answer purely by luck –
an outcome which is virtually impossible in a written or oral test. But in an MCQ exam, a lucky
guess is indistinguishable from a carefully reasoned correct choice based on knowledge.
Suppose that each question has four options, of which one is right and three are wrong.
A student guessing randomly will have a one-in-four chance of getting the correct answer. Thus
a student could get about 25% just by guessing. A simple adjustment (to negate the gains of this
guessing) would be to subtract 25% from everyone, and base the mark on what a student can
manage beyond chance alone. However, such a marking scheme would not give full credit to
students who get all their answers without guessing.
A better scheme is to give positive marks to correct answers, and negative marks to incorrect
answers. Since a random guesses is three times more likely to be wrong than right, the reward
© Insurance Institute of Ireland 2010
2
New Marking Scheme
for a correct answer (3) is made three times as large as the penalty for a wrong answer (-1).
Then, in the long run, the score due to random guessing is just zero, which is what it should be
for a fair test. A student who is guessing randomly can expect the same score as a student who
doesn’t answer at all.
Questions which are not attempted, don't figure into this scheme, since this indicates no
guessing. Such answers are not counted as wrong; they are just scored as zero. From the May
2011 exams, the III MCQ answer forms will contain a fifth option - Option E - in addition to the
existing Options (A – D) to facilitate the student who choose not to attempt a question. Students
who decide they do not know the answer to the question and do not want to risk guessing and
losing a mark can select Option E to indicate that they wish to not answer that particular
question.
In keeping with this logic, the Institute is to award each correct answer 3 marks (+3), each
incorrect answer will be awarded a minus 1 mark (-1) and each unanswered question (indicated
by selecting Option E) will be awarded a zero mark (0).
There are common misconceptions about negative marking. As mentioned above, they are
associated with fear and suspicion. Some students have a gut feeling that the marking is
‘unfair’. Others feel so intimidated by the prospect of negative marking that they refrain from
answering any questions because they think that one is penalised for guessing. But this is an
overly conservative strategy and in actual fact, negative marking is more fair than merely
counting correct answers and ignoring incorrect ones. Note that a student even guessing blindly
is not really penalised - the scoring method just ensures that such a student does not get an
advantage.
It is probably a rare question in which the student cannot quite confidently narrow down the
choices to two or three. In such a case, there is an advantage in giving your best answer, for
you will gain more marks if you guess right than you lose if you guess wrong. However, if you
absolutely have no clue about any of the choices, it is safer to leave the question blank.
Students sometimes feel cheated about the marks they lost because of an incorrect guess. In
such cases they should reflect first on how many marks they gained because of lucky guesses.
Can they honestly say that they were 100% confident about all their right answers, and yet got
every single guess wrong?
© Insurance Institute of Ireland 2010
3
New Marking Scheme
So, how should you tackle a negatively marked MCQ examination
paper? In summary:

If you haven’t got a clue, mark the ‘Don’t Know’ option.

If you haven’t got a clue, but one of the answers ‘looks right, it probably isn’t.

Best of all, know the material, and spend time thinking carefully about the question, so
that you don’t have to guess at all.
© Insurance Institute of Ireland 2010
4
Download