Most Important EMI Test Results

Overall results in German and English version
-
All parts (LC and RC numerical questions & lexical items): German version significantly
better results than English version
Item
Schwierigkeitsindex
Signifikanz
Signifikanzniveau
d. V.
e. V.
A1_1 und Q1_1
A1_2 und Q1_2
.91
.80
.75
.73
.001
.179
0.1%
n. s.
***
-
A1_3 und Q1_3
.76
.57
.002
1%
**
A2_1 und Q2_1
.79
.81
.596
n. s.
-
A2_2 und Q2_2
.75
.69
.235
n. s.
-
A2_3 und Q2_3
.47
.38
.144
n. s.
-
A2_4 und Q2_4
.43
.24
.001
0.1%
***
A2_5 und Q2_5
.29
.47
.002
1%
**
A2_6 und Q2_6
.72
.52
.001
0.1%
***
A2_7 und Q2_7
.75
.54
.000
0.1%
***
A2_8 und Q2_8
.43
.35
.152
n. s.
-
-
Questions 1.1 / 1.3 / 2.4 / 2.6 and 2.7 got better results in the German, while question 2.5
scored better results in the English version

LC versus RC in German version
-
LC: 81.38% of questions correctly answered  RC 57.84%
In follow-up student interview RC was considered more challenging
-
Numerical questions Q2_1 – Q2_4: 61.02% correct answers
Lexical items Q2_5 – Q2_8: 54.66% correct answers

LC versus RC in English version
-
LC: 67.43% of questions correctly answered  RC 50.00%
Numerical questions Q2_1 – Q2_4: 53.11%
Lexcical items Q2_5 – Q2_8: 46.89% correct answers

Subjects who have grown up bilingually show slightly better test results (statistically
not significant, however)

Subjects who speak English as a second language show slightly better test results,
particularly in LC (statistically not significant, however)

Subjects who have attended a language course abroad have significantly better test
results
106749871
Page 1 of 2
Most Important EMI Test Results

Test results of 6th semester students versus 8th semester students: 6th semester
students show significantly better test results in the RC part of the English version than
8th semester students

Influence of profession / occupational background (Tech / Non-Tech / IT):
Tech & Non-Tech subjects have better test results in the German version

Regular use of spoken and written English:
Subjects who use spoken and written English regularly at work and at home have equal
test results in the English and German version of the test

Subjects who use spoken and written English regularly at work and at home have better
results in the LC part and in questions Q2_A1-4 (numerical items) of the RC part in the
English version of the test (t(134) = -4.467, p < .00)

Use of English at work and home: IT subjects use English more often at work and home
(holiday, chat rooms etc) and have almost similar test results in the German and
English test version – even slightly better test results in the English version
(statistically not significant, however)

Regular use of written English: Subjects who use written English rarely have worse
results in questions Q2_5–8 (lexical items) of the RC part of the English test version (M
= 1.65) than subjects who use written English more often (M = 2.25)

Preliminary marks: Subjects with IT background have worse preliminary marks in
maths (M = 3.89) than Tech subjects (M = 4.42) and Non-Tech subjects (M = 4.22)

Subjects who have attended an English language course (e.g. FCE) have significantly
better test results than subjects who have not attended a course. However, subjects
who have completed an FCE course do not have better results in the RC part of the test

How is EMI perceived by future students?
Before the test:
54.1% (151) of subjects find the idea of attending core subject courses in English
daunting
41.6% (116) of subjects are confident that they can cope with EMI. These students have
better preliminary language (English, but also French and German) marks
4.3% (12) of subjects have no clear opinion (no answers)
After the test:
84.9% (237) of subjects have not changed their opinion
8.2% (23) have changed their opinion (12 feel confident, 11 feel daunted)
6.8% (19) have no clear opinion (no answers)

Questionnaire (after the test) - Which part did you find more difficult – LC or RC?
27.2% (76) of subjects found LC more difficult
64.2% (179) of subjects found RC more difficult
8.6% (24) of subjects have no clear opinion (no answers)
106749871
Page 2 of 2