The TIMSS 2011 study in Israel

advertisement
RAMA
State of Israel
The National Authority for Measurement
& Evaluation in Education
Ministry of Education
Abstract
Main findings from the TIMSS 2011 study
Mathematics and science achievements among eighth graders
in Israel
The National Authority for Measurement and Evaluation in Education (RAMA) is
pleased to present the main findings in Israel1 from the TIMSS 2011 study for 8th
graders.
The TIMSS study

TIMSS – Trends in International Mathematics and Science Study – is an
international study in mathematics and science conducted by the IEA (International
Association for the Evaluation of Educational Achievement). The study is
conducted once every four years, beginning from 1995. Israel has fully
participated in the study since 1999, and on a regular basis since then in 2003, 2007,
and 2011.

The TIMSS 2011 study was carried out in Israel by the National Authority for
Measurement and Evaluation in Education (RAMA), and accompanied by a
steering committee, which included academic experts from in the fields of
mathematics and sciences and their teaching, experts in measurement and
evaluation, and representatives of the Ministry of Education.

The TIMSS study examines students’ mathematical and scientific knowledge in
fourth and eighth grades, and the educational context of teaching these subjects in
various countries. In Israel, the study is only carried out in the eighth grade, and this
abstract therefore discusses the TIMSS 2011 study results only for that grade.

The study enables reliable information to be obtained about Israel’s education
system as compared to other education systems around the world. The study
provides important information to the participating countries, regarding their
students’ strengths and weaknesses in mathematics and science on a systematic
level, and the educational context in which these subjects are studied. Likewise,
1
The complete international report of the study can be found on the TIMSS study website, at the following
link: http://timss.bc.edu/TIMSS2011/index.html
1
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
changing trends over the years may be identified and these may then be examined
in light of the curricula for the tested subjects, accepted teaching methods, and
various intervention programs operated by the education system.2

The conceptual framework of the TIMMS tests revolves around two dimensions:
the content dimension – which includes the various fields within each subject, and
the cognitive dimension – which lists the cognitive skills which 8th grade students
are expected to have mastered in these fields. Content domains in mathematics:
numbers (29% of the questions), algebra (33% of the questions), geometry (19% of
the questions), and data and chance (19% of the questions). Content domains in
science: biology (37% of the questions), chemistry (20% of the questions), physics
(25% of the questions), and earth sciences (18% of the questions) The questions in
the two knowledge domains also test the following cognitive skills: knowing – in
mathematics, 36% of the questions, and in science 32% of the questions; applying –
in mathematics, 39% of the questions, and in science 44% of the questions;
reasoning – in mathematics, 25% of the questions, and in science, 24% of the
questions.

The conceptual framework, according to which the contents of the mathematics and
science tests were determined, was constructed based on the mathematics and
science curricula in the countries participating in the study, with an attempt made to
create the broadest possible common denominator among the participating
countries.

The study included 14 versions of the test, with a total of 217 mathematics
questions and 217 science questions. This large number of questions allowed a
broad coverage of knowledge domains including all their topics and required
reasoning skills.

The study was accompanied by background questionnaires with the goal of
collecting information about the educational context in which these knowledge
domains were studied. The questionnaires were distributed to the students,
mathematics and science teachers, and school principals.

In each of the participating countries, approximately 5000 eighth graders from
approximately 150 schools, sampled by the IEA, participated in the study. The
sampling method used in the study ensured that a representative sample of the target
population participate in each country3. In total, around 240,000 eighth grade
students from 42 countries around the world participated in the TIMSS 2011 study.
In addition to these participating countries, eight independent regional educational
authorities also participated in the study, such as several Canadian provinces and
USA states, as well as three states in which students from a different age group
(ninth grade) participated in the study. These states and provinces are reported in
2
Read more about the trends for change, and ability to compare the different studies in note 6.
For further information on the sampling procedure, see: http://timssandpirls.bc.edu/methods/t-sampledesign.html
3
2
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
the TIMSS 2011 report using separate tables, and will not be surveyed in this
abstract.

The composition of participating countries varies slightly from one study to the
next, and is different from the composition of countries participating in the PISA
study4.
The TIMSS 2011 study in Israel

4699 eighth graders from 151 schools, representative of all those studying in the
regular education system (Hebrew speaking students under the State and StateReligious inspectorate and Arabic speaking students) participated in the study in
Israel. As in previous TIMSS studies, the sampling framework did not include
schools under the ultra-Orthodox inspectorate, nor special education students in
their various learning frameworks.5

In each of the schools sampled for the study, one or two of the eighth grade classes
in the school were randomly chosen to participate in the study.

The tests were translated and adapted for Israel from English into the two accepted
languages for teaching – Hebrew and Arabic. The translation and adaptation for
these languages in Israel was carried out and administered by the RAMA, using
designated translation teams and in coordination with, and under the supervision of
the IEA. There was an improvement in the translation process for the TIMSS 2011
study, in comparison with the previous studies, and some of the repeated items were
retranslated6.
4
The PISA study is conducted by the OECD, and takes place in all member countries, as well as in an
additional 30 non-member countries. The study tests reading literacy, mathematical literacy, and scientific
literacy among 15 year old students (in Israel, most are 10th graders, and some are 9th graders).
5
The rate of diminution in the study population in Israel stood at approximately 23%. This rate is similar to
the rate of diminution in the previous TIMSS studies. The study does not include students from the ultraOrthodox sector (14.9%), students in special education schools (around 1.5%), and special education
students integrated into regular schools, as well as students with special needs in regular schools
(approximately 6%). In light of these high rates of diminution, an asterisked note was added to the
international report of the current and previous TIMSS study reports alongside the data for Israel, regarding
incomplete coverage of the population of 8th graders in Israel. To read more about the sampling process,
the creation of the sampling framework, and the rates of diminution and Israeli participation, see the
National Authority for Measurement and Evaluation in Education (RAMA), at the “International Studies”
tab, at the following link: http://rama.education.gov.il.
6
The new translation of some of the repeated items in 2011 was necessary after it became apparent to the
RAMA (and with the agreement of the IEA), that translation quality in the previous studies had not always
been sufficiently ensured. The decision to improve the translation emanated first and foremost from
educational considerations (the need to present the students with questions worded in fluent and up-to-date
Hebrew or Arabic) and from the need to ensure a wording of the questions which corresponded as closely
as possible to the original, both in their content, and their level of register and clarity. As a result of this
change in some of the details, the international report chose not to present the performance gap data
between the current study and those of previous years. At the same time, the IEA did not disqualify the data
from previous years, and continues to claim that they are valid. In addition, the National Authority for
Measurement and Evaluation in Education (RAMA) conducted an empirical test regarding the questions
which were given in both studies (2007 and 2011). In accordance with this test, the National Authority for
Measurement and Evaluation in Education (RAMA) concluded that the influence of the improvement in the
3
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il

The conceptual framework for the test was in complete congruence with the current
mathematics and science and technology curricula in Israel for junior high schools7.
In mathematics – the new curriculum for junior high schools implemented in the
education system since the 2009/10 school year; in science – the science and
technology curriculum for junior high schools which was originally written in
1995/6 and which had its content and teaching order reprocessed and reorganized in
2009/10.

In each class, the tests and questionnaires were administered by two RAMA testers,
aided by a contact person from the school staff. The tests lasted for an hour and a
half (45 minutes for each of the knowledge domains) with another half an hour for
completion of the students’ questionnaires.

While the students were being tested, quality control staff from RAMA and the IEA
visited some of the classes. There were no special incidents recorded while the tests
and questionnaires were being completed.

The questionnaires for the teachers and principals were completed online.
How the findings are reported

The achievements in mathematics and science are each reported individually on the
TIMSS score ranking. This ranking was determined by the IEA in 1995, so that the
average score for participating countries in this study cycle would be 500, and the
standard deviation would be 1008. It should be emphasized that the “average for
participating countries” has changed over the years, due both to variations in the
composition and number of participating countries, and changes in the knowledge
level of the students in the various countries.

Results are reported by giving both a general score and scores according to content
domains and cognitive skills.

The score rankings for mathematics and science are divided into five proficiency
levels which were determined and defined by the IEA, and which provide meaning
to the reported scores. The proficiency levels were determined according to four
threshold points on the score ranking: the threshold for “outstanding students”
(score of 625 and over), the threshold for “high achievers” (score of 550 and over),
the threshold for “intermediate students” (score of 475 and over), and the threshold
for “low achievers” (score of 400 and above). A score under 400 is defined as
“below the threshold”.
translation on the 2011 achievements was minimal, and therefore the data for the performance gap between
the current and previous study are valid and can be published.
7
Information on the curricula in Israel in the context of the conceptual framework of the 2011 TIMSS
study
can
be
found
in
the
TIMSS
encyclopedia,
using
the
following
link:
http://timssandpirls.bc.edu/timss2011/encyclopedia-timss.html
8
The scores usually range between 200 and 800.
4
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
Israel’s achievements in the TIMSS 2011 study – A description of
the main findings.
The data for Israel is presented below –
o From an international perspective – in comparison with the average for the
42 participating countries9, (hereinafter “the average for participating
countries”) and countries selected for comparison.
o The perspective of within Israel – according to language sector, gender, and
socioeconomic background, and in comparison with the results of previous
TIMSS studies.
9
In this abstract, the average for participating countries is calculated as a simple average of the scores of
the 42 participating countries, with each country having equal weight.
5
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
Mathematics
Israel from an international perspective

The average result in mathematics in Israel for 2011 is 516 score points. This
average is higher than the “average for participating countries” (467), and ranks
Israel in 7th place out of the 42 countries which participated in the study.

This average is lower than the results for Korea, Singapore, Taiwan, Hong Kong,
Japan, and Russia which are ranked in positions 1-6.

Israel’s results in mathematics place it in the same group as Finland, the USA,
England, Hungary, and Australia, which are ranked in positions 8-12
(hereinafter “countries with similar results to Israel”).

The average result in Israel is statistically significantly higher than the average
results for the countries ranked in positions 13-42 in the ranking of participating
countries.

This achievement reflects a marked rise of 53 score points in Israel’s average
score for mathematics, when compared to the TIMSS 2007 study10. Israel’s
improvement in its results between 2007 and 2011 is the third highest among the
countries which participated in the last two studies, and the greatest among the
countries with achievements which are high or similar to those of Israel.11

The distribution12 in student achievements in mathematics in Israel (325 score
points) is the greatest among the countries with achievements which are high or
similar to those of Israel (excluding Taiwan). For example, the average score in
Finland (514) is very similar to that of Israel, but the distribution is far smaller (212
score points).

Distribution according to proficiency levels:
o The percentage of students in Israel at the two highest proficiency levels
(“high achievers” and “outstanding students”) is 39%, higher than their
percentage among countries with similar results to Israel.
o The percentage of students in Israel at the two lowest proficiency levels (“low
achievers” and “below the threshold”) is 32%.
o The percentage of students whose achievements are below the threshold
(13%) is higher than their percentage among countries with similar results to
Israel.

The scores in the various content domains in mathematics: In Israel, the score
averages in the three content domains: numbers, algebra, and geometry, are high
and fairly similar to one another, and similar to the general score for
mathematics – numbers (518), algebra (521) and data and chance (515). The scores
10
For more on the subject of presenting the improvement in scores, see note 6 above, which discusses the
improvement in the translation and the trends for change in the long-term.
11
36 countries participated in these two study cycles (2007 and 2011).
12
The distribution is calculated here as the range between student scores in the 5th and 95th percentiles.
6
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
for geometry (496) are lower. In each of the areas, the average score in Israel is
higher than the “average for participating countries” (466, 470, 458, and 463,
respectively).

7
The scores in the cognitive dimensions (reasoning skills) in mathematics: the
average score of students in Israel is similar for questions which examined
“applying” (513), “knowing” (516), and “reasoning” (520). For the three reasoning
skills, the scores in Israel are higher than the average for participating countries
(465, 467, and 464, respectively).
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
The perspective within Israel
Changing trends over the years13

In 2011, there was a marked rise of 53 score points in the average score of the
students from Israel in mathematics, as compared with 2007.

The last decade has been characterized by a rise in the achievements of the students
of Israel in mathematics in the TIMSS study, with the exception of one study in
2007 in which there was a sharp drop in scores as compared with the results of the
TIMSS 2003 study. It should be noted, that a long teachers’ strike took place in
Israel in 2007, and studies in junior high schools were interrupted. In total, since
1999, there has been a rise of 50 score points (approximately half a standard
deviation) in the average of Israeli students in mathematics in the TIMSS studies.

Between 2007 and 2011, the rate of students in Israel positioned in the two highest
proficiency levels rose sharply (“high achievers” and “outstanding students”)
from 19% to 39%, and the percentage of students in the lowest two proficiency
levels (“low achievers” and “below the threshold”) dropped from 52% to 32%.

The rise in the average scores from 2007 to 2011 is expressed in all content
domains. The rise in the average scores in the areas of numbers, algebra, and data
and chance is similar to the rise in the general score (around 50 score points). The
greatest improvement in student achievements out of all the four domains was in
geometry (a rise of approximately 60 score points). However, similarly to the
TIMSS 2007 study, the Israeli students’ scores in geometry also remained the
lowest of the four content domains in mathematics in the current study.

For reasoning skills, there was a marked rise in the average scores for questions
which examined “reasoning” and “knowing” (58 and 60 score points, respectively),
and a more moderate rise in the questions which tested “applying” (40 score
points).
Language sector, socioeconomic background and gender
Achievements according to language sector

The average score in mathematics among Hebrew speakers is 536, and among
Arabic speakers is 465 (a gap of 71 score points in favor of the Hebrew speakers).

The average score in mathematics among Hebrew speakers corresponds to the
achievement level for the 7th position in the ranking of the countries participating
in the TIMSS 2011 study, and the average score in mathematics among Arabic
speakers corresponds to the achievement level of the 22nd position in the ranking
of the countries participating in the study.
13
The presentation of the changing trends in the various parameters over the years, in this chapter and the
following ones (comparing language sectors, gender groups, socioeconomic background, and more) is
based on the premise that the data for previous studies (2007, 2003, and 1999) are valid, and can be
compared with the current study. For more information, see note 6 above.
8
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il

Between 1999 and 2011, there was a rise of 54 score points among Hebrew
speakers, and a rise of 68 score points among Arabic speakers.

The gap in mathematics between Hebrew speakers and Arabic speakers (71 score
points) was slightly reduced as compared with the parallel gap in the TIMSS study
2007 (76 score points). This finding expresses the fact that the two language
sectors improved to a similar extent between 2007 and 2011 (an improvement of
52 score points among Hebrew speakers and 57 score points among Arabic
speakers).

Among Hebrew speakers, 15% of students are above the “outstanding
students” threshold, and the rate of students at the two highest proficiency levels
(“high achievers” and “outstanding students”) is 46%. Among Arabic speakers,
5% of students are above the “outstanding students” threshold, and 22% of
students are at the two highest proficiency levels.

Among Hebrew speakers, 7% of students are below the lowest threshold, and
the rate of students at the two lowest proficiency levels (“low achievers” and
“below the threshold”) is 24%. Among Arabic speakers, 29% of students are
below the lowest threshold, and 52% of students are at the two lowest
proficiency levels.

In light of the above, it is clear that there has been a rise in the percentage of
outstanding students and high achievers in both language sectors, alongside a
drop in the percentage of students in the two lowest proficiency levels as
compared with 2007.
Achievements according to socioeconomic background:

The average scores for Hebrew speakers studying in schools of a high, middle and
low socioeconomic background are 565, 521, and 493, respectively. In other words,
there is a gap of 72 score points between the scores of students from schools of a
high socioeconomic background, and those of a low one.

The average scores for Arabic speakers studying in schools of a middle or low
socioeconomic background are 507 and 454, respectively. In other words, there is a
gap of 53 score points between the scores of students from schools of a middle
socioeconomic background, and those of a low one.14

Performance gaps between the language sectors, after controlling of
socioeconomic background: The performance gap between the language sectors
(71 score points in favor of Hebrew speakers) is small when achievements are
examined separately for each socioeconomic background: a performance gap of
14 score points (in favor of Hebrew speakers) between the students in both
14
There are almost no schools of high socioeconomic background in the Arab sector, and there are
relatively few schools of a middle socioeconomic background.
9
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
language sectors in schools of a middle socioeconomic background, and a
performance gap of 39 score points (in favor of Hebrew speakers) between students
from both language sectors in schools of low socioeconomic background. It would
seem, therefore, that the general performance gap in scores between Hebrew
speakers and Arabic speakers can be partially explained by the socioeconomic
background of students in the two sectors.
Achievements according to gender:
10

Between 2007 and 2011, there was a large rise in scores for both boys and girls
in Israel (50 score points among boys, and 55 score points among girls).

Among Hebrew speakers, the boys’ and girls’ scores are high and identical
(536). Between 2007 and 2011, there was a similar rise in the boys’ and girls’
scores (50 score points and 54 score points, respectively).

Among Arabic speakers, girls’ scores are clearly higher than those of boys (482
and 447, respectively – a performance gap of 35 score points in favor of girls). This
performance gap grew between 2007 and 2011 due to the greater improvement in
scores of Arabic speaking girls (66 score points as opposed to 48 score points,
respectively).
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
Science
Israel from an international perspective

The average result in science in Israel for 2011 is 516 score points. This average is
higher than the “average for participating countries” (477), and ranks Israel in 13th
place out of the 42 countries which participated in the study.

This average is lower than the results for Singapore, Taiwan, Korea, Japan,
Finland, Slovenia, Russia, Hong Kong, and England which are ranked in
positions 1-9.

Israel’s results in science place it in the same group as the USA, Hungary,
Australia, Lithuania, New Zealand, and Sweden, which are ranked in positions
10-16, countries with a similar average score to Israel (hereinafter “countries with
similar results to Israel”).

The average result in Israel is higher than the average results for the countries
ranked in positions 17-42 in the ranking of participating countries.

This achievement reflects a marked rise of 48 score points in the average score for
science, when compared to the TIMSS 2007 study15. Israel’s improvement in its
results between 2007 and 2011 is the second highest among the countries which
participated in the last two studies, and the greatest among Western countries16.

The distribution17 in student achievements in science in Israel (309 score points) is
the greatest among the countries with achievements which are high or similar
to those of Israel (excluding Singapore). For example, the average score in
Australia (519) is very similar to that of Israel, but the distribution is smaller (277).

Distribution according to proficiency levels:
o The percentage of students in Israel at the two highest proficiency levels
(“high achievers” and “outstanding students”) is 39% – higher or similar to
their percentage among countries with similar results to Israel.
o The percentage of students in Israel at the two lowest proficiency levels (“low
achievers” and “below the threshold”) is 31%.
o The percentage of students whose achievements are below the threshold
(12%) is higher than their percentage among countries with similar results
to Israel.

The scores in the various content domains in science: in Israel, the average
scores in the content domains were slightly higher for biology (523), similar to
one another for chemistry and physics (514 in both areas), and similar to the
general score for science, and lower for earth sciences (504). In all four areas,
15
For more on the subject of presenting the improvement in scores, see note 6 above, which discusses the
improvement in the translation and omitting the performance gap data between 2007 and 2011 in the
international report.
16
36 countries participated in these two study cycles.
17
The distribution is calculated here as the range between student scores in the 5th and 95th percentiles.
11
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
the average score in Israel is higher than the “average for participating
countries” (475, 477, 474, and 474, respectively).

The scores in the cognitive dimensions (reasoning skills) in science: the students
in Israel achieved similar scores on average for questions which tested “knowing”
(518) and “reasoning” (519), and were slightly lower for questions which tested
“applying” (512). In the three reasoning skills, the scores in Israel are higher than
the “average for participating countries” (477, 474, and 475, respectively).
The perspective within Israel18
Changing trends over the years

Between 2007 and 2011, there was a marked rise of 48 score points in the average
score of students of Israel in science in the TIMSS study.

During the last decade, there has been a marked rise in the achievements of the
students of Israel in science in the TIMSS study, with the exception of the 2007
study, in which there was a sharp drop in scores as compared with the results of the
TIMSS 2003 study. It should be noted that a long teachers’ strike took place in
Israel in 2007, and studies in junior high schools were interrupted. In total, since
1999, there has been a rise of 48 score points (approximately half a standard
deviation) in the average of Israeli students in science in the TIMSS studies.

Between 2007 and 2011, the rate of students in Israel positioned in the two highest
proficiency levels rose sharply (“high achievers” and “outstanding students”)
from 21% to 39%, and the percentage of students in the lowest two proficiency
levels (“low achievers” and “below the threshold”) dropped from 49% to 31%.

The rise in the average scores from 2007 to 2011 is expressed in all content
domains. The rise in the average scores is the greatest for biology (51 score points),
followed by chemistry (47 score points), and lastly physics and earth sciences (42
score points in both fields). From all the domains, the scores are lowest for earth
sciences in both 2007 and 2011.

There was a substantial rise in the average score for reasoning skills, in questions
which tested “applying” (56 score points), followed by “knowing” (46 score
points), and “reasoning” (38 score points). The great improvement in 2011 for
questions which tested “applying” narrowed the performance gap between the
scores for the “applying” questions and those for the questions testing “knowing”
and “reasoning” as compared to 2007.
18
The presentation of the changing trends in the various parameters over the years, in this chapter and the
following ones (comparing language sectors, gender groups, socioeconomic background, and more) is
based on the premise that the data for previous studies (2007, 2003, and 1999) are valid, and can be
compared with the current study. For more information, see note 6 above.
12
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
Language sector, socioeconomic background and gender
Achievements according to language sector:

The average score in science among Hebrew speakers is 530, and among Arabic
speakers is 481 (a performance gap of 49 score points in favor of the Hebrew
speakers).

The average score in science among the Hebrew speakers corresponds to the
achievement level for the 10th position in the ranking of the countries
participating in the TIMSS 2011 study, and the average score in science among
Arabic speakers corresponds to the achievement level of the 22nd position in the
ranking of the countries participating in the study.

Since 1999, there has been a rise of 46 score points among Hebrew speakers, and
an even greater rise of 87 score points among Arabic speakers.

The performance gap in science between Hebrew and Arabic speaking students (49
score points) was slightly reduced as compared with the parallel performance gap
in the 2007 TIMSS study (63 score points). This finding expresses the fact that the
two language sectors improved by varying degrees between 2007 and 2011 (an
improvement of 45 score points among the Hebrew speakers and 59 score points
among the Arabic speakers).

Among the Hebrew speakers, 13% of the students are above the “outstanding
students” threshold, and the rate of students at the two highest proficiency levels
(“high achievers” and “outstanding students”) is 43%. Among the Arabic
speakers, 7% of the students are above the “outstanding students” threshold,
and 28% of the students are at the two highest proficiency levels.

Among the Hebrew speakers, 8% of the students are below the lowest
threshold, and the rate of students at the two lowest proficiency levels (“low
achievers” and “below the threshold”) is 25%. Among the Arabic speakers, 23%
of the students are below the threshold, and 46% of the students are at the two
lowest proficiency levels.

In light of the above, it is clear that there has been a rise in the percentage of
outstanding students and high achievers in both language sectors, alongside a
drop in the percentage of students in the two lowest categories as compared with
2007.
Achievements according to socioeconomic background:

13
The average scores for Hebrew speaking students studying in schools of a high,
middle and low socioeconomic background are 555, 516, and 491, respectively. In
other words, there is a performance gap of 64 score points between the scores of
students from schools of a high socioeconomic background, and those of a low one.
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il

The average scores for Arabic speaking students studying in schools of a middle or
low socioeconomic background are 523 and 471, respectively. In other words, there
is a performance gap of 52 score points between the scores of students from
schools of a middle socioeconomic background, and those of a low one.19

Performance gaps between the language sectors, after controlling for
socioeconomic background: The performance gap between the language sectors
(49 score points) becomes small and even reverses when achievements are
examined separately for each socioeconomic background: a performance gap of
7 score points (in favor of Arabic speakers) between students from both sectors in
schools of a middle socioeconomic background, and a performance gap of 20 score
points (in favor of Hebrew speakers) between students from both sectors in schools
of low socioeconomic background.
Achievements according to gender:

Between 2007 and 2011, there was a large rise in scores for both boys and girls
in Israel (49 score points among boys, and 47 score points among girls).

Among the Hebrew speakers, the boys’ and girls’ scores are similar to each
other (531 and 528, respectively). Between 2007 and 2011, there was a similar rise
in the boys’ and girls’ scores (46 score points and 43 score points, respectively).

Among Arabic speakers, girls’ scores are clearly higher than those of boys (498
and 463, respectively – a performance gap of 35 score points in favor of girls). This
performance gap is similar to that observed in 2007 (30 score points). We can see
from here that the improvement in the scores of Arabic-speaking girls is somewhat
greater in comparison to the Arabic-speaking boys (62 score points as opposed to
57 score points, respectively).
Summary
The data for Israel in the TIMSS 2011 study in mathematics and science indicates a
marked improvement in the achievements of the Israeli students. The data indicates a
rise of around 50 score points (around half a standard deviation) between the parallel
scores from the TIMSS 2007 study and those from the current study20. After this rise, the
Israeli average for the two knowledge domains which were tested – mathematics and
science – is at a markedly higher value than the “average for participating
countries” (516 for mathematics and 516 for science in Israel, as compared with 467 for
mathematics and 477 in science in the “average for participating countries”). These
19
There are almost no schools with socioeconomically advantaged backgrounds in the Arab sector, and
relatively few schools with a medium socioeconomic background.
20
The presentation of the changing trends over the years in this abstract is based, as already noted, on the
premise that the data for previous studies (2007, 2003, and 1999) are valid, and can be compared with the
current study. For more information, see note 6 above.
14
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
scores place Israel in a high position in the ranking of the participating countries: at 7th
place in mathematics, and 13th in science (although still lower than the countries
heading the list, which are mostly Far Eastern countries, such as Korea, Hong Kong,
Japan, and Singapore). These increases in the average scores are accompanied by a rise
in the rate of students in the two highest proficiency levels (“high achievers” and
“outstanding students”), as well as a real decline in the number of students in the
lowest proficiency levels (“low achievers” and “below the threshold”).
The improvement in scores is evident in both language sectors (Hebrew speakers and
Arabic speakers), and for all three socioeconomic backgrounds. However, there is still a
relatively high distribution (variance) characterizing Israel’s achievements: a
performance gap of around two-thirds of a standard deviation for mathematics, and a
smaller performance gap of around half a standard deviation for science. Likewise,
performance gaps have remained between students from different socioeconomic
backgrounds. These gaps stand at about two-thirds of a standard deviation in the Hebrew
speaking sector (among students from schools with a high socioeconomic background,
and students from schools with a low socioeconomic background) and at about half a
standard deviation among Arabic speaking students from schools with a medium
socioeconomic background, as opposed to low socioeconomic background which
characterizes the majority of this Arabic language sector. The differences in the scores
due to socioeconomic background can explain some of the performance gaps between the
two language sectors.
A multi-year (since 1999) follow-up on the Israeli TIMSS study scores demonstrates that
the last decade has been characterized by a rise in the scores of Israel’s students for
mathematics and science, with the exception of 2007 when there was a decline in scores.
In that year, it would seem that Israel’s achievements were negatively affected by an
extended teachers’ strike in junior high schools. The rise in scores for 2011 may be
explained by the introduction of the program for promoting achievements two years
prior to the TIMSS 2011 study. As part of the program, the Ministry of Education
invested additional resources (teaching hours, training, new and updated curricula) with
the aim of raising achievement in language, mathematics and science in elementary and
secondary schools. The TIMSS 2011 results support the view that the investment in
educational resources contributes to raising both the level of knowledge and the mastery
of cognitive skills for students in Israel.
15
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
TIMSS 2011
Mathematics
Posi Country
tion
1
2
3
4
5
6
Science
Score
7
8
Korea
Singapore
Taiwan
Hong Kong
Japan
Russia
Israel – Hebrew speaking
Israel
Finland
613
611
609
586
570
539
536
516
514
9
USA
509
10
11
12
13
14
15
16
17
18
19
20
England
Hungary
Australia
Slovenia
Lithuania
Italy
New Zealand
Kazakhstan
Sweden
Ukraine
Norway
Average for participating
countries
507
505
505
505
502
498
488
487
484
479
475
467
Armenia
467
Israel – Arabic speakers
546
Romania
United Arab Emirates
Turkey
Lebanon
Malaysia
Georgia
Thailand
Macedonia
Tunisia
Chile
Iran
Qatar
Bahrain
Jordan
Palestinian Authority
458
456
452
449
440
431
427
426
425
416
415
410
409
406
404
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
16
Posi Country
tion
1
2
3
4
5
6
7
8
9
Score
590
564
560
558
552
543
542
535
533
10
11
12
13
14
15
16
17
18
19
20
Singapore
Taiwan
Korea
Japan
Finland
Slovenia
Russia
Hong Kong
England
Israel – Hebrew
speaking
USA
Hungary
Australia
Israel
Lithuania
New Zealand
Sweden
Italy
Ukraine
Norway
Kazakhstan
21
Turkey
483
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
Israel – Arabic
speakers
Average for participating
countries
Iran
Romania
United Arab Emirates
Chile
Bahrain
Thailand
Jordan
Tunisia
Armenia
Saudi Arabia
Malaysia
Syria
Palestinian Authority
Georgia
Oman
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
530
525
522
519
516
514
512
509
501
501
494
490
481
477
474
465
465
461
452
451
449
439
437
436
426
426
420
420
420
37
38
39
40
41
42
17
Saudi Arabia
Indonesia
Syria
Morocco
Oman
Ghana
394
386
380
371
366
331
37
38
39
40
41
42
Qatar
Macedonia
Lebanon
Indonesia
Morocco
Ghana
Government Complex, 5 Jabotinsky Street., Tel Aviv 67012 Tel: 03, Fax: 03Email:rama@education.gov.il Website:http://rama.education.gov.il
419
407
406
406
376
306
Download