Looking Beneath the Surface What we can learn from the Minnesota TIMSS Science Results William H. Schmidt Michigan State University 2007 Grade 4 Mathematics Nation Nation Hong Kong SAR Singapore Chinese Taipei Massachusetts, US Japan Mean 607 599 576 572 568 Nation Minnesota, US Kazakhstan Russian Federation England Mean 554 549 544 541 Significantly Higher than MN Not Significantly Different from MN Significantly Lower than MN © 2008 Center for Research in Mathematics and Science Education, Mean Latvia Netherlands Lithuania 537 535 530 United States 529 Germany Denmark Australia Hungary Italy Austria Sweden Slovenia Armenia Slovak Republic Scotland New Zealand Czech Republic Norway Ukraine Georgia Iran, Islamic Rep. of Algeria Colombia Morocco El Salvador Tunisia Kuwait Qatar Yemen 525 523 516 510 507 505 503 502 500 496 494 492 486 473 469 438 402 378 355 341 330 327 316 296 224 Michigan State University 2007 Grade 8 Mathematics Nation Nation Chinese Taipei Korea, Rep. of Singapore Hong Kong SAR Japan Massachusetts, US Nation Minnesota, US Mean 598 597 593 572 570 547 Mean 532 Significantly Higher than MN Not Significantly Different from MN Significantly Lower than MN Mean Hungary England Russian Federation 517 513 512 United States 508 Lithuania Czech Republic Slovenia Armenia Australia Sweden Malta Scotland Serbia Italy Malaysia Norway Cyprus Bulgaria Israel Ukraine Romania Bosnia and Herzegovina Lebanon Thailand Turkey Jordan Tunisia Georgia Iran, Islamic Rep. of 506 504 501 499 496 491 488 487 486 480 474 469 465 464 463 462 461 456 449 441 432 427 420 410 403 © 2008 Center for Research in Mathematics and Science Education, Nation Bahrain Indonesia Syrian Arab Republic Greece Romania Lithuania Colombia Oman Palestinian Nat'l Auth. Botswana Kuwait El Salvador Saudi Arabia Ghana Qatar Michigan State University Mean 398 397 395 391 387 381 380 372 367 364 354 340 329 309 307 Grade 8 Mathematics Mean Teaching Emphasis 2007 TIMSS GRADE 8 MATHEMATICS TEST EMPHASIS 1995 2007 TIMSS TEST EMPHASIS 2007 NUMBER NUMBER ALGEBRA ALGEBRA GEOMETRY GEOMETRY DATA OTHER DATA NUMBER ALGEBRA GEOMETRY DATA OTHER © 2008 Center for Research in Mathematics and Science Education, Michigan State University 2007 Grade 4 Science Nation Mean Singapore Massachusetts, US Nation 587 571 Nation Chinese Taipei Hong Kong SAR Minnesota, US Japan Russian Federation Latvia England United States Mean 557 554 551 548 546 542 542 539 Significantly Higher than MN Not Significantly Different from MN Significantly Lower than MN © 2008 Center for Research in Mathematics and Science Education, Mean Hungary Italy Kazakhstan Germany Australia 536 535 533 528 527 Slovak Republic 526 Austria 526 Sweden 525 Netherlands Slovenia Denmark Czech Republic Lithuania New Zealand Scotland Armenia Norway Ukraine Iran, Islamic Rep. of Georgia Colombia El Salvador Algeria Kuwait Tunisia Morocco Qatar Yemen 523 518 517 515 514 504 500 484 477 474 436 418 400 390 354 348 318 297 294 197 Michigan State University Grade 4 Science: 1995 & 2007 1995 Rescaled Scores Nation Japan Minnesota, US United States Austria Czech Republic Netherlands England Singapore Australia Scotland Hong Kong SAR Hungary New Zealand Norway Latvia Slovenia Iran, Islamic Rep. of 2007 Scores Mean 553 553 542 538 532 530 528 523 521 514 508 508 505 504 486 464 380 Significantly Higher than MN Not Significantly Different from MN Significantly Lower than MN Nation (8.8) (1.8) (3.3) (3.6) (3.0) (3.2) (3.1) (4.8) (3.8) (4.5) (3.3) (3.4) (5.3) (3.7) (4.9) (3.1) (4.6) Singapore Hong Kong SAR Minnesota, US Japan England Latvia United States Hungary Australia Austria Netherlands Slovenia Czech Republic New Zealand Scotland Norway Iran, Islamic Rep. of Mean 587 554 551 548 542 542 539 536 527 526 523 518 515 504 500 477 436 2005 NAEP Grade 4 Science At advanced At proficient Vermont States New Jersey New Hampshire Minnesota Massachusetts 0 20 Percent Students 40 2007 Grade 8 Science Nation Nation Mean Singapore Chinese Taipei Massachusetts, US Japan Korea, Rep. of 567 561 556 554 553 Nation Mean England Hungary Czech Republic Minnesota, US Slovenia Hong Kong SAR Russian Federation 542 539 539 539 538 530 530 Significantly Higher than MN Not Significantly Different from MN Significantly Lower than MN United States Mean Lithuania Australia 520 519 515 Sweden 511 Scotland 496 Italy 495 Armenia Norway Ukraine Jordan 488 487 485 482 471 471 470 470 468 467 466 462 459 457 454 452 452 445 Malaysia Thailand Serbia Bulgaria Israel Bahrain Bosnia and Herzegovina Romania Iran, Islamic Rep. of Malta Turkey Syrian Arab Republic Cyprus Tunisia © 2008 Center for Research in Mathematics and Science Education, Nation Indonesia Oman Georgia Kuwait Colombia Lebanon Egypt Algeria Palestinian Nat'l Auth. Saudi Arabia Morocco El Salvador Botswana Qatar Ghana Michigan State University Mean 427 423 421 418 417 414 408 408 404 403 402 387 355 319 303 Grade 8 Science: 1995 & 2007 1995 Rescaled Scores Nation 2007 Scores Mean Nation Singapore Czech Republic Japan Sweden Korea, Rep. of Minnesota, US Hungary England Bulgaria Russian Federation Australia 580 555 554 553 546 544 537 533 527 523 514 Norway Slovenia 514 (2.4) 514 (2.7) 513 (5.6) 510 (5.8) 501 (5.6) 471 (5.1) 464 (4.0) 463 (3.6) 452 (2.1) 365 (6.2) United States Hong Kong SAR Scotland Romania Lithuania Iran, Islamic Rep. of Cyprus Colombia Significantly Higher than MN Not Significantly Different from MN Significantly Lower than MN (5.5) (4.5) (1.8) (4.4) (2.0) (7.9) (3.1) (3.6) (5.8) (4.5) (3.9) 1995 Mean Singapore Japan Korea, Rep. of England Czech Republic Hungary Minnesota, US Slovenia Hong Kong SAR Russian Federation 567 554 553 542 539 539 539 538 530 530 United States 520 Lithuania Australia Sweden Scotland Norway Bulgaria Romania Iran, Islamic Rep. of Cyprus Colombia 519 515 511 496 487 464 462 459 452 417 Significa Not Signif Signific 2005 NAEP Grade 8 Science At advanced Vermont At proficient States New Jersey New Hampshire Minnesota Massachusetts 0 10 20 30 Percent Students 40 Grade 4 Science 1 1995 Life Earth Earth Earth in the Plants & Organs & Life Cycles & Processes & Features Processes Universe Animals Tissues Genetics Functions Minnesota 67 Minnesota 70 Minnesota 88 Minnesota 89 Minnesota 70 Japan 75 Czech Republic 73 Japan U.S.A. England Czech Republic Hungary Norway Australia Hong Kong International Mn Singapore 63 60 59 58 58 56 56 54 53 53 57 Japan U.S.A. Australia England Singapore Czech Republic Hungary Hong Kong International Mn Norway 62 61 56 55 54 54 53 51 50 42 54 Czech Republic Hong Kong Hungary Norway Australia England U.S.A. Japan Singapore International Mn 75 75 75 75 72 71 70 69 69 67 72 Japan Australia Czech Republic Singapore U.S.A. England Hungary Hong Kong International Mn Norway 78 72 72 70 70 67 66 65 64 60 69 Singapore Australia Czech Republic U.S.A. Hong Kong Japan England Hungary Norway International Mn 67 66 65 65 65 63 62 61 61 59 64 Australia Czech Republic Minnesota England Singapore U.S.A. Norway Hong Kong Hungary International Mn 70 69 69 69 69 68 67 66 64 64 69 Minnesota Australia Japan U.S.A. Norway England Hong Kong Hungary Singapore International Mn 72 71 71 70 68 68 68 67 67 64 69 2007 Minnesota Hong Kong 70 Japan 66 Minnesota 70 England 67 Singapore U.S.A. 64 England 65 Hong Kong Singapore 64 U.S.A. 65 Minnesota England Japan Australia Hungary Norway International Mn Czech Republic 63 63 60 58 54 51 50 60 64 64 60 60 60 51 51 62 Earth Features Hong Kong Australia Hungary Singapore Czech Republic International Mn Norway Earth Processes U.S.A. Australia Hungary Norway Japan Czech Republic International Mn 66 Singapore 66 Minnesota 63 U.S.A. 62 England 61 60 56 55 54 53 50 59 Earth in the Universe Hungary Hong Kong Australia Czech Republic Japan International Mn Norway Plants & Animals 70 Hungary 62 Singapore 61 Minnesota 63 Singapore 82 Singapore 62 60 Hong Kong 63 Czech Republic 56 58 Hungary 56 60 U.S.A. 60 England 59 England 60 59 59 57 56 50 50 59 58 58 56 53 53 50 49 57 U.S.A. Hong Kong Czech Republic Australia Japan Norway International Mn Organs & Tissues Minnesota Japan Australia Hungary Czech Republic International Mn Norway 56 Minnesota 55 Australia 55 48 48 47 45 35 55 Life Processes & Functions Japan England U.S.A. Hong Kong International Mn Norway 55 53 52 52 52 49 43 42 53 Life Cycles & Genetics Grade 4 Science 2 1995 Human Biology & Health Matter Minnesota Australia U.S.A. Norway Singapore England Hong Kong Czech Republic Japan Hungary International Mn 75 70 69 68 68 67 67 66 66 65 63 67 Japan Singapore Minnesota Australia U.S.A. Czech Republic Hong Kong Hungary England International Mn Norway 75 67 66 63 61 61 60 59 58 58 56 62 Japan Singapore Hong Kong Hungary Minnesota England U.S.A. Australia Czech Republic Norway International Mn 65 64 61 60 57 57 55 54 54 51 48 58 Singapore Hong Kong Japan Minnesota England Hungary U.S.A. Czech Republic Australia International Mn Norway 72 67 65 61 59 59 59 58 55 50 48 60 Energy & Physical Processes Japan Minnesota Australia England Czech Republic U.S.A. Singapore Hong Kong Hungary International Mn Norway 70 66 63 62 61 61 61 59 57 56 53 61 Physical & Chemical Changes Japan Minnesota Hong Kong Czech Republic U.S.A. Singapore Australia England Hungary International Mn Norway Forces & Motion 72 69 68 67 65 65 63 61 60 59 58 64 Japan Czech Republic Singapore Minnesota Norway Australia Hungary Hong Kong U.S.A. International Mn England 62 62 60 59 58 55 55 54 53 51 49 56 69 65 61 58 57 57 55 55 51 46 40 57 Hong Kong Singapore Minnesota Australia England U.S.A. Japan Hungary International Mn Czech Republic Norway 71 70 67 62 62 61 61 58 54 54 53 61 Environmental & Resource Issues Minnesota 79 Japan 72 Australia 69 U.S.A. 68 Czech Republic 63 Hungary 62 England 60 International Mn 58 Norway 58 Singapore 57 Hong Kong 54 62 Scientific Processes Minnesota U.S.A. Australia Singapore England Japan Hong Kong Czech Republic Norway International Mn Hungary 67 63 59 54 54 53 51 51 48 46 40 53 Singapore Hong Kong England Minnesota U.S.A. Australia Japan Hungary Czech Republic International Mn Norway 70 70 69 67 67 67 65 62 57 56 54 64 2007 Human Biology & Health Matter Singapore Japan Hong Kong Minnesota England U.S.A. Hungary Australia Czech Republic International Mn Norway Energy & Physical Processes 73 67 61 58 56 55 54 53 50 47 42 57 Singapore Japan Hong Kong Hungary Minnesota England Czech Republic U.S.A. Australia International Mn Norway Physical & Chemical Changes Forces & Motion Singapore Minnesota Hong Kong Japan Australia England U.S.A. Hungary Czech Republic International Mn Norway 62 63 61 59 58 58 57 57 51 45 41 56 Environmental & Resource Issues Scientific Processes Comparing MN and the US: Grade 4 Science Topic Earth Features Earth Processes Earth in the Universe Plants & Animals Organs & Tissues Life Processes & Functions Life Cycles & Genetics Interactions of Living Things Human Biology and Health Matter Energy and Physical Processes Physical & Chemical Changes Forces and Motion Environmental & Resource Issues Scientific Processes 1995 2007 MN>US MN=US MN<US MN Grade 4 Student Science Performance > 75% Correct 1995 Earth Processes Earth in the Universe Plants & Animals 2007 Scientific Processes Between 50 to 74% Correct 10 of 14 Topics 14 of 14 Topics < 50% Correct The 1995 Scores have been adjusted to account for the differences in difficulty of the 1995 & 2007 tests. Grade 8 Science 1 1995 Earth Features Czech Republic Hungary Korea Singapore Earth in the Universe Earth Processes 67 67 65 65 Minnesota 64 Sweden Thailand Russian Federation Norway Japan England Australia U.S.A. Israel International Mn Hong Kong 61 60 59 59 59 59 57 57 56 55 54 60 Minnesota 61 Hungary Czech Republic Japan Russian Federation S. Korea Sweden Norway Singapore U.S.A Australia Hong Kong England International Mn Israel Thailand 59 59 58 57 57 56 54 53 51 51 50 50 38 37 34 52 Minnesota 67 Minnesota 74 England Singapore Norway U.S.A. Russian Federation Sweden Korea Japan Czech Republic Australia Thailand Israel International Mn Hong Kong Hungary 67 67 62 61 61 60 59 58 57 57 56 55 54 52 51 59 Sweden Norway Czech Republic Japan Thailand Singapore Korea U.S.A. Australia England Hungary International Mn Hong Kong Israel Russian Federation 71 70 67 67 66 65 64 63 63 59 59 58 58 56 57 63 Czech Republic Hong Kong Japan 60 60 59 Czech Republic S. Korea 61 60 Diversity & Structure of Living Things Japan 76 Singapore 74 Hong Kong 73 Korea 72 Czech Republic 72 Singapore Japan Korea Czech Republic Thailand Minnesota 70 Minnesota 63 Thailand Sweden Hungary Australia Russian Federation England U.S.A. International Mn Israel Norway 69 68 67 67 66 64 64 61 60 59 68 Hungary Russian Federation England U.S.A. Australia Israel Hong Kong Sweden International Mn Norway 60 59 59 58 57 57 56 55 55 54 61 61 60 Singapore S. Korea Japan Hong Kong England 68 63 62 59 58 Minnesota 56 Russian Federation U.S.A Czech Republic Sweden Australia Hungary International Mn Thailand Norway Israel 52 52 47 47 47 43 43 41 38 38 51 Life Processes & Functions 72 70 68 64 63 Life Cycles & Genetics Minnesota 86 Czech Republic U.S.A. England Israel Sweden Norway Korea Russian Federation Japan Hungary Australia International Mn Singapore Thailand Hong Kong 82 81 80 79 78 78 76 76 75 74 73 70 69 67 65 75 S. Korea Japan Hong Kong Singapore Russian Federation Hungary 65 60 60 57 52 51 2007 Earth Features Minnesota 58 Russian Federation Singapore U.S.A Australia England Sweden Hungary S. Korea Norway Thailand International Mn Israel 57 56 53 52 52 51 50 50 47 46 41 40 52 Earth Processes Singapore S. Korea Minnesota 60 Minnesota 59 U.S.A Sweden Norway Singapore England Russian Federation Australia Hong Kong Hungary Thailand Japan International Mn Israel 58 57 57 57 56 55 53 51 49 49 48 45 38 54 Japan Hungary Czech Republic England U.S.A Russian Federation Hong Kong Australia Sweden Thailand Norway International Mn Israel 57 56 56 55 54 53 51 50 48 44 42 41 41 52 Earth in the Universe Diversity & Structure of Living Things Life Processes & Functions Minnesota 49 U.S.A England Czech Republic Australia Sweden Israel International Mn Norway Thailand 47 47 46 44 41 39 38 38 35 49 Life Cycles & Genetics Grade 8 Science 2 Interactions of Living Things Korea Singapore Human Biology & Health 69 66 Singapore Czech Republic 74 72 Minnesota 65 Minnesota 71 Japan Thailand Hungary Australia England Norway Czech Republic U.S.A. Russian Federation Sweden International Mn Israel Hong Kong 65 64 63 62 62 60 58 54 52 52 51 50 47 59 Japan Hungary England Israel U.S.A. Thailand Australia Korea Sweden Russian Federation Norway International Mn Hong Kong 69 69 68 68 67 67 66 66 64 63 63 61 60 67 Singapore S. Korea 64 62 Minnesota 70 S. Korea Czech Republic England Hungary Japan Singapore Sweden U.S.A. Hong Kong Russian Federation Australia Norway Thailand Israel International Mn 69 66 66 65 65 64 63 63 63 62 62 59 57 54 50 63 1995 Properties & Classification of Structure of Matter Matter Japan 67 Russian Federation 56 Singapore 67 Hungary 54 Korea 65 Czech Republic 54 Czech Republic 60 Singapore 53 Hungary 57 Minnesota 49 Sweden 57 U.S.A. 48 Hong Kong 56 Israel 45 Norway 55 Sweden 43 Australia 55 Korea 42 England 55 Japan 41 Russian Federation 54 Hong Kong 40 Israel 53 International Mn 40 Minnesota 52 Australia 39 International Mn 52 England 38 U.S.A. 50 Norway 32 Thailand 47 Thailand 31 57 44 Energy & Physical Processes Singapore Japan Korea England 71 69 67 64 Minnesota 63 Czech Republic Australia Hungary Hong Kong Israel Russian Federation U.S.A. Norway Sweden International Mn Thailand 62 61 60 60 59 58 57 57 57 56 55 61 Singapore S. Korea Japan England Hungary Czech Republic Hong Kong Russian Federation Sweden Australia 63 59 58 54 54 52 51 49 45 45 Physical Changes Japan Singapore Czech Republic Israel Sweden Hungary Norway England Korea Australia Russian Federation Thailand International Mn 67 63 63 61 61 61 60 59 57 57 57 53 53 Minnesota 50 U.S.A. Hong Kong 49 49 58 S. Korea Singapore Japan England Russian Federation Hungary Czech Republic Hong Kong Sweden 57 55 53 52 49 49 47 45 44 2007 Minnesota 62 Hungary Japan England Czech Republic U.S.A. Hong Kong Australia Russian Federation Sweden Norway Israel Thailand International Mn 60 59 58 57 57 55 55 55 53 46 44 43 42 55 Interactions of Living Things Human Biology & Health Singapore S. Korea Japan Hungary Czech Republic Russian Federation England Hong Kong 53 53 50 50 49 48 47 44 Minnesota 41 Sweden U.S.A. Australia Israel International Mn Norway Thailand 40 40 39 37 35 34 33 44 Properties & Classification of Matter Singapore Czech Republic Russian Federation Hungary Japan U.S.A. 64 60 60 57 52 49 Minnesota 46 Israel Sweden International Mn England S. Korea Australia Thailand Norway Hong Kong 44 44 43 42 42 35 35 31 29 46 Structure of Matter Minnesota 45 U.S.A. International Mn Norway Israel Thailand 43 40 39 38 38 49 Energy & Physical Processes Minnesota 43 Australia U.S.A. Norway Israel International Mn Thailand 42 41 40 39 37 34 46 Physical Changes Grade 8 Science 3 Chemical Changes Singapore Korea Hungary 74 66 65 Minnesota 65 Czech Republic England Japan Australia Russian Federation U.S.A. Israel Hong Kong Sweden International Mn Norway Thailand 64 64 64 62 62 61 61 58 57 56 53 51 62 England Singapore Hong Kong Japan Australia 55 55 48 47 45 Minnesota 45 Russian Federation Hungary U.S.A. Czech Republic S. Korea Norway International Mn Sweden Thailand Israel 44 43 43 39 37 35 34 34 31 30 42 Forces & Motion Czech Republic Japan Singapore Korea Hong Kong Hungary England Sweden Australia Norway 78 74 73 70 69 69 68 68 67 67 1995 Science, Technology, & Society Korea 74 Hungary 73 Sweden 67 Singapore 66 Japan 60 Thailand 59 England 57 Hong Kong 55 Norway 52 Czech Republic 52 Minnesota 63 Minnesota 52 Russian Federation U.S.A. International Mn Israel Thailand 62 61 61 55 56 67 Australia Israel International Mn U.S.A. Russian Federation 52 51 48 48 40 58 Czech Republic Japan S. Korea Singapore England Hungary 49 49 48 48 45 44 Singapore Japan Czech Republic Russian Federation England Hong Kong S. Korea Environmental & Resource Issues Singapore Thailand 73 70 Scientific Processes Singapore Korea 75 64 Minnesota 68 Minnesota 63 England Australia Korea Japan U.S.A. Czech Republic Norway Hong Kong International Mn Sweden Israel Hungary Russian Federation 67 65 63 62 60 59 58 53 53 52 52 49 47 59 Czech Republic Australia Japan England U.S.A. Hungary Hong Kong Thailand International Mn Sweden Norway Israel Russian Federation 61 61 60 60 59 57 57 55 53 52 52 52 51 58 55 Japan Singapore S. Korea 56 52 50 2007 Chemical Changes Minnesota 43 Hong Kong Russian Federation Sweden U.S.A. Australia Norway Israel International Mn Thailand 42 41 41 40 38 32 32 31 29 41 Forces & Motion 51 50 44 44 41 39 39 Minnesota 38 U.S.A. Australia Hungary Sweden International Mn Thailand Norway Israel 37 36 34 26 26 19 17 16 35 Science, Technology, & Society Singapore Minnesota 55 England Australia Hungary S. Korea Hong Kong Russian Federation U.S.A. Czech Republic Japan Sweden Norway Thailand International Mn Israel 53 52 51 51 50 49 49 48 48 43 42 40 38 35 48 Environmental & Resource Issues Minnesota 48 England Czech Republic Hong Kong U.S.A. Australia Hungary Russian Federation Israel Sweden Thailand International Mn Norway 46 45 43 43 42 40 38 34 34 29 29 28 41 Scientific Processes Comparing MN and the US: Grade 8 Science Topic Earth Features Earth Processes Earth in the Universe Diversity & Structure of Living Things Life Processes & Functions Life Cycles & Genetics Interactions of Living Things Human Biology and Health Properties & Classification of Matter Structure of Matter Energy and Physical Processes Physical Changes Chemical Changes Forces and Motion Science, Technology, & Society Environmental & Resource Issues Scientific Processes 1995 2007 MN>US MN=US MN<US MN Grade 8 Student Science Performance 1995 2007 > 75% Correct Between 50 to 74% Correct < 50% Correct 11 of 17 Topics 8 of 17 Topics Properties & Classification of Matter Physical Changes Chemical Changes Forces and Motion Science, Technology, & Society Scientific Processes Life Cycles & Genetics Structure of Matter Energy and Physical Processes The 1995 Scores have been adjusted to account for the differences in difficulty of the 1995 & 2007 tests. Grade 4 Earth Features: Average Percent Correct by SES 0.85 0.80 0.75 0.70 0.65 0.60 0.55 0.50 0.45 0.40 Less than 10% 10 to 24.9 % FRL FRL 25 to 49.9% FRL 50 to 74.9% FRL 75% or more FRL Grade 4 Life Cycles and Genetics: Average Percent Correct by SES 0.70 0.65 0.60 0.55 0.50 0.45 0.40 0.35 Less than 10% 10 to 24.9 % FRL FRL 25 to 49.9% FRL 50 to 74.9% FRL 75% or more FRL Grade 4 Physical and Chemical Changes: Average Percent Correct by SES 0.75 0.70 0.65 0.60 0.55 0.50 0.45 0.40 0.35 0.30 Less than 10% 10 to 24.9 % FRL FRL 25 to 49.9% FRL 50 to 74.9% FRL 75% or more FRL Grade 4 Environmental and Resource Issues: Average Percent Correct by SES 0.80 0.75 0.70 0.65 0.60 0.55 0.50 0.45 0.40 Less than 10% 10 to 24.9 % 25 to 49.9% 50 to 74.9% 75% or more FRL FRL FRL FRL FRL Grade 8 Earth in the Universe: Average Percent Correct by SES 0.80 0.75 0.70 0.65 0.60 0.55 0.50 0.45 0.40 0.35 0.30 Less than 10% 10 to 24.9% FRL FRL 25 to 49.9% FRL 50 to 74.9% FRL 75% or more FRL Grade 8 Human Biology and Health: Average Percent Correct by SES 0.75 0.70 0.65 0.60 0.55 0.50 0.45 0.40 Less than 10% 10 to 24.9% FRL FRL 25 to 49.9% FRL 50 to 74.9% FRL 75% or more FRL Grade 8 Science, Technology and Society: Average Percent Correct by SES 0.50 0.45 0.40 0.35 0.30 0.25 0.20 0.15 0.10 Less than 10% 10 to 24.9% FRL FRL 25 to 49.9% FRL 50 to 74.9% FRL 75% or more FRL Grade 8 Earth in the Universe: Average Percent Correct by SES 0.55 0.50 0.45 0.40 0.35 0.30 0.25 0.20 Less than 10% 10 to 24.9% FRL FRL 25 to 49.9% FRL 50 to 74.9% FRL 75% or more FRL Instructional Content Constructs Curricular Coherence Curricular Structure Curricular Focus Exposure Time (OTL) Curricular Rigor Level of Cognitive Complexity 2003 MN Science Curriculum Science Topics Intended at Each Grade Grade Topics Organs, Tissues Physical Properties of Matter Plants, Fungi Animals Classification of Matter Rocks, Soil Light Electricity Life Cycles Physical Changes of Matter Heat & Temperature Bodies of Water Interdependence of Life Habitats & Niches Biomes & Ecosystems Reproduction Time, Space, Motion Types of Forces Weather & Climate Planets in the Solar System Magnetism Earth's Composition Organism Energy Handling Land, Water, Sea Resource Conservation Earth in the Solar System Atoms, Ions, Molecules Chemical Properties of Matter Chemical Changes of Matter Physical Cycles Land Forms Material & Energy Resource Conservation Explanations of Physical Changes Pollution Atmosphere Sound & Vibration Cells Human Nutrition Building & Breaking Energy Types, Sources, Conversions Dynamics of Motion Organism Sensing & Responding 1 l l l l 2 l l l 3 4 l l l l l l l 5 6 7 8 l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l l Grade 4 Science Mean Teaching Emphasis 2007 TIMSS GRADE 4 SCIENCE TEST EMPHASIS 2007 TIMSS TEST 1995 EMPHASIS 2007 LIFE LIFE PHYSICAL PHYSICAL EARTH EARTH OTHER LIFE PHYSICAL EARTH OTHER Grade 4 Teachers’ Reported Percent Teaching Time on Science Topics by School SES 25 Percent Students Eligible for FRL 75 percent or more FRL 37 40 50 to 74.9 percent FRL 41 22 25 to 49.9 percent FRL 34 28 10 to 24.9 percent FRL 34 31 37 Less than 10 percent FRL 0 20 26 13 33 Life Science 5 31 33 40 0 6 27 60 80 Percent Teaching Time Physical Science 3 100 Earth Science © 2008 Center for Research in Mathematics and Science Education, 120 Other Topics Michigan State University Grade 4 Teachers’ Reported Percent Teaching Time on Science Topics by School SES Grade 4 Lowest SES Schools Grade 4: Highest SES Schools Life Science Physical Science Earth Science Other Topics © 2008 Center for Research in Mathematics and Science Education, Michigan State University Mean Percent of Grade 4 Science Teaching Time Topic Highest SES Lowest SES Difference Life Science 37 25 4+ Weeks Earth Science 27 41 5 Weeks Grade 4 MN Teachers’ Yearly Total Science Instructional Time by SES 90 80 70 60 50 40 30 20 Less than 10 percent FRL 10 to 24.9 percent FRL 25 to 49.9 percent FRL 50 to 74.9 percent FRL 75 percent or more FRL © 2008 Center for Research in Mathematics and Science Education, Michigan State University MN Students Overall Percent Correct on TIMSS 2007 Science Fourth Grade Test by Percentage of FRL Students in School 0.8 Total Proportion of TIMSS Science Items Correct 0.75 0.7 0.65 0.6 0.55 0.5 0.45 0.4 0.35 0.3 FRL>25% FRL25% to 50% FRL>50% Free/Reduced Lunch Percentage © 2008 Center for Research in Mathematics and Science Education, Michigan State University Grade 8 Science Mean Teaching Emphasis 2007 TIMSS GRADE 8 SCIENCE TEST EMPHASIS 1995 EMPHASIS 2007 TIMSS TEST 2007 BIOLOGY BIOLOGY CHEMISTRY CHEMISTRY PHYSICS PHYSICS EARTH SCIENCE EARTH SCIENCE OTHER BIOLOGY CHEMISTRY PHYSICS EARTH SCIENCE OTHER Grade 8 Teachers’ Reported Percent Teaching Time on Science Topics by School SES 39 Percent Students Eligible for FRL 75 percent or more FRL 4 50 to 74.9 percent FRL 11 8 25 to 49.9 percent FRL 10 to 24.9 percent FRL 6 Less than 10 percent FRL 7 0 4 3 53 8 9 7 75 12 3 66 9 9 2 6 78 15 20 46 40 Biology 2 13 60 80 Percent Teaching Time Chemistry Physics 100 Earth Science © 2008 Center for Research in Mathematics and Science Education, 120 Other Topics Michigan State University Grade 8 Teachers’ Reported Percent Teaching Time on Science Topics by School SES Grade 8 Lowest SES Schools Grade 8 Highest SES Schools Biology Chemistry Physics Earth Science Other Topics © 2008 Center for Research in Mathematics and Science Education, Michigan State University Mean Percent of Grade 8 Science Teaching Time Topic Highest SES Lowest SES Difference Biology 7 39 11+ Weeks Earth Science 46 53 2+ Weeks Physics 15 3 2+ Weeks Other Topics 13 2 4 Weeks Grade 8 MN Teachers’ Yearly Total Science Instructional Time by SES 155 150 145 140 135 130 125 120 115 110 Less than 10 percent FRL 10 to 24.9 percent FRL 25 to 49.9 percent FRL 50 to 74.9 percent FRL © 2008 Center for Research in Mathematics and Science Education, 75 percent or more FRL Michigan State University MN Students Overall Percent Correct on TIMSS 2007 Science Eighth Grade Test by Percentage of FRL Students in School Total Proportion of TIMSS Science Items Correct 0.80 0.70 0.60 0.50 0.40 0.30 0.20 FRL>25% FRL25% to 50% FRL>50% Free/Reduced Lunch Percentage © 2008 Center for Research in Mathematics and Science Education, Michigan State University MN Grade 4 Students Eligible for School Lunch Program: NAEP 2005 Science Proficiency Levels by Ethnicity Hispanic Group Below basic At basic Black At proficient At advanced White 0% 10% 20% 30% 40% 50% Percent Students 60% 70% 80% 90% 100% Hispani Hispani c c Black 2000 Black FRL 2005 Black Non-FRL 2005 Black FRL 2000 White Non-FRL 2000 White FRL 2005 White Non-FRL White FRL 2005 2005 2000 Non-FRL 2005 MN Grade 4 Students: NAEP 2005 and 2000 Science Proficiency Levels by Ethnicity and School Lunch Eligibility Non-FRL FRL 0% 10% 20% 30% 40% 50% 60% Percent Students Below basic At basic At proficient At advanced 70% 80% 90% 100% 2005 Black FRL 2005 Black Non-FRL 2000 White MN Grade 8 Students: NAEP 2005 and 2000 Science Proficiency Levels by Ethnicity and School Lunch Eligibility FRL Below basic At basic 2000 White Non-FRL 2005 White FRL 2005 White At proficient Non-FRL At advanced 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% 2005 Black 2005 Black FRL 2007 Black Non-FRL 2007 Black FRL 2009 Black Non-FRL 2009 Black FRL White White White White White White 2009 2009 2007 2007 2005 Non-FRL 2005 MN Grade 4 Students: NAEP 2009, 2007 and 2005 Math Proficiency Levels by Ethnicity and School Lunch Eligibility Non-FRL FRL Non-FRL FRL Non-FRL FRL 0% 10% 20% 30% Below basic 40% At basic 50% At proficient 60% At advanced 70% 80% 90% 100%