Reports and Scores Fen Chou, Ph.D. Louisiana Department of Education August 2006 LA’s NCLB Assessment Plan Keep LEAP (CRT) • grades 4 & 8 Keep GEE (CRT) • grades 10 & 11 Augment The Iowa Tests (NRT + CRT) • grades 3, 5, 6, 7, & 9 Augmented NRT Model English and Math Tests The Iowa Tests Items The Iowa Tests items National norms Most items measure Louisiana GLEs GLE-Based Items Align with LA GLEs Measure GLEs not assessed on NRT Developed specifically for Louisiana + iLEAP Test Structure English and Math The Iowa Tests GLE-Based Items Entire iLEAP Test Basic Scores Needed for a Test Raw Score: Number of items correct • Has little meaning unless you know the total number of items on a test and how difficult the test is Scaled Score: Scores to which raw scores are converted by statistical transformations • Put results from different tests on the same • scale Allows for comparisons NRT Component of iLEAP English and Math The Iowa Tests Count for NRT Score Compares LA students’ performance with the national norm group GLE-Based Items The Iowa Tests Scores Reading Total Language Total Mathematics Total Survey Total (grades 3, 5, 6, 7) Core Total (grade 9) NRT Score: Percentile Rank Percentile Rank: Percentage of students in the norm group that the student scored equal to or above • The norm group is the group used to • establish “typical” or average performance on a particular test. Example: A percentile rank score of 70 means that the student scored the same as or higher than 70% of the students in the norm group NRT Score: Stanine Score Stanine Score (Standard Nine): The entire range of scores is divided into 9 parts and each is given a number. Stanine Score 1 2 3 Below Average 4 5 Average 6 7 8 9 Above Average Purposes of Using NRT Results To determine how well individual students perform relative to the norm group students who took the same test. • Example: high low Norm Group Score Range Average Performance PR Score of 25 PR Score of 50 Student A Purposes of Using NRT Results (continued) To determine how well groups of students perform, on average, compare to the norm group students who took the same test. low • Example: high Norm Group Score Range School A Average Average Performance School B Average Sample of NRT School Summary Report CRT Component of iLEAP English and Math Iowa Items not aligned with GLEs The Iowa Tests Items GLE-Based Items (Aligned with GLEs) Count for CRT Score How well a student mastered the state content standards iLEAP CRT Scores (Grade 3 Math Example) Achievement Level Advanced Scaled Score Achievement Level Descriptors 500 Apply strategies of measurement to solve real-world problems Select and use appropriate tools and units of measure Measure objects using specified tools and units Identify measurement tools and units Mastery Basic Approaching Basic Unsatisfactory 100 Purposes of Using CRT Results To compare the performance of individual students to a criterion or standard of performance. • A criterion may be a predetermined • number of correct responses (e.g., 8 of 10 responses). Standard of performance can be like LEAP achievement levels (e.g., Advanced, Mastery, Basic). Purposes of Using CRT Results (continued) To determine the percentage of students in a school, district, or state who obtain the criterion or achieve a performance standard. • Example: Grade 4 English (2004), State Purposes of Using CRT Results (continued) To compare the percentages of students at different schools who attain the criterion or achieve a performance standard. • Example: Grade 4 English (2004), Allen Parish Purposes of Using CRT Results (continued) To evaluate the extent to which students are achieving relative to a particular curriculum. • Example: Math Results by Content Standard iLEAP Test Structure Science and Social Studies ♦ ♦ ♦ ♦ Contain all GLE-based items Align with Louisiana GLEs Developed specifically for Louisiana Provide CRT scores only Difference between CRT and NRT Not the types of test items Not the procedures used to develop items Not the procedures used to construct tests But The manner in which test results may be interpreted Cautions for Comparison of CRT and NRT Scores Not an apples-to-apples comparison NRT score does not represent a student’s performance on the entire test. A student may have a high score on CRT but a low score on NRT or vice versa. Two students may have the same CRT achievement level but different NRT scores. Possible Explanation Count for NRT Scores Iowa Items not aligned with GLEs The Iowa Tests Items GLE-Based Items (Aligned with GLEs) Count for CRT Scores Possible Explanation (continued) high NRT Scores low low high CRT Scores Projected Release Dates 2006 iLEAP Hardcopy Studen Studen School Report Label Roster iLEAP Online Summary Reports September 8, 2006 CSV File Reports for Schools NRT Student-Level Reports and Summary Reports CRT Student-Level Reports CRT Summary Reports Where to Find Interpretive Guides www.louisianaschools.net Where to Find Interpretive Guides www.louisianaschools.net 2006 Baseline SPS iLEAP uses achievement levels Advanced – 200 pts. Mastery – 150 pts. Basic – 100 pts. Approaching Basic – 50 pts. Unsatisfactory – 0 pts. Bulletin 111, Section 405 2006 Baseline SPS – K-8 Assessment Index Grade – Subject weighting Grade ELA Math Science Soc. Stud. 3rd 2 1 ½ ½ 4th 2 2 1 1 5th 1 1 1 1 6th 1 1 1 1 7th 1 1 1 1 8th 2 2 1 1 Bulletin 111, Section 405 2006 Baseline SPS – High Schools Assessment Index Weights Grad ELA Math 9th 1 1 10th 1.25 1.25 11th Bulletin 111, Section 409 Sci. Soc. Stud 1.25 1.25 Reports and Scores LAA 2 CRT Scores (Grade 4 Math Example) Achievement Level Basic Scaled Score 340 Approaching Basic Foundational Achievement Level Descriptors show some understanding of fractions, decimals, and percents and their relationships recognize fractions, decimals, and percents demonstrate minimal recognition of fractions, decimals, and percents PreFoundational 100 Need to develop the ability to demonstrate minimal recognition of fractions, decimals, and percents Projected Release Dates 2006 LAA 2 Hardcopy Studen Studen School Report Label Roster LAA 2 Online Summary Reports September 8, 2006 CSV File Where to Find Interpretive Guides www.louisianaschools.net