TEST CHAIRPERSONS’ ORIENTATION Miami-Dade County Public Schools September 25, 2009 TEST CHAIRPERSON SURVEY: JUNE 2009 Percent of Test Chairpersons Participating, by School Level 100% 80% 60% 40% 20% 0% Elementary Middle / Combination Senior/ Alternative/ Adult In all, 436, or 84% of the Test Chairpersons completed the survey. 2 ALL ABOUT YOU . . . Full results on the Test Chairperson’s Webpage under Miscellaneous: http://oada.dadeschools.net/TestChairInfo/1402008-09TestChairSurveyReport.pdf 3 GENERAL SATISFACTION ACROSS PROGRAMS 2009-10 TESTING CALENDAR http://oada.dadeschools.net/TestingCalendar/TestingCalendar.asp 5 SENATE BILL 1908 FCAT Testing Program Florida School Grades Elimination of Norm Referenced Test Transition to the Next Generation Sunshine State Standards (NGSSS) Changes to FCAT Writing End-of-course assessments Later administration of FCAT beginning in 2010-11 New Components for High Schools Inclusion of Florida Alternate Assessment in calculations Grades/School Improvement Ratings for alternative centers Enhanced Postsecondary Readiness Assessment (CPT) and Preparatory Coursework 6 CHANGES TO THE TESTING PROGRAM IN 2009-10 Florida Assessment for Reading Instruction (FAIR) Baseline Benchmark Assessment and Interim Assessment Tests provided for all schools Stanford Achievement Test (SAT-10): Grades 1 and 2 The Iowa Tests (ITBS and ITED) New vendor for FCAT and CELLA New courier service 7 PROGRAM UPDATES: 8 Florida Assessment for Instruction in Reading (FAIR) Ms. Pauline Ward Reading/Language Arts FLORIDA COMPREHENSIVE ASSESSMENT TEST (FCAT) Sunshine State Standards (SSS) Maria C. Bruguera, Director I Mara Ugando, Staff Specialist TEST ADMINISTRATIONS • FCAT SSS Writing (Grades 4, 8, 10) Reading and Mathematics (Grades 3-10) Science (Grades 5, 8, 11) • FCAT Retake administered twice a year: – Spring – Fall (Retake only) 11 UPDATES: 2009-2010 SCHOOL YEAR FCAT Writing: Only one prompt at all grade levels 4, 8, and 10 For grade 4, the mode of the prompt will be either narrative or expository and at grade levels 8 and 10, persuasive or expository FCAT Mathematics: Grades 3 and 4 will be provided with rulers for session 3 (Exception: Calibration schools) Gridded-response items appear in Grade 4 for the first time (Exception: Calibration schools) Gridded-response items with the option for negative answers appears in Grades 7, 8, and 10 (Exception: Calibration schools) New reference sheets in Grades 5-8, 10 12 UPDATES: 2009-2010 SCHOOL YEAR, CONT. FCAT Science: Performance tasks (constructed-response items) will be removed beginning with the spring 2010 test administration Shorter sessions in Science for all grade levels FCAT Retakes: All summer FCAT retake administrations have been eliminated beginning with summer 2009 Handscoring: All responses to reading and mathematics performance tasks at grades 4, 5, 8, and 10, and writing essays at grades 4 ,8, and 10 will be scored by one reader Note: For quality control purposes, 20% of all students’ responses will be read by a second reader 13 FCAT SAMPLE MATERIALS The FCAT 2010 Sample Materials will be provided one per student in grades 3-11 Reading and Mathematics sample test materials will reflect the transition from the current SSS to the new NGSSS Science sample test materials will be reprints from last year No writing sample test materials will be provided Sample answer keys available online only Note: Reduced page counts from previous years 14 NEW FCAT CONTRACTOR: PEARSON Website: www.PearsonAccess.com/fl Access FCAT state, district, and school reports Password protected to maintain the confidentiality of student information School principals will receive the new Web site address and passwords via email. FCAT Training Materials Packing Slips Test Administration Manual Administration Record/Security Checklist Missing Materials Report Form Test Irregularities and Security Breaches 15 FCAT WINDOWS: SPRING 2010 AND 2011 Statute 1008.22(3)(c) 12.b. will require that the statewide assessment be administered later in the school year. The following schedule has been proposed for Spring 2011: FCAT Component Spring 2010 Spring 2011 Writing February 9-11, 2010 March 1-4, 2011 Reading and Math Retake March 9-19, 2010 March 30-April 6, 2011 Grade 3 Reading and Mathematics March 9-19, 2010 April 18-26, 2011 Grades 4-10 Reading and Mathematics, and Grades 5, 8, and 11 Science March 9-19, 2010 April 18-29, 2011 16 NEW FCAT-2 PROGRAM The FCAT-2 will be aligned to the Next Generation Sunshine State Standards (NGSSS). Note that NGSSS field test items will be embedded in reading (grades 3 through 10) and mathematics (grades 3-8) in this year’s FCAT (Spring 2010), but the NGSSS items will not count toward students’ scores. Beginning in spring 2011 and each spring thereafter: The FCAT-2 Reading (grades 3-10) and Mathematics (grades 3-8) will be administered Performance Tasks (constructed-response items) will not be included in the FCAT -2 Reading, Mathematics, or Science 17 NEXT GENERATION SUNSHINE STATE STANDARDS Test Item Specifications Reading and Mathematics Test Item Specifications for FCAT-2 Reading (grades 3-10) and Mathematics (grades 3-8) are available at http://fcat.fldoe.org/fcatis01.asp. Draft test item specifications for FCAT-2 Mathematics (grades 9-10) may be found on the Web site of the FLDOE’s Test Development Center at http://sharepoint.leon.k12.fl.us/tdc/external/default.aspx. Select “FCAT Mathematics” from the folder list and select “FCAT HS_Math_App_B.” Note that this document is still in draft form and is subject to change. 18 CHANGES TO FCAT FOR HIGH SCHOOL GRADUATION (CLASS OF 2013) Reading The current grade 9 student cohort will take FCAT-2 Reading next year (2011) as the reading graduation requirement The score requirements for FCAT-2 Reading for this student cohort will be linked to the current 300 passing scale score The current passing concordant scores on the SAT and ACT will remain the same for this student cohort, but may change in subsequent years 19 CHANGES TO FCAT FOR HIGH SCHOOL GRADUATION, (CLASS OF 2013) CONT. Mathematics New NGSSS tests will not be used as a graduation requirement for the current grade 9 student cohort The Grade 10 FCAT-1 Mathematics Retake will be administered to the current grade 9 cohort, next year when they are grade 10 students as a graduation requirement. This version of the test does NOT include short-response or extended-response items, only multiple-choice and gridded-response items The passing score requirement for FCAT-1 Mathematics will remain at scale score 300 until spring 2013 The current passing concordant scores on the SAT and ACT will remain the same for this student cohort, but may change in subsequent years 20 COMING CHANGES TO FCAT PROGRAM The plans for secondary end-of-course exams are still being finalized End-of-course Algebra I field test will administered to Grade 9 students in May 2010 at selected schools End-of-course exams will be administered on computer except for limited paper-based versions administered to accommodate students with disabilities 21 Interim Assessment Program Baseline Benchmark Assessments (BBA) Interim Assessment (IA) Tests Benchmark Assessment Item Bank Felicia Mallory, Executive Director Denetra Collins, Staff Specialist Purpose of the Baseline Benchmark Assessments (BBA) • To determine students’ baseline knowledge of the Sunshine State Standards in Reading, Mathematics, and Science • To provide teachers with a quick snapshot of students’ initial knowledge and abilities to focus instruction • To provide for state required baseline report in schools classified under the Differentiated Accountability System as Prevent I or II, Correct I or II, or Intervene • Program guide and instructions are available at http://oada.dadeschools.net/IAP/IAP.asp 23 Purpose of Interim Assessment Tests To monitor student progress on the Reading, Mathematics, and Science Sunshine State Standards To provide teachers with classroom assessment tools that will provide reliable student-level benchmark information to inform instruction To provide students with information on their progress on specific benchmarks To provide Differentiated Accountability schools with a reliable and valid assessment tool for state progress reporting 24 Overview of the Interim Assessment Program • Interim Assessment tests administered three times per year: fall, winter, and spring • Alignment with the Sunshine State Standards and District’s pacing guides • Benchmark Assessment Item Banks for Reading, Mathematics, and Science are available in ExamView • Data analysis and disaggregation, score reports, and item analysis are available in Edusoft 25 Interim Assessment Administration Windows, 2009-10 Fall October 23 –November 9, 2009* Winter December 14 – 18, 2009* and January 4 – 15, 2010 Spring April 6 – 16, 2010 *All Differentiated Accountability Intervene and Correct II D or F Schools must complete testing during the first scheduled week. 26 Performance Levels Satisfactory Progress Students who are likely to score in FCAT levels 3 and above Limited Progress Students whose performance was not sufficient to predict success. Insufficient Progress Students who are likely to score below FCAT level 3. This student demonstrated a satisfactory level of achievement on the content focus of the Florida Sunshine State Standards assessed during this instructional period. To attain high levels of achievement in this content area, the student must receive continued instruction on the challenging content and skills across the benchmarks designated for this grade level. This student demonstrated a limited level of achievement on the content focus of the Florida Sunshine State Standards assessed during this instructional period. To attain high levels of achievement in this content area, the student must receive targeted interventions and remediation in the areas of concern, and continued instruction on the challenging content and skills across the benchmarks designated for this grade level. This student demonstrated an insufficient level of achievement on the content focus of the Florida Sunshine State Standards assessed during this instructional period. To attain high levels of achievement in this content area, the student must receive intensive interventions and remediation in the areas of concern, and continued instruction on the challenging content and skills across the benchmarks designated for this grade level. 27 Score Reports Useful reports that can be retrieved via Edusoft: • Class List • Item Analysis • Item Response • Student Performance • Subgroup • Custom Group • Performance Band District School Improvement Plan (SIP) Reports http://osi.dadeschools.net/ 28 Benchmark Assessment Item Bank • To allow teachers to monitor student progress on the Reading, Mathematics, and Science Sunshine State Standards • To provide teachers with classroom assessment tools that will provide reliable student-level benchmark information to inform instruction • To provide students with information on their progress on specific benchmarks Item Bank Resources: • Item Bank Overview • Item Bank Newsletter • Download Examview Test Generator 29 Comprehensive English Language Learners (CELLA) Felicia Mallory, Executive Director Denetra Collins, Staff Specialist 30 Overview of CELLA • CELLA is a four-skill English language assessment measuring student proficiency in listening, speaking, reading, and writing. • Listening, Reading, and Writing are administered in groups • Speaking is administered on a one-on-one basis • Kindergarten students are assessed in all four areas on a one-to-one basis. • CELLA is not a timed test. 31 Purposes of CELLA The test results can provide: • Data useful for charting student progress over time, • Diagnostically useful information about students’ strengths and weaknesses in English, • The language proficiency levels of individual students can be used in making decisions regarding placement into, or exit from English for Speakers of Other Languages (ESOL) programs, • Identifying the proper ESOL level, and • Determining whether Annual Measureable Achievement Objectives (AMAOs) have been met. 32 Annual Measurable Achievement Objectives (AMAOs) AMAO 1: Progressing in English language acquisition annual increases in the number or percentage of students making progress in learning English AMAO 2: Exiting or reaching English language proficiency annual increases in the number or percentage of students attaining English language proficiency by the end of each school year AMAO 3: ELL-Adequate Yearly Progress (AYP) AYP for the ELL subgroup in demonstrating proficiency on grade-level in reading and mathematics on the FCAT 33 Important Dates for 2010 CELLA Administration Individual : April 19 – May 19, 2010 Group : April 26 – May 7, 2010 34 National Assessment of Educational Progress (NAEP) Felicia Mallory, Executive Director Denetra Collins, Staff Specialist Purpose of the National Assessment of Educational Progress (NAEP) • A common nationwide measure of student performance • Reports changes over time • Provides results for the nation, states, and some urban districts • Secondary indicator for state progress and allows national comparisons between states and large urban districts • Used by the President, Congress, and state leaders to set education policy 36 Overview of the NAEP • A representative sample of schools and students are selected • Randomly selected students in grades 4, 8, and 12 are assessed in reading, writing, mathematics, science, U.S. history, civics, and geography • Assessments include multiple-choice and constructed responses • Assessments are administered by NAEP field staff • Assessments are 90 to 120 minutes, which include testing and answering background questions • Accommodations are offered for ELL and SWD students • Results are reported by scale scores, subscales, achievement levels, subgroups, and geography 37 Features of NAEP-TUDA (Trial Urban District Assessment) •Provides district-level data to participating urban districts •Provides a common yardstick to measure student achievement in comparison to Other urban districts States Large Central Cities National Public Schools Census Regions 38 Important Dates for NAEP 2009 Event Date My School Registration and School Data October 1, 2009 Collection Form Assessment Coordinator will contact schools to schedule an assessment visit December 2009 Pre-Assessment packet arrives in selected schools By January 4, 2010 Pre-Assessment visits will be scheduled after registration January 4 – January 22, 2010 NAEP Testing Administration Window January 25 – March 4, 2010 39 NAEP-TUDA Release Dates Subject and Grades Release Date Math – Grades 4 and 8 November 2009 Reading – Grades 4 and 8 February 2010 Science – Grades 4 and 8 April 2010 40 Stanford Achievement Test, Tenth Edition (SAT-10) • Ms. Mayda Cabeza, Director I 41 SAT-10 • History of the SAT-10 • What is the SAT-10? • Who is administered the SAT-10? oGrades 1 and 2, district wide • Important dates to remember oMarch 16-19, 2010 42 SAT-10 • How do SAT-10 materials arrive to schools? • Is the SAT-10 a secure test? • SAT-10 Test Chairperson Training (February 2010) • School level training of test administrators and proctors • Test Administration (untimed) 43 SAT-10 SCANNING/SCORING: Sample SAT-10 Test Booklets and Header Sheets SAT-10 RESULTS • School Listing of Results (May) o Must be picked up at ITS • Individual Student Reports (May-June) o Delivered to schools via school mail • School Content Cluster Analysis (Fall) o Must be picked up at ITS 45 SCHOOL USE OF RESULTS • Referral of students to the district’s gifted program (Plan A or Plan B) • Early identification of students who would be considered at high risk for problems associated with reading comprehension 46 Grade 3 Opportunities for Promotion 47 GRADE 3 OPPORTUNITIES FOR PROMOTION • Section 1008.25, Florida Statutes, (Eliminating Social Promotion) o March FCAT SSS (Level 2 or higher) o Alternative Standardized Reading Assessment ASRA (50th percentile or higher) o Spring Grade 3 Portfolio (“good cause” criteria) o Alternative Assessment for Grade 3 Promotion AAFGTP (45th percentile or higher) o Grade 3 Mid-Year Promotion (GTMYP) 48 GRADE 3 STUDENT READING PORTFOLIO • Administered during the 2nd semester • Scored at the school site • Represents the 3rd opportunity for student to be promoted to grade 4 • Student must demonstrate mastery of the Sunshine State Standards 49 ALTERNATIVE STANDARDIZED READING ASSESSMENT (ASRA) Administered the last two weeks of schools. Students scoring FCAT level 1 and students who did not participate in the spring 2010 FCAT should participate in the ASRA. Represents the 3rd and last opportunity within the school year prior to retention This assessment is scanned via Edusoft therefore results are available immediately. Students must score at or above the 50th percentile on the ITBS to be considered for promotion. 50 ALTERNATIVE ASSESSMENT FOR GRADE 3 PROMOTION • Administered at the end of the summer Reading camp. • Scored locally through ITS • Represents 4th opportunity for students to be promoted to 4th grade • Student must score at the 45th percentile or above on the SAT-10 51 GRADE 3 MID-YEAR PROMOTION (MAT-7) • Administered in late November • Scored at the school site • Represents fifth opportunity for retained 3rd grade students to be promoted to 4th grade • Students must have a passing score on the MAT-7 representing 4th grade work. 52 THE IOWA TESTS Iowa Tests of Basic Skills (ITBS), Grades K - 8 Iowa Tests of Educational Development (ITED), Grades 9 - 12 53 IOWA TESTS New for 2009-2010 Used for ELL placement and plan B gifted placement Replaces the SAT-9 (Gifted) and MAT-7 (ELL) Scored via Edusoft Download a copy of the Iowa Test Guidelines at http://oada.dadeschools.net/TestChairInfo/1382 009-10IowaTestGuidelines.pdf 54 FLORIDA COLLEGE ENTRY-LEVEL PLACEMENT TEST (FCLPT or CPT) Commonly known as the CPT Testing window November 2, 2009 – March 26, 2010 (Optional) CPT test scores may be used for the following: To establish eligibility for Florida Gold Seal Vocational Scholars Award, Bright Future Scholarship Program, and dual enrollment/early college programs. New for CPT as per Senate Bill 1908: Students may be offered remedial coursework through the Adult Vocational Centers during the second semester of grade 11. Included in high school grades 2010 55 SECURITY Standards, Guidelines, and Procedures for Test Administration and Test Security Adopted by School Board General Guidelines Testing program administration manuals and/or program guides Specific guidelines for each program 56 GENERAL SECURITY GUIDELINES DO Provide secure storage Restrict access ◦ Maintain documentation ◦ ◦ (3 or fewer keys) Chain of custody Book assignment to students Send Test Chairs to training Train test administrators and proctors Return materials promptly Schedule lunch breaks around testing schedule DO NOT Do not allow unauthorized access to materials or content Do not open secure materials prior to date allowed Do not allow untrained or uncertified staff to test students o o No coaching/assistance during test administration No viewing, reviewing, copying, debriefing test content 57 REPORTING IRREGULARITIES AND SECURITY VIOLATIONS All school staff are responsible for ensuring appropriate administration procedures and reporting any irregularities. Reporting procedures Specified in Standards, Guidelines, and Procedures for Test Administration and Test Security Test Chairperson / Principal Student Assessment and Educational Testing Regional Center or District Administrative Office Appropriate investigative unit 58 DISTRICT RESOURCES Assessment, Research, and Data Analysis Website: http://oada.dadeschools.net/ Test Chairperson Website: http://oada.dadeschools.net/TestChairInfo/InfoForTestChair.asp Testing Calendar (check for updates regularly): http://oada.dadeschools.net/TestingCalendar/TestingCalendar.asp Guidelines and Tips for School Test Chairpersons: http://oada.dadeschools.net/TestChairInfo/27GuidelinesandTipsforSchoolTest Chairpersons.pdf Standards, Guidelines, and Procedures for Test Administration and Test Security: http://oada.dadeschools.net/TestChairInfo/29testsecuritymanual.pdf 59 CONTACTS • Student Assessment and Educational Testing: • • • Florida Comprehensive Assessment Test (FCAT): • Maria C. Bruguera, Director I • Mara Ugando, Staff Specialist Stanford Achievement Test-Tenth Edition (SAT-10) & Grade 3 Promotion Opportunities: • • • Dr. Sally A. Shay, District Director Mayda Cabeza, Director I Comprehensive English Language Learning Assessment (CELLA), Interim Assessment, and National Assessment of Educational Progress (NAEP): • Felicia Mallory, Executive Director • Denetra Collins, Staff Specialist Test Distribution Center • Magaly Hernandez, Supervisor 60 NEW COMPONENTS FOR HIGH SCHOOL GRADING SYSTEM Ms. Gisela Feild Ms. Vilma Rubiera NEW HIGH SCHOOL COMPONENTS OF SCHOOL GRADES As per Senate Bill 1908, beginning in the 2009-2010 school year, 50% of the school’s grade will be based on the existing FCAT-related factors and the remaining 50% will be based on factors that include: Graduation Rates; Performance and participation in accelerated coursework; The college readiness of the students in reading and mathematics; Growth or decline from year to year. 62 CURRENT FCAT SCHOOL GRADES COMPONENTS, TOTAL POINTS READING MATH WRITING SCIENCE Performance 100 possible pts. Performance 100 possible pts. Performance 100 possible pts. Performance 100 possible pts. Learning Gains 100 possible pts. Learning Gains 100 possible pts. Learning Gains of Lowest 25% 100 possible pts. Learning Gains of Lowest 25% 100 possible pts. TOTAL POINTS 800 POINTS 63 HIGH SCHOOL GRADING MATRIX NEW 50% (WITH POINTS POSSIBLE) GRADUATION ACCELERATION READINESS GROWTH/DECLINE Overall Rate Participation Performance on Reading 200 200 (in 2009-10) 175 (in 2010-11) 150 (in 2011-12) For each component schools may earn up to 20 additional points for GROWTH (40 points for factors worth 200 points) 100 At-Risk Rate Performance 100 100 (in 2009-10) 125 (in 2010-11) 150 (in 2011-12) 100 Total Acceleration Points 300 Total Readiness Points 200 Total Graduation Points 300 Performance on Math For each component schools may lose 5 additional points for DECLINE (10 points for factors worth 200 points) Total NEW HIGH SCHOOL Points Possible 800 64 GRADUATION Graduate Rate Methods Students Not Included in the Calculation Graduates Non-Graduates For use in 2009-10 and 2010-11 Students who transfer to: Other schools (public, private, or Dept. of Juvenile Justice facilities); Home-education programs; Adult education programs Deceased students Standard Dropouts Diploma recipients Special Diploma recipients Certificate Students who transfer to: Other schools (public or private) Home-education programs Deceased students Standard Dropouts National Governors Association (NGA) Rate For use beginning in 2011-12 New Federal Uniform Rate *Note: If federal requirements for the uniform rate change in the interim, Florida’s federal uniform rate calculation will be adjusted accordingly. Diploma recipients of Completion recipients GED recipients Continuing enrollees who are not ontime graduates Certificate of Completion recipients GED recipients Continuing enrollees who are not ontime graduates Special Diplomas Transfers to Adult education programs or Dept. of Juvenile Justice facilities who are not standard diploma recipients. 65 PARTICIPATION IN ACCELERATED COURSEWORK Proposed Calculation: Numerator Denominator 9th-12th* graders that completed an accelerated exam or dual enrollment course during the academic year (weighted) All 11th-12th graders For a school to receive credit for participation in an accelerated course that ends in an exam (e.g., AP, IB, AICE), the student must take the exam. For dual enrollment, a student must earn a grade in the course for a school to receive credit for participation. For industry certification, a student must have taken an industry certification exam on the SBE approved “Industry Certification Funding List” for the year. *To help ensure that 9th and 10th graders taking acceleration exams/courses are prepared to take those exams/courses, schools will only receive participation credit for 9th and 10th graders who successfully complete the acceleration (pass the AP, IB, and/or AICE exam, pass the dual enrollment course, pass the industry certification exam). 66 ACCELERATED COURSEWORK Weighting for Performance in Accelerated Coursework Measure will be based on credits earned. Depending on their score on AP, IB, and/or AICE, students will receive weight in the formula based on the number of postsecondary courses for which the student earns credit as determined by the Articulation Coordinating Committee’s Credit-by-Exam Equivalencies List. (http://www.fldoe.org/articulation/pdf/ACC-CBE.pdf) Successful completion (a “C” or higher) of a Dual Enrollment course leads to students earning credit in one course. Successful passage of an Industry Certification exam. 67 POSTSECONDARY READINESS Proposed Calculation: Numerator Denominator Number of students scoring “ready” on SAT, ACT, and/or CPT any time during their high school careers On-time high school graduates who scored a Level 3 or higher on the 10th Grade FCAT in Reading or Mathematics (depending on component) Separate Measures for Reading and Math. If student takes multiple tests (ACT, SAT, or CPT), the student’s highest score by subtest is used. The scores used to define “ready” are set in State Board of Education Rule 6A10.0315, F.A.C. This measure will be based on all on-time standard high school graduates beginning no later than 2011-12. 68 GROWTH OR DECLINE IN COMPONENTS Schools earn an escalating number of points based on the magnitude of their improvement. Additional points would be awarded based on the number of points the school improved (growth from prior year); up to 20 additional points. Schools will lose 5 points if a component declines by at least 10 percentage points. EXAMPLES GROWTH: A school’s acceleration performance improves from 25% to 32%; the school earns an additional 7 points resulting in a total of 39 points (32 + 7). DECLINE: A school’s acceleration performance declines from 30% to 20%; the school would lose an additional 5 points resulting in a total of 15 points (20 – 5). 69 NEW HIGH SCHOOL GRADE 50% on FCAT Components 800 Points Possible TOTAL POINTS (FCAT + New High School Components) 1600 Points Possible A B C D F 50% on New High School Components 800 Points Possible Grade Scale >= 1050 990 to 1049 870 to 989 790 to 869 < 790 70 Thank You Have A Great Year!