Request for Information High School Assessment Framework Requirements North Carolina is proposing a new assessment model to replace the current end-of-course assessments in Math I, English II, and Biology. The proposed assessment framework will be designed to maintain high standards and to provide a national comparison of student performance. This framework involves the design and administration of a grade level assessments of reading, mathematics and science administered at grades 9, 10, and 11, which support data for growth and for predictive information so instructional programs may be altered to ensure students are college and career ready at the completion of high school. The purposes of this Assessment Framework are: To provide formative feedback to teachers on student performance and progress toward college and career readiness at grades 9, 10, and 11 To provide students growth information both for school accountability and for the educator evaluation instrument’s Standard 6 To report school performance grades To fulfill ESEA accountability requirements To provide data for state and national comparison To facilitate the evaluation of the feasibility of the proposed framework, the NCDPI is requesting potential vendors respond to this Request for Information by providing the following information on current assessments offered by the vendor. Vendors must explain in detail how their assessments meet each of the following requirements. Vendors may elect to propose a system and specify how the requirements would be fulfilled. For each of the solutions, either current assessments or proposed, the cost per student must be provided. Development Development Timeline: Pilot year 2015–16 Provide process and methodology for identifying a representative sample of students Provide documentation that assessments are based on sound research in assessment (e.g., 2014 Standards for Educational and Psychological Testing) Provide evidence the following accommodations do not invalidate the assessments o Math read aloud o Use of calculators Provide evidence that the assessment model fulfills the summative requirements outlined by the state Provide evidence that reliability estimates for the assessments meet technical standards. Provide content validity evidence that affirms each grade level in mathematics, English language arts/reading and science content standards and depth of knowledge adopted by the North Carolina State Board of Education are fully assessed Provide validity evidence that the assessments measure college-and-career readiness o Academic achievement levels that report grade level proficiency (at least 3 and preferably 5) generated from a research-based standard setting methodology that uses the content standards as the foundation o Academic achievement level descriptors o State and national percentiles 1 March 16, 2015 Provide range of actual content standards measured on each assessment Outline process for revising the assessments due to changes to the content standards and the timeline necessary for implementation Provide evidence that the assessment includes items other than multiple-choice Provide detailed description of any technology-enhanced item types Outline item development process and provide information on the replacement of items over time (if new items will be written and field tested or reclaimed from existing item banks) Provide the approximate number of items, forms and sub-forms, if applicable, per assessment Provide availability of comparable assessments for significant cognitively disabled students Administration Provide testing window requirements and outline the availability of the assessment for administration and scoring Provide an approximate test administration time for each grade level to include reading of directions and set up of computers, if online Provide delivery specifications of the assessments, meaning, online or paper/pencil Provide the technical specifications and requirements for the online platform, if applicable Provide the process for scheduling a student for an online assessment Provide detailed description of the computerized adaptive system, if applicable, to include evidence that all students are measured on all content standards (on-grade level only) and at the same depth of knowledge Provide evidence that the assessments are accessible to all students including students with disabilities and English language learners and provide the following formats o Braille o Large print o One-item per page o Read aloud for mathematics Provide a list accommodations approved for use on paper and online formats Provide a list of the accommodations offered in the online system, if applicable Provide availability of comparable assessments for significant cognitively disabled students Calibration and Scaling Outline plan and timeline for calibration for each assessment and for producing a summative result Provide evidence of how items are calibrated by item type Provide evidence of the scoring model used to include scaling Provide evidence of how each assessment provides student-level reporting of each content standard assessed to guide instruction Provide evidence of how the assessments support growth analysis as generated by EVAAS (a proprietary product of SAS) Scoring Outline process to include the timeline for scoring each assessment Provide time frame for scoring performance-based or constructed response items Provide process for loading scores into North Carolina’s student information management system 2 March 16, 2015 Reporting Provide framework of the reporting system to be used for reporting to parents, teachers, administrators, districts and to the state Provide specifications of assessment reports for students, teachers, schools, districts, and the state for each assessment Provide the delivery system for providing the student, school, and district data files to the state Provide student-level performance feedback specifications for each assessment and document the minimum number of items to report student-level content standards results 3 March 16, 2015