TOM TORLAKSON National Center and State Collaborative California Activities State Superintendent of Public Instruction Common Core State Standards Symposium for Special Educators Monday, December 2, 2013 Kristen Brown, Ph.D. Common Core State Standards and Assessment Consultant Special Education Division TOM TORLAKSON State Superintendent of Public Instruction National Center and State Collaborative (NCSC) California Activities National Center and State Collaborative Overview TOM TORLAKSON State Superintendent of Public Instruction – LED by 5 centers and 26 states – Alternate assessment in grades 3 through 8 and grade 11 – Development of formative, interim, and summative assessments for students with the most significant cognitive disabilities National Center and State Collaborative: Organization Partners TOM TORLAKSON State Superintendent of Public Instruction National Center and State Collaborative: State Partners TOM TORLAKSON State Superintendent of Public Instruction National Center and State Collaborative: A Comprehensive Model TOM TORLAKSON State Superintendent of Public Instruction • CREATE and implement professional development modules and curriculum/instruction resources, including formative assessment strategies and progress monitoring tools • BUILD an alternate assessment based on alternate achievement standards (AA-AAS) for students with the most significant cognitive disabilities • GOAL is to ensure that students with the most significant cognitive disabilities achieve increasingly higher academic outcomes and leave high school ready for post-secondary options How It All Fits Together TOM TORLAKSON State Superintendent of Public Instruction National Center and State Collaborative TOM TORLAKSON State Superintendent of Public Instruction Building an assessment system based on research-based understanding of: • • • • Technical quality of AA-AAS design Formative and interim uses of assessment data Summative assessments Academic curriculum and instruction for students with significant cognitive disabilities • Student learning characteristics and communication • Effective professional development 11 National Center and State Collaborative: A Comprehensive System TOM TORLAKSON State Superintendent of Public Instruction California National Center and State Collaborative Communities of Practice TOM TORLAKSON State Superintendent of Public Instruction Approximately 90 special educators representing Northern, Southern, and Central California have reviewed and commented on the following: – Webinars – Cognitive labs and small-scale item/lesson plan tryouts – Item reviews California National Center and State Collaborative State Advisory Group TOM TORLAKSON State Superintendent of Public Instruction • California Department of Education (CDE) • Special Education Local Plan Areas (SELPA) • Special Education Administrators of County Offices (SEACO) • Curriculum and Instruction Steering Committee (CISC) • Advisory Commission on Special Education (ACSE) • Regional Assessment Network (RAN) • Local Educational Agencies (LEAs) NCSC Pilot and Operational Assessment Activities TOM TORLAKSON State Superintendent of Public Instruction • Winter 2013−2014—Schools prepare for the Pilot Test (Phase I) for item tryouts. • Spring 2014—Sample schools and students will pilot NCSC test items from mathematics and English language arts at each grade level. • Fall 2014—Electronic test forms for operational administration (Phase II) will be piloted • Spring 2015—The operational NCSC assessment will be available for administration. • Summer 2015—Scores will be released for operational assessments and standard setting study will be conducted. Pilot Tests Spring/Fall 2014 TOM TORLAKSON State Superintendent of Public Instruction • Phase I: Test items will be administered broadly to evaluate item performance. • Phase II: Drawing on the item statistics from phase I, test forms will be piloted. Purpose of Pilot (Phase I) TOM TORLAKSON State Superintendent of Public Instruction • Collect data about how students perform on the items • Gather information about how test items function • Examine test administration conditions • Review item scoring processes and procedures • Provide information for the development of Pilot Phase 2 (fall 2014) Features of Pilot (Phase I) TOM TORLAKSON State Superintendent of Public Instruction Pilot – Phase 1: Designed to present all test items to students who are eligible to take the alternate assessment (spring 2014) • All items developed will be piloted to students in all grades and content areas (English language arts, mathematics, and writing). • Students will experience all levels of challenge with the expectation that students will obtain both correct and incorrect answers so statistical information is adequately gathered. What is the Student/Teacher Experience During the Pilot Administration? TOM TORLAKSON State Superintendent of Public Instruction • The student will be tested in three subject areas: English language arts, including writing, and mathematics. • The student will be exposed to 12 content items, except in writing. • The duration of each session is anticipated to be 1.5 to 2 hours and will be conducted over several days during the testing window. • Each student will be tested one-on-one by their teacher. • Each student will have appropriate supports and accommodations and have items read to them as necessary. What is the Student/Teacher Experience During the Pilot Administration? (Cont.) TOM TORLAKSON State Superintendent of Public Instruction • Pilot items will be presented online; however, the teacher will be able to print a hard copy as needed for student access to the items. • For selected response items, the test administrator may enter the student’s response, or the student may do so directly. • For an open-ended item in mathematics, the test administrator will use a scoring rubric to determine if the student responded correctly and will enter the information. • For writing, the student will respond to a writing prompt with appropriate supports and accommodations. Pilot I Registration TOM TORLAKSON State Superintendent of Public Instruction • November 25, 2013: Registration opens to schools To register your school for the phase 1 pilot test visit www.ctb.com/NCSCPilot • January 10, 2014: Final date to register schools participating in the NCSC phase 1 pilot test. Essential Features of Pilot (Phase II) TOM TORLAKSON State Superintendent of Public Instruction Pilot – Phase 2: Designed to try out the test format and adaptive algorithm with students who will take the alternate assessment. (fall 2014) • The items tried out in Pilot Phase II will be the same items as Phase I, but configured to mirror the summative adaptive test design. • Computer adaptive test forms will be developed using constraints based on content design and statistical measures generated from Pilot Phase 1 student performance. Summative Assessment Timeline TOM TORLAKSON State Superintendent of Public Instruction • Full operational assessment for participating states in the spring of 2015 • Standard setting will be conducted based on results in summer 2015 • Reports and technical documentation will be produced in fall 2015 Description of Assessment System TOM TORLAKSON State Superintendent of Public Instruction • Classroom assessments and progress monitoring tools embedded in model instructional materials; professional development on demand modules for teachers to learn to develop their own. • Summative math and ELA tests for grades 3−8 and 11 administered in a 2 month window. • Technology delivery. NCSC Assessment Outcomes TOM TORLAKSON State Superintendent of Public Instruction • Outcomes will include a total score and performance level for mathematics and ELA, which will combine reading and writing. • Separate information for writing will be produced, such as a raw score and/or narrative description of student performance. • At the total score level for each content area, scores will be comparable within year and across years. NCSC Resources NCSC Wiki: Resource Materials https://wiki.ncscpartners.org/mediawiki/index.php/Instructional_Resources TOM TORLAKSON State Superintendent of Public Instruction This wiki has been created to host the materials that educators will need to accomplish these goals and deliver instruction aligned to the CCSS. NCSC Presentations http://www.ncscpartners.org/resources-cop-presentations On this site is a set of training materials on NCSC content, curriculum, and instruction resources. These materials offer information on the CCSS content resources, model curricula, and other tools housed on the NCSC Wiki page. CDE SED CCSS http://www.cde.ca.gov/sp/se/cc/ The site showcases the CCSS and related SBAC and NCSC work by providing information on activities and resources related to the Special Education Community. CDE SED Contact Information TOM TORLAKSON State Superintendent of Public Instruction Kristen Brown, Ph.D. Common Core State Standards and Assessment Consultant Policy and Program Services Unit Special Education Division California Department of Education Telephone: (916) 445-1064 E-mail: kbrown@cde.ca.gov 1