2016 Turnkey Training for Speaking and Writing NYSESLAT Turnkey Training Welcome New York State Education Department Introductions Presenters from MetriTech, Inc. and Center for Applied Linguistics (CAL) Special thank you to our RBE-RN partners and sponsors 2016 NYSESLAT Turnkey Training 2 2016 NYSESLAT Turnkey Training Two Day Training—Activities Day 1: Speaking Scoring Training Day 2: Writing Scoring Training Grades 1–12 Short Constructed-Response (SCR) Rubric Review Grades 1–12 Annotated Student SCR Responses Review & Practice Scoring Grades 1–12 Extended Constructed-Response (ECR) Rubric Review Grades 1–12 Annotated Student ECR Responses Review & Practice Scoring Kindergarten Writing Rubrics and Sample Responses Kindergarten Practice Scoring Sample Training Agendas—Speaking and Writing 2016 NYSESLAT Turnkey Training 3 Training Binder and Purposes Review of Training Binder Content Training Purposes To provide an overview of the 2016 NYSESLAT Testing Program To explain and highlight the dimensions and content of the Speaking and Writing Scoring Rubrics To demonstrate the application of the Speaking and Writing Scoring Rubrics to audio and written student responses To provide an opportunity to practice scoring in a guided setting To review a process for training local educators to score Speaking and Writing responses 2016 NYSESLAT Turnkey Training 4 What Is the NYSESLAT? NYSESLAT annually assesses English language proficiency of NYS English Language/Multilingual Learners (ELLs/MLLs) in Grades K–12 Provides information about ELL/MLLs’ English language development NYSESLAT results help determine the level of support services provided to ELLs/MLLs Resources available on engageny Sample items posted for all grades and modalities 2016 NYSESLAT Turnkey Training 5 NYSESLAT Foundations NYSESLAT measures New Language Arts Progressions—articulation of the Linguistic Demands of New York State Learning Standards for ELA and Literacy Linguistic Demands—the words, phrases, and forms of language that students will need to understand and use in order to participate successfully in instruction Targets of Measurement—the linguistic demands presented at a level necessary for the development of an assessment 2016 NYSESLAT Turnkey Training 6 NYSESLAT Foundations: ToMs READING : GRADE BAND 3–4 Claim Anchor Target of Measurement ToM.R.3-4.1 ANCHOR 1 Students can identify key narrative elements and central ideas in a grade-level text. Students can identify words, phrases, or sentences that signal important individuals, ideas or concepts, events, point of view, and/or the main idea in a grade-level text. GENERAL CLAIM 1 Students can determine information in a grade-level text. TOM.R.3–4.2 ANCHOR 2 Students can identify words, phrases, and sentences used to elaborate on and connect ideas in a grade-level text. identify or refer to: a character, an individual, or a subject the setting or a place the point of view an event or an action a step in a process a feeling an idea, a concept, or a topic a main idea or a message signal or describe: a key detail the motivation of a character or an individual a sequence of events or a chronology of ideas a connection between characters or ideas a cause and effect relationship a comparison or contrast of information a problem and solution relationship TOM.R.3–4.3 ANCHOR 3 Students can determine the meaning of vocabulary in a grade-level text. Anchor statements are the same for all grade bands. Students can identify words, phrases, or sentences that signal or describe key details, sequence, connections, and/or relationships in a grade-level text. Language Purpose/Function Students can determine the literal or figurative meaning of Tier 1 and some Tier 2 vocabulary in a grade-level text. ToMs are the linguistic demands of the NYSLS. Items align to the ToMs. 2016 NYSESLAT Turnkey Training provide: a context clue to determine meaning textual information to determine meaning Items focus on the purposes, functions, or characteristics of the language. 7 Key NYSESLAT Characteristics Five Performance Levels Entering, Emerging, Transitioning, Expanding, and Commanding Integrated Approach to Modalities A cohesive assessment experience similar to the instructional experience found in the classroom Designed to measure language that is embedded in content, not the content itself 2016 NYSESLAT Turnkey Training 8 Key NYSESLAT Characteristics Text Complexity Students engage with texts of grade-level complexity as required by the new York State Learning Standards and aligned with text types encountered in content-area instruction Instructionally Relevant Academic Language Test questions are grounded in academics, not in personal experience or background Test questions focus on language and language structures that support content as opposed to testing content knowledge 2016 NYSESLAT Turnkey Training 9 NYSESLAT Test Structure: Grades 1–12 Administered in grade bands: 1–2, 3–4, 5–6, 7–8, 9–12 Test forms: Speaking or Listening/Reading/Writing (L/R/W) Speaking administered individually Three L/R/W Sessions—group administered Testing times are estimates and for planning purposes only Additional time is allowable for a student to complete the untimed tests Session Grade Band Speaking 1–12 Listening/Reading/Writing Session 1 Listening/Reading/Writing Session 2 Listening/Reading/Writing Session 3 Number of Items/Tasks Total Number of Items/Tasks Estimated Testing Time (minutes) 12 15/student 17 35–55/session 17 35–55/session 20 35–55/session 12 questions Listening: 8 1–12 Reading: 8 Writing: 1 SCR Listening: 8 1–12 Reading: 8 Writing: 1 SCR Listening: 8 1–12 Reading: 11 Writing: 1 ECR 2016 NYSESLAT Turnkey Training 10 Grades 1–12 Test Administration: Listening and Reading Materials Needed by the Examiner Directions for Administration (DFA) for Sessions 1, 2, and 3 Student test booklets for Sessions 1, 2, and 3 Student multiple choice answer sheets, 1 per student per session Pre-recorded Listening CD (and CD player) for Grades 3–12 Materials Needed by the Students L/R/W test booklets for Sessions 1, 2, and 3 Grades 3–12 NYSESLAT answer sheets for Sessions 1, 2, and 3 No. 2 pencils 2016 NYSESLAT Turnkey Training 11 Administration Notes: Grades 1–2 L/R/W Students record answers in test booklet Student answers transcribed to answer sheet by examiner or aide Script for Listening modality in DFA for each session 2016 NYSESLAT Turnkey Training 12 Administration Highlights: Grades 1–12 Speaking administration window: Tuesday, April 12–Friday, May 13 L/R/W administration window: Monday, May 2–Friday, May 13 Four testing sessions: Speaking and three L/R/W sessions Three L/R/W test booklets, each containing a theme-based Listening, Reading, and Writing Section A CD player is necessary for Listening for each of the Grades 3–12 L/R/W testing sessions Braille checklists available for Grades 1–2; braille tests available for Grades 3–12 3 student identification labels—one for each L/R/W booklet All test booklets to be returned to MetriTech after scoring 2016 NYSESLAT Turnkey Training 13 Grades 1–12: Sequencing of L/R/W Test Sessions Administer in testing window (May 2–13, 2016) Administer in numerical sequence (1, 2, then 3) Do not break up L/R/W session by modality Administering one session/day is permissible Not required to administer sessions on consecutive days 2016 NYSESLAT Turnkey Training 14 2016 Test Enhancements: Grades 1–12 Speaking Scorers will be able to indicate that an item was skipped Rephrasing text in DFA to be used with Emerging items when: Student doesn’t respond Student responds in a language other than English Student doesn’t understand the question When student response isn’t audible, examiner can ask student to repeat the response 2016 NYSESLAT Turnkey Training 15 2016 Test Enhancements: Grades 1–12 L/R/W L/R sample questions are unique to each session within a grade span and are not repeated Writing Scoring Guide annotations will be provided below the sample response The Writing Rubric and Scoring Notes have been integrated and are provided in one document 2016 NYSESLAT Turnkey Training 16 NYSESLAT Test Structure: Kindergarten Kindergarten will be tested by modality in 2016 o o o Listening on Day 1—group administered Reading on Day 2—group administered Writing on Day 3—group administered Speaking is administered individually Testing times are estimates and are for planning purposes only Additional time is allowable for a student to complete the untimed tests Session Grade Band Speaking K Listening Number of Items/Tasks Total Number of Items/Tasks Estimated Testing Time (minutes) 12 questions 12 15 K 19 questions 19 35–40 Reading K 18 questions 18 35–40 Writing K 8 Short CR 8 35-40 2016 NYSESLAT Turnkey Training 17 Administration of Kindergarten Tests Materials needed by the examiner: Directions for Administration (DFA) for each modality Student test booklets for each session by modality Student multiple choice answer sheets, 1 per student for Listening and Reading (responses transcribed by examiner or aide) Materials needed by students Test booklet for each modality No. 2 pencils 2016 NYSESLAT Turnkey Training 18 Administration Highlights: Kindergarten Speaking administration window: Tuesday, April 12–Friday, May 13 L/R/W administration window: Monday, May 2–Friday, May 13 Kindergarten testing by modality Listening on Day 1, Reading on Day 2, Writing on Day 3 Students circle answers in test booklets Examiner or aide transcribes responses on answer sheets Braille checklists available for Kindergarten 1 set of student identification labels—for the Writing modality only All test booklets to be returned to MetriTech after scoring 2016 NYSESLAT Turnkey Training 19 Sequencing of Kindergarten Test Sessions Administer Listening, Reading, and Writing modalities in testing window (May 2–13, 2016) Administer in modality sequence (Listening, Reading, then Writing) Administering one modality/day permissible Not required to administer modalities on consecutive days 2016 NYSESLAT Turnkey Training 20 2016 Test Enhancements: Kindergarten Speaking Scorers will be able to indicate that an item was skipped Rephrasing text in DFA to be used with Emerging items when: Student doesn’t respond Student responds in a language other than English Student doesn’t understand the question When student response isn’t audible, examiner can ask student to repeat the response 2016 NYSESLAT Turnkey Training 21 2016 Test Enhancements: Kindergarten L/R/W Major change: Administration by modality (K only) Listening session Reading session Writing session Number of answer choices reduced from 4 to 3 Sample items show students how to circle answers Multi-picture answer choices feature maximum of 3 pictures presented horizontally 2016 NYSESLAT Turnkey Training 22 NYSESLAT Materials Delivery 2016 Dates Activity Beginning Ending Speaking materials delivered to schools Tuesday, April 5 Monday, April 11 Speaking administration period Tuesday, April 12 Friday, May 13 L/R/W materials delivered to schools Monday, April 18 Friday, April 22 L/R/W administration period Monday, May 2 Friday, May 13 Writing scoring materials delivered to schools Wednesday, May 11 Friday, May 13 Scoring of Writing responses Monday, May 16 Thursday, May 26 Deadline to submit answer sheets to scanning centers Thursday, May 26 Deadline to return secure materials to MetriTech, Inc. Friday, June 10 2016 NYSESLAT Turnkey Training 23 Resources Details regarding Spring 2016 NYSESLAT will be found in: School Administrator’s Manual (SAM) Directions for Administration (DFA) Materials available on the engageny web site: www.engageny.org/resource/new-york-state-english-a-second-language-achievement-test-nyseslat-resources 2016 NYSESLAT Turnkey Training 24 2016 NYSESLAT Turnkey Training 25