2016 MCAS Alternate Assessment Introduction to MCAS-Alt Massachusetts Department of Elementary and Secondary Education with Measured Progress and MCAS-Alt Teacher Consultants Welcome Introductions Department staff Teacher Consultants Measured Progress Training Specialists Goals for the session To provide you with tools and strategies for constructing the alternate assessment portfolio To help you to understand the alternate assessment process 2 How to link instruction to assessment Massachusetts Department of Elementary and Secondary Education Let’s Agree to: Eliminate distractions Cell phones, email, and internet Participate Work with table mates, minimize/eliminate side chats, review all handouts Take care of your needs Coffee, breaks Use the “Parking Lot” “I have a student who…” Massachusetts Department of Elementary and Secondary Education 3 If a child can’t learn the way we teach, maybe we should teach the way they learn. -Ignacio ‘Nacho’ Estrada 4 Massachusetts Department of Elementary and Secondary Education Educator’s Manual, p. 7 MCAS-Alt Security Requirements Your role is to ensure that evidence is: authentic and portrays student performance accurately. not replicated, altered, or fabricated. Evidence must reflect each student’s unique abilities and performance, regardless of participation in similar classroom activities. 5 ESE may request fact-finding investigation if irregularities are found or reported. Massachusetts Department of Elementary and Secondary Education Educator’s Manual, pp. 9–10 “Who Should Take MCAS-Alt?” IEP team and 504 developers must decide annually in each subject whether the student… — Is generally unable to demonstrate knowledge and skills on a paper-and-pencil test, even with accommodations, AND — Is addressing learning standards that have been substantially modified due to the severity and complexity of their disability, AND — Receives intensive, individualized instruction in order to acquire and generalize knowledge and skills. If so, then he or she should take the MCAS-Alt in that subject. Yes, a student can take the standard test in one subject, and an alternate assessment in another. Massachusetts Department of Elementary and Secondary Education 6 Educator’s Manual, pp. 11, 21—30 Other students who may benefit from the MCAS-Alt If a student with a disability is… — Addressing standards at or near grade-level, — Sometimes able to take a paper-pencil test with accommodations, — Presented with unique and significant challenges in demonstrating knowledge and skills on a test like the MCAS, and — Those challenges cannot be overcome using accommodations on the standard test, Then… 7 — Teams may consider the MCAS-Alt “Grade-level” (grades 3-8) or “Competency” (high school) portfolio. Massachusetts Department of Elementary and Secondary Education MCAS-Alt Terminology 8 Massachusetts Department of Elementary and Secondary Education What’s the “Buzz:” MCAS-Alt Terminology Content Area: The subject in which an MCAS-Alt portfolio is submitted; e.g., English Language Arts/Literacy (ELA), Mathematics, Science and Technology/Engineering (STE) Strand: A group of standards in ELA/Literacy and STE organized around a central idea, concept, or theme. (e.g., Writing, Life Science) Domain: A group of related standards in Mathematics organized around a central idea, concept, or theme. (e.g., Functions) Massachusetts Department of Elementary and Secondary Education 9 MCAS-Alt Terminology-cont’d Cluster: Smaller group of related standards (e.g., “Define, evaluate, and compare functions") Standard: Statement of what all students should know and be able to do. (e.g., 8.F.A.1 – Understand that a function is a rule that assigns to each input exactly one output.) Entry Points: Outcomes described in the Resource Guide that are based on a learning standard at lower levels of complexity or difficulty. Entry points form the basis of the measurable outcome. Access Skills: Developmental (communication or motor) skills that are addressed during standards-based academic activities in the content area being assessed. Massachusetts Department of Elementary and Secondary Education 10 MCAS-Alt Terminology-cont’d Measurable Outcome: A specific goal based on an entry point in the strand/domain required for assessment of a student in that grade. A measurable outcome identifies an acceptable skill to be assessed. Portfolio evidence in each portfolio strand documents the student’s performance of the measurable outcome. (e.g., “Student will sort 3-dimensional shapes by attribute with 80% accuracy and 80% independence”) Resource Guide: Curriculum guide used to determine 11 instruction for students with disabilities based on the Massachusetts Curriculum Frameworks. Massachusetts Department of Elementary and Secondary Education Strand Cover Sheet Sheldon Cooper 12 Massachusetts Department of Elementary and Secondary Education 2015 Resource Guide: ELA Cluster Heading Standards 13 Massachusetts Department of Elementary and Secondary Education 2015 Resource Guide for ELA: Entry Points and Access Skills Access Skills Entry Points Massachusetts Department of Elementary and Secondary Education 14 Access to Your Digital Resources 15 Massachusetts Department of Elementary and Secondary Education Flash Drive Tablets www.mcas-alt.org/materials open PDF version of documents iPads: “Open in” iBooks to save Laptops/computers Windows: My Computer> find drive with flashdrive MAC: Desktop> flashdrive “MCAS-Alt” Massachusetts Department of Elementary and Secondary Education 16 View Flash Drive Contents www.mcas-alt.org/materials 17 Massachusetts Department of Elementary and Secondary Education Flash Drive You Received Today: Contents Includes: Fall 2015 Resource Guides (Updated) English Language Arts and Literacy Mathematics Science and Technology/Engineering 2016 Educators’ Manual for MCAS-Alt PowerPoint Presentations Math Glossary ELA Glossary Writing Scoring Rubrics Literature and Informational text list, with authors Massachusetts Department of Elementary and Secondary Education 18 Quick Tips • Search Text • Comment • Magnify 19 Massachusetts Department of Elementary and Secondary Education Fall 2015 Resource Guide to the Massachusetts Curriculum Frameworks for Students with Disabilities (“Resource Guides”) 20 Massachusetts Department of Elementary and Secondary Education Educator’s Manual, p. 28 Fall 2015 Resource Guides Used as the basis for identifying skills (entry points or access skills) to be assessed in the MCAS-Alt portfolio Intended for use by educators to align and develop instruction for students who have not yet mastered the performance expectations of their peers Outlines a progression of skills from lower to higher complexity (high-, medium-, and low-), based on grade-level learning standards Math and ELA are based on the 2011 Massachusetts Curriculum Frameworks incorporating the Common Core. Science Technology/Engineering is based on the 2001/200621 Massachusetts Curriculum Frameworks. Massachusetts Department of Elementary and Secondary Education Features of the 2015 Resource Guides All entry points are shown on a continuum, from More complex to Less complex, to allow teachers to “spiral” to lower levels of complexity. Entry points were designed to use “as is” to develop measurable outcomes, although some modifications are possible. Access skills are listed at the lowest grade in each strand/domain or topic, for use by students with the most significant disabilities. Some standards, entry points, and access skills provide examples to illustrate and model the standard (“e.g., …”) Massachusetts Department of Elementary and Secondary Education 22 Unique Features of the ELA Resource Guide ELA entry points are numbered to correspond with standard 23 Massachusetts Department of Elementary and Secondary Education Unique Features of the Mathematics Resource Guide The term Domain is used (rather than Strand) to describe groups of standards at grades Pre-K through grade 8 (e.g., “The Number System”) Although Cluster headings likely will change when spiraling to entry points in lower grades, you must remain in the same domain when selecting a skill for the measurable outcome. The term Conceptual Category is used in high school to describe groups of standards (e.g., “Algebra”) Each domain/conceptual category includes low-complexity 24 entry points regardless of the grade-level. Massachusetts Department of Elementary and Secondary Education Mathematics Progression of Skills Must be assessed in Grades 3-8 Choose 3 of the 5 Conceptual Categories to assess in High School 25 Massachusetts Department of Elementary and Secondary Education Features Unique to the Science and Tech/Eng Resource Guide Strands are the science disciplines. Topics are groups of standards within a discipline. The essence of each standard is included (big idea) 26 Massachusetts Department of Elementary and Secondary Education The Path to Assessment… 27 Massachusetts Department of Elementary and Secondary Education Sometimes, It Seems Like This…. Learning Standards as written 28 Massachusetts Department of Elementary and Secondary Education …It Could Be More Like This… Learning Standards Grade Level Entry Points Access Skills 29 Massachusetts Department of Elementary and Secondary Education Educator’s Manual, p. 29 Standards, Entry Points, Access Skills “Essence” of standard: Solve mathematical problems involving 3-D shapes Visually track geometric shapes Access Skills Less Complex Match same shapes with different orientations Sort twodimensional shapes by attribute (e.g., number of sides) Entry Points Calculate the surface area of a cube H.G.-GMD.4 Identify the shapes of two-dimensional cross-sections of three-dimensional objects, and identify threedimensional objects generated by rotations of twodimensional objects. Standard as written More Complex Massachusetts Department of Elementary and Secondary Education 30 Educator’s Manual, p. 28 “How will my student address the learning standards for the MCAS-Alt portfolio?” Students can address a standard in several ways: At the same level of difficulty as non-disabled students in that grade (“at grade-level”) If not, then… At a lower level of complexity (i.e., below grade-level expectations) (“entry point”) Or Address an (“entry point” at a lower grade) For students with the most significant cognitive disabilities who are working on developmental skills, 31 Address an “access skill” during standards-based instruction Massachusetts Department of Elementary and Secondary Education Educator’s Manual, pp. 28, 38 Access Skills Students with the most significant cognitive disabilities will address a developmental skill, if not yet able to address lowest level entry point. For the portfolio, student must address the access skill in the context of a standards–based activity in the required strand/domain assessed in the student’s grade. Possible approaches for students who do not produce written samples: Design instruction that does not require a written product. Record the student’s responses (“teacher-scribed work 32 sample”). Photograph or video the student performing the task (with written consent). Massachusetts Department of Elementary and Secondary Education Required Assessments in Each Grade 33 Massachusetts Department of Elementary and Secondary Education Educator’s Manual, pp. 13-14 MCAS-Alt Requirements Grade 3–4 Must be assessed in the following Strands/Domains Content areas A student in this grade One portfolio strand each in: o Reading o Language (Vocabulary Acquisition and Use) o Writing (Text Types and Purposes) One portfolio strand each in: o Operations and Algebraic Thinking o Measurement and Data One portfolio strand each in: o Reading o Language (Vocabulary Acquisition and Use) o Writing (Text Types and Purposes) 34 One portfolio strand each in: o Operations and Algebraic Thinking o Number and Operations-Fractions English Language Arts 3 Mathematics English Language Arts 4 Mathematics Massachusetts Department of Elementary and Secondary Education Educator’s Manual, pp. 15-16 MCAS-Alt Requirements Grade 5–6 A student in this grade Must be assessed in the following Content areas English Language Arts 5 Mathematics Strands/Domains One portfolio strand each in: o Reading o Language (Vocabulary Acquisition and Use) o Writing (Text Types and Purposes) One portfolio strand each in: o Number and Operations in Base Ten o Number and Operations-Fractions Science and Technology/Engineering One portfolio strand each in any three Science Tech/Eng. Strands English Language Arts One portfolio strand each in: o Reading o Language (Vocabulary Acquisition and Use) o Writing (Text Types and Purposes) 35 6 Mathematics One portfolio strand each in: o The Number System Ratios ofand Proportional Relationships MassachusettsoDepartment Elementary and Secondary Education Educator’s Manual, pp. 17-18 MCAS-Alt Requirements Grade 7 –8 Must be assessed in the following A student in this grade Content areas Content areas One portfolio strand each in: o Reading o Language (Vocabulary Acquisition and Use) . o Writing (Text Types and Purposes) One portfolio strand each in: o Ratios and Proportional Relationships o Geometry One portfolio strand each in: o Reading o Language (Vocabulary Acquisition and Use) o Writing (Text Types and Purposes) English Language Arts 7 8 Mathematics English Language Arts One portfolio strand each in: 36 Mathematics o Expressions and Equations o Geometry One portfolio strand each in any three Science and STE strands (may be done over 2 Technology/Engineering Massachusetts Department of Elementary and Secondary Education years) High School Must be assessed in the following A student in this grade Content areas Content areas 9 OR 10 Educator’s Manual, p. 19 Science and Technology/Engineering English Language Arts 10 Mathematics 3 standards in one of the following disciplines: o Biology o Introductory Physics o Chemistry o Technology/Engineering One portfolio strand each in: o Reading o Language (Vocabulary Acquisition and Use) o Writing (Text Types and Purposes) Any three of five Conceptual Categories : o Number and Quantity o Functions o Algebra o Geometry o Statistics and Probability Massachusetts Department of Elementary and Secondary Education 37 Educator’s Manual, p. 19 Science and Technology/Engineering Different requirements in high school Grades 5 and 8: Any three STE strands; one portfolio strand in each Grades 9 or 10: 3 standards in one of the following disciplines: o Biology, or Introductory Physics, or Chemistry, or Technology/Engineering High School Example: Biology 1 – Learning Standard 2.7 (Meiosis) Biology 2 – Learning Standard 6.4 (Ecology) Biology 3 – Learning Standard 5.1 (Evolution) 38 Evidence may be compiled over two consecutive school years in this subject (in all grades). Massachusetts Department of Elementary and Secondary Education Educator’s Manual, p. 27 Required Portfolio Elements Artistic Cover Portfolio Cover Sheet School Calendar (including holidays, summer school, snow days; previous year for Science, if applicable) Student’s Weekly Schedule Student’s Introduction to the Portfolio Verification Form (signed by parent; or log of attempts) Consent Form for photo or Video (if needed) (Note: Keep on file at school) Massachusetts Department of Elementary and Secondary Education 39 Educators Manual, p. 33 “Core Set of Evidence” A complete Portfolio Strand must include at least the following evidence (except for ELA-Writing): Data Chart Strand Cover Sheet + showing performance of the measurable outcome on at least 8 different dates with brief descriptions + First piece of additional primary evidence* showing performance of the measurable outcome listed on data chart + Second piece of additional primary evidence* showing performance of the measurable outcome listed on data chart * Can be a work sample, video segment, or photograph (or series of photos) that clearly shows a final product. Evidence must be labeled with name, date, percent accuracy,40 and percent independence. Massachusetts Department of Elementary and Secondary Education Strand Cover Sheet Sheldon Cooper 41 Massachusetts Department of Elementary and Secondary Education Data Chart Sheldon Cooper Student will identify examples of personification with 80% accuracy and 80% independence. 42 Massachusetts Department of Elementary and Secondary Education Work Sample Description Label Sheldon Cooper Required information: • • • • Name Date % Accuracy and % Independence Brief Description of the activity (either on a Work Sample Description Label or on the evidence) Massachusetts Department of Elementary and Secondary Education 43 Primary Evidence #1 Sheldon Cooper 44 Massachusetts Department of Elementary and Secondary Education Primary Evidence #2 Sheldon Cooper 45 Massachusetts Department of Elementary and Secondary Education Educator’s Manual p.38 Supporting Documentation Products that show or describe the learning context, but do not show actual performance or a final product Massachusetts Department of Elementary and Secondary Education 46 Educator’s Manual, pp. 37, 70 What is Self-Evaluation? Evidence of choices made by the student For example, that he/she has: Reflected on his or her performance What did I work on? How did I do? Where do I need help? Selected work for the portfolio Chosen materials/activities Set own goal(s) for learning Graphed own performance Monitoring accomplished tasks on a checklist Used a scoring rubric to rate own performance Self-corrected mistakes (as indicated by the teacher) Self-evaluation must be done by the student, not by the teacher. Stickers placed on work are not examples of self-evaluation Massachusetts Department of Elementary and Secondary Education 47 Reflection: An Example of Self-Evaluation Educator’s Manual, pp. 37, 70 Student responded in writing to questions about the work he/she completed. Student used symbols and text to respond to questions about his/her work. 48 Massachusetts Department of Elementary and Secondary Education “Time” for a break 49 Massachusetts Department of Elementary and Secondary Education Portfolio Assessment Process 50 Massachusetts Department of Elementary and Secondary Education Educator’s Manual, pp. 30-37 Steps in Assessing Your Student 1. Identify the assessment requirements for a student in that grade (Educator’s Manual pp 13-19). 2. Identify a standard in the required strand at the grade level of the student (Resource Guide). 3. Identify an entry point (or access skill) for the standard (Resource Guide). 4. Pre-test to find the correct level of difficulty to begin assessing the student. 5. Create the measurable outcome from the selected entry point (or access skill), by adding criteria (e.g. 80% accuracy and 100% independence) 6. Collect and label evidence based on measurable outcome. Massachusetts Department of Elementary and Secondary Education 51 Educator’s Manual, pp. 28–29 How to Identify Which Skill to Assess Identify a strand required for MCAS-Alt in student’s grade. Example: Biology Then, using the Resource Guide, select one standard you feel is appropriate to teach your student. Topic: Heredity, Standard 3.4, (Resource Guide, page 60): Distinguish among observed inheritance patterns caused by several types of genetic traits…. Review all of the entry points, beginning with “more complex” Review what each skill is asking the student to do. Determine which skill seems appropriate, and the level of complexity that meets your student’s needs. Try it with the student does it challenge without being overwhelming? Does it seem within the student’s range? Massachusetts Department of Elementary and Secondary Education 52 Read Entry Points Carefully Review the verb linked to the skill (e.g., describe, identify, match, etc.) The entry point or access skill you select becomes 53 the skill you will assess. Massachusetts Department of Elementary and Secondary Education Educator’s Manual, pp. 28–29 How to Identify a Skill (cont’d) Based on pre-testing, what single skill should be targeted for assessment? Select the skill at the level of complexity that challenges the student. If too challenging, adjust level downward. Describe how the cell’s genetic code is mapped in its DNA. If student masters the skill quickly, then not challenging enough. Identify parents and offspring of different species If challenging and attainable, then that should be the target skill. Sort characteristics by inherited versus not inherited. Once the level of complexity is established, begin collecting data and evidence for the portfolio. Massachusetts Department of Elementary and Secondary Education 54 Educator’s Manual, p. 29 Measurable Outcome Will… Indicate which skill will be assessed and documented. Be based on a grade-level learning standard at a level of complexity appropriate for the student. Be listed on: the Strand Cover Sheet (line 5), data chart, and Work Sample Description labels. Assess the same skill consistently for the portfolio strand. All brief descriptions and evidence must document the same outcome. Allow students to progress toward mastery. Document progress on the data chart. Massachusetts Department of Elementary and Secondary Education 55 Examples of Measurable Outcomes in Three Content Areas The student will… Identify the major stages of the life cycle of a butterfly with 80% accuracy and 100% independence. Order simple fractions on a number line with 90% accuracy and 90% independence. Summarize a text from a story read aloud with 100% accuracy and 100% independence. 56 Massachusetts Department of Elementary and Secondary Education Create a Measurable Outcome Use the Resource Guide to locate an entry point or access skill for the student you discussed with your tablemates. Materials: Excerpt of the entry points from the 2015 Resource Guide or flash drive 2016 Educator’s Manual (“Required Assessments…”), PowerPoint, or flash drive Create a measurable outcome based on the selected entry point. Modify if needed, without altering essential meaning Add % of accuracy and % independence required for mastery Remember to review what the skill asks the student to do (think Bloom’s Taxonomy) Massachusetts Department of Elementary and Secondary Education 57 Forms and Graphs 58 Massachusetts Department of Elementary and Secondary Education Where to find: Forms and Graphs Online: www.doe.mass.edu/mcas/alt/resources.html Registration for trainings in January and March Registration flyer will be posted to www.doe.mass.edu/mcas/alt/resources, under the heading Statewide Training Registration site is at www.mcasservicecenter.com Reminder will be sent to your email address. Flyer will be faxed to your school. Massachusetts Department of Elementary and Secondary Education 59 Forms and Graphs Available at www.doe.mass.edu/mcas/alt/resources.html 60 Massachusetts Department of Elementary and Secondary Education Acceptable Digital Evidence for the Portfolio Submit separate CD, DVD, or flash drive for each student Acceptable digital evidence includes: • • • • • • PowerPoint Word document .pdf files .txt files .jpg (JPEG) DVD or standard movie formats Massachusetts Department of Elementary and Secondary Education 61 Technical Support By telephone (toll-free): 1-866-834-8880 (Measured Progress Tech Support) By email: TechProductSupport@measuredprogress.org When requesting support, have available: Your name, school, and district Your computer platform (Windows or Macintosh) A summary of the problem you are experiencing Expect a response within 24 hours (or sooner). Massachusetts Department of Elementary and Secondary Education 62 Data Charts Educator’s Manual, pp. 30-34 A Data Chart is Required in Every Strand except ELAWriting Choice of Data Chart format: Bar Graph, Line Graph, or Field Data Chart What to include on each: • Student’s name • Standard at the student’s grade • Measurable Outcome aligned with grade-level standard • Data points on at least different dates showing percent accuracy and independence on each date • Brief, clear descriptions beneath each date explaining What student was asked to do and how he or she did it) • Optional, but strongly encouraged: Include ten dates, rather than eight. Massachusetts Department of Elementary and Secondary Education 64 Data Chart Requirements, cont’d Dates must be from current school year for ELA and Math (i.e., 7/1/15 - 4/1/16) Must be from current and/or one previous school year for Science and Tech/Eng (i.e., 7/1/14 4/1/16) Dates for classroom work must reflect days when school was in session No dates on weekends, holidays, during school vacations, snow days, etc., unless marked “homework” 65 Massachusetts Department of Elementary and Secondary Education Educator’s Manual, p. 32 Sample: Bar Graph Measurable Outcome At least 8 different dates are included on graph. Brief descriptions of each activity address what student did and how they did it. Massachusetts Department of Elementary and Secondary Education 66 66 Educator’s Manual, p. 33 Sample: Line Graph Measurable Outcome At least 8 different dates are included on graph. Brief description of each activity addresses what the student did and how they did it. Massachusetts Department of Elementary and Secondary Education 67 Educator’s Manual, p. 34 Sample: Field Data Chart Measurable Outcome At least 8 different dates Responseby-response data collection Brief description on each date addresses what the student did and how they did it. Massachusetts Department of Elementary and Secondary Education 68 Educator’s Manual, p. 37 Determining Accuracy and Independence 1. 2. 3. 4. Determine the outcome – What are you asking the student to do? Determine the activity – How will the student perform the skill? Divide the activity into “items” or steps – See example below Use a system to mark each “item” – For example, +, —, I, P Sample Brief Description: Student answered five comprehension questions about Wayside School read aloud in class. Question Number Question 1 Question 2 Question 3 Question 4 Question 5 Overall Percent Accurate (Correct) or Inaccurate (+, —) + (Correct response) — (Incorrect response) + (Correct response) — (Incorrect response) + (Correct response) 60% accuracy (3 of 5 correct) Independent or Prompted (I, P) P (Verbal prompt) P (Verbal prompt) P (Gestural prompt) P (Verbal prompt) I (No prompt) 20% independence (1 of 5 independent) Massachusetts Department of Elementary and Secondary Education Note: Any prompted response = Not independent 69 Educator’s Manual, p. 30 Brief Descriptions must include: What did the student do? • What skill was assessed? How did the student demonstrate the skill? • What instructional approach was used? • What materials (including name of text) was used? Measurable outcome: Student will sort objects/materials by two properties with 80% accuracy and 100% independence. WHAT Brief description of activity: Student sorted real objects (book, pencil, rock) by size and weight, on a pre-labeled chart. HOW Massachusetts Department of Elementary and Secondary Education 70 Educator’s Manual p. 30 Brief Descriptions must also: Document the same skill throughout the strand, although the conditions (context) may differ. Measurable outcome: Student will multiply two-digit number by a two-digit number using an array or area model with 80% accuracy and 100% independence. WHAT Brief description of activity: Student solved 5 two-digit by two-digit multiplication problems, using arrays created by the student on a whiteboard. HOW Were all aspects of the measurable outcome described in the brief description? Would a scorer understand what the student did? Massachusetts Department of Elementary and Secondary Education 71 Acceptable Brief Descriptions Measurable Outcome: Walter will identify simple machines with 80% accuracy and 100% independence. Date (m/d/y) What the student did (skill): 9/12/14 10/15/14 10/17/14 10/24/14 11/4/14 11/14/14 11/20/14 Identified 2 simple machines by labeling How they pictures did it? in an (approach, adapted materials) textbook After listening to “Simple Machines,” identified 3 simple machines by pointing to correct name of the simple machine Homework: Identified 4 simple machines at home, by making a list of the ones he found Worksheet identified inclined planes and levers as simple machines using pictures and text After watching video, Wheels and Axles, identified wheels and axles around the school Using Home Depot flyer, Walter identified levers and wedges using a bingo dauber After watching Eduhead on the computer, Walter identified inclined planes by matching them to the pictures in the video 12/5/14 Class created a poster of simple machines he identified the simple machines by labeling the poster with Post-it 72 Notes. Massachusetts Department of Elementary and Secondary Education Activity Are the following brief descriptions acceptable? (All measurable outcomes are taken from the Resource Guide.) Measurable Outcome: Mary will answer simple comprehension questions about an informational text with 80% acc. and 100 % ind. (Reading) Brief Description: Read chapter 1 from Fudge, summarized the main idea. Measurable Outcome: Pasqual will find the sum of the values of a mixed group of coins with 80% acc. and 100 % ind. (MD) Brief Description: Student used money to buy a soda. Measurable Outcome: Sophia will label common icons found in the environment with 80% acc. and 100% ind. (Lang.) Brief Description: Verbally named all the EXIT signs on the way to the bus. Measurable Outcome: Yi will distinguish between parallel and intersecting lines with 80 % acc and 100% ind. (G) 73 Brief Description: Worked on EDM during morning group with Miss Sue, pointed to parallel lines, 3/5 prompted. Massachusetts Department of Elementary and Secondary Education Activity Are the following brief descriptions acceptable? (All measurable outcomes are taken from the Resource Guide.) Measurable Outcome: Mary will answer simple comprehension questions about an informational text with 80% acc. and 100 % ind. Brief Description: Read chapter 1 from Fudge, summarized the main idea Not Acceptable Measurable Outcome: Pasqual will find the sum of the values of a mixed group of coins with 80% acc. and 100 % independence. Brief Description: Student used money to buy a soda. Not Acceptable Measurable Outcome: Sophia will label common icons found in the environment with 80% acc. and 100% ind. Acceptable Brief Description: Verbally named all the EXIT signs on the way to the bus. Measurable Outcome: Yi will distinguish between parallel and intersecting lines with 80 % acc and 100% ind. 74 Brief Description: Worked on EDM during morning group with Miss Sue, pointed to parallel lines, 3/5 prompted. Not Acceptable Massachusetts Department of Elementary and Secondary Education Write a Brief Description Use the measurable outcome you created earlier from the entry point or access skill. Create 2 activities that would align with the measurable outcome. Write brief descriptions that describe “what the student did” (skill from the entry point) and “how they did it” (instructional approach and materials) for each activity. Do the brief descriptions address the measurable outcome? Is the action verb synonymous with the verb in the measurable outcome? Then, report out at your table. Massachusetts Department of Elementary and Secondary Education 75 Educator’s Manual, p. 54 Generalized Performance: Different Instructional Methods/Approaches What is Generalized Performance, and where is it found? Variations in “How” the student performed the skill. Brief descriptions on the data chart include the instructional method or approach. Student’s evidence shows us how the student completed the activity. More instructional methods = higher GP score Examples of varied activity formats include: Multiple-choice and open-response formats Verbal and written responses Varied media and materials (not only paper/pencil) Work completed in the community Note: Different settings and people assisting the student do not by themselves demonstrate generalized performance, unless the activity format also differs. Massachusetts Department of Elementary and Secondary Education 76 Portfolio Evidence Educator’s Manual, pp. 30–36 What Is Primary Evidence? Primary Evidence: Evidence that documents the student’s performance of the measurable outcome, including: • Data charts – bar or line graphs: one task or activity per date – field data charts: several tasks on each date, with percentages summarized for each date • Work samples – produced by student (or scribed by teacher), including digital evidence And, if they show the student’s actual performance (i.e., final product): • Photographs that show a final product of instruction • Video segment (up to 3 minutes) Massachusetts Department of Elementary and Secondary Education 78 Educator’s Manual, p. 35 A Photograph is Primary Evidence If… It clearly shows the end product of instruction or a sequence of steps leading to creation of the final product. The work sample is either too large, fragile, temporary, or unsafe to include in a portfolio. Like work samples, photos must be labeled: List the following information on the evidence or on a Work Sample Description label: Student’s name Date % Accuracy and % Independence Brief description of the activity Massachusetts Department of Elementary and Secondary Education 79 Educator’s Manual, p. 35 A Series of Photographs = One Piece of Primary Evidence Student was asked to find a shape by its attribute (i.e., round). Student’s response can be seen clearly. Student was asked to find a shape by its attribute (i.e., with straight sides). Student’s response can be seen clearly. Each series shows a two-step activity that was described and labeled correctly. [Student] September 14, 2015 Accuracy: 100% Independence: 100% Massachusetts Department of Elementary and Secondary Education 80 Could this photograph be used as primary evidence? NO! This photo only shows the context of the learning activity, but no clear evidence of his/her responses. It does not meet the criteria for primary evidence. Massachusetts Department of Elementary and Secondary Education 81 Educator’s Manual, p.35 Video is Primary Evidence If… Student performs a task and no other tangible evidence can be collected; OR It shows the sequence of steps leading to the creation of a final product; OR It shows or describes a work sample that is either too large, fragile, temporary, or unsafe to include in a portfolio. Video evidence must be 3 minutes or less. NOTES: Must include a brief description of the task or activity Must have clear sound quality, or be transcribed in writing. Massachusetts Department of Elementary and Secondary Education 82 Educator’s Manual, p. 35 Teacher-Scribed Work Sample Typically used with students who do not produce written work If a series of trials is conducted at the same time, then it will list the student’s response to each item/trial (i.e., whether accurate and independent). Must describe the materials/context of the activity: What and How activities were conducted. Labeled with name, date, accuracy, independence, other information as needed. Massachusetts Department of Elementary and Secondary Education 83 Educator’s Manual, p. 35 Example of a Teacher-Scribed Work Sample 9/16/15 Jose Starbright A series of tasks recorded by the teacher on one date. 84 Massachusetts Department of Elementary and Secondary Education ELA Resource Guide, p. 5 ELAWriting ELA Resource Guide For the purpose of assessing the ELAWriting strand, use the student’s primary mode of communication to recount/retell, explain, clarify, argue, persuade, create, or express, based on a text they have read (or that was read to them), using any of the text types. 85 Massachusetts Department of Elementary and Secondary Education How does your student communicate? Oral language Sounds Symbols (photos, icons) Objects Gestures Sign language Eye gaze High tech device (e.g., Dynavox) Low tech device (e.g., communication book) Other Massachusetts Department of Elementary and Secondary Education 86 Educator’s Manual, pp. 22-25 ELAWriting Requirements Three different writing samples are required, including any combination of “text types:” Argument/opinion: States a claim or preference, based on a text or topic. Informative/explanatory text: Conveys facts or ideas, based on a text or topic. Narrative: Tells a story, based on real or imagined events. Poetry: Uses figurative language, imagery, sound of words, meter, etc. to express emotion or tell a story. Use entry points and access skills in “Text Types and Purposes” cluster (W.x.1, W.x.2, W.x.3, MA.W.x.3a). Draft/baseline samples: One is required for each text type submitted in final samples. Massachusetts Department of Elementary and Secondary Education 87 Educator’s Manual, pp. 22-25 Scoring the Writing Samples Teachers will pre-score their students’ final writing samples, using standardized scoring rubrics. Separate rubrics were developed by the Department for use with each text type. (see handouts) Completed rubrics must be included in the portfolio. Scorers will verify the teacher’s scores. Scoring rubrics include the following areas: Level of Complexity Demonstration of Skills and Concepts Clarity of Expression Text Structure (words, phrases, sentences) Vocabulary Writing Conventions (mechanics) Independence (frequency of prompts) Self-Evaluation Massachusetts Department of Elementary and Secondary Education 88 Educator’s Manual, pp. 22-25 ELA-Writing 2016 (cont’d) Do not score the draft/baseline sample. No data chart is required. Include completed Work Sample Description label. Use the online Forms and Graphs for the efficient completion of the ELAWriting strand. Example of Measurable Outcome in Writing for a Narrative text: Student will create sentences related to a one or more pictures to tell a story….. Massachusetts Department of Elementary and Secondary Education 89 Educator’s Manual, pp. 22-25 Required Elements for Writing X Baseline writing sample X For each final writing sample (1 of 3) X X + Writing Sample + Writing Sample (not scored) Rubric (scored) + 90 90 Massachusetts Department of Elementary and Secondary Education Educator’s Manual, p. 38 General Reminders: Use only the most current versions of Resource Guides. ELAReading strands must include the name of the published text, or a photocopy if it is teacher- created or downloaded from the web. ELAReading strands must be based either on Literature or Informational text, but not both. Use entry points as listed in the Resource Guide to create measurable outcomes, with minor modifications, if necessary. Outcomes not found in the Resource Guide must be preapproved by the Department. 91 You may also use the standards as written to create a measurable outcome (Call the Department for guidance.) Massachusetts Department of Elementary and Secondary Education Reminders (cont’d): No data charts required for ELAWriting ONLY. Pre-score all final writing samples, using stateprovided scoring rubrics. Data charts that begin at or above 80% in both accuracy and independence are not scorable. Data points that are 0% accuracy and 0% independence are not scorable. 92 Massachusetts Department of Elementary and Secondary Education Educator’s Manual p.30 Reminder: IMPORTANT: First date on chart must begin below 80% accurate or below 80% independent (or both) to show that a new skill was taught. Massachusetts Department of Elementary and Secondary Education 93 Educator’s Manual pp., 3, 30 What’s New? Data points Data points that are listed as 0 percent for both accuracy and independence will not be considered valid data points and will not be scored or included in the minimum of eight data points that address the measurable outcome. 94 Massachusetts Department of Elementary and Secondary Education Educator’s Manual p.3 ELA : Reading ELAReading = “Text Comprehension” The understanding of words, phrases, and sentences in the context of a text, rather than in isolation. Example: A list of idiomatic expressions matched to their meanings should not be included in the portfolio as evidence of text comprehension. Instead, students should identify the meaning of idiomatic expressions as they are used in a specific text. 95 Massachusetts Department of Elementary and Secondary Education Educator’s Manual, p. 38 Possible Modifications to Math Entry Points If conditions are listed in the entry point, such as: …using real-life examples, manipulatives, a visual model, arrays, number sentences, in a real-world problem, etc. Determine whether the condition is necessary to address the skill. If unnecessary, then the entry point can be modified by deleting the condition. Examples: Entry point: Round whole three-digit numbers to the nearest 100 using place value materials. (“…using place value materials” is unnecessary to address the skill, so it can be deleted.) Entry point: Locate unit fractions on a number line. (“…on a number line” is a necessary condition, so it must be Massachusetts Department of Elementary and Secondary Education included.) 96 Educator’s Manual, p. 39 Related Skills in an Entry Point If an Entry Point is written with multiple, related skills: Option 1: Use entry point “As is.” “Student will solve number sentences that represent one-step multiplication and division word problems with 80% accuracy and 100% independence” All work samples and data points must show “solving number sentences involving one-step multiplication and division problems.” OR Option 2: Modify the entry point to address one of the skills. “Student will solve number sentences that represent one-step multiplication 97 word problems with 80%accuracy and 100% independence” All work and all data points must show “solving number sentences involving multiplication” Massachusetts Department of Elementary and Secondary Education Educator’s Manual, p. 53 Using Age-Appropriate Materials The example below, and others like them, are inappropriate to include in student portfolios at grade 6 or higher. Grade 10 Document respectful tasks that are meaningful and developmentally-appropriate. Massachusetts Department of Elementary and Secondary Education 98 Portfolio Submission Date Portfolios must be picked up from the school by UPS on or before Friday, April 1, 2016. Late portfolios will not be scored! Massachusetts Department of Elementary and Secondary Education 99 Contact Information: MA Dept. of Elementary and Secondary Education Daniel Wiener, Administrator of Inclusive Assessment Debra Hand, MCAS-Alt Program Specialist 781-338-3625 Email: dhand@doe.mass.edu Website: www.doe.mass.edu/mcas/alt/ Resources and information: www.doe.mass.edu/mcas/alt/resources Measured Progress Kevin Froton, Project Manager Email: froton.kevin@measuredprogress.org Tech Support for Forms and Graphs Online: (toll-free) 1-866-834-8880 Register for trainings: www.mcasservicecenter.com Massachusetts Department of Elementary and Secondary Education 100