Getting the Most from your ACT Explore and ACT Plan Reporting Package 1 OUR MISSION Helping people achieve education and workplace success OUR VALUES Excellence Diversity Leadership Empowerment Learning Sustainability 2 ACT Learning Insights Team What We Do Insights from ACT Data Insights from Professional Practice Insights from ACT Research LIT-designed Professional Learning Experiences Raise Academic Standards and Increase Achievement to Ensure All Students Are College and Career Ready (CCR) 3 Workshop Objectives Introduction Describe ACT’s definition of college and career readiness Explain ACT’s College and Career Readiness System and how ACT Explore/ACT Plan fit Find key data points in the ACT Explore/ACT Plan Student and Summary Profile Reports Translate data into insights about curriculum, instruction and support at the district, school, and classroom levels 4 Workshop Agenda College and Career Readiness Student Score Report Break Profile Summary Report Item Response Summary Report Early Intervention Rosters Reflections 5 Workshop Materials Workbook Road Map 6 Introduction College and Career Readiness What does College and Career Readiness mean to you? 7 p. 5 8 ACT’s Definition of College Readiness College Readiness is the level of preparation a student needs to be equipped to enroll and succeed – without remediation – in a credit-bearing, first-year course at a two-year or four-year institution, trade school, or technical school. www.act.org/commoncore p. 7 9 ACT’s College and Career Readiness System Components p. 8 10 The Core Practice Framework www.act.org/products/additional-products-assessments/act-core-practice-framework/ 11 ACT National Curriculum Survey® The Foundation of ACT’s College and Career Readiness System Conducted every three to five years Nationwide survey of educational practices and expectations – – – – College instructors High school teachers Middle school teachers Elementary teachers http://www.act.org/research-policy/national-curriculum-survey 12 ACT National Curriculum Survey® The Foundation of ACT’s College and Career Readiness System Identifies the skills and knowledge postsecondary institutions expect of students Guides the development of ACT’s assessments that measure college-ready skills Informs efforts to develop, refine, and update academic standards Inform policymakers and educators 13 Curriculum-based assessments in English, math, reading, and science Career planning component 14 Longitudinal Assessments Common Score Scale Relationship 36 32 25 15 ACT’s College Readiness Benchmarks Test College Course English 8th Grade 9th Grade English Composition 13 14 15 18 Math College Algebra 17 18 19 22 Reading Social Sciences 15 16 17 21 22 Science Biology 20 20 21 24 23 Empirically derived 50% likelihood of achieving a B or higher or about a 75% likelihood of achieving a C or higher in the corresponding credit-bearing college course p. 6 16 Condition of College and Career Readiness, 2012 National Results Percent of ACT-Tested High School Graduates by Number of ACT College Readiness Benchmarks Attained, 2012 http://www.act.org/research/policymakers/cccr12/readiness4.html 17 Condition of College and Career Readiness, 2013 National Results Percent of ACT-Tested High School Graduates by Number of ACT College Readiness Benchmarks Attained, 2013 http://www.act.org/research/policymakers/cccr13/readiness4.html 18 2012-2013 Hawaii Results ACT Explore − 8th Grade Students Percent of 8th Grade Students in Hawaii At or Above Benchmark on ACT Explore, 2013 100 90 80 72 70 60 Hawaii 55 National 50 50 37 40 41 38 30 20 15 19 10 0 English Math Reading Science 19 2012-2013 Hawaii Results ACT Explore − 9th Grade Students Percent of 9th Grade Students in Hawaii At or Above Benchmark on ACT Explore, 2013 100 90 80 67 70 60 Hawaii 52 50 National 45 40 33 35 28 30 22 21 20 10 0 English Math Reading Science 20 2013 Hawaii Results ACT Plan Percent of 10th Grade Students in Hawaii At or Above Benchmark on ACT Plan, 2013 100 90 80 66 70 60 Hawaii 59 National 50 50 39 40 30 35 25 18 20 22 10 0 English Math Reading Science 21 College and Career Readiness Reflections What insights have you gained from learning about ACT’s definition of College and Career Readiness? Record your insights on the Readiness section of your Road Map. 22 Preparing to Unpack the Box www.act.org/learningevents/resources p. 13 23 p. 15 24 Student Score Report p. 16/20 25 Student Score Reports Introduction Components – College readiness indicators – Academic strengths and weaknesses – Suggestions for improvement – Career and postsecondary aspirations Foundation of all aggregate reporting 26 Student Score Report Header 2. Intervention Planning 1. Academic Achievement & Education Planning 3. Career Exploration p. 16/20 27 Report Header Student Information Student’s Name Student’s Grade Level Test Date Student’s School Test Form p. 16/20 28 1. Academic Achievement and Education Planning: Your Scores Student Scores and Norms p. 16/20 29 1. Academic Achievement and Education Planning: Your Scores Estimated Scores on ACT Plan or The ACT p. 16/20 30 1. Academic Achievement and Education Planning: Your Plans High School Course Plans p. 16/20 31 1. Academic Achievement and Education Planning: Your Plans Reported Needs p. 16/20 32 1. Academic Achievement and Education Planning: Your Plans College Readiness p. 16/20 33 1. Academic Achievement and Education Planning: Your Plans Additional Information p. 16/20 34 2. Intervention Planning: Your Skills Item Response Summary and Suggestions for Improvement p. 18/22 35 3. Career Exploration: Your Career Possibilities World of Work p. 17/21 36 3. Career Exploration: Your Career Possibilities World of Work You and the World of Work Your Interests Exploring Career Options p. 17/21 37 p. 17/21 38 3. Career Exploration: Your Career Possibilities World of Work p. 17/21 39 Student Score Report Dissemination What happens next? – Teachers/counselors learn to interpret individual student results – School administrators should be aware of individual student results – Teachers/counselors review results with students – Teachers/counselors review results with parents 40 Student Resources www.explorestudent.org www.planstudent.org 41 Student Score Report Reflections What insights have you gained from examining your Student Score Reports? What implications does this report have for counseling students about: – Curriculum and Course Selection – Intervention and Student Support – Career Possibilities Record your thoughts on the Student Score Report section of your Road Map. 42 Break (15 minutes) 43 p. 25 44 Profile Summary Report Introduction What is the Profile Summary Report? Aggregates the data from Student Score Reports Identifies if students are on target to be college and career ready when they graduate from high school Shows if their coursework aligns with their career interests and educational plans p. 25 45 Frequency Distribution Table Profile Summary Report: Table 1a ACT Explore: Page 2 in Profile Summary Report ACT Plan: Page 2 in Profile Summary Report p. 37/47 46 Frequency Distribution Table Profile Summary Report 191 Total Students Students on target to be college ready Students on the cusp Benchmark Students in need of real intervention 53 (28%) Students Above Benchmark 100 (52%) Students on the Cusp 44 in danger of slipping 41 within 2 points of benchmark 38 (20%) Students Below Benchmark 47 Application Exercise Frequency Distribution Table Use either your ACT Explore or ACT Plan data Complete the activity on p. 27. 10 minutes Answer questions 1-8 p. 37/47 48 ACT’s College Readiness Standards Identify the knowledge and skills students are likely to demonstrate at various score levels on each academic test. Help interpret what the scores earned on ACT Explore, ACT Plan, and The ACT mean. Direct link between what students have learned and what they are ready to learn next. http://act.org/standard/ 49 Statements that describe what students are likely to know and be able to do... And statements that provide suggestions to progress to a higher level of achievement 50 College Readiness Standard Score Ranges Profile Summary Report: Table 1c ACT Explore: Page 4 in Profile Summary Report ACT Plan: Page 4 in Profile Summary Report 48% 9% p. 39/49 51 Profile Summary Report Local Items 12 multiple choice items added by Hawaii Dept. of Education to ACT Explore & ACT Plan Topics covered: – Post-high school plans – Parental education level – Parental involvement in education – Experiences with bullying – Co-curricular activities – Academic behaviors 52 Profile Summary Report Local Item Report: Table 6 p.44/55 / 53 Profile Summary Report Additional information Profile Summary Report also includes: – National comparisons – Differences by ethnic & gender groups – Relation between scores & coursework – Relation between scores and career/educational plans and interests 54 Profile Summary Report Reflections What insights have you gained from examining your Profile Summary Report? What implications do the data reveal for: – – – – Curriculum Staff Development Instruction Intervention/Student Support Record your thoughts on the Profile Summary Report section of your Road Map. 55 p. 56/62 56 Item Response Summary Report Introduction Provides data on the item-by-item performance of your students. Is a very useful tool for curriculum review when used along with the test booklet. Test Form 57 Item Response Summary Report p. 59/64 58 Application Exercise Item Response Summary Report Pick 1 content area. Circle the *asterisked numbers (correct answers) for each question. Use your highlighters to mark only the circled numbers: No Mark 75%+ Green 50-74% Yellow 25-49% Pink 0-24% p. 56/62 59 Application Exercise Item Response Summary Report No color 75-100% Correct Green 50-74% Correct Yellow 25-49% Correct Pink 0-24% Correct 60 Replace image with what is in the workbook and fix the color coding key to match 61 Application Exercise Analysis Look for the following patterns: Dramatic differences from the reference group High percentages clustered around a wrong answer High percentages of omitted questions High percentages clustered around a correct answer Do any of these situations occur more frequently for some domains than others? 62 63 Item Summary Report Reflections What insights have you gained from examining your Item Response Summary Report? What implications do the data reveal for: – – – – Curriculum Staff Development Instruction Intervention/Student Support Record your thoughts on the Item Response Summary Report section of your Road Map. 64 EARLY INTERVENTION ROSTERS p. 68/71 65 Early Intervention Roster Introduction School-level reports that identify students who fall into three categories: – Roster 1: Students indicating they do not plan to finish high school or have no post-high school educational plans 66 ACT Plan Early Intervention Rosters Roster 1: Early Identification 67 ACT Plan Early Intervention Rosters Roster 2: Coursework Intervention – Roster 2: ACT Explore: Students scoring below the national 10th percentile ACT Plan: students with 2a) composite score of 16 or higher who reported they have no plans to go to college 2b) reported that they plan to attend college but earned a composite score of 15 or less, or reported that they do not plan to take college core coursework. 68 ACT Plan Early Intervention Rosters Roster 2a: Coursework Intervention 69 ACT Plan Early Intervention Rosters Roster 2b: Coursework Intervention Which of our students plan to go on to post secondary but lack the necessary skills or don’t plan to take college prep courses? 70 Early Intervention Roster Roster 3: Need for Assistance – Roster 3: Students who expressed a need for help in a particular area This roster can help you identify instructional needs, design intervention strategies, and assist students with reaching their academic and career goals. 71 ACT Plan Early Intervention Rosters Roster 3: Need for Assistance Are we providing programs or services to meet our students’ needs? 72 Reflections What might you add to your intervention program based on these rosters? What have you added to your understanding of College and Career Readiness at your school? 73 Conclusion Workshop Objectives Describe ACT’s definition of college and career readiness Explain ACT’s College and Career Readiness System and how ACT Explore/ACT Plan fit Find key data points in the ACT Explore/ACT Plan Student and School Reports Translate data into insights about curriculum, instruction and support at the district, school, and classroom levels. 74 Additional Resources Future events shown at www.act.org/learningevents Additional questions? Contact Customer Service: 877-789-2925 75 Mahalo Mahalo for all you do for Hawaii’s students! Have a great school year! 76