English Interview Online Administration and Selection Advice Module Published by Student Department of Early Childhood Development Melbourne February 2013 Learning Education © State of Victoria (Department and Early Childhood Development) 2013 of Division and Education The copyright in this document is owned by the State of Victoria (Department of Education and Early Childhood Development), or in the case of some materials, by third parties (third party materials). No part may be reproduced by any process except in accordance with the provisions of the Copyright Act 1968, the National Education Access Licence for Schools (NEALS) (see below) or with permission. An educational institution situated in Australia which is not conducted for profit, or a body responsible for administering such an institution may copy and communicate the materials, other than third party materials, for the educational purposes of the institution. Authorised by the Department and Early Childhood 2 Treasury Place, East Melbourne, of Education Development, Victoria, 3002. This document is also available on the internet at www.education.vic.gov.au/school/teachers/teachingresources/disciplin e/english/assessment/Pages/default.aspx Contents English Online Interview assessment period 4 Module selection recommendations 4 EOI Scale Score 5 Score points for each module 5 Module 1 6 Module 2 7 Module 3 8 Module 4 9 EOI Scale Score / Indicative AusVELS Level English Online Interview Administration and Module Selection Advice 10 Page 3 English Online Interview assessment period The English Online Interview assessment period occurs at the beginning of each school year. Details are published on the English Online Interview homepage each year at http://www.education.vic.gov.au/school/teachers/teachingresources/discipline/english/assessment/Pages/default.aspx. It is mandatory for Prep students to be assessed during the English Online Interview assessment period. Schools can elect to use the English Online Interview for students in Years 1 and 2 during the assessment period. To ensure the integrity of data and make valid comparisons of student achievement, all assessments should be finalised within the assessment period. Schools are encouraged to use the Interview during the assessment period to collect baseline data for students in Prep and to track, review and monitor progress for students in Years 1 and 2. Module selection recommendations All modules are available for use during the assessment period. Each module includes tasks and questions of a wide range of difficulty which match the expected range of student achievement for students in years Prep to 2. This decision should be made balancing the recommendations below with the particular needs of the individual student with consideration given to the range of difficulty of the tasks and questions in each module as outlined in the specific module information provided in this document. Following the ACER evaluation of the student data the recommended modules for each year level are: Year Level Recommended Module Start of Prep Module 1 Start of Year 1 Module 2 Start of Year 2 Module 3 When all students in a year level complete a common module, information at an item level across the class can be easily compared. Groups of students with similar teaching needs can be identified based on their responses and patterns and trends of learning within a class can also be identified. If students within a year level are administered different modules the overall results will be directly comparable, however other comparisons can only be made by matching similar items across the different modules. Module 4 is also available. This module could be used with students that have previously completed the English Online Interview in Year 1 and their results indicate they are operating at a higher level than expected and provides flexibility for students who have already completed Module 3. Module 4 provides evidence of achievement at AusVELS levels 2 – 4. Further information on the content of each module is available in the video clips and assessment notes titled Understanding the English Online Interview available on the English Online Interview website at: www.education.vic.gov.au/school/teachers/teachingresources/discipline/english/assessment/Pages/understanding.aspx English Online Interview Administration and Module Selection Advice Page 4 EOI Scale Score Reports in the English Online Interview are based on the EOI Scale score. When Victorian schools were using the VELS, the EOI Scale score was converted to an indicative VELS level. From 2013 the EOI Scale score will be converted to the AusVELS achievement standards but where possible the reports will show both the EOI Scale score and the indicative AusVELS level. As the questions in the English Online interview have not changed and reporting has always been based on the EOI Scale score, it is possible to continue to access and use historical data from the Interview. Score points for each module Each question or task in the English Online Interview has a rubric that teachers use to evaluate students’ responses. The rubrics associate score points with the various responses a student may give to a question. In questions where a response is simply correct or incorrect, the correct response will have a single score point. In other questions, the rubrics generate multiple score points. For example, a rubric with four possible response categories will have three score points for the highest level responses, two score points for the next level responses and one score point for the lowest level responses. ‘No attempt’ is awarded zero score points. The score points awarded for responses to the questions of a module are added to make a total module score. In the following pages the number of scores on a module available at each AusVELS level, mapped on to the English Online Interview EOI scale, is provided for each module. This is used as the basis for identifying how well the module is matched to the expected achievement levels of the target student groups. Care needs to be taken when interpreting data for students who demonstrate achievement at levels where there are relatively few module scores. This applies to students who are working well above expected levels as well as students who are working well below expected levels. Locations on the EOI scale are expressed numerically with scale scores in eoi units. For example, a scale score of 126 eoi units is the location of the boundary between AusVELS Levels 1 and 2. English Online Interview Administration and Module Selection Advice Page 5 Module 1 Module 1 is recommended for students at the beginning of Prep. The following table gives the number of different scores on Module 1 that are available for each AusVELS Level. As shown in the table, almost all of the scores on Module 1 fall in AusVELS Foundation and Level 1, below 126 eoi units. Number of scores AusVELS Level and location on EOI scale on Module 1 AusVELS Level 4 2 above 154 eoi units AusVELS Level 3 3 between 140 and 154 eoi units AusVELS Level 2 7 between 126 and 140 eoi units AusVELS Level 1 16 between 108 and 126 eoi units AusVELS Foundation Level 36 below 108 eoi units Module 1 is well matched to the expected range of achievement levels for most students at the start of Prep. It provides extensive evidence of achievement (52 module scores) to show what students can do as they work in AusVELS Foundation and Level 1. Students working above 126 eoi units are at the upper extreme of the distribution range for students starting Prep. Module 1 provides only a very small amount of indicative evidence of achievement above 126 eoi units – there are only two module scores to indicate skills in AusVELS Level 4, three in AusVELS Level 3 and seven in AusVELS Level 2. English Online Interview Administration and Module Selection Advice Page 6 Module 2 Module 2 is recommended for students beginning Year 1. The following table gives the number of different scores on Module 2 that are available for each AusVELS Level. Most of the scores on Module 2 are for responses that range from AusVELS Foundation to AUSVELS Level 2, below 140 eoi units. There is a small number of module scores (17 scores) in AusVELS Levels 3 and 4. Number of scores AusVELS Level and location on EOI scale on Module 2 AusVELS Level 4 5 above 154 eoi units AusVELS Level 3 12 between 140 and 154 eoi units AusVELS Level 2 20 between 126 and 140 eoi units AusVELS Level 1 27 between 108 and 126 eoi units AusVELS Foundation Level 28 below 108 eoi units Module 2 is well matched to the expected range of achievement levels of most students at the start of Year 1. It provides extensive evidence of achievement (55 module scores) to show what students can do as they work in AusVELS Foundation and Level 1 and provides a reasonable indication of skills in AusVELS Level 2 (20 module scores). Students working at or below 108 eoi units are at the lower extreme of the distribution range for students starting Year 1. Students working in AusVELS Level 3 are at the upper extreme of the distribution for start of Year 1. Module 2 provides only a small amount of indicative evidence of student achievement above 140 eoi units (17 scores). English Online Interview Administration and Module Selection Advice Page 7 Module 3 Module 3 is recommended for students beginning Year 2. The following table gives the number of different scores on Module 3 that are available for each AusVELS level. Most scores on Module 3 are for responses that range from AusVELS Level 1 to AusVELS Level 3 (76 scores), between 108 and 154 eoi units. There are also module scores in AusVELS Foundation (21 scores) and in AusVELS Level 4 (13 scores). Number of scores AusVELS Level and location on EOI scale on Module 3 AusVELS Level 4 13 above 154 eoi units AusVELS Level 3 17 between 140 and 154 eoi units AusVELS Level 2 27 between 126 and 140 eoi units AusVELS Level 1 32 between 108 and 126 eoi units AusVELS Foundation Level 21 below 108 eoi units Module 3 is well matched to the expected range of achievement levels for most students starting Year 2. Module 3 provides extensive evidence of student achievement (59 scores) to show what students can do as they work in AusVELS Level 1 (32 scores) and in AusVELS Level 2 (27 scores). Module 3 provides some indicative evidence of student achievement in AusVELS Level 3 (17 scores) and AusVELS Level 4 (13 scores). English Online Interview Administration and Module Selection Advice Page 8 Module 4 The following table gives the number of different scores on Module 4 that are available for each AusVELS Level. Most of the module scores are for responses that range from AusVELS Level 1 up to responses in AusVELS Level 3 (73 scores) between 108 and 154 eoi units, with some scores in AusVELS Level 4 (16 scores). Data from the October 2009 assessment period indicated that Module 4 is well matched for approximately seventy five per cent of students at the end of Year 2 and is less suited to approximately 25 per cent of students working close to or in AusVELS Level 3. Number of scores AusVELS Level and location on EOI scale on Module 4 AusVELS Level 4 16 above 154 eoi units AusVELS Level 3 21 between 140 and 154 eoi units AusVELS Level 2 27 between 126 and 140 eoi units AusVELS Level 1 25 between 108 and 126 eoi units AusVELS Foundation Level 12 below 108 eoi units Module 4 provides reasonable evidence of achievement in AusVELS Level 1 (25 scores) and AusVELS Level 2 (27 scores). Module 4 also provides some evidence of achievement in AusVELS Level 3 (21 scores) and a small amount of indicative evidence in AusVELS Level 4 (16 scores). Students working below 108 eoi units are at the lower extreme of the distribution for students at the end of Year 2. There are only 12 scores in Module 4 for responses in AusVELS Foundation Level. Students working in AusVELS Level 4 are at the upper extreme of the distribution for the end of Year 2. Module 4 provides a small amount of indicative evidence of student achievement at this level (16 scores). English Online Interview Administration and Module Selection Advice Page 9 EOI Scale Score / Indicative AusVELS Level Indicative AusVELS Level EOI Scale Score A scale score is expressed in EOI units, e.g. the scale score of 120 EOI represents location 120 on the EOI scale. 180 It is important to keep in mind that boundaries between indicative AusVELS levels overlap significantly 170 AusVELS Level 4 160 154 EOI 150 AusVELS Level 3 140 EOI AusVELS Level 2 130 126 EOI 120 AusVELS Level 1 110 108 EOI 100 AusVELS Foundation Level 90 80 AusVELS Foundation level is the region of the scale below 108 EOI AusVELS Level 1 is the region of the scale between 108 and 126 AusVELS Level 2 is the region of the scale between 126 and 140 AusVELS Level 3 is the region of the scale between 140 and 154 AusVELS Level 4 and higher levels is the region of the scale above 154 English Online Interview Administration and Module Selection Advice Page 10