Diagnostic Assessment Tools in English fact sheet

advertisement
Diagnostic Assessment Tools in English Fact Sheet
About the assessment tool
A brief description of the
Tool
The Diagnostic Assessment Tools in English are a suite of validated assessment tools to enable teachers to:
 gain additional diagnostic information about students’ learning strengths and challenges in English
 plan for, and monitor the impact of teaching and literacy interventions throughout the year
 monitor student progress in one or more modes of English throughout students’ early literacy
development.
These tools assess the three modes of AusVELS English: Reading and Viewing, Writing, and Speaking and
Listening, and are particularly useful for students who are working outside the typical range of ability for
their age.
What does the assessment
tell you about the child?
These tools help teachers to clarify or elaborate on data obtained from the English Online Interview.
Completing all of the tasks within an assessment tool will provide an indicative AusVELS score. However,
teachers can select to use part of an assessment tool to support assessment of specific skills within reading
and viewing, writing, speaking and listening. If they choose this option, they will obtain assessment
information to inform their teaching but will not obtain an indicative AusVELS score.
Each tool includes questions of a range of difficulty that extend beyond and below the designated standard.
To indicate achievement of an AusVELS Level, students need to have answered most of the questions below
the difficulty level of the targeted AusVELS Level correctly as well as answering some of the questions above
the difficulty level of the targeted AusVELS Level correctly.
What are the educational
aspects being measured?
Early Literacy in English Tools is skill specific and assesses the emergent literacy skills that develop reading,
writing, and speaking and listening capabilities. Early Literacy in English comprises nine assessment tools
covering alphabet letters, comprehending text, concepts of print, phonemes, listening and recall, oral
language, phonological awareness, reading and writing.
There are nine Early Literacy in English Tools:

Alphabet Letters

Comprehending Text

Concepts of Print

Listening and Recall

Oral Language

Phonemes

Phonological Awareness

Reading

Writing
These tools are designed for students working towards AusVELS Foundation level, but they are divided into
three levels, these being Beginning (well below Progression Point 0.5), Progressing (around Progression Point
0.5) and Working Towards AusVELS Level 1.
The information gathered through the administration and marking of these tools provides teachers with
diagnostic information about students’ strengths and areas for future improvement and supports planning of
appropriate learning programs. Given the focused nature of these tools, the Early Literacy in English Tools
does not provide an indicative AusVELS English score.
The Monitoring Progress Tools is used to monitor student progress and identify areas requiring specific
teaching for students working towards AusVELS Levels 1 - 4.
These tools include:
 Reading and Viewing – covering a range of reading skills including retrieving information, linking
information; global understanding, making inferences and reflecting on the text. A range of text
types are used including imaginative, information, narrative and argument.
 Writing – primarily focus on students’ ability to produce first-drafts of complete pieces of writing
for a variety of purposes and to demonstrate appropriate planning and editing skills in narrative
writing, information reports and persuasive writing. Lists of words of increasing complexity and a
range of spelling patterns are also included to provide information about students’ spelling skills.
 Speaking and Listening – focus on comprehensive understanding of complete spoken word
covering oral language retell, comprehension retell and oral language conversation.
What are the components
of the tool (e.g. no of
questions/tasks, question
style, etc.)?
There are nine Early Literacy in English Tools and seventeen Monitoring Progress Tools.
What is the style of
assessment (e.g. interview,
self‐assessment)?
The Early Literacy in English tools are administered one-to-one, and take between 2 - 10 minutes to
administer.
Each of the Monitoring Progress Tools includes a variety of texts or purposes at each level.

The Reading Tool has five different texts at each level.

The Writing Tool has prompts with three different purposes: narrative, persuasive and information
report.

The Speaking and Listening Tool is a series of digital texts that include presentations of information,
instructional presentations and pair discussions. Teachers can select parts of the tools to
administer to find out how students respond to particular kinds of texts or writing purposes.
Alternatively, the teacher can administer all the tasks in the tool to identify the scope of students’
mastery of the skills in a dimension and obtain an indicative AusVELS score.
The Reading and Writing assessments can be completed by an individual, small group or a class, and take
between 30 – 50 minutes to administer.
The Speaking and Listening assessment is completed one-to-one and takes approximately 10 minutes to
administer. Students watch a short video and then answer questions.
An Administration and Marking Guide is provided for each tool. This provides all the information required to
select, administer and mark the tasks and also provides some follow up advice.
What are the limitations of
the tool (if any)?
The administration time for a single task varies from two minutes up to one hour, depending on the task.
The Early Literacy in English tools generally covers a wider range of skills than those described in the AusVELS
Foundation and Level 1. Students are not required to write a personal recount or to use a range of writing
implements and software. There is no assessment of student performance in discussion.
The Monitoring Progress Reading tools cannot address all the aspects of the AusVELS English domain,
especially at Levels 3 and 4. Some issues, such as symbolic meaning and stereotypes cannot be easily
addressed at a system level. These are issues that the classroom teacher needs to discuss with sensitivity to
the cultural backgrounds of students and the influences of those cultures on their understanding of symbols
and stereotypes.
It should be noted that students need to have experience with reading longer texts than those provided in
the Reading tools. Students would benefit from reading authentic electronic and multi-media texts also.
The Writing tools do not require students to produce a final polished piece of work, but the rubrics can be
used to score final pieces.
How long does the
assessment take?
The administration time for a single task varies from two minutes up to one hour, depending on the task.
How was the assessment
tool developed?
The Diagnostic Assessment Tools in English have been developed over 2010 to 2012 in response to the
identified need for early intervention and diagnosis in both low and high-achieving students, and to support
the English Online Interview by providing on-demand diagnostic assessments.
Background to the assessment tool
The project involved close consultation with the DEECD project team and extensive review by teachers, a
Domain Reference Group (DRG) consisting of early literacy experts, special schools, ACER internal experts
and other stakeholders. The project was jointly managed within ACER by the same people who managed the
development of the English Online Interview modules in 2007-08.
The assessment development phase involved participation of teachers through a pilot study. Nine pilot
schools, one per region, were administered draft diagnostic assessments from Prep to Year 5 to ensure
students would be working from AusVELS Foundation to Level 4. The pilot provided an important
opportunity for improving the assessment literacy of participating teachers, as well as ensuring that the
assessments were appropriate in content and practical to implement. DEECD received feedback from
specialist schools who participated in the pilot as a separate DEECD managed small-scale project.
How long has the tool been
used?
Relevant research
underpinning tool
Launched on 28 May 2013.
The Diagnostic Assessment Tools in English project has been developed in consultation with leading
academics and in consideration of current national and international research in the area of early year’s
literacy.
The project report includes a literature review which indicates the tools developed for this project reflect
recent developments in early years teaching and assessment practices and in some instances offer innovative
examples of testing materials that could guide future research. The Literature Review cites research that has
focused on the importance of early intervention and diagnosis for those students struggling with literacy, and
those surpassing expectations to which the Diagnostic Assessment Tools in English have been developed in
response to.
Validation process and
data for the tool
An equating study calibrated the diagnostic tools onto the English Online Interview scale to ensure the items
targeted the designated AusVELS Levels. The equating study also allowed for investigation of the item
statistics to evaluate the measurement integrity of the items. Putting the diagnostic assessments onto the
EOI scale also ensured that new EOI Diagnostic reports could advise teachers about appropriate starting
points in diagnostic tools.
Sixty schools were invited to participate in the equating study and fifty-eight returned student responses to
the assessments. Sufficient data was collected to allow calibration of the diagnostic assessments onto the
EOI scale.
Five schools were selected by DEECD from those participating in the equating study, to investigate teachers’
experience of the Diagnostic Assessment Tools in English and their understanding of the new EOI Diagnostic
Reports.
Supporting Information for the assessment tool
Link to the assessment tool
http://www.education.vic.gov.au/school/teachers/support/Pages/date.aspx
Download