ACCESS for ELLs Training Novemeber 2012

advertisement
ACCESS for ELLs Training
®
Jennifer McCabe M.Ed.
Malden Public Schools
© 2012 Board of Regents of the University of Wisconsin System, on behalf of the WIDA Consortium
www.wida.us
Workshop Outline
Essential background on the WIDA assessments
Test Administration training
Desire2Learn (D2L) online courseware and training
Group Test Administration Procedures (Listening, Reading, Writing
Tests)
Speaking Test — format and scoring
Kindergarten Test
Monitoring Test Security
Interpreting Scores
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
2
Important Dates: ACCESS for ELLs®
Test Administration Training
09/17/12--12/05/12
Test Ordering
10/13/12--10/29/12
Pre-ID Ordering
10/13/12--10/29/12
State Receives Test Materials
12/10/12
Test Window
01/12/13--02/01/13
Order Additional Materials Deadline 01/18/13
Districts Ship Completed Materials
to MetriTech
02/13/13
Reports Shipped to State
04/12/13--04/09/13*
Correction Window
04/09/13--05/12/13
* Subject to change depending on when all test booklets are received by MetriTech
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
3
WIDA
Management
WCER
SEA Steering
Committee
Test
Development
Center for Applied
Linguistics
& WIDA Test Item
Committee
WIDA Consortium / CAL / MetriTech
PDSR
MetriTech, Inc
Standards
Development
Margo Gottlieb &
WIDA Standards
Committee
ACCESS for ELLs Training
4
The WIDA Consortium States
Alabama
Delaware
District of Columbia
Georgia
Illinois
Kentucky
Maine
New Hampshire
New Jersey
North Dakota
Oklahoma
Pennsylvania
Rhode Island
Vermont
Wisconsin
Massachusetts
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
5
Testing
Responsibilities &
Procedures
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
6
Facilitator/DAC Responsibilities
Coordinate test administration activities within the state or
district
Coordinate with WIDA administrators, MetriTech, and the
Center for Applied Linguistics
Schedule the testing dates and ordering booklets
Enroll test administrators in the online training course and/or
providing alternative means of training
Certify test administrators
Arrange for reporting and dissemination of testing results.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
7
Coordinator Responsibilities
Direct assignment of students to tiers
Receive, secure, distribute, and return test materials
Arrange and schedule test sessions and generally
oversee all aspects of test administration
Assure that test administration is performed by properly
trained test administrators
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
8
Test Administrator Responsibilities
Assure accuracy of student demographic information
on test labels
Administer parts of the ACCESS for ELLs® test for
which he/she is certified
Group test (Listening, Reading, Writing)
Speaking test
Kindergarten test
Secure test materials
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
9
Training for
®
ACCESS for ELLs
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
10
Why do the online course?
Do training in own time
Refer back many times if necessary
Access to sample items
Access to sound files and scoring rationale to calibrate
for rating speaking
Download and print Test Administration Manual
Participate in the Discussions Board
Take quizzes for certification
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
11
Certification
Separate certifications in:
Group administration
Speaking test administration
Kindergarten administration
Certification is based on successful quiz completion
(80%)
Qualifications checked by facilitators through Grade
menu
Certification process handled by state
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
12
www.wida.us
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
13
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
14
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
15
Opening the D2L ACCESS training course
Remember
to click on
the + if the
course does
not appear.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
16
Note menu of options
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
17
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
18
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
19
Make use of the sounding board to
post questions, comments, ideas,
and issues; feel free to respond to
your colleagues’ postings as well.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
20
The WIDA Standards
and the ACCESS for
ELLs® Test
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
21
Centrality of the ELP Standards
Classroom
Assessment
Framework
Large-Scale
Assessment
Framework
English Language
Proficiency
Standards
& Performance
Definitions
Model
Performance
Indicators:
Classroom
WIDA Consortium / CAL / MetriTech
Model
Performance
Indicators:
Large-Scale
ACCESS for ELLs Training
22
Overall Organization of Standards
Frameworks for Classroom & Large-Scale Assessment (2)
English Language Proficiency Standards (5)
Language Domains (4)
Grade Level Clusters (4)
Language Proficiency Levels (5)
Model Performance Indicators
Model PIs are the lowest level of
expression of the standards
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
23
The WIDA ELP Standards
Standard 1—SI
English language learners communicate in English for social and instructional
purposes in the school setting.
Standard 2— LA
English language learners communicate information, ideas and concepts
necessary for academic success in the content area of Language Arts.
Standard 3—MA
English language learners communicate information, ideas and concepts
necessary for academic success in the content area of Math.
Standard 4—SC
English language learners communicate information, ideas and concepts
necessary for academic success in the content area of Science.
Standard 5— SS
English language learners communicate information, ideas and concepts
necessary for academic success in the content area of Social Studies.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
24
Five Levels of English Language
Proficiency
5
BRIDGING R
4
3
2
1
6
EXPANDING
DEVELOPING
BEGINNING
E
A
C
H
I
N
G
ENTERING
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
25
Criteria for Proficiency Level Definitions
6
1
2
ENTERING
BEGINNING
3
DEVELOPING
4
5
EXPANDING
BRIDGING
REACHING
Linguistic Complexity: Extent of functional language (text or
discourse)
Vocabulary Usage: Comprehension and use of the technical
vocabulary of the content areas
Language Control: Comprehension and use of phonological,
syntactic, and semantic structure & rules
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
26
Organization of PI’s within Standards
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
27
Individual Model Performance
Indicators (PIs) as Basis of Test Items
Single PI
from strand
Classify living
organisms (such as
birds and
mammals) by using
pictures or icons
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
28
Sequence of Model PI’s within a
Theme Folder
Match sources of
data depicted in
tables, charts, or
graphs from
scientific studies
with research
questions
Extract information
on the use of data
presented in text
and tables
Interpret data
presented in text
and tables in
scientific studies
Model PI’s for a Tier B Theme Folder for 9-12
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
29
ACCESS for
WIDA Consortium / CAL / MetriTech
®
ELLs
ACCESS for ELLs Training
30
WIDA Assessment Tools
W-APT™ (Placement Test)
ACCESS for ELLs®
Secure, large-scale test
Three tiers for each grade level cluster
Tier A: Proficiency levels 1-3
Tier B: Proficiency levels 2-4
Tier C: Proficiency levels 3-5
Approximately one third of the items replaced annually
Administered once per year to satisfy NCLB accountability
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
31
Test Alignment with Proficiency Levels
1
2
3
4
5
ENTERING BEGINNING DEVELOPINGEXPANDING BRIDGING
W-APT™
Tier A
Tier B
Tier C
Annual ACCESS for ELLs®
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
32
Tier Placement
Follow Criteria for Tier Placement (available in
Informational Handbook and at www.wida.us)
Use previous test scores
Use teacher judgment
Keep in mind 70-80% will be Tier B
When in doubt, place the student in the higher
tier
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
33
ACCESS Administration Times
and Weights
Listening (15%):
20-25 minutes, machine scored
Test Times
Speaking,
15
Listening,
25
(Minutes)
Reading (35%):
35-40 minutes, machine scored
Listening
Reading
Writing
Speaking
Writing, 60
Reading, 40
Writing (35%):
Up to 1 hour, rater scored
Test Weights
Speaking,
15%
Listening,
15%
(Percent)
Speaking (15%):
Up to 15 minutes, administrator
scored
Listening
Reading
Writing
Speaking
Writing,
35%
WIDA Consortium / CAL / MetriTech
Reading,
35%
ACCESS for ELLs Training
34
Structure of ACCESS for ELLs
A (adaptive)
K
Grade Level
and Tier
1-2
ABC
3-5
ABC
6-8
ABC
9-12
ABC
Listening — group admin, machine scored
Domains
Reading — group admin, machine scored
Speaking — individual admin, adaptive, TA scored
Writing
— group admin, rater scored
100 (roll-out Spring 2005)
Forms
101 (roll-out Spring 2006)
102 (roll-out Spring 2012)
103 (roll-out Spring 2013)
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
35
Administering Group
Components
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
36
Test Administration Overview
Listening and Reading are administered together in one
group session (approximately 75 minutes)
Writing is administered in a separate group session
(approximately 75 minutes)
15-20 students per group session
Speaking is administered individually
All test sessions must occur within state’s testing window
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
37
Listening Test
Multiple choice
20-25 minutes
Thematically organized
Scripted
Group administered
Machine scored
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
38
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
39
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
40
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
41
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
42
Reading Test
Multiple choice
35-40 minutes
Thematically organized
Group administered
Machine scored
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
43
Examining Reading Items
Across a Strand
Language Arts, Reading, Grades 3-5
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
44
Sample Item
Reading, LA, Grades 3-5, Tier C, P3-5
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
45
Items Tied to Performance Indicators:
Tier C Items
#11: “To Jessica, he was the best dog in the world.” This sentence
shows Jessica’s opinion. Which of the following also shows an
opinion?
PI (p3): Identify language associated with stating opinions found in
fiction or non-fiction text.
#12: When Jessica saw the sign for the lost dog, why did she believe it
was Blue?
PI (p4): Differentiate between statements of fact and opinion found in
various reading selections.
#13: Why does the woman say at the end of the story, “He’s your dog,
all right!”?
PI (p5): Identify author’s reasons or intent for selecting facts or
opinions found in fiction or non-fiction from grade-level language arts
text.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
46
Reading Items Adapted for Tier A
Simpler text and more graphic support
Items at proficiency levels 1, 2, and 3
For example:
1. Which is Blue?
PI (p1): Match labels or identify facts from pictures and
phrases.
2. “I know he has white spots.” Which words in this sentence tell
you it is a fact?
PI (p2): Identify language associated with stating facts found
in short fiction or non-fiction text supported by pictures or
graphics
3. [Same item from Tier C] “To Jessica, he was the best dog in
the world.” This sentence shows Jessica’s opinion. Which of
the following also shows an opinion?
PI (p3): Identify language associated with stating opinions
found in fiction or non-fiction text.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
47
Writing Test
Up to 1 hour
4 tasks per tiered form:
1. SI
2. MA
3. SC
4. Integrated Task on Tiers B and C
(combines LA/SS/SI)
Writing task is modeled for child
Rater scored (by MetriTech)
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
48
Sample Item: Writing Grades 6-8
LA Writing PI — 6-8 P5
Defend positions or stances
using original ideas with
supporting details
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
49
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
50
Speaking Test
Up to 15 minutes per student
No tiers – adaptive format
Individually administered
3 parts per form:
SI
LA/SS
MA/SC
Scored by test administrator
Qualitative ratings assigned according to
Speaking Rubric
Numeric score calculated by MetriTech
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
51
Navigating the Speaking Test
(Grades 1-12)
Part C
Part B
Part A
T1
T1
T2
T2
T2
T3
If score on
level is ?,
Meets, or
Exceeds,
go to next
level task.
If score on
level is
Approaches
or No
Response,
go to Task 1
of Part B.
WIDA Consortium / CAL / MetriTech
END
T1
T3
T3
If score on
level is ?,
Meets, or
Exceeds,
go to next
level task.
If score on
level is
Approaches or
No Response,
go to Task 1 of
Part C.
T4
T5
If score on
level is ?,
Meets, or
Exceeds,
go to next
level task.
T4
T5
If score on
level is
Approaches or
No Response,
stop the
Speaking Test.
ACCESS for ELLs Training
52
Speaking Picture Cue Booklet
Picture Cue booklets are printed two sided and bound in a flip chart format. The
picture cue faces the student and the script faces the test administrator. The
script also includes a thumbnail graphic of what the student is seeing.
Script Side
WIDA Consortium / CAL / MetriTech
Picture Cue Side
ACCESS for ELLs Training
53
Sample Item: Speaking
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
54
Speaking Task: SI, 3-5, Level 1
First let’s talk about things people do outside.
This is a picture of people in a park. I’m
going to ask you some questions about this
picture.
Q1: (Point to TREE) What is this?
Q2: (Point to BALL) What is this?
Q3: (Point to DOG) What is this?
PI:
Respond to WHquestions
WIDA Consortium / CAL / MetriTech
Q4: (If necessary) What else do you see in this
picture (OR) What other things do you see in
this picture?
ACCESS for ELLs Training
55
Speaking Task: SI, 3-5, Level 2
Now listen carefully. I’ve just asked you some
questions about this picture. Now I want you to
ask me some questions about it. (OR) Pretend
you are the teacher and want to ask me some
questions about this picture. For example, you
could ask me, “Where are the people?” OK?
Q1: (Point to BOY ON BIKE) What do you want to
know about him? (OR) Ask me a question about
him.
PI:
Ask and respond
to questions
WIDA Consortium / CAL / MetriTech
Q2: (Point to PICNIC TABLE) What do you want
to know about this? (OR) Ask me a question
about this.
Q3: What other things do you want to know
about his picture? (OR) What’s another
question you can ask me about (anything in)
this picture?
(Answer student’s question.)
ACCESS for ELLs Training
56
Speaking Task: SI, 3-5, Level 3
Now let me tell you something about these
children. (Point to CHILDREN PLAYING
CATCH) Their names are Alex and Leticia.
They like to play catch.
Q1: Do you like to play catch?
Q2: (If “Yes”) What else do you like to do?
Q3: (If “No”) What do you like to do?
PI:
Exchange
personal
information
WIDA Consortium / CAL / MetriTech
Q4: What do you like about __________?
(OR) Tell me something about ___________.
Q5: (If necessary) Tell me more.
ACCESS for ELLs Training
57
Navigating the Test
Part 1: SI
Part 2: LA/SS
T1
Part 3: MA/SC
T1
T1
T2
T2
T2
T3
If score on
task is ?,
Meets or
Exceeds,
go to next
task.
If score on
task is ?,
Meets or
Exceeds,
go to next
task.
or
If score on
task is
Approaches or
No Response,
go to Task 1 of
Folder B.
or
If score on
task is
Approaches or
No Response,
go to Task 1 of
Folder C.
WIDA Consortium / CAL / MetriTech
T3
T3
T4
T5
If score on
task is ?,
Meets or
Exceeds,
go to next
task.
or
T4
T5
If score on
task is
Approaches or
No Response,
stop the
Speaking Test.
ACCESS for ELLs Training
58
Task Level Expectations
Every task and question asked the student is based on a
set of expectations for what the response will look like.
Areas of speech around which scoring expectations are
based
Linguistic Complexity
Expectations of the quantity and organization of the student’s verbal
response
Vocabulary Usage
Expectations of the student’s use of appropriate vocabulary for grade level
and proficiency level
Language Control
Expectations of the student’s control of English grammar, word choice in
context, and the English sound system
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
59
The Scoring Scale
Speaking Test Scoring Scale
Exceeds
Meets
Exceeds task level expectations in quantity and/or quality
Meets all task level expectations in quantity and quality
Approaches
Approaches task level expectations, but falls short in quantity
and/or quality
No Response
No response; response incomprehensible; student unable to
understand directions
“Meets” is highlighted on the scale to emphasize that a task is designed to
elicit speech that will meet expectations of the proficiency level it targets.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
60
Scoring Rules
A rating of Meets or Exceeds each receives a point
value of 1.
There are no extra points awarded a score of Exceeds.
The Exceeds rating indicates a strong expectation that the
student will be able to respond with at least a Meets rating to
the following task in the test.
A rating of Approaches or No Response each receives
a point value of 0.
The 0 point value reflects the fact that the student could not
meet one or more of the requirements of the scoring rubric.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
61
Scoring Rules
If in doubt between a score of Meets or Approaches,
you can mark in the center column below the question
mark (?) on the score sheet and administer the next
task.
 If the student gives a performance that meets the task level
expectations on the next task, assign that task a score of Meets,
and go back and assign the task, previously scored a question
mark, a score of Meets.
 If the student gives a performance that very clearly fails to meet
the task level expectations on the next task, it is most likely that
the performance was also deficient on the previous task.
Assign the current task a score of Approaches or No Response
as appropriate, and go back and assign the task in question a
score of Approaches.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
62
The Scoring Sheet
The Speaking Test Scoring Sheet is found as the last page of the
student test booklet.
In some states that have a longer test window for the speaking test
than for the other tests, the Speaking Test Scoring Sheet is a
separate document.
Test administrators must make a mark on the scoring sheet
immediately after the student responds to the last question in a
task.
The mark represents the student’s performance on the complete
task, not individual questions on the task.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
63
The Scoring Sheet
The scoring sheet should be
filled out completely; that is, a
score for each of the 13 task
items must be marked.
Any task not administered
because the student has reached
a ceiling level within a part
should be marked as Not
Administered.
If a “?” is marked for a task and
resolved with a Meets or
Exceeds by administering the
following task, it is not necessary
to erase the mark.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
64
Speaking Test Materials
Rubrics
Scoring sheet
Samples—sound files
Scored sheets with rationale and transcript
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
65
Kindergarten
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
66
Kindergarten Test
All components individually administered
All components adaptive—stop a test component when
child reaches his/her ceiling
All responses, except for Writing section, recorded by TA
TA scores all components, including Writing, during
administration
Averages 30 minutes per student for all components
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
67
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
68
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
69
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
70
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
71
Accommodations for SwD

In general, accommodations for students with
disabilities are allowable, as outlined in IEP.

Accommodations must not invalidate the test
construct.

See Accommodations section of the Test
Administration Manual for a list of allowable
accommodations for the ACCESS test.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
72
Logistics
Test administrators
Teachers
Other professional staff
Aides?
Students must be grouped by grade level cluster and tier. Tiers
cannot be combined.
Keep the test secure
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
73
Managing Test Security &
Test Operations
for the ACCESS for
ELLs® Testing Window
2012-2013
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
74
Objective
To learn about test security procedures
To explain and clarify the roles and responsibilities of
those involved in testing
To explain and clarify how to handle various possible
security situations
To know what to expect when your test shipment
arrives
Which materials arrive at the district? The school?
How do I keep track of my shipment or order more
materials?
How do I draft a security checklist?
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
75
Security Plan: General Overview
Roles and Responsibilities
Our state/district/school security plan and testing dates
District-level security
Materials
Follow-up
Procedures
Checklists
School-level security
Materials
Follow-up
Procedures
Checklists
Contact information for MetriTech
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
76
General Security Guidelines
Only test administrators or other authorized staff
may handle secure test materials.
Place all secure materials in locked storage.
Do not leave materials unattended before or after
testing.
Do not share any specific test information with
students prior to or after testing.
Do not copy any test booklets or other secure
materials.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
77
Roles and Responsibilities (1)
District Assessment Coordinator
 Serve as main contact with MetriTech, Inc.
 prepares list of grades to be tested in each school, list of
testing materials required by each school, and testing schedule
of each school
 Coordinates ordering and distribution of test materials to the
schools and returning of test materials to MetriTech
 Takes inventory of materials distributed and returned
 Responsible for training School Assessment Coordinators &
Test Administrators on test administration and security
 Anticipate and answer questions from school assessment
coordinators at your schools
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
78
Roles and Responsibilities (2)
Test Coordinator (at school-level)
 Take inventory of boxes immediately upon their arrival from the
District Assessment Coordinator
 Verify that there are enough testing materials
 Request additional needed testing materials from MetriTech if
necessary
 Coordinate and distribute test materials in your school;
 Take inventory of materials that are returned to District Test
Coordinators
 Remind Test Administrators that all test materials are to be
kept secure and confidential
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
79
Roles and Responsibilities (3)
Test Administrators
 Complete online training course and certification through
Desire2Learn system (www.uwosh.edu/d2l)
 Become familiar with procedures in Test Administration Manual for
test accommodations for ELLs with disabilities
 Fill out the demographic student information on each test booklet (if
pre-ID labels were not ordered)
 Administer the components of ACCESS for ELLs® for which you are
certified (Kindergarten/Group Components/Speaking)
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
80
Materials Received by the District
District Packing List
Each school’s Packing List
Your state’s schedule
Test Administration Manuals (1 per set of 20 test
booklets)
Test Administration Scripts Speaking Test Picture
Cue Booklet/Script (1 per set of 8 booklets ordered
per grade-level cluster)
10 % overage of Listening, Reading and Writing
test booklets
Return instructions and labels
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
81
Sample District Security Checklist
Grade
Materials
Kindergarten
Test Booklets
# of copies
Administrator’s scripts
1-2 Tier A
Test Booklets
Administrator’s scripts
1-2 Tier B
Test Booklets
Administrator’s scripts
1-2 Tier C
Test Booklets
Administrator’s scripts
1 -2
WIDA Consortium / CAL / MetriTech
Speaking Tests
ACCESS for ELLs Training
82
Materials for Each School
School Packing List
Grade/Tier Header Sheets
Documentation of Materials Not Returned form
District and School Test Administration Manuals
(1 per set of 20 test booklets)
Speaking Tests for each grade-level cluster;
Listening, Reading and Writing test booklets and
scripts for each grade/tier tested
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
83
School Procedures Upon Receipt
of Test Materials
Divide test booklets into groups for each scheduled testing session
Test booklets may not be distributed prior to testing session
Students must use Number 2 pencils; the scanning equipment
used to score answer documents will not read anything but
Number 2 pencil marks
Place pre-ID labels containing the student demographic information
in the box on the front cover of the test booklet
If pre-ID labels were not ordered or if any label contains incorrect
information, the student demographic information must be filled in by
hand; school test coordinator will give District Code number and
School Code number to test administrators
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
84
Sample School Security Checklist (Part 1)
School Security Checklist
ACCESS for ELLs® Check List
Spring 2012
District:________________ School:___________________
DIRECTIONS: The School Test Coordinator must make sure that the test
administrator has signed the Agreement to Maintain Confidentiality
before issuing secure test materials. The test administrator must date
and sign this form when secure test materials are issued. The School
Test Coordinator must sign this form when secure test materials are
returned.
NOTE: The School Test Coordinator should keep one copy of all completed
forms and return the original to the District Test Coordinator with the
secure test materials.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
85
School Security Checklist (Part 2)
Grade
Materials
Kindergarten
Test Booklets
# of copies
Receiving Test
Administrator’s
Signature
Date & Time
Received
School Test
Coordinator’s
Signature
Date and
Time
Returned
Administrator
scripts
1-2 Tier A
Test Booklets
Administrator
scripts
1-2 Tier B
Test Booklets
Administrator
scripts
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
86
MetriTech Contact Information
Telephone: (217) 398-4868
Toll-Free: (800) 747-4868
Fax: (217) 398-5798
E-mail: wida@metritech.com
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
87
Interpreting ACCESS for ELLs® Results
Be familiar with the ELP Performance
Definitions
Target certain reports to specific
stakeholders
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
88
Consider summarizing or consolidating the
suggestions for using the information from
each score report according to target
audience.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
89
Look at different configurations of
data in the reports for individual
and group placement or to
develop a plan for organizing
services for English Language
Learners for the coming school
year.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
90
Types of Scores
Raw Scores---by ELP Standard
Scale Scores
Vertically scaled K-12 (100-600)
Scale scores for each language domain are
separate
English Language Proficiency Level (1.0-6.0)
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
91
Scores
Language Domains—Listening, Speaking, Reading, and
Writing
Composite Scores
Oral Language (50% L + 50% S)
Literacy (50% R + 50% W)
Comprehension (30% L + 70% R)
Overall (15% L + 15% S + 35% R + 35% W)
NA (Not Attempted)=Absent
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
92
Types of Reports
Individual Student Parent/Guardian
Teacher
Student Roster
School Frequency Report by Grade
District Frequency Report by Grade
Electronic data from MetriTech
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
93
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
94
What does the parent report tell us?
Information about the student’s English language
proficiency in relation to the WIDA ELP Standards—NOT
information on the student’s academic achievement
Indicates the extent to which a student has acquired
listening, speaking, reading and writing—reflective of a
test given annually.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
95
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
96
How do we use this information?
Standards-based results help inform curriculum,
instruction and assessment of ELLs.
The Overall Score summarizes student’s global
language proficiency.
Domain subscale scores allow for examination of
strengths and weakness by domain.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
97
Raw scores by standards allow for examination of
strengths and weakness by standards
Individual report components offer a starting point for
differentiating instruction and assessment.
Rubrics in Interpretative Guide—Writing and
Speaking—criteria with rubrics scaffold across the
levels of language proficiency and may be used in
assessing classroom tasks and projects throughout the
year.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
98
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
99
Using this information?
Examine scores from each language domain within a
grade level cluster to detect patterns. (To what extent are
there differences in student performance between the
language domains, and are these differences attributed to
second language development or delivery of instructional
services?)
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
100
Continued:
Inform school and district improvement plans for ELLs.
A starting point for grouping students for support services
according to their Overall Score or by their profiles
according to language domains.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
101
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
102
How to use this information
Frequency reports for two consecutive years provide crosssectional data (unless the set of students from one year to the
next is identical, which is highly unlikely.)
If data in this report are used to make cross-sectional
comparisons, this is applicable across grade level clusters, as
ACCESS for ELL’s is a vertically scored test, k-12.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
103
In communicating results of this report, use both the
numbers and their corresponding percents. If numbers
are low, the percent may appear distorted if shown in
isolation.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
104
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
105
How do we use this information?
This report may serve as a district’s estimate of the number
and/or percent of students who have met criterion for Annual
Measurable Achievement Objectives (AMAO’s).
Data can be shared with local boards of education or
community groups.
Information will be useful in planning, designing, or
restructuring program services.
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
106
Guide and
Parent/Guardian
Report Translation
available on the
WIDA Website
(www.wida.us)
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
107
For more information, please contact the WIDA
Hotline:
1-866-276-7735 or www.wida.us/helpform
World Class Instructional Design and Assessment, www.wida.us
Center for Applied Linguistics, www.cal.org
Metritech, Inc., www.metritech.com
WIDA Consortium / CAL / MetriTech
ACCESS for ELLs Training
108
Download