SCHOOL ASSESSMENT COORDINATOR (SAC) TRAINING
January 13 and 14, 2016
ACCESS for ELLs 2.0
&
Alternate ACCESS for ELLs
Office of Accountability
Research, Evaluation & Assessment
ACCESS 2.0
1 Important Dates
2 Test Overview
3 WIDA Systems : AMS and WIDA-us
4 Roles and Responsibilities : Training Requirements
5 Structure of the Test
6 Before Testing
7 Accommodations
NE
8 Test Security
1
Office of Accountability
Research, Evaluation & Assessment
Introduction
ACCESS for ELLs 2.0
• The ACCESS is an English language proficiency assessment
based on the Minnesota Standards for English Language
Development, developed by the WIDA Consortium.
• There are four language domains assessed by the ACCESS:
Reading, writing, listening and speaking.
NEW
• The ACCESS is administered online at grades 1-12.
NEW
• The test is available in six grade-level clusters:
Grades K, 1, 2-3, 4-5, 6-8, 12.
• The Kindergarten ACCESS is a paper-pencil assessment.
2
Office of Accountability
Research, Evaluation & Assessment
Important Dates
• 12/14/15 - Pre-ID file data provided by the state
• 1/13/16 - Receive paper accommodated and other paper test materials
• 2/1/16 – 3/24/16 - ACCESS for ELLs 2.0 test window
• 4/1/16 - All paper test materials returned to DRC
• 5/23/16 - Retrieve early student-level results in Test WES
• 7/28/16 - Public release of results
• 8/1/16 - District receives student paper results, ISRs
1
3
Office of Accountability
Research, Evaluation & Assessment
Test Overview
2
4
Office of Accountability
Research, Evaluation & Assessment
Benefits of the Online Test
• Built-in accommodations and accessibility features
appropriate for a range of student needs
• Staged adaptivity targets students’ individual range of
language skills
• Increased ease for test administrators
• Logistical flexibility as a result of being able to simultaneously
administer multiple grades and proficiency levels
• Central scoring by DRC for all four domains
• Test Administrators will not need to determine tiers
5
Office of Accountability
Research, Evaluation & Assessment
Student Experience
• Graphic-supported items
• Audio-supported directions
• Narrated and guided introduction by a human voice for each domain test
• Practice items
• Modeled responses for the productive domains
• Simple navigation
•
Embedded accessibility features, such as:
– Magnification
– Highlighter
– Writing tools (e.g. cut and paste, copy, underline)
6
Office of Accountability
Research, Evaluation & Assessment
Domains & Online Grade Level
Clusters
*Note: Kindergarten will remain an interactive, paper-based kit.
7
Office of Accountability
Research, Evaluation & Assessment
Response Capture
• Listening and Reading: student responses will be captured
digitally and scored by the online test engine
• Speaking: student responses will be recorded (captured
digitally) and automatically sent to DRC for scoring by trained
raters
• Writing: typed student responses will be recorded (captured
digitally) and automatically sent to DRC for scoring by trained
raters; handwritten responses will also be returned to DRC for
scoring - - Writing provisions, page 23
8
Office of Accountability
Research, Evaluation & Assessment
Paper-based Test Forms
9
Office of Accountability
Research, Evaluation & Assessment
WIDA Systems
• Assessment Management System (AMS)
• WIDA-us
3
10
Office of Accountability
Research, Evaluation & Assessment
Two WIDA Systems For ACCESS 2.0
WIDA Assessment Management System (AMS)
https://www.wida-ams.us/
• For Test Administration
WIDA-us
https://www.wida.us/
• For Training
11
Office of Accountability
Research, Evaluation & Assessment
WIDA Assessment Management
System (WIDA AMS)
One-stop resource for all tools needed for ACCESS for ELLs 2.0
administration
https://www.wida-ams.us/
12
Office of Accountability
Research, Evaluation & Assessment
WIDA-us
13
Office of Accountability
Research, Evaluation & Assessment
Roles and Responsibilities
4
14
Office of Accountability
Research, Evaluation & Assessment
Roles and Responsibilities - SAC
 ACCESS School Assessment Coordinator
 Inventory test materials immediately upon receipt and returns all test
materials to DRC Inc
 Consolidates and request additional materials needed for testing.
Request additional materials from robin.lane@spps.org or
michael.wirtz@spps.org
 Schedule test sessions
 Makes sure test administration is performed by trained test proctors
 Distributes test materials on each day of the test
 Reminds test proctors that all test materials are to be kept secure and
confidential at all times
15
Office of Accountability
Research, Evaluation & Assessment
Roles and Responsibilities, cont.
Test Administrators
 Completes online WID training for each domain
 Becomes familiar with procedures for test
accommodations for ELLs with disabilities
 Administers the online ACCESS for ELLs via AMS
 For Paper Tests:
- Properly account for test booklet security
immediately
before, during, and after test
administration
- Assures that pre-ID labels are attached to test
booklets
correctly or that student data is properly
bubbled in
on test booklet covers if no label is
provided
16
Office of Accountability
Research, Evaluation & Assessment
Required Training on WIDA-us
Online Test Coordinator Checklist
• Required for School Assessment Coordinators (SACs)
• SAC checklist was emailed to you. Will also be available on REA
Test Coordinator site:
http://rea.spps.org/Test_Coordination2
Online Test Administrator Checklist
• Required for Test Administrators
Handout
• ACCESS 2.0 Training Guidelines
17
Office of Accountability
Research, Evaluation & Assessment
WIDA-us : Required Training
18
Office of Accountability
Research, Evaluation & Assessment
Structure of the Test
5
19
Office of Accountability
Research, Evaluation & Assessment
NEW
Order of Administration
• The new online test is staged adaptive, meaning students will progress
through the test based on their performance on previous folders (test items
grouped around a common theme) and domains. Based on their performance
in an individual folder, the test engine will determine the appropriate next
folder for individual students.
• Students must first take the Listening and Reading tests because their
performance on those domains determines their placement on the remaining
domains (Speaking and Writing).
• Students should take the Listening test first, followed by the Reading test.
Then, students may take Speaking and Writing in either order. This sequence
is reflected in the graphic below.
• The Listening Test and Reading Test may be administered on the same day.
• The Speaking Test and Writing Test cannot be be administered on the same
day as the Listening and Reading Tests.
20
Office of Accountability
Research, Evaluation & Assessment
Estimated Administration Times
Students work at their own pace using the
following guidelines:
21
Office of Accountability
Research, Evaluation & Assessment
Information About the Writing Domain
• The different test delivery and response modes of the Writing
test are designed to meet the needs of all learners:
See Provisions Next Page
See Provisions Next Page
22
Office of Accountability
Research, Evaluation & Assessment
Provisions for the Writing Domain
•
While the ACCESS for grades 1–12 is administered primarily online, there are
provisions for the writing subtest as follows:
•
The grades 1–3 writing subtest is entirely a paper administration, meaning
students will read prompts and write their responses in a paper test booklet.
•
The grades 4–5 writing prompts are presented to students online and students
respond in a writing response booklet. If students in grades 4–5 are competent
at keyboarding and wish to respond online, the school should determine if it
will allow individual students the option to respond online. Students who will
respond online need to be moved to the appropriate session in WIDA AMS.
•
Students in grades 6–12 who are inexperienced, unfamiliar, or uncomfortable
with keyboarding may write their responses in a writing response booklet. The
writing prompts are presented to students online. Students who will respond
on paper need to be moved to the appropriate session in WIDA AMS.
23
Office of Accountability
Research, Evaluation & Assessment
Before Testing
Handouts
• Computer Registration Instructions for ACCESS 2.0
• Flashdrive
6
24
Office of Accountability
Research, Evaluation & Assessment
Register Student Computers
Handout, Page 1
25
Office of Accountability
Research, Evaluation & Assessment
Register Student Computers
Handout, Page 2
26
Office of Accountability
Research, Evaluation & Assessment
27
Office of Accountability
Research, Evaluation & Assessment
Office of Accountability
Research, Evaluation & Assessment
Student Test Tickets & Rosters
29
Office of Accountability
Research, Evaluation & Assessment
Accommodations
• All accommodations must be updated in IEP and 504 plans.
Accommodations are automatically entered into AMS.
• Paper accommodations for the grades 1–12 ACCESS for
ELLs 2.0 will be available as required by a student's
IEP or 504 plan.
• Accommodations Descriptions Document
- Available on REA Test Coordinator site
http://rea.spps.org/Test_Coordination2
7
30
Office of Accountability
Research, Evaluation & Assessment
WIDA Assessment Management
System (WIDA AMS)
Within the system, designated staff may:
• Access any needed user guides or software
downloads
• Add students for test sessions
• Designate accommodations
• Create test sessions
• Print test tickets
• Monitor student progress
• View/print reports
31
Office of Accountability
Research, Evaluation & Assessment
Test Security
•
•
•
•
Nondisclosure Agreement
Test items
Security Measures for 2015-16
Staff Security Training
8
32
Office of Accountability
Research, Evaluation & Assessment
Test Security Policies
•
Nondisclosure Agreement
– Everyone with secure access to ACCESS 2.0 must complete the
Nondisclosure Agreement.
– Test Monitors & data entry personnel must accept the agreement in
PearsonAccess or they will not be able to monitor tests or enter student
responses.
– Everyone with access to the test items must complete the Nondisclosure
Agreement.
– Anyone who may come in contact with or see test items, can be asked by a
student about an item or handle test materials must sign a Nondisclosure
Agreement.
– Paper Nondisclosure Agreement available here on REA website:
http://rea.spps.org/Test_Coordination2
33
Office of Accountability
Research, Evaluation & Assessment
Test Security Policies cont.
•
All Test Items are secure
– Discussions of items are not allowed with students and
co-workers.
– Test items and student tests are not allowed to be reviewed by teachers or
building staff.
– Test items may not be reproduced in any form or by anyone.
– Cell phone cameras are not allowed.
– Emails or discussions in on-line social media are not allowed.
34
Office of Accountability
Research, Evaluation & Assessment
Test Security & Training Proctors
• School SAC Meeting
• You must
˗ hold a training meeting for your monitors,
˗ have them sign-in to prove they attended the meeting,
˗ allow time for monitors to read the non-disclosure agreement,
˗ have them sign one Non-Disclosure Agreement per school year, collect the NonDisclosure Agreements and file.
• Topics to Cover during your Training Session
•
•
•
•
•
•
Proctors must be impartial observers during the test administration.
Reproducing or paraphrasing an item in an email or in writing is a breach in security.
Cell phones, PDAs or translation devices may not be used.
Dictionaries may not be used.
Test Tickets must be collected from students before leaving the testing room.
All instructional posters and graphics in the computer lab or where students will be
taking the ACCESS 2.0 must be covered or removed.
35
Office of Accountability
Research, Evaluation & Assessment
Test Security & Training Proctors, cont.
• Test Administration Report (TAR)
• The TAR is used to record test misadministrations and reasons for invalidations.
• The SAC completes the TAR and forwards a copy to Robin or Michael in the
testing office.
• The TAR must be kept on file for 12 months.
• The TAR is available here on REA website: http://rea.spps.org/Test_Coordination2
• Examples of misadministrations
• A student uses a calculator during a non calculator segment.
• A student engages in inappropriate behavior or action that results in a test being
invalidated.
• A student refuses to take an assessment or cheats on an assessment, requiring the
assessment to be invalidated.
• A student’s responses are transferred by staff from an answer document to the Data
Entry Interface incorrectly.
36
Office of Accountability
Research, Evaluation & Assessment
Security Measures for 2015-16
Tip Line
• MDE has launched a Test Security Tip Line.
• Educators, parents, students and others
can report suspected incidents of cheating,
improper or unethical behavior on any Statewide
assessments.
• Links to the Test Security Tip Line are
available in two places on the MDE web
site.
˗ View the Test Administration page
(MDE>School Support>Test Administration)
˗ View the Testing Information page
(MDE>Just for Parents> Testing Information)
37
Office of Accountability
Research, Evaluation & Assessment
Site Visit Checklist
38
Office of Accountability
Research, Evaluation & Assessment
Front and Back Covers of Test Booklet
SAINT PAUL SCHOOLS
2014-2015
0625
X
MN
123
X
X
X
Place correct student label
here if available.
X X X X
X
MARSS #
Fill in grids if you
do not have a
correct label.
X
X
X
CIF #
39
Office of Accountability
Research, Evaluation & Assessment
Contact Information
For more information, please contact the WIDA Help Desk:
1-866-276-7735 or help@wida.us
MDE
http://education.state.mn.us/mde/index.html
REA Test Coordinator Site
http://rea.spps.org/Test_Coordination2
DRC
DRC Customer Service: WIDA@datarecognitioncorp.com or 1-855-787-9615.
SPPS District Assessment Coordinators (DACs)
Robin Lane
Office; 651-767-8257
Cell: 651-335-3594
Email: robin.lane@spps.org
Michael Wirtz
Office: 651-632-3776
Cell: 651-261-0045
Email: michael.wirtz@spps.org
40
Office of Accountability
Research, Evaluation & Assessment