NYSAA ASSESSMENT COORDINATOR MANUAL 2015-16

advertisement
N Y S AA A S SE S S M EN T
C O O RD I N ATO R
M A NUA L 20 15 - 16
Revision Date: 05/18/2016
All screenshots shown or referred to in this manual are accurate on the Publication Date
noted above.
When this manual is updated, the Revision Date will also be updated. An alert will be
posted on the Test Updates webpage. A summary of changes is included in Appendix A
under Document History.
DYNAMIC LEARNING MAPS CONSORTIUM
NYSAA Assessment Coordinator Manual 2015-16 v YE
COPYRIGHT ©2015
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 1 of 59
1-844-261-6481
SERVICE DESK
Hint: Print this page and keep it handy!
For questions regarding the online testing system or for additional assistance, please
contact the Service Desk at 1-844-261-6481 (toll-free) or DLM-support@ku.edu.
The Service Desk is open Monday through Friday from 7:00 a.m. to 8:00 p.m. Eastern
Time.
The Service Desk is closed or has reduced staffing in observance of the following
holidays:
Martin Luther King Day
President’s Day
Memorial Day
Independence Day
Labor Day
Veterans Day
Thanksgiving
Monday, Jan 18, 2016
Monday, Feb 15, 2016
Monday, May 30, 2016
Monday, July 4, 2016
Monday, Sep 5, 2016
Friday, Nov 11, 2016
Thursday and Friday, Nov 24 and 25, 2016
The Service Desk provides support for a variety of situations, including:
•
•
•
testing environment issues
test administration and user account issues
student information issues
When contacting the Service Desk, provide as much detail as possible about the issues
encountered and the system on which they occurred. Please include:
• your contact information (name and email address)
• the state and district in which your school is located
• error messages, including the testlet number, if applicable to the problem
• operating system and browser information
• status if using a local caching server
• information about network configuration
Test administrators should contact the local Technical Liaison if they encounter technical
issues related to Internet availability, KITE™ Client installation, display resolution,
and/or issues with sound/headphones/speakers, etc.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 2 of 59
1-844-261-6481
NYSAA ASSESSMENT COORDINATOR
MANUAL 2015-16
CONTENTS
Service Desk ............................................................................................................................. 2
Audience and Purpose ............................................................................................................ 5
What’s New In This Version? ............................................................................................... 5
INTRODUCTION ............................................................................................................ 6
Checklists for Assessment Coordinators ............................................................................ 7
About Dynamic Learning Maps ......................................................................................... 13
The Dynamic Learning Maps ...........................................................................................................14
Essential Elements .............................................................................................................................14
Assessment System Design and Delivery ......................................................................................14
Assessment Results ............................................................................................................... 15
About KITE Client and Educator Portal............................................................................ 16
How to Use the DLM Website ............................................................................................ 17
PREPARE FOR THE DLM ASSESSMENT ADMINISTRATION .......................... 19
Overview ................................................................................................................................. 19
Manage District/School Staff Roles and Responsibilities............................................. 19
Develop and Implement a Comprehensive Training Plan............................................ 19
Resources for Data Stewards and Technical Liaisons ...................................................................20
Resources for Test Administrators ..................................................................................................21
Prepare for Assessment Implementation .......................................................................... 23
Monitor and Support Test Preparations and Administration....................................... 24
Form Delivery ....................................................................................................................................26
Scoring a Student’s Response ...........................................................................................................27
Develop a Communication Plan ......................................................................................... 27
EDUCATOR PORTAL USER GUIDE FOR ASSESSMENT COORDINATORS. 28
Required Software................................................................................................................. 28
Supported Browsers ..........................................................................................................................28
PDF Viewer .........................................................................................................................................29
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 3 of 59
1-844-261-6481
Manage User Account ........................................................................................................... 30
Activate Educator Portal Account ...................................................................................................30
Access Educator Portal ......................................................................................................................32
Reset Educator Portal Password ......................................................................................................33
Change Password ..............................................................................................................................35
Complete Security Agreement .........................................................................................................37
Change Display Name ......................................................................................................................38
Change User Role View ....................................................................................................................39
Change Default Organization and Role ..........................................................................................40
Access Data Extracts .............................................................................................................. 40
View a Data Extract ...........................................................................................................................40
Understanding the Accessibility Profile Extract ............................................................................43
Understanding the Accessibility Profile Summary Extract .........................................................44
Understanding the Current Enrollment Extract ............................................................................46
Understanding the Roster Extract ...................................................................................................47
Understanding the Users Extract .....................................................................................................47
Understanding the DLM Test Administration Monitoring Extract ............................................48
Test Administrator Procedures ........................................................................................... 50
Manage Student Data ........................................................................................................................50
Manage Assessments.........................................................................................................................50
KITE CLIENT ................................................................................................................. 51
KITE Client Testing Devices ............................................................................................... 51
Ensure Internet Connectivity .............................................................................................. 51
KITE Procedures .................................................................................................................... 51
GLOSSARY ..................................................................................................................... 52
APPENDIX A ................................................................................................................. 54
Document History ................................................................................................................. 54
APPENDIX B–AGE RANGES FOR TESTING .......................................................... 55
APPENDIX C—REASONS FOR NOT TESTING ..................................................... 56
Enter a Special Circumstance Code .................................................................................... 56
Special Circumstance Codes................................................................................................ 59
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 4 of 59
1-844-261-6481
AUDIENCE AND PURPOSE
This document supports the Assessment Coordinator in preparing schools for the
Dynamic Learning Maps® (DLM®) Alternate Assessment. It also provides information to
enable Assessment Coordinators to support the roles of Data Stewards, Technical
Liaisons, and test administrators/examiners. It provides an overview of the DLM
alternate assessment and includes a checklist of key duties. This document addresses
planning needs, resources, and Educator Portal (EP) procedures.
This DLM-provided manual is designed for Assessment Coordinators in all states in the
DLM Alternate Assessment Consortium. However, your state may have also provided
appendices that provide clarifications and supplemental information specific to your
state. Be sure to check the resources provided on your state’s DLM webpage and follow
any additional instructions provided at the state level.
To learn about updates to Assessment Coordinator resources, such as this manual,
subscribe to Test Updates on the DLM website under Assessments | Operational
Testing.
WHAT’S NEW IN THIS VERSION?
Information about these topics has been added or enhanced in this version.
Topic
Added an appendix regarding Special Circumstance Codes
Page
Error!
Bookmark
not defined.
A more comprehensive list of changes to this manual is included in Appendix A under
Document History.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 5 of 59
1-844-261-6481
INTRODUCTION
This manual provides information and a checklist for the Assessment Coordinator to
support district staff and educators participating in DLM testing. It includes policies and
procedures, and outlines the roles and responsibilities the DLM Alternate Assessment
Consortium has defined for participants.
The DLM Alternate Assessment Consortium has defined four participants/roles in test
delivery. We use these titles throughout the assessment administration manuals and
training resources.
•
•
•
•
test administrator, also known as
educator or examiner
Assessment Coordinator
Data Steward
Technical Liaison
One person may fill
multiple roles.
Information related to the roles of Data Steward and Technical Liaison is included in this
manual only as it supports Assessment Coordinators in their activities. Resources
specifically written for Data Stewards and Technical Liaisons are available on your
state’s page on the DLM website. The roles and responsibilities of the people
administering tests are addressed in the TEST ADMINISTRATION MANUAL (TAM).
How your state defines the tasks and titles may vary. First, check your state’s page on
the DLM website to see if your state has provided additional information.
Title
Task Summary
The Assessment Coordinator is presumed to be at the
district level and is the one main point of contact
between the NYSED, the DLM Alternate Assessment
Consortium, and the district.
Assessment Coordinator
The key duty of the Assessment Coordinator is to
oversee the assessment process, including managing
staff roles and responsibilities, developing and
implementing a comprehensive training plan,
developing a schedule for test implementation,
monitoring and supporting test preparations and
administration, and developing a plan to facilitate
communication with parents/guardians and staff.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 6 of 59
1-844-261-6481
Title
Task Summary
The Data Steward is presumed to be at the district or
school level, but may be at a higher level.
Data Steward
The key duty of the Data Steward is to manage
educator, student, and roster data. The Assessment
Coordinator and Data Steward work together
throughout the year.
The Technical Liaison is presumed to be at the district
or school level, but may be at a higher level.
Technical Liaison
Test Administrator
(Examiner)
The key duty of the Technical Liaison is to verify that
the network and testing devices are prepared for test
administration.
Test administrators are educators who are responsible
for working with Committees on Special Education
(CSEs) to select and enter the accessibility features and
supports for each student into Educator Portal. They
are also responsible for completing Required Test
Administration Training, reviewing and verifying
student data, preparing students for assessment,
instructing students on the Essential Elements (EEs),
and administering the DLM alternate assessments to
students.
CHECKLISTS FOR ASSESSMENT COORDINATORS
The following checklists detail the critical steps for Assessment Coordinators to follow.
Refer to them as you read this manual and prepare your school or district for the DLM
alternate assessments. Follow the links provided for more information, to quickly go to
topics in this guide, or to access other resources.
The checklists are organized into three sets of tasks for different parts of the school year:
1. Before Beginning Assessment
2. Spring Operational Assessment
3. Preparing for Next Year
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 7 of 59
1-844-261-6481
Before Beginning Assessments

Tasks
1. Bookmark your state’s page on the DLM website. Use
the resources on your state’s page to become familiar
with the DLM assessment window(s) identified for
your state, your roles and responsibilities, the roles
and responsibilities of other participants from your
state and district, and the procedures and materials
needed to prepare for the assessment, including the
DLM support resources.
2. Activate your Educator Portal (EP) account by
following the instructions in the KITE activation
email. You will not receive an activation email until
your Data Steward uploads your information into EP.
The State Education Agency (SEA) must upload Data
Steward information.
(If you already have an EP account, skip this step.)
Resources
The DLM website,
Assessments
|Operational Testing
http://dynamiclearning
maps
.org/content/
operational-testing.
Activate Educator
Portal Account,
page 30.
Educator
Portal: https://educator.
cete.us.
3. Work with your State Education Agency (SEA) and
Data Steward to activate accounts equal to or above
the District Test Coordinator (DTC) level.
4. Complete the annual Security Agreement in your EP
profile.
5. Sign up for the DLM test notifications during the
year.
Complete Security
Agreement, page 37.
Educator
Portal: https://educator.
cete.us.
The DLM website,
Assessments |
Operational Testing:
http://dynamiclearning
maps
.org/content/
operational-testing.
6. Participate in Assessment Coordinator training. States The DLM website
http://www.dynamiclea
may also provide their own training for Assessment
rningmaps.org/content/
Coordinators.
district-staff-trainingresources-ye.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 8 of 59
1-844-261-6481

Tasks
7. Manage district/school staff roles and responsibilities.
a) Identify personnel to fill the roles of Technical
Liaison and Data Steward, as needed. Designate
backup personnel for each role.
b) Identify educators who will serve as test
administrators/examiners for the DLM alternate
assessments.
c) Make sure that each person is aware of his or her
roles and responsibilities and the timeline of
events, including firm deadlines for required
steps.
Resources
Checklists for Data
Stewards, Technical
Liaisons, and test
administrators from
role-specific manuals.
Manage
District/School Staff
Roles and
Responsibilities, page
19.
d) Make sure that the Technical Liaison, the Data
Steward, and test administrators understand the
DLM test policies and procedures, as well as statespecific policies.
8. Develop and implement a comprehensive training
plan OR implement your state’s training plan for
district staff and test administrators.
a) Review the checklists for Data Stewards, Technical
Liaisons, and test administrators.
b) Encourage Data Stewards and Technical Liaisons
to complete the DLM-sponsored or statesponsored training on their roles.
c) Deliver Required Test Administration Training (if
assigned to you by your state/district).
d) Monitor educator completion of all parts of
Required Test Administration Training and the
Security Agreement (if assigned to you by your
state/district).
e) Identify additional training or resource needs
specific to your local DLM participants; develop
resources to address needs.
f) Encourage and monitor participation in the DLM
professional development for instruction (if
assigned to you by your state/district).
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Checklists for Data
Stewards, Technical
Liaisons, and test
administrators from
role-specific manuals.
The DLM training for
Data Stewards and
Technical Liaisons.
The DLM Required
Test Administration
Training
http://training.dynamic
learningmaps.org/.
Develop and
Implement a
Comprehensive
Training Plan, page
19.
Rev: 05/18/2016 9 of 59
1-844-261-6481

Tasks
9. Prepare for assessment implementation.
a) Gather Technical Liaison and Data Steward
contact information and initiate communication
between district staff. Encourage staff to sign up
for Test Updates on the DLM website.
b) Establish communication between Data Stewards,
Technical Liaisons, and the DLM Alternate
Assessment Consortium.
c) Determine how you will receive communications
from your state or district representatives for
information that is specific to your state or district.
d) Monitor creation of Educator Portal user accounts.
e) Follow up, as needed, to ensure that deadlines are
met for test administrators to activate accounts
and complete training.
f) Establish a test security plan and monitor
adherence to the DLM and the state-specific testsecurity policies.
Resources
Test Updates Page
http://dynamic
learningmaps.org/
content/test-updates.
Educator
Portal https://educator.
cete.us.
Educator Portal
section in this
manual.
Prepare for
Assessment
Implementation, page
23.
g) Troubleshoot issues as they arise.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 10 of 59
1-844-261-6481

Tasks
10. Monitor and support test preparations and
administration.
a) Remind Technical Liaisons, Data Stewards, and
test administrators about important deadlines.
b) Make sure that educators have identified students
who will participate in the DLM assessments.
Advise educators about your state’s policy for
students who are hospitalized or home-bound, as
needed.
c) Support test administrators and Data Stewards in
conducting data verification/revision within the
window. Understand what data lockdown means
and how it is used in your state. The DATA
STEWARD MANUAL includes recommended
procedures.
d) Ensure that every student who is supposed to
participate is listed in EP and assigned to an
educator.
e) Monitor completion of the Access (Personal Needs
& Preferences) Profile and the First Contact survey
for all students who will be assessed. Follow up
with test administrators as needed.
f) Assist test administrators with technology
preparations (e.g., making sure that assistive
devices work) and test environment setup (e.g.,
computer lab scheduling) as needed. Use the
practice tests to ensure that computers are
configured correctly.
Resources
Educator
Portal https://educator.
cete.us.
Educator Portal
section in this
manual.
Participation
Guidelines on the
DLM website.
Your state page on
the DLM website.
Monitor and Support
Test Preparations and
Administration, page
24.
GUIDE TO PRACTICE
ACTIVITIES AND
RELEASED TESTLETS
on the DLM website.
g) Support test administrators in preparing the test
environment.
h) If responsibility for printing student usernames
and passwords for KITE Client will be centralized
in the school/district, assign responsibility for that
task (the DLM Alternate Assessment Consortium
assumes that test administrators are responsible).
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 11 of 59
1-844-261-6481

Tasks
11. Develop a plan to facilitate communication with
parents/guardians and district staff OR follow your
state-developed communication plan. Schedule
meetings, as necessary.
a) Consider what parents/guardians and district staff
will need and want to know about the DLM
assessments.
b) Determine the frequency of communication to
various audiences.
c) Deliver communication to various audiences
according to the timeline in your communication
plan.
Resources
The DLM information
for
parents/guardians htt
p://dynamiclearning
maps.org/content/info
rmation-parents.
Develop a
Communication Plan,
page 27.
d) Relay new information from the DLM Alternate
Assessment Consortium, your state, and your
district to appropriate audiences, as needed.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 12 of 59
1-844-261-6481
Spring Operational Assessment

Tasks
12. Support test administrators in rechecking student
demographic information, PNP settings, and First
Contact responses.
Resources
TEST ADMINISTRATION
MANUAL.
13. Monitor and support test administration.
a) Facilitate communication between the DLM
staff and district staff during the testing
window(s).
Form Delivery, page 26.
b) Obtain and deliver braille forms, as needed.
c) Monitor test activity, including test completion,
prior to the end of the testing window.
d) Serve as the first point of contact for educators,
answering questions about the assessment.
Troubleshoot issues, as they arise.
Prepare for Next Year

Tasks
14. Prepare Assessment Coordinator plans for next
year (develop calendar, design communication
plan, schedule required training, etc.).
15. Support test administrators in preparing for next
year (evaluate Personal Needs & Preferences
Profiles, review blueprints for the next grade, etc.).
Resources
TEST ADMINISTRATION
MANUAL.
Blueprints on your state
page on the DLM
website.
ABOUT DYNAMIC LEARNING MAPS
Dynamic Learning Maps (DLM) Alternate Assessment Consortium is a multi-state
consortium that has developed a computer-delivered alternate assessment. The DLM
alternate assessment system is an assessment program designed to validly measure
what students with the most significant cognitive disabilities know and can do. The
DLM system provides accessibility by design, and is guided by the core belief that all
students should have access to challenging, grade-level content, and that test
administrators should adhere to the highest levels of integrity in providing instruction
and administering assessments based on this challenging content.
Students who are eligible for the DLM Alternate Assessment are those for whom general
education assessments, even with accommodations, are not appropriate. Students taking
the DLM alternate assessment require extensive, direct instruction and substantial
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 13 of 59
1-844-261-6481
supports to achieve measurable gains. These students learn academic content aligned to
grade-level content standards, but at reduced depth, breadth, and complexity. The DLM
content standards are called Essential Elements and are the learning targets for the
assessments for grades 3-12 in English language arts (ELA) and mathematics.
THE DYNAMIC LEARNING MAPS
The dynamic learning maps are highly connected representations of how academic skills
are acquired, as reflected in research literature. Nodes in the maps represent discrete
knowledge, skills, and understandings in either English language arts or mathematics,
as well as important foundational skills that provide a foundation for academic skills.
The maps go beyond traditional learning progressions to include multiple and alternate
pathways by which students may develop content knowledge.
ESSENTIAL ELEMENTS
The Dynamic Learning Maps Essential Elements (EEs) are specific statements of
knowledge and skills linked to the grade-level expectations identified in college- and
career-readiness standards. The purpose of the EEs is to build a bridge from those
content standards to academic expectations for students with the most significant
cognitive disabilities.
The EEs specify academic targets, while the dynamic learning maps clarify how students
can reach those targets. For each EE, small collections of nodes are identified earlier in
the map that represent critical junctures on the path toward the standard. These small
collections of nodes are called linkage levels. The fourth level is the Target. There are
three levels below the Target and one that goes beyond the Target. See Linkage Level in
the Glossary, page 52, for more detail.
ASSESSMENT SYSTEM DESIGN AND DELIVERY
The DLM assessments are delivered in “testlets.” Each testlet consists of an engagement
activity and 3-9 items. The items in each testlet align to nodes in a single linkage level
within an EE. An engagement activity for an ELA testlet consists of a reading or writing
task. For math, an engagement activity gives context, which is carried throughout the
testlet. Specific item types are described in the TEST ADMINISTRATION MANUAL.
Information on accessing practice activities and released testlets, where educators can
view various item types, is also included in the TEST ADMINISTRATION MANUAL.
Required tests are delivered in the spring (see Figure 1).
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 14 of 59
1-844-261-6481
In the spring, all students are assessed on the full range of EEs in the blueprint. The
educator is responsible for providing instruction on those EEs during the year. Using an
algorithm that defines the relationships between the nodes in the map and uses
information about the student, the system dynamically routes students to testlets at the
appropriate linkage level for each EE.
Figure 1—Summative scores based on all EEs covered in the blueprint.
During the year-end window, the estimated total testing time per student is 35-60
minutes in mathematics and 70-90 minutes in English language arts.
ASSESSMENT RESULTS
The scoring system in the DLM alternate assessment works differently from scoring in
traditional alternate assessments. The system combines a student’s responses on
operational testing and data about the dynamic learning map to determine which nodes
the student has mastered. Students are not given raw scores, percentages, or scale scores.
Results for each node are determined based on probability that the students has
mastered the node. Summative results for a student are determined from the node
mastery data. The information about each node leads to a summary of a student’s
mastery of each linkage level, and, in turn, each EE. Summative results are based on the
mastery probabilities for all linkage levels in all EEs in which a student was assessed.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 15 of 59
1-844-261-6481
ABOUT KITE CLIENT AND EDUCATOR PORTAL
The KITE platform was designed and developed to meet the needs of the next
generation of large-scale assessments. KITE Client consists of four applications. Students
and educators each see a different part:
Students have accounts in KITE Client.
KITE Client delivers assessments to students through the use of a
customized, secure web browser that is accessible on multiple devices.
Practice activities and released testlets are also available to students
through KITE Client. Educators and staff do not have accounts in KITE Client.
Staff and educators have accounts in Educator Portal (EP).
Educator Portal is the administrative application that allows staff and
educators to manage student data and retrieve reports. Users can access
Educator Portal via https://educator.cete.us.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 16 of 59
1-844-261-6481
HOW TO USE THE DLM WEBSITE
Additional resources for test administrators, Assessment Coordinators, Data Stewards,
and Technical Liaisons are available on the DLM website. Resources are provided by the
DLM Alternate Assessment Consortium and state-specific resources may also be
available.
To access resources for your state and role, follow these steps:
1. Go to the DLM website http://dynamiclearningmaps.org/.
2. Click Assessments | Operational Testing.
3. Select your state.
Hint: Bookmark the page or save it to your favorites for quick access later.
4. Choose your role; click Apply.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 17 of 59
1-844-261-6481
5. Resources appear below the role field. The DLM resources appear first, sorted
alphabetically. State-specific resources appear next, sorted alphabetically.
These DLM resources are designed for specific roles, and are available to all states:
ASSESSMENT
Supports the Assessment Coordinator in preparing
COORDINATOR MANUAL
district and school staff for testing.
(PDF)
DATA STEWARD MANUAL
Supports the Data Steward in gathering, editing, and
(PDF)
uploading user (educator/staff) data, enrollment
(student) data, and roster (groups of students by
educator) data via Educator Portal.
TECHNICAL LIAISON
Supports the Technical Liaison in preparing schools for
MANUAL (PDF)
the technology needs of the DLM assessment.
TEST ADMINISTRATION
Supports test administrators in preparing themselves
MANUAL (TAM) (PDF)
and students for testing. Expands the knowledge base
for the Assessment Coordinator on specific topics.
Accessibility Manual (PDF) Provides guidance to state leaders, districts, educators,
and CSEs on the selection and use of accessibility
features available in KITE Client.
Educator Resource Page
Provides supplemental instruction and testing
(webpage)
resources for educators and test administrators.
GUIDE TO DLM REQUIRED
Helps users access the DLM Required Test
TEST ADMINISTRATOR
Administrator Training on the DLM Moodle training
TRAINING (PDF)
website.
GUIDE TO PRACTICE
Supports the test administrator in accessing practice
ACTIVITIES & RELEASED
activities in KITE Client.
TESTLETS (PDF)
Test Updates Page
Provides breaking news on test administration
(webpage)
activities. Sign up to receive alerts when new resources
become
available. http://dynamiclearningmaps.org/content/testupdates.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 18 of 59
1-844-261-6481
PREPARE FOR THE DLM ASSESSMENT
ADMINISTRATION
OVERVIEW
The key duty of the Assessment Coordinator is to oversee the assessment process,
including managing staff and educator roles and responsibilities, developing and
implementing a comprehensive training plan, developing a schedule for test
implementation, monitoring and supporting test preparations and administration, and
developing a plan to facilitate communication with parents/guardians and staff. In some
cases, your responsibilities will be determined by plans and communications decided at
the state level.
The DLM Alternate Assessment Consortium suggests that you prepare for the DLM test
administration through careful planning, implementation, and monitoring.
MANAGE DISTRICT/SCHOOL STAFF ROLES AND RESPONSIBILITIES
 Identify personnel to fill the roles of Technical Liaison and Data Steward as
needed. Designate backup personnel for each role.
 Identify educators who will serve as test administrators/examiners for the DLM
assessments.
 Make sure that each person is aware of his or her roles and responsibilities and
the timeline of events, including firm deadlines for required steps.
 Make sure that the Technical Liaison, the Data Steward, and test administrators
understand the DLM test policies and procedures, as well as state-specific
policies.
DEVELOP AND IMPLEMENT A COMPREHENSIVE TRAINING PLAN
The user manuals for test administrators, Data Stewards, and Technical Liaisons
guide users to contact their District Assessment Coordinator for a training plan
tailored specifically to their state and district.
The DLM Alternate Assessment Consortium suggests developing a training plan to
support test administration efforts by test administrators/examiners, Data Stewards, and
Technical Liaisons. Consider these tasks when developing your plan:
 Participate in the DLM- or state-sponsored training for Assessment
Coordinators. Recorded webinars by role are available on the DLM
website. Check to see if state-sponsored training is available in your state.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 19 of 59
1-844-261-6481
 Review the checklists for Data Stewards, Technical Liaisons, and test
administrators, which are located in individual manuals for each role.
 Encourage Data Stewards and Technical Liaisons to complete the DLMsponsored or state-sponsored training on their roles and responsibilities.
 Deliver Required Test Administration Training (if assigned to you by your
state/district).
 Monitor educator completion of all parts of Required Test Administration
Training and the Security Agreement (if assigned to you by your state/district).
 Identify additional training or resource needs specific to your local DLM
participants; develop resources to address these needs.
 Encourage and monitor participation in the DLM professional development for
instruction (if assigned to you by your state/district).
 Direct any Alternate Assessment Training Network (AATNs) who should need
training DVDs to the DLM Service Desk.
RESOURCES FOR DATA STEWARDS AND TECHNICAL LIAISONS
Most training and professional development modules provided by the DLM Alternate
Assessment Consortium are intended for educators and test administrators/examiners.
However, resources specific to Data Stewards and Technical Liaisons include:
•
•
Webinars for Data Stewards and Technical Liaisons
Instructional videos for Data-Steward tasks in Educator Portal
All resources listed above are located on the DLM website;
none of them are located in Educator Portal.
See How to Use the DLM Website on page 17 to find resources by role.
RESOURCES FOR AATNS
Members of the Alternate Assessment Training Network (AATNs) facilitate test
administration training. AATNs who need training DVDs may contact the Assessment
Coordinator for more information. In this event, AATNs should be re-directed to the
Service Desk.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 20 of 59
1-844-261-6481
RESOURCES FOR TEST ADMINISTRATORS
The DLM Alternate Assessment Consortium provides required test administrator
training, professional development for instruction, and supplemental training. The
following chart compares these three categories.
Required Test
Administrator Training
•
Covers critical content
for managing and
delivering the DLM
alternate assessments.
•
Required for test
administrators.
•
No tests will be
delivered if training is
incomplete.
•
New York State
requires facilitated
training for 2015-16.
•
Successful completion
= a score of 80% or
higher on the post-test
quiz.
Professional
Development for
Instruction
Supplemental Training
•
Addresses topics to
support instruction in
academics for students
who take the DLM
alternate assessment.
•
Includes a variety of
topics to supplement
the use of the DLM
materials and system
navigation.
•
Optional, but strongly
recommended.
•
Optional, but strongly
recommended.
•
States and districts
may recommend or
require specific
modules.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 21 of 59
1-844-261-6481
Required Test Administrator Training
Hint: See the GUIDE TO DLM REQUIRED TEST ADMINISTRATOR TRAINING
located on the DLM website for complete information.
Training is required for all educators who will administer Dynamic Learning Maps
alternate assessments. Test administrators must successfully complete four modules,
with a passing score on each module’s post-test, before administering DLM assessments.
Total training time is estimated at less than four hours.
Modules should be completed in the order listed.
1. About the DLM System
2. Accessibility by Design
3. Understanding and Delivering Testlets in the DLM System
4. Preparing to Administer the Assessment
All post-tests for required training must be completed in Moodle.
More information about the contents of each module, training formats, and procedures
for completing required training is provided in the GUIDE TO DLM REQUIRED TEST
ADMINISTRATOR TRAINING, located on the DLM website.
Professional Development for Instructional Support
Professional development for instruction is strongly encouraged. If you wish to
incorporate professional development for instruction into your training plan, the DLM
Alternate Assessment Consortium offers a variety of content, and multiple methods to
access the materials.
The professional development website is http://dlmpd.com/.
• Facilitated modules for groups focus on a single topic related to the instruction of
students with the most significant cognitive disabilities. These modules provide
materials to support a facilitator in addressing a group of test administrators.
However, test administrators who participate in facilitated training must also log on
to the website and receive a passing score of 80% or higher on the posttest quiz in
order to be included on the completed modules list for their district.
A Virtual Community of Practice is provided to encourage collaboration between
educators across the consortium. The website is http://dlmpd.com/clds/forum/.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 22 of 59
1-844-261-6481
Supplemental Training
Supplemental training plans and materials are being developed. Resources may include
short how-to videos on common EP procedures and best practices to help test
administrators. Subscribe to Test Updates to learn when new training is released.
PREPARE FOR ASSESSMENT IMPLEMENTATION
To prepare for assessment implementation, consider these tasks:
 Gather Technical Liaison and Data Steward contact information and initiate
communication between district staff. Encourage staff to sign up for Test
Updates on the DLM website.
 Establish communication between Data Stewards, Technical Liaisons, and the
DLM Alternate Assessment Consortium.
 Determine how you will receive communications from your state or district
representatives for information that is specific to your state or district.
 Monitor the creation of EP user accounts.
 Follow up, as needed, to ensure that deadlines are met for test administrators to
activate accounts and complete training.
 Establish a test security plan, and monitor adherence to the DLM and statespecific test-security policies. Consider these tasks when developing your plan:
 Designate the testing location(s); a quiet, private environment is best.
 Ensure that test administrators complete the required training on test
security, and agree to the Security Agreement in Educator Portal.
 Adhere to state and district policies for test security.
 Troubleshoot issues as they arise.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 23 of 59
1-844-261-6481
Security Agreement
Test administrators have a unique opportunity to administer new items and
assessments. These items are expected to be treated as secure assessments.
Each year, anyone with access to EP will renew her or his DLM Security Agreement.
Help test administrators avoid this common pitfall.
If a user does NOT agree to the annual Security Agreement (and print or
save the Required Test Administration Training completion certificate),
the user will NOT have access to the Test Management tab in Educator
Portal.
MONITOR AND SUPPORT TEST PREPARATIONS AND ADMINISTRATION
The DLM Alternate Assessment Consortium suggests that you monitor and support test
preparations and administration to promote success in your school/district. Include
these tasks:
 Remind Technical Liaisons, Data Stewards, and test administrators about
important deadlines.
 Make sure that educators have identified students who will participate in the
DLM assessments. Advise educators about your state’s policy for students who
are hospitalized or home-bound, as needed.
 Support test administrators and Data Stewards in conducting data
verification/revision within the window. Understand what data lockdown means
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 24 of 59
1-844-261-6481
and how it is used in your state. The DATA STEWARD MANUAL includes the
recommended procedures.
 Ensure that every student who is supposed to participate is listed in EP and is
assigned to a test administrator, AND that no student who is not supposed to
participate appears in Educator Portal. Educators, along with CSEs, identify
students who will participate in the DLM assessments. Participation guidelines
are available on the DLM website.
Hint: Help educators who have a student who is leaving or joining
the classroom after the spring testing window has started. Work
with your Data Steward (who has more information about best
practices and procedures) so that these students have accurate
records and receive testlets at their current schools.
 Monitor completion of the PNP and First Contact survey for all students who
will be assessed. Follow up with test administrators as needed.
More checklist items appear after this supplemental information.
Access (Personal Needs & Preferences) Profile
The test administrator, using information and procedures from the ACCESSIBILITY
MANUAL, will complete an Access (Personal Needs & Preferences) Profile for each
student. This Access Profile ensures the correct selection and use of the accessibility
features that are available in KITE Client.
Two data verification/revision windows are outlined in the DLM Administration
Calendar 2015-16. These are the dates when test administrators should enter new Access
Profile information or verify existing information in EP.
First Contact Survey
The test administrator completes a First Contact survey for each student. This survey
data helps place the student in the map and determine their initial testlet.
Test administrators receive training on how to answer the First Contact questions as part
of the Required Test Administration Training. The Assessment Coordinator’s job is to
answer questions and help test administrators make sure that they have answered all
items and successfully completed the survey.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 25 of 59
1-844-261-6481
For each of the items in the following checklist, see the TEST ADMINISTRATION
MANUAL. Use the TAM checklists to find specific sections in the TAM that define
policies and procedures for test administrators.
 Assist test administrators with technology preparations (e.g., making sure that
assistive devices work) and test environment setup (e.g., computer lab
scheduling), as needed. Use the practice tests to ensure that computers are
configured correctly.
 Support test administrators in preparing the test environment.
 If responsibility for printing student usernames and passwords for KITE Client
will be centralized in the school/district, assign responsibility for that task. (The
DLM Alternate Assessment Consortium assumes that test administrators are
responsible.)
 Facilitate communication between the DLM staff and district staff during the
testing window.
 Obtain and deliver braille forms, as needed. See Form Delivery below.
 Monitor test activity, including test completion, prior to the end of the testing
window.
 Serve as the first point of contact for test administrators, answering questions
about the assessment. Troubleshoot issues as they arise.
Responsibilities for Braille Test Administration
Assessment Coordinators monitor and support the administration of braille forms
during the spring testing window. Braille forms are created for grades 3-5 at the Target
and Successor levels and in grades 6-8 and 9 at the Proximal Precursor, Target, and
Successor levels. However, not all parts of the test at every grade level have braille
equivalents. Where they are not provided, test administrators will use other approaches
to deliver assessments to students who have blindness or visual impairments. For more
information see the Braille Fact Sheet available on the Educator Resource Page.
FORM DELIVERY
Select the braille support on the Access (PNP) Profile so that the system will assign
braille forms to the student when available. Braille Ready Files (BRF) are delivered
through Educator Portal. They are located in the same area of the Test Management
screen as the Testlet Information Page. See the procedure titled Retrieve Braille Ready
File in the TEST ADMINISTRATION MANUAL for the steps to retrieve the BRF.
Select the braille support on the Access (PNP) Profile so that the system will assign
braille forms to the student when braille forms are available. When the braille support is
selected on the PNP, the teacher of record will receive an email from DLM staff after
February 29 regarding the embossing of braille materials. The deadline to mark braille
on the PNP for access to braille forms during the spring 2016 window is March 28.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 26 of 59
1-844-261-6481
SCORING A STUDENT’S RESPONSE
When the system assigns a testlet, it delivers a computer-based version through KITE
Client. This version is equivalent to the braille version that the student receives. As the
student takes the testlet on the braille paper version, the student indicates each answer
choice to the test administrator as she or he normally would on other braille
assignments. The test administrator inputs each student response into KITE Client.
Responses are scored by the system, the same way that non-braille forms are.
Monitor Test Activity
You may retrieve reports to monitor student enrollment in testlets and completion of
testlets through the DLM Test Administration Monitoring Extract. Using this same
extract, educators have the ability to monitor students who are rostered to them.
Building-level users have the ability to monitor students in the building, while districtlevel users have the ability to monitor students in the district. See the procedure titled
Understanding the DLM Test Administration Monitoring Extract on page 48 for more
detail.
DEVELOP A COMMUNICATION PLAN
The DLM Alternate Assessment Consortium suggests developing a plan to facilitate
communication with parents/guardians and district staff OR follow your statedeveloped communication plan. Schedule meetings, as necessary. Consider these tasks
when developing a plan:
 Consider what parents/guardians and district staff will need and want to know
about the DLM assessments.
 Determine the frequency of communication to various audiences.
 Deliver communication to various audiences, according to the timeline in your
communication plan.
 Relay new information from the DLM Alternate Assessment Consortium, your
state, and your district to appropriate audiences, as needed.
The DLM Alternate Assessment Consortium provides a Parent Notification Letter,
available in English and Spanish, as an editable Word document. These are available on
each state’s Operational Testing website. These resources are available to download and
edit to fit the needs of a state or district. The DLM Alternate Assessment Consortium
offers information and resources for parents/guardians at the
website: http://dynamiclearningmaps.org/content/information-parents.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 27 of 59
1-844-261-6481
EDUCATOR PORTAL USER GUIDE
FOR ASSESSMENT COORDINATORS
This information outlines the step-by-step procedures that an Assessment Coordinator
might use in EP.
Hint: If EP or KITE Client look or behave differently, and you are
using a printed version of this manual, check for an updated
version of the manual on your state’s DLM website.
Ignore these features in Educator Portal: Test Coordination,
and Add New Test.
Create Account is available, but not recommended for the DLM users.
REQUIRED SOFTWARE
SUPPORTED BROWSERS
See the KITE Requirements website to choose a browser that will work well with EP. For
more information on browsers and technology in your district, contact your Technical
Liaison.
To access the KITE Requirements website, follow these steps:
1. Go to www.dynamiclearningmaps.org.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 28 of 59
1-844-261-6481
2. Click Assessments | KITE & Educator Portal.
3. Click View KITE Requirements.
4. Look for the section titled Supported Browsers.
PDF VIEWER
To view PDFs in EP, educators will need Adobe Reader or other software that allows
you to view and print PDFs. Download Adobe Reader
from http://get.adobe.com/reader/. Contact your Technical Liaison for questions related
to technology specifications.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 29 of 59
1-844-261-6481
MANAGE USER ACCOUNT
Avoid this common pitfall.
A state-level user (commonly someone from your SEA) must assign you
the role of District Test Coordinator in Educator Portal before you can
complete responsibilities such as monitoring testing or checking
enrollments.
ACTIVATE EDUCATOR PORTAL ACCOUNT
This procedure is required for all first-time DLM users.
Hint: Go to the procedure titled Access Educator Portal on page 32 if
you have already activated your EP account and received your
username and password.
1. Did you receive your KITE activation email message from KITE-support@ku.edu?
If:
Yes
No
Then:
Go to Step 2.
The activation email message is sent ONLY after your state or
district Data Steward has uploaded your user information into
Educator Portal.
Did your Data Steward upload your user information into
Educator Portal?
If:
Then:
Yes
Ask your Data Steward to resend the
KITE activation email message.
No
Wait until your Data Steward has
uploaded your user information.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 30 of 59
1-844-261-6481
Hint: The email message may reference the KITE system, but this is
the path to Educator Portal.
2. Click the link in the message. The Activate User screen appears.
3. Complete these fields:
First Name
Last Name
Password
Confirm Password
4. Click Activate.




5. Receive a confirmation message. Click Back To Login.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 31 of 59
1-844-261-6481
ACCESS EDUCATOR PORTAL
Hint: The first time you access Educator Portal, go to the procedure
titled Activate Educator Portal Account on page 30 of this guide.
To log in to Educator Portal, follow these steps:
1. Using a recommended internet browser, go to https://educator.cete.us.
2. Complete these fields on the Sign In screen.
Username (usually your email address; use lower case)
Password (case sensitive)
3. Click Sign In.


NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 32 of 59
1-844-261-6481
RESET EDUCATOR PORTAL PASSWORD
Hint: Use this procedure ONLY if you forget your password. To
change your password, see Change Password on page 35.
To reset a password in EP, follow these steps:
1. Go to Educator Portal at https://educator.cete.us.
2. Click Forgot Password?
3. Type your Username.
4. Click Submit.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 33 of 59
1-844-261-6481
5. You will receive a notification that the password reset request has been received.
KITE-support@ku.edu will send a password reset email within one hour; check your
junk or spam email folders if this automated message does not arrive.
6. Click the link in the message.
7. Type your Username.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 34 of 59
1-844-261-6481
8. Type a new password in the Password and Confirm Password fields.
9. Click Submit.
10. Click Return to KITE Login Page.
CHANGE PASSWORD
To change your password, follow these steps:
1. Click My Profile.
2. Click Change Password on the left menu.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 35 of 59
1-844-261-6481
3. Complete these fields.



Current Password
New Password
Confirm Password
4. Click Save.
5. Click X to close the pop-up window.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 36 of 59
1-844-261-6481
COMPLETE SECURITY AGREEMENT
This procedure is required for all first-time DLM users and at annual renewal. It will
appear the first time you log in.
All educators who administer the DLM alternate assessments are required to read and
respond to a security agreement. This information is stored in EP, and is renewable
annually.
To complete the Security Agreement, follow these steps:
1. Click My Profile.
2. Click Security Agreement on the left menu.
3. Read the agreement.
4. Choose your reply.
5. Type your full name in the field.
6. Click Save.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 37 of 59
1-844-261-6481
A message indicates that you have successfully saved the security agreement
information.
7. Click X to close the pop-up window.
CHANGE DISPLAY NAME
The display name is the name that shows when logging into the application. The default
display name is the first name and last name that was defined in the user upload
completed by your Data Steward to create your account. Editing your display name is
an option.
To edit your display name, follow these steps:
1. Click My Profile.
2. Click Edit Display Name on the left menu.
3. Type your Display Name.
4. Click Save.
5. Click X to close the pop-up window.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 38 of 59
1-844-261-6481
CHANGE USER ROLE VIEW
If you require multiple roles (because you teach in different buildings or districts) AND
your Data Steward has set up your access with those roles, you are able to switch your
user role view to see the students in a particular building or district. The role name is
followed by the building or district. Click the drop-down arrow to choose the desired
role.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 39 of 59
1-844-261-6481
CHANGE DEFAULT ORGANIZATION AND ROLE
The default organization and role affect the view that appears when logging in to EP.
The default organization and role was defined in the user upload completed by your
Data Steward when she or he created your account. Changing the default organization
and role is an option.
To change the default organization and role, follow these steps:
1. Click My Profile.
2. Click Change Default Organization and Role on the left menu.
3. Choose the organization and role you want to be the default.
4. Click Save.
5. Click X to close the pop-up window.
ACCESS DATA EXTRACTS
This section summarizes the data extracts available through EP.
VIEW A DATA EXTRACT
The following data extracts are available for select users. If the user does not have
permission to view the extract, it will not appear in the list.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 40 of 59
1-844-261-6481
Name of Data Extract
Current Enrollment
Accessibility Profile
Roster
Users
Test Records
DLM Test Administration Monitoring
Accessibility Profile Summary
Summary
Enrollment data for your organization
Access (PNP) settings for your organization
Roster data for your organization
User data for your organization
Test records for students in your organization
Testlets assigned and completed in a subject
(per student)
Student counts by organization for supports
selected in Access (PNP) Profile
To view a data extract, follow these steps:
1. Click Reports.
2. On the left side of the Reports screen, under Data Extracts, click Downloads.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 41 of 59
1-844-261-6481
3. Click New File for the extract that you wish to view.
4. Select your organization (district or school).
5. Choose begin and end dates when applicable; click Ok.
6. If you accessed the report previously, you will receive this message. Click Yes to
proceed.
Hint: Each request for an extract replaces the previous extract. Save
extracts to your computer if you require an archive.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 42 of 59
1-844-261-6481
7. The File field transitions from “In Queue” to “CSV.”
8. Click CSV to access the extract file.
Hint: Think of a CSV file as a completely unformatted Excel file. The
inability to apply formatting mostly impacts fields with leading
zeroes.
9. Follow the browser’s procedure for viewing or saving the CSV file to your computer.
UNDERSTANDING THE ACCESSIBILITY PROFILE EXTRACT
Accessibility Profile creates a CSV file that lists the accessibility (PNP) settings for the
students enrolled in a particular district or school. Only students who have PNP settings
are included in the file. The file contains a column for every possible PNP setting and
indicates whether or not that setting has been chosen for a student.
Name of the Extract
When saving the Accessibility Profile download, the file will have the following name:
Educator_Portal_PNP_OrgID_UserID_MM-DD-YY_HH-MM-SS.csv
Hint: OrgID is the organization identifier for your school or district.
UserID is your user identification number.
MM-DD-YY is the month, day, and year that the file was
created.
HH-MM-SS is the hour, minute, and second that the file was
created.
Fields in the Extract
The file includes information about a student’s PNP settings. Each of the possible PNP
settings is included in the file. See the example below.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 43 of 59
1-844-261-6481
The file indicates whether or not a feature or support has been selected for a student,
and, if a feature or support has multiple settings, the details of those settings are listed.
For example, the overlay color can be set to one of several pre-determined colors. The
file lists the hexadecimal value of the color selected (e.g., #87cffd), as well as the
description of the color (e.g., Light Sky Blue). You may also see the following results in
columns:
• N/A–indicates that the feature or support has not been selected, either because the
selection depends upon another item being checked or because the accommodation
is not available for your organization.
• Not Selected–appears when a feature or support has been selected, but “Activate by
Default” has not been selected.
• Selected–indicates that the feature or support has been selected on the student’s
PNP.
Some columns on the file that may be of particular interest are described in the table
below.
Column Name
Description
Last Modified Time
The date and time that the PNP settings were last
modified. The format used is MM/DD/YYYY HH:MM
AM/PM and time zone.
Last Modified By
The name of the person who made the last change to
the PNP settings.
UNDERSTANDING THE ACCESSIBILITY PROFILE SUMMARY EXTRACT
The Accessibility Profile Summary extract creates a CSV file that lists the total number of
students who have a particular setting on their Access Profile (PNP). Depending upon
the level of access, you can retrieve summary data in several configurations. If you have
district-level or state-level access, select filters for the report.
Note: If you have school-level access to Educator Portal (i.e., you access the data
for one school), there is no need to select any filters. The CSV file will have two
lines of data, summarizing the PNP settings for your school.
District-Level Access
The district-level filter window displays a choice of two summary levels: District or
School, and three possible combinations for selecting the data to be included in the CSV
file. When the contents include two rows of data, one marked as General Assessment
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 44 of 59
1-844-261-6481
and one marked as DLM, use only the DLM rows. See the screenshot below.
Settings
Filter
CSV Contents
District Summary
Level
CSV file contains two lines
of data–PNP counts
summarized for the district.
School Summary
Level
CSV file contains multiple
lines of data–two lines for
each of the schools in the
district.
School Summary
Level
CSV file contains two lines
of data–PNP counts
summarized for a single
school.
School selected
Name of the Extract
When saving the Accessibility Profile Summary download, the file will have the
following name:
Summary_Accessibility_Profile_OrgID_UserID_MM-DD-YY_HH-MM-SS.csv
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 45 of 59
1-844-261-6481
Hint: OrgID is the organization identifier for the school or district.
UserID is the user identification number.
MM-DD-YY is the month, day, and year that the report was created.
HH-MM-SS is the hour, minute, and second that the report was
created.
Fields in the Extract
The report includes columns of information about the PNP settings in use. Unlike the
Accessibility Profile extract, PNP settings are summarized by category.
The extract provides a count of the total number of students who have the
accommodation selected in their PNP.
UNDERSTANDING THE CURRENT ENROLLMENT EXTRACT
The Current Enrollment extract includes all records for students who are enrolled in the
user’s organization.
Hint: There will be multiple records for one student if the student has
been enrolled in more than one school or grade.
Name of the Extract
When saving the Current Enrollment extract, the file is named:
KITE_Enrollment_Extract_OrgID_UserID_MM-DD-YY_HH-MM-SS.csv
Hint: OrgID is the organization identifier for your school or district.
UserID is your user identification number.
MM-DD-YY is the month, day, and year that the report was
created.
HH-MM-SS is the hour, minute, and second that the report was
created.
Fields in the Extract
The extract includes information about each student. With the addition of Extract_State,
Extract_District, and Extract_School_Name, the columns are the same as those in the
Enrollment Upload Template.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 46 of 59
1-844-261-6481
UNDERSTANDING THE ROSTER EXTRACT
The Roster extract creates a CSV file that lists the students and educators on every roster
in a particular school. When creating the extract, you must select the school. The Roster
extract is similar, but not identical to the Roster Upload Template.
Note: If your program will use the report to maintain rosters, be sure to delete
the first five columns in the report (State, District, School, Last Modified Time,
and Last Modified By) and any other columns that do not identically match the
Roster Template.
Name of the Extract
When saving the Roster extract, the file is named:
KITE_Roster_Extract_OrgID_UserID_MM-DD-YY_HH-MM-SS.csv
Hint: OrgID is the organization identifier for your school or district.
UserID is your user identification number.
MM-DD-YY is the month, day, and year that the report was
created.
HH-MM-SS is the hour, minute, and second that the report was
created.
Fields in the Extract
The extract includes information about rosters. With the addition of Extract_State,
Extract_District, and Extract_School, the columns are the same as those in the Roster
Upload Template.
UNDERSTANDING THE USERS EXTRACT
Note: Depending upon account permissions, you may not be able to access this
report. Contact your Data Steward.
The Users extract creates a CSV file that lists the users and their role(s) in a particular
school. When creating the extract, you must select the school. The extract contains a
column for all of the roles available in EP and indicates if that role has been assigned to
the user.
Name of the Extract
When saving the Users extract, the file is named:
KITE_User_Extract_OrgID_UserID_MM-DD-YY_HH-MM-SS.csv
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 47 of 59
1-844-261-6481
Hint: OrgID is the organization identifier for your school or district.
UserID is your user identification number.
MM-DD-YY is the month, day, and year that the report was
created.
HH-MM-SS is the hour, minute, and second that the report was
created.
Fields in the Extract
The extract includes information about the roles assigned to a user. If a user is assigned
to more than one organization, she or he will appear on multiple lines in the CSV. For
example, if an educator works in more than one school, she or he will appear on a line
for each school in the CSV.
All of the user’s assigned roles for a particular organization appear on a single line of the
CSV. For example, if the user is a Building Test Coordinator and a Building Principal, an
X will be in each column.
UNDERSTANDING THE DLM TEST ADMINISTRATION MONITORING EXTRACT
The DLM Test Administration Monitoring Extract includes the number of testlets
confirmed, in progress, and completed by a student. Testlet counts are included for each
subject, so a student may appear on more than one line in the extract. If a student is in
more than one roster, grade, or school, separate lines will appear for the student.
•
•
A student will not appear on this extract until they are enrolled and rostered to at
least one subject in the current school year.
Data is available for the current testing year (September 1 through July 31).
Hint: There are two subsections of the extract: the Instructional dates
apply to the four columns of Instructional testlets; the End of
Year dates apply to the four columns of End of Year testlets.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 48 of 59
1-844-261-6481
Use the system default dates for accurate results. Do NOT
change the dates that appear.
When saving the DLM Test Administration Monitoring extract, the file will have the
following name:
KITE_DLM_Test_Administration_Status_Extract_MM-DD-YY_HH-MM-SS.csv
Hint: MM-DD-YY is the month, day, and year that the extract was
created. HH-MM-SS is the hour, minute, and second that the
extract was created.
These four columns include data from the spring testing window.
Hint: The End of Year Begin and End dates affect the data in these
columns. Use the system default dates for accurate results. Do
NOT change the dates that appear.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 49 of 59
1-844-261-6481
Column Heading
End of Year # Testlets Not
Started
Definition
The number of testlets assigned by the system for the
spring testing window, but which the student has not
yet started.
Hint: The system assigns testlets one at a time, not all
at the beginning of the window.
End of Year # Testlets In
Progress
The number of spring window testlets that are in
progress.
End of Year # Testlets
Completed
The number of testlets from the spring testing
window that have been completed by the student. By
the end of the state’s spring testing window, the
numbers in this column should equal the number in
the “End of Year # Testlets Required” column.
The number of required testlets, based on the
blueprint for the subject. See the section titled
Number of Testlets for Spring Testing in the TEST
ADMINISTRATION MANUAL.
End of Year # Testlets
Required
TEST ADMINISTRATOR PROCEDURES
See the TEST ADMINISTRATION MANUAL for these procedures that are specific to test
administrators.
MANAGE STUDENT DATA
•
•
•
•
•
View and Check Student Data
View and Check Roster
Complete Access (Personal Needs & Preferences) Profile
Complete First Contact Survey
Record Testing Exceptions
MANAGE ASSESSMENTS
•
•
View Student Username and Password
Retrieve Testlet Information Page
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 50 of 59
1-844-261-6481
KITE CLIENT
KITE CLIENT TESTING DEVICES
The DLM alternate assessments may be administered on:
Windows PC desktops
Via KITE Client with Windows and Mac
Mac desktops
instructions
Laptops (PC or Mac)
iPads
Via KITE Client app with iPad instructions
(previous versions are not supported)
Chromebooks
Via KITE Client or Google app with Chromebook
instructions
Local devices attached to these machines, such as interactive whiteboards, are also
acceptable. Interactive whiteboards (brand names SMART, Promethean, etc.) may be
used in testing. The same hardware, software, and screen resolution constraints apply.
The projector associated with the interactive whiteboard must project the computer
screen at a resolution of no lower than 1024 x 768. For more information on testing
devices, contact your Technical Liaison.
ENSURE INTERNET CONNECTIVITY
An internet connection is required to deliver assessments through the use of KITE
Client. Test administrators may contact you or a Technical Liaison to ask about
opportunities available for testing without the use of an internet connection.
KITE PROCEDURES
See the TEST ADMINISTRATION MANUAL for these KITE procedures that support test
administrators.
•
•
•
•
•
•
•
Access Practice Activities and Released Testlets
Start a Test
Navigate in KITE Client
Take a Break During Testing
Complete the Test
Change An Accessibility Support During Testing
Troubleshoot in KITE Client
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 51 of 59
1-844-261-6481
GLOSSARY
This glossary compiles definitions and acronyms relevant to testing for the Dynamic
Learning Maps Alternate Assessment.
claim
A broad statement about what the DLM consortium expects
students to learn and to be able to demonstrate within each
content area. Each claim is subdivided into two or more
conceptual areas.
conceptual area
A region within the dynamic learning map that contains nodes
associated with related Essential Elements and nodes that
represent concepts and skills that support the learning of the
Essential Elements. Conceptual areas are comprised of clusters of
connected concepts and skills, and serve as models of how
students may acquire and organize their content knowledge.
Conceptual areas are considered subparts of the overall claims.
connection
The relationship between two nodes. Connections are illustrated
with arrows in the map.
engagement
activity
An activity that precedes a testlet and describes a scenario, taps
into prior knowledge or experience, and/or introduces the
concept to be addressed. In English language arts, the first
reading of the text often serves as the engagement activity. In
math, the engagement activity provides context for the items.
Essential
Elements (EE)
Specific statements of knowledge and skills linked to the gradelevel expectations identified in college- and career-readiness
standards. EEs build bridges from the content in the grade-level
standards to academic expectations for students with the most
significant cognitive disabilities.
First Contact
(FC)
A survey used to collect background information about students
who are eligible for the DLM assessments. The survey goes
beyond basic demographic information to include questions on
communication, assistive technology devices, motor and sensory
impairments, and academic performance. Some questions from
the First Contact survey are used to determine a student’s entry
point, or initialization, into the assessment.
initialization
The process by which existing information about a student is used
to determine the point in the map at which the student enters the
assessment for the first time.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 52 of 59
1-844-261-6481
linkage level
A small section of the dynamic learning map that contains one or
more nodes that represent critical concepts or skills needed to
learn the Essential Element. Linkage levels are always related
directly to grade-level Essential Elements but extend back to
foundational skills at the Initial Precursor level. There are five
linkage levels: Initial Precursor, Distal Precursor, Proximal
Precursor, Target, and Successor. The nodes at the Target level are
most closely related to the expectation in the Essential Element.
node
Individual skills and understandings that were identified in the
research in mathematics and English language arts.
Personal Needs
& Preferences
(PNP) Profile
Also called Access Profile. Student-specific information that tells
KITE Client about individual users' needs. The PNP includes
information that the system needs to make the student’s user
interface compatible with her or his accessibility needs. In
Educator Portal, the PNP profile includes information about
display enhancements, language and braille, and audio and
environment supports. Educators who know the student provide
the information in the profile.
State Education
Agency (SEA)
A state department of education.
testlet
Short for instructionally relevant testlet. A testlet includes an
engagement activity and a set of three to nine items. Beginning
with an engagement activity and combining multiple items
increases the instructional relevance of the assessment, and
provides a better estimate of the students’ knowledge, skills, and
abilities than can be achieved by a single test item.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 53 of 59
1-844-261-6481
APPENDIX A
Your state has provided an appendix to this manual with information customized for
your state. You will find this same information on your state’s DLM website. The
filename will look like this:
ASSESSMENT COORDINATOR MANUAL APPENDIX ST (where ST is the two-letter
abbreviation for your state). See How to Use the DLM Website on page 17 to get started.
SEAs: If you wish to provide a state appendix to this manual, send the finished file,
along with a DLM Website Update Request Form.
DOCUMENT HISTORY
Page numbers are valid ONLY for the date and version noted.
They may change in future versions.
Date
05/18/2016
02/23/2016
Section Name/
Summary of Changes
Added an appendix regarding Special Circumstance
Codes
Starting Page
Added statements regarding the new Data Lockdown in
Checklists for Assessment Coordinators and Monitor
and Support Test Preparations and Administration
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Error!
Bookmark not
defined.
7, 24
Rev: 05/18/2016 54 of 59
1-844-261-6481
APPENDIX B–AGE RANGES FOR TESTING
NYSAA is administered only to high school students who are or will be 18 according to
the age range chart. Enroll the student in grade 9 to receive the appropriate test.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 55 of 59
1-844-261-6481
APPENDIX C—REASONS FOR NOT TESTING
ENTER A SPECIAL CIRCUMSTANCE CODE
In the event that a student cannot participate in a testlet that generates a performance
level used for federal and state accountability, a special circumstance code can be
entered in Educator Portal to provide explanation for the reason the student was not
tested. Your state’s SEA submitted a list of codes and their meanings, which may be
available on your state’s DLM website if your state requested they be posted.
Note: Codes must be entered before the testing window ends.
The Special Circumstances fields are located in EP on the same screen where the TIP is
accessed, and are descriptive words, e.g., medical Waiver or Parental Refusal. Only
educators with the role of District Test Coordinator, Building Test Coordinator, or State
Assessment Administrator have the permissions to choose the code. We recommend
that the special Circumstance code not be entered until late in the state’s testing
window, but before the window closes. The code needs to be entered once per content
area associated with the first testlet to be delivered. The testlet does not need to be
opened.
Note: Once the code is selected and saved, the code can be changed by any
authorized user.
To enter the special circumstance for a student, follow these steps.
10. Click Test Management.
11. Click Test Management.
12. Select the following options in these fields:




Assessment Program: Dynamic Learning Maps
Testing Program: Summative
District: Your district
School: Your school
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 56 of 59
1-844-261-6481
13. Click Search.
14. Click the Test Session Name you want to update. Please note that this will need to
be repeated for each subject.
15. Select the student.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 57 of 59
1-844-261-6481
16. Select the applicable Special Circumstance.
17.
Note: If the wrong code is selected and saved, the code can be changed by any
authorized user.
18. Click Save.
Hint: Once the Save button is clicked, the Special Circumstances column
updates to indicate the special circumstance code has saved.
Hint: Code entry in Educator Portal is independent of the testlet delivery
system. A new testlet is delivered each time a testlet is submitted.
Note: If a special circumstances code was selected, but is not needed, the user
should follow steps 1-8 and choose the default “select” as the special
circumstances code for the student.
See the following page for the special circumstance codes and descriptions.
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 58 of 59
1-844-261-6481
SPECIAL CIRCUMSTANCE CODES
NYSAA Not
Tested Category *
NYSAA Not Tested Description *
New York users should
use the following
Special Circumstances
Code in Educator Portal
to indicate a NYSAA
Not Tested Category.
Absent
The student was in attendance for fewer than Chronic Absences
30 school days as a NYSAA eligible student
between March 21—June 3, 2016 (ELA and
Mathematics) and it was determined that
there was not enough time to assess the
student.
Not Enrolled at
The student left the district before an
Other
Time of Test
assessment could be collected, or the student
arrived in the district too late for the district
Administration
to enter the student into SIRS as NYSAA
eligible and an assessment could not be
completed.
Medically Excused To be medically excused from taking the
Medical Waiver
NYSAA, the student must be too
incapacitated to be assessed because of
illness or injury resulting from a significant
medical emergency, as documented by a
medical practitioner, for more than 30 school
days between March 21—June 3, 2016 (ELA
and Mathematics). Students taking the
NYSAA are not considered medically
excused from testing because of their
disability.
Took Another
The student took another approved
Other Reason for NonAssessment to
assessment (i.e., a New York State general
Participation
assessment, Regents Competency Test (or
Fulfill Testing
approved alternative), Regents Examination
Requirement
(or approved alternative)) to fulfill the
testing requirement in a particular content
area.
The student is expected to participate in the Parent Refusal
NYSAA but does not participate.
*http://www.p12.nysed.gov/assessment/nysaa/2015-16/nottested16.pdf
NYSAA Assessment Coordinator Manual 2015-16 v YE
DLM-support@ku.edu
Service Desk Support
Rev: 05/18/2016 59 of 59
1-844-261-6481
Download