OLPA

advertisement
School Assessment Coordinator Meeting
October 28 and 29, 2015
Optional Local Purpose
Assessment (OLPA)
November 2 – December 22, 2015
Office of Accountability
Research, Evaluation &
Assessment
Pearson Online Assessment System
Sections:
1
Questions about OLPA -
2
Landing Pages
NEW
3 Resource
NEW
4
Before Testing
5
During Testing
6
TestNav8 Function
7
Test Results
8
Training Management System (TMS)
NEW
NEW
and
Office of Accountability
Research, Evaluation &
Assessment
Questions about OLPA
•
•
•
•
•
What is it?
Accommodations
Scheduling
Test Administrations Times
SAC Responsibilities
1
3
Office of Accountability
Research, Evaluation &
Assessment
What’s The OLPA?
• An on-line reading and math test
• MCA format
• Given prior to spring MCA
Who Takes The OLPA?
• All Grade 3-7 students
• Testing eighth grade students is a building level option
What’s the testing window for The OLPA?
• November 2 through December 22, 2015
What’s the purpose of The OLPA?
• Allows students to familiarize themselves
with on-line MCA testing
• Provides teachers with information to
target instruction prior to spring MCA
How many times can students take The OLPA?
• One testing opportunity per student
˗ math and reading
What student information do I need for The OLPA?
• Student login information
˗ MARSS number
˗ Who requires the Accommodated Text-to-Speech (ATTS)
accommodation
4
Office of Accountability
Research, Evaluation &
Assessment
What Materials are Allowed when taking The OLPA?
• Scratch paper
• A pen or pencil to use with scratch paper
• Head phones for Text-to-Speech
• Hard-copy mathematics formula sheets for grades 5-8
What Materials are Not Allowed when taking The OLPA?
• Handheld calculators (Unless specified in IEP)
Are there Accommodations with The OLPA?
• Accommodations for some grades 3-8 students
˗ ONLY Accommodated Text-to-Speech
(ATTS) for ELs and Special Ed
students with ATTS listed in their IEPs or 504 Plan
˗ No paper scripts
• No paper accommodated test materials, large print or Braille
tests
5
Office of Accountability
Research, Evaluation &
Assessment
Scheduling OLPA Test Administrations
• Elements of OLPA by Subject
− Allows students to exit their test at different points and to return to
complete it later
− Students responses are saved in the system
− Student is brought back to the item last viewed before exiting
• Mathematics OLPA
‒ Review screens divide four sections
‒ Before exiting
› students must complete a section
› review items
› select Next to go to the next section
› students must exit the test on the first item in the next section
• Reading OLPA
‒ Divided into sections by passage and test items
‒ Number and placement of passages will vary by form
‒ Each section begins with a title page
‒ Students will know they have completed all items for the passage
when they reach the review screen for the section
‒ Before exiting
› students must complete a section
› review items
› select Next Section to go to the next section
› students must select Close to move to the next section
› students must exit the test on the title page for the next
passage
 A dialog box will ask students if they want to close the section. Once
the section is closed it cannot be reopened.
6
Office of Accountability
Research, Evaluation &
Assessment
Test Administration Times
Total Test Administration includes:
1. Time needed to review the Test Monitor and Student Directions.
2. Answer student questions.
3. Students logging in to the test.
4. Student work time.
Note: The estimated times do not include time for completion of
item samplers or viewing of the online student tutorial.
7
Office of Accountability
Research, Evaluation &
Assessment
SAC Responsibilities
Online Test Sessions
• Manage online test sessions
– Know which students have the Math
Accommodated Text-to-Speech (ATTS)
– Have head-phones for Text-to-Speech
– Create and start test sessions
– Monitor student progress
• Proctor cache test sessions
8
Office of Accountability
Research, Evaluation &
Assessment
Pearson
Landing Pages
•
•
•
•
•
Overview
Home
Student & Family
Teacher & Test Monitor
Signing In to Pearson Access
2
9
Office of Accountability
Research, Evaluation &
Assessment
Overview
Home Landing Pages
The PearsonAccess website (http://www.pearsonaccess.com/mn)
is the portal to all Pearson services used by the Minnesota
school districts. Use this site to access test administration
activities, training, and other resources.
10
Office of Accountability
Research, Evaluation &
Assessment
Student & Family
Landing Pages
• Learning Resources
• Item Samplers
• Student Resources
11
Office of Accountability
Research, Evaluation &
Assessment
Teacher & Test Monitor
Landing Page
• Training Center
˗ Practice test sessions
˗ Administering Item Samplers
• Resources
˗ Training Materials
˗ Manuals and Directions
˗ Student Resources
˗ User Guides
12
Office of Accountability
Research, Evaluation &
Assessment
SIGN IN
to PearsonAccess
Any Secure Web Browser
1. Enter https://pearsonaccess.com
2. Select our state
3.
4.
Helpful links for
User IDs and
passwords
13
Office of Accountability
Research, Evaluation &
Assessment
Resources
• Item Samplers
• Training Center
3
14
Office of Accountability
Research, Evaluation &
Assessment
Resource Page
Select the Go to Resources link on any of the landing pages.
Items available include:
 Student Resources
o Student Tutorials
o Formula Sheets
o Calculators
 Manuals
o Procedures Manual
o All assessment manuals
 Directions
o Student Login Information
Instructions and Template
o Test Monitor and Student
Directions
o Student Directions
Presentations
 User Guides & Technology
o PearsonAccess
o TestNav
o SystemCheck
o Proctor Caching
 MDE Trainings
o Training Module I
o Test Security Training
o MTAS Trainings
 Pearson Trainings
o Online Test Monitor
Certification Course
o All recorded trainings and
PowerPoints
15
Office of Accountability
Research, Evaluation &
Assessment
Item Samplers
•
•
•
Use item samplers to familiarize students with the format of the
test.
Item samplers are not practice tests and cannot be used to
predict how well students will perform on the assessments.
Two ways to access item samplers:
 Select the Go to Item Samplers link on any of the landing
pages.
o ePATs (Electronic Practice Assessment Tools) will be
available for all applicable test administrations.
o Use this as a quick way for students to get familiar with the
online testing format.
o PDFs will also be available for download for any applicable
paper accommodations.
 Sign in to the Training Center.
o After creating sample students and a test session, students can
log in to TestNav to take an online item sampler.
o Use this to provide both Test Monitors and students
familiarity with PearsonAccess functionality and the online
testing format.
16
Office of Accountability
Research, Evaluation &
Assessment
When Are Item
Samplers Available?
•
Grades 3–7 Math MCA Online Item Samplers:
Available now
•
Grades 3–7, 10 Reading MCA Online Item Samplers:
Available now
•
Grades 5, 8, HS Online Science Item Samplers:
Available now
•
MTAS Reading, Math, Science Paper Item Samplers:
Available now
* Paper item samplers will be available via PDF for students
requiring accommodations.
17
Office of Accountability
Research, Evaluation &
Assessment
Training Center
• Practice setting up mock test sessions and administering
Item Samplers.
• Become familiar with PearsonAccess administration
functions.
 KEY DIFFERENCES between PearsonAccess operational vs.
Training Center:
 PearsonAccess operational:
o All student data comes from MDE’s precode file
o Shipment Tracking and Additional Orders available
 PearsonAccess Training Center:
o Create sample students
o No real data is affected
o Item samplers are available through practice test sessions
* Remember you will receive two separate emails from Pearson.
−
−
−
−
One for Training Site
One for Live Site
Usernames are Different
Passwords the Same
18
Office of Accountability
Research, Evaluation &
Assessment
Training Center: SIGN IN
User IDs are different
for the Training Center
TIP: When creating user accounts, assign different
User IDs for PearsonAccess and Training Center.
* Passwords can be the same for both accounts.
19
Office of Accountability
Research, Evaluation &
Assessment
Before Testing
•
•
•
•
Prepare Testing Labs with TestNav8
Create a Test Session
Proctor Cache Tests
Dates for PearsonAccess Tasks
4
20
Office of Accountability
Research, Evaluation &
Assessment
Create a Test Session
Steps to create an online test session:
1. Log-in to PearsonAccess using secure browser
2. Enter https://pearsonaccess.com
3. Select Minnesota
4. Select Online Test Sessions
5. Verify the test administration OLPA 2015-16
6. Complete fields (fields with a red arrow are required):
• Session Name:
• School:
• Test to be Administered:
• Read Aloud by Test Examiner will automatically default to
NO
• Form Group Type: Main, Accommodated, or Data Entry
• Scheduled Start Date: select the calendar button; used for
planning only–does not start the test
• Scheduled Start Time and Location/Room: optional fields, for
planning purposes only
7. Select Save.
21
Office of Accountability
Research, Evaluation &
Assessment
Proctor Cache Tests
Steps to Proctor Cache:
1. Pre-caching (download) the test content
• Online Test Sessions must be created prior to Proctor
Caching.
2. Running Proctor Caching during testing
• In order for Proctor caching to be successful, the proctor
caching machine must be on AND the software must be
running during testing.
22
Office of Accountability
Research, Evaluation &
Assessment
What is Proctor Caching?
23
Office of Accountability
Research, Evaluation &
Assessment
Dates for PearsonAccess
Tasks
• OLPA 2015–2016
˗ Testing Dates: Nov. 2–Dec. 22
˗ Create Test Sessions: Oct. 8–Dec. 22
˗ Proctor cache Tests: Oct. 31–Dec. 19
24
Office of Accountability
Research, Evaluation &
Assessment
During Testing
• Start a Test Session
• Provide Student Login Information
• Monitor Test Session
• Resume a Test
• Enter Test/Accountability Codes or Invalidate a Test
DAC only (Robin L. or Michael W., REA)
• Student Logs Into TestNav to Take Test
5
25
Office of Accountability
Research, Evaluation &
Assessment
Start a Test Session
Steps to start a test session:
1. Select Online Test Sessions on the Home page.
2. Find and select your test session under the Session Name
column.
3. Select the Start button on the top left.
4. It will ask you “Are you sure you wish to do this?” Select
Yes-Start Session.
5. Select Return to Session detail.
6. You have now started the test session and will see a Stop
button instead of the Start button.
26
Office of Accountability
Research, Evaluation &
Assessment
Student Login To TestNav
1.
To log in to TestNav, student’s need the following information:
 First Name and Last Name
 User Name (Not MARSS Number this year)
o The User Name is automatically generated after a test
session is created.
 Test Code
o The test code is automatically generated after a test
session is created. Test codes are specific to each test
session.
2. Write the test code (from the test session) on the board for all
students that should be in that specific test session.
 Note: Test sessions are specific to the test grade, subject, and
form group type (Main, Accommodated, or Data Entry).
27
Office of Accountability
Research, Evaluation &
Assessment
Student Login to
TestNav
Test Ticket
Specific to each
test session
created in
PearsonAccess
28
Office of Accountability
Research, Evaluation &
Assessment
Student Login TestNav
Student’s Computer
1. Log-in to the student’s computer.
a. In the “Log On to Windows” box enter:
a. Username: pearson
b. Password: pearson
b. Locate and double click on the TestNav secure browser,
on the desktop. The system should launch directly to the
student’s log-in page. The student will see the page
loading (gray screen).
Username
29
Office of Accountability
Research, Evaluation &
Assessment
RECAP……..NOW WHAT?
Recap of completed steps:
1. Created a test session
2. Proctor cached tests
3. Started the test session
4. Provided student login information
5. Student entered information and logged into TestNav
NOTE: Logging out of PearsonAccess will NOT effect
students testing in Test Nav.
30
Office of Accountability
Research, Evaluation &
Assessment
Monitor a Test Session
•
In addition to monitoring the students testing in the classroom, you
can monitor in PearsonAccess by viewing the Status column.
•
Students in Active status are actively testing.
•
If a student exits the test for whatever reason, the student will display
in Exited status.
•
Students in Exited status need to be resumed before continuing to
test.
Sample student data
31
Office of Accountability
Research, Evaluation &
Assessment
Resume a Test
Steps to resume a test (if a student exits the test and needs to resume
testing):
1. Select the checkbox next to the student(s) that need(s) to be
resumed.
2. Select Resume Test.
3. Student’s can now log back into TestNav with the same student
information that they used initially.
4. When the student(s) have submitted the test in TestNav, the
student will be in Completed status.
Sample student data
32
Office of Accountability
Research, Evaluation &
Assessment
TestNav8 Tools and Functionality
6
33
Office of Accountability
Research, Evaluation &
Assessment
What is TestNav?
Browser-Based Test Engine
• Student desktops are secured and locked down, no other
applications are accessible during testing.
• Test content is encrypted before transferred across the Internet.
Username
34
Office of Accountability
Research, Evaluation &
Assessment
Features and Functionality
•
Wide array of tools and accommodations. Text-to-speech,
magnifying and zoom capabilities, color-contrast, etc. makes
online testing accessible to more students.
•
Industry standard calculators. Embedded TI calculators
provide consistency with what students use in the classroom.
•
Embedded text-to-speech feature. High-quality voice
feature (Julie voicepack) included within the test engine,
eliminates the need for schools to download special software.
35
Office of Accountability
Research, Evaluation &
Assessment
Test Results
7
36
Office of Accountability
Research, Evaluation &
Assessment
Viewing Test Results in
Pearson Access
• Three components:
• On-Demand Reports – Preliminary results available during the
testing window
• Published Reports – PDF versions of final paper reports delivered
to districts, available following the Posttest Edit Window
• Longitudinal Reporting System – Results following the Posttest
Edit Window loaded to the system for districts to analyze trends
and patterns over time
37
Office of Accountability
Research, Evaluation &
Assessment
On-Demand and Longitudinal
Reports
•
On-Demand Reports – access to preliminary online rosters and ISRs
– Users can drill down to an individual student to see preliminary
student-level results.
•
Longitudinal Reports - analyze results from a specific administration,
multiple administrations within a year, or assessment results from year
to year
– Drill-down, filtering, and sorting capabilities
– Aggregate and disaggregate data all the way down to individual
student-level results
– District, school, and teacher access to student results
38
Office of Accountability
Research, Evaluation &
Assessment
Which Reports are Available
for Which Tests?
Test Administration
MCA Math, Reading,
Science
On-Demand Reports

MTAS Math, Reading,
Science
OLPA Math and
Reading

GRAD Math and
Reading

GRAD Written
Composition
Published
Reports
Longitudinal Report







39
Office of Accountability
Research, Evaluation &
Assessment
When will Results Be
Available?
Test Administration
Historical Data
On-Demand Reports
-
Published
Reports
Longitudinal Report
-
10/14/2014
Loaded weekly
beginning 10/24/14
OLPA Math and
Reading
Within 1 hour
-
MCA Math, Reading,
Science
Within 1 hour
7/29/2015
7/29/2015
7/29/2015
7/29/2015
MTAS Math, Reading,
Science
-
40
Office of Accountability
Research, Evaluation &
Assessment
Training Management System (TMS)
Required for SACs and Test Monitors!
8
41
Office of Accountability
Research, Evaluation &
Assessment
Training Management System (TMS)
42
Office of Accountability
Research, Evaluation &
Assessment
Test Monitor Certification
Training Course
• Required for Test Monitors and
SACs
• Learn to create, start and monitor
test sessions
43
Office of Accountability
Research, Evaluation &
Assessment
SAC & Test Monitor Training
Modules
44
Office of Accountability
Research, Evaluation &
Assessment
Required Training Modules
45
Office of Accountability
Research, Evaluation &
Assessment
TMS Also Available Under
Resources
• Go to Pearson Access : Resources : Training
46
Office of Accountability
Research, Evaluation &
Assessment
Test Security
•
•
•
•
Nondisclosure Agreement
Test items
Security Measures for 2015-16
Staff Security Training
47
Office of Accountability
Research, Evaluation &
Assessment
Test Security Policies
•
Nondisclosure Agreement
– Everyone with secure access to Pearson must complete the
Nondisclosure Agreement.
– Test Monitors & data entry personnel must accept the
agreement in PearsonAccess or they will not be able to
monitor tests or enter student responses.
– Everyone with access to the test items must sign the
Nondisclosure Agreement.
– Anyone who may come in contact with or see test items, can
be asked by a student about an item or handle test materials
must sign a Nondisclosure Agreement.
– Paper Nondisclosure Agreement available here on REA
website: http://rea.spps.org/Test_Coordination2
48
Office of Accountability
Research, Evaluation &
Assessment
Test Security Policies cont.
•
All Test Items are secure
– Discussions of items are not allowed with students and
co-workers.
– Test items and student tests are not allowed to be reviewed
by teachers or building staff.
– Test items may not be reproduced in any form or by
anyone.
– Cell phone cameras are not allowed.
– Emails or discussions in on-line social media are not
allowed.
49
Office of Accountability
Research, Evaluation &
Assessment
Test Security & Training Proctors
• School SAC Meeting
• You must
˗ hold a training meeting for your monitors,
˗ have them sign-in to prove they attended the meeting,
˗ allow time for monitors to read the non-disclosure
agreement,
˗ have them sign one Non-Disclosure Agreement per school
year collect the Non-Disclosure Agreements and file, and
˗ decide what to do when students finish their test, remain
seated or leave the classroom.
• Topics to Cover during your Training Session
• Proctors must be impartial observers during the test
administration.
• Reproducing or paraphrasing an item in an email or in writing is
a breach in security.
• Cell phones, PDAs or translation devices may not be used.
• Dictionaries may not be used.
• Scratch paper must be collected from students before leaving the
testing room.
• All instructional posters and graphics in the computer lab or
where students will be taking the MCAs must be covered or
removed.
50
Office of Accountability
Research, Evaluation &
Assessment
Test Security & Training Proctors, cont.
• Test Administration Report (TAR)
• The TAR is used to record test misadministrations and reasons
for invalidations.
• The SAC completes the TAR and forwards a copy to Robin or
Michael in the testing office.
• The TAR must be kept on file for 12 months.
• The TAR is available here on REA website:
http://rea.spps.org/Test_Coordination2
• Examples of misadministrations
• A student uses a calculator during a non calculator segment.
• A student engages in inappropriate behavior or action that
results in a test being invalidated.
• A student refuses to take an assessment or cheats on an
assessment, requiring the assessment to be invalidated.
• A student’s responses are transferred by staff from an answer
document to the Data Entry Interface incorrectly.
51
Office of Accountability
Research, Evaluation &
Assessment
Security Measures for 2015-16
Tip Line
• MDE has launched a Test Security
Tip Line.
• Educators, parents, students and others
can report suspected incidents of
cheating, improper or unethical
behavior on any Statewide assessments.
• Links to the Test Security Tip Line are
available in two places on the MDE web
site.
˗ View the Test Administration page
(MDE>School Support>Test
Administration)
˗ View the Testing Information page
(MDE>Just for Parents> Testing
Information)
52
Office of Accountability
Research, Evaluation &
Assessment
Site Visit Checklist
53
Office of Accountability
Research, Evaluation &
Assessment
Links and Resources
• Assurance of Test Security and Non-Disclosure
OLPA Assessment Manual; Page 39 Appendix A
Online Go To: PearsonAccess / Resources / Manuals
http://www.pearsonaccess.com
• Online Tools & Accessibility Tools
OLPA Assessment Manual; Page 41 Appendix B
http://www.pearsonaccess.com
• Proctor Caching Test Sessions
OLPA Assessment Manual; Page 55 Appendix D
http://www.pearsonaccess.com
• MDE
http://education.state.mn.us/mde/index.html
• REA Test Coordinator Site
http://rea.spps.org/Test_Coordination2
54
Office of Accountability
Research, Evaluation &
Assessment
Contact Information
PEARSON
http://www.pearsonaccess.com/cs/Satellite?pagename
=Pearson/QuickLink/PearsonAccess
SAC’s site for all assessment tasks
Help Desk
Phone: 888-817-8659
Mnhelp@support.pearson.com
Monday – Friday 7:00 am – 6:00 pm (CST)
Robin Lane
Office; 651-767-8257
Cell: 651-335-3594
Email: robin.lane@spps.org
Michael Wirtz
Office: 651-632-3776
Cell: 651-261-0045
Email: michael.wirtz@spps.org
55
Office of Accountability
Research, Evaluation &
Assessment
New Resource in Pearson
• Searchable Knowledge Base in Pearson
56
Office of Accountability
Research, Evaluation &
Assessment
• Searchable Knowledge Base in Pearson
57
Office of Accountability
Research, Evaluation &
Assessment
Download