Who is tested? - The Bookshelf

advertisement
September
2015
 3,
SCPCSD District Office Training Room
o
o
o
o
o
o
o
o
o
o
Introductions
The School Test Coordinator’s role
Resources for the STC
Overview of all State Tests
Test Security
Lunch 12:00-1:00
Materials and Ordering—Precode
English Language Learners
Students with Disabilities
Accountability
Please tell us:
o Your name
o Your school
o What else you do besides testing
Organized—plans and implements
effectively
o Responsible—Successfully completes
tasks ON TIME
o Detail-Oriented—Assures Accuracy of
every aspect and document related to
testing
o Dedicated– go “above and beyond”
o
o
o
o
o
Coordinates the administration of all statewide
assessments, including preparation before and
follow up after testing.
Implements all policies/procedures for the
assessments as directed by Test Coordinator
and Test Administration Manuals, and SCPCSD
Directives.
Assures the security of all secure testing
materials.
Adheres to all state policies regarding test
security.
o
Assures that students with Disabilities, Students
with ELL Accommodations Plans and Students with
504 Plans receive appropriate testing
accommodations.
o
Assures that appropriate testing environments are
maintained.
o
Trains building level staff in test security
administration. (Test Administrators & Monitors).
o
Emails from the District Test Coordinator will alert
you of upcoming deadlines.
o
Emails from Test Contractors (i.e., ACT)
o
Test Contractor web pages and portals:
o eDirect (for SCPASS and End of Course Tests)
o ACT WorkKeys : South Carolina web page for ACT
WorkKeys (also for the ACT and ACT Aspire)
Our Charter District site for sharing documents and resources
!!
The Bookshelf
https://sccharter-public.sharepoint.com (GO To
ASSESSMENTS)
o Will include information such as:
o The District Assessment Calendar
o STC Handbook
o PowerPoint Trainings
o Links to eDirect, SCDE websites, and contractor websites
o Contact information for Customer Support
*Many dates are TBD.
o
The Assessment Calendar will be on SharePoint.
o
Caution: Test Manuals for some tests will list the State
Testing Window. Districts are often required to select a
shorter window of dates within the state window.
o
o
o
o
o
o
32 Schools
More online availability
Still unknown!
gr. 3-8 ELA and math test,
gr. 11 college and career
readiness assessment
ELL assessment
*Scheduled Tests


o My IGDIS (Individual Growth and
Development Indicators)
o An early literacy measure
o Individual Administration required first 45
days and last 45 days
o
Developmental Reading Assessment 2
o
Provides a measure of independent
reading level and comprehension
o
Individual Administration required first
45 days and last 45 days
o Name: Cognitive Abilities Test & Iowa Assessment
o Grades: 2nd
o Subject Areas: Aptitude (verbal, quantitative, and nonverbal),
reading, and math
o Test Dates: October 21– November 11
o Format: Paper-and-pencil
Who is tested?
The norm-referenced tests (aptitude and achievement) for gifted and
talented screening are administered in the fall of each year to students in
grade 2. The information from the administration of the norm-referenced
tests is entered into the GIFT software program, which identifies students
who qualify for the program. Based on the results from the normreferenced tests, a secondary screening using a performance assessment
may be required for possible candidates.
o Name: SC Performance Tasks Assessment
o Grades: Typically 2nd, but may include others
o Subject Areas: Verbal and nonverbal
o Test Dates: February 16– March 3
o Format: Paper-and-pencil with preteaching and manipulatives
Who is tested?
Students who partially qualify as Gifted and Talented in either Dimension A
or Dimension B, but not both, based on CogAT/ITBS scores, may be given
the Performance Tasks Assessment. This assessment provides a second
opportunity to become identified as Gifted and Talented.
o Name: End-of-Course Examination Program
o Grades: 7-12
o Subject Areas: Algebra 1, English 1, US History and the Constitution,
and Biology 1
o Test Dates: January, May, July
o Format: Paper-and-pencil or Online
Who is tested?
All students who are enrolled in courses in which the academic standards
corresponding to the EOCEP tests are taught must take the appropriate
tests.
The examinations count 20 percent of the students’ final grade in each
course.
South Carolina Alternate Assessment (SC-ALT) and National Center and State
Collaborative (NCSC)
o NCSC – ELA and Math-ages 8-13 and 16
o SC-ALT – Science and Social Studies, ages 9-13; Biology, age 16
o Test Dates: March 1-29, 2016
o Format: Paper-and-pencil
Who is tested?
Alternate assessment is for students with significant cognitive disabilities who are
unable to participate in the general assessment program even with
accommodations. Students must meet the participation guidelines for alternate
assessment.
With undetermined
dates


Procurement activities not finalized
o Name: End-of-Course Examination
Program
o Grades: 7-12
o Subject Areas: Geometry, English 2
If required for federal accountability.
Test contractor names and administration
dates to be announced.
o Name: SC Palmetto Assessment of State Standards
o Grades: 4-8
o Subject Areas: Science and Social studies
o Test Dates: May
o Format: Paper-and-pencil or online
Who is tested?
o Students in grades 4-8 take both science and social studies.
o
Dates to be announced when the Summative Assessment
ELA and math dates are announced.
Test names and administration dates will be
announced as soon as procurement activities
are finalized.
o
All students in grade 11 and students in
their third year of high school must be
administered a College and Career
Readiness Assessment and WorkKeys.
o
The College and Career Readiness
Assessment is still TO BE DETERMINED. Test
name and administration dates to be
announced.
o To Be Announced as soon as the procurement activities are
finalized.
o Test Dates: typically mid February – mid March
Who is tested?
All students in grades K-12 who are determined to have limited English
proficiency - based upon the completion of a Home Language Survey and
the initial assessment of their English proficiency. This includes those
students whose parents have waived direct ESOL services.
Participation is expected to be 100%, verified by the SCDE Title III office.
o
What Is WorkKeys? A job skills assessment
published by ACT.
o
Three 45 minute assessments: reading for
information, applied math, and locating
information.
Dates: Negotiations with ACT are in progress.
NAEP
Assessments

Formative
PSAT AP
o Grades: 4, 8, and 12
o Subject Areas: 12 subject areas
Test Dates: January – March
o Format: Paper-and-pencil; pilot testing of tablets in 2015,
technology based assessments begin in 2017.
Who is tested?
NAEP statisticians carefully select a sample of students to represent the
entire student population. Main NAEP is administered to students in
grades four, eight, and twelve; however, samples for long-term trend are
based on age (9, 13, and 17) rather than grade. Test scores and
questionnaire responses are always kept confidential. Results are never
reported for individual students or schools.
For the 2015-16 school year, NAEP assessment will focus on the Arts. NO
DISTRICT PARTICIPANTS.
The following assessments have been
approved by the State Board of Education:
o Blending Assessment with Instruction
Program (BAIP-Math)
o STAR Reading and STAR Mathematics
o Measures of Academic Progress (MAP)
o Istation
o I-Ready – Paid for by the SCPCSD in
2015-16!
Funding Process
Each year, schools complete a survey to indicate
the number of students tested and submit an
invoice showing funds spent. The state collects
this information from all districts and allocates
funds based on the number of students tested
statewide.
Reimbursement varies each year and is not
expected to be 100%.
o
The PSAT can be administered by Schools with a Level
II code from the College Board.
o
Schools without a Level II code should refer students to
other schools
o
The SCDE Office of Assessment will pay the College
Board for all TENTH grade students who take the in
grade 10 in 2015-16.
o
Test Date: October 14, 2015
o Name: Advanced Placement
o Grades: Typically 11 & 12
o Subject Areas: 31 subjects including Calculus, Biology, & English Lit
o Test Dates: May
o Format: Paper-and-pencil
Who is tested?
The state will pay for students enrolled in approved Advanced Placement
courses to take the exam (students may pay a small administrative fee).
Any student may take any exam for $89.
Schools must apply to the College Board for a level II code in order to
administer AP exams. Students may make arrangements with their local
high school.


Dr. Kathryn Rhodes, SCDE
o
DTCs, STCs and all personnel involved in
paper/pencil and online testing must be familiar
with SC test security legiislation and State Board
Regulations.
o Pages 11-14 in Handbook
o Pages 13-14: Read X. A-U
Any suspected violation must be reported to the DTC
o
All STCs, TAs, and Monitors must
sign after receiving training
o
Scan and Return to district office
and keep copies.
o
In 2015-16 you will be asked to
return these prior to the test
dates.
Secure materials must be kept in
secure, locked storage when not in use.
o If possible—no outside or inside
windows.
o No copy or fax machine or frequently
accessed materials in the room.
o
o
Do not leave secure materials
unattended at any time. If a TA must
leave the room before testing begins,
materials should be placed in a locked
drawer, cabinet, etc. or materials
should be taken with the TA.
o
o
Schools and districts are required to use
security checklists to track distribution and
return of all secure paper/pencil test
materials
STCs, TAs, and monitors are responsible for
ensuring that all test materials and student
responses for online tests are handled in
accordance with security procedures
outlined in the TAM.
State Board Regulation 43-100, X, C: “Failing to proctor the test to
ensure that examinees are engaged in appropriate test-taking
activities” is considered a security violation.
o
Preparation- The TAs should make certain they have read
the test manual and are well-prepared.
o
TAs should not deviate from the directions for conducting
the test.
o
TAs should be alert and move throughout the room during
testing in order to:
observe any apparent cheating, talking, or copying,
o Observe any cellphone use or use of electronic device
o Check that students are following directions for marking responses
or entering into the online testing system.
o
o
Monitors may not be left in charge of a classroom in which
students are testing or in which test materials are not in
secure storage.
These are actual violations that occurred in our district in 2013-14:
o A test Administrator was using a cell phone during a small group
administration of a high school test.
o A student did not receive a test in a small group even though small
group administration was included in his IEP.
o A student was not allowed to type responses although his IEP specified
that he should be allowed to do so.
o A student received an oral administration accommodation of the SC
PASS test but the student did not have an IEP or 504 plan .
o A student was allowed to type responses even though typing responses
was not an accommodation for that student.
o Student was allowed to use a calculator (not in IEP).
o A teacher administered the entire CogAt test on one day even though
the Test Administration Manual specified that specific subtests be given
on specific days..
o A test booklet and answer document were not returned on time.
o
o
o
o
o
A TA administered the ACT with Timing Accommodations
when the students should have had the standard
administration.
A LEP student was supposed to have oral administration of
the Algebra EOC and did not receive it.
The ACT was administered to a small group of Students with
Disabilities using the WorkKeys manual.
The TA left a monitor with students taking the SCPASS
makeup test while he went to another room to read
directions to another group of students taking makeups.
CogAt/IA tests were returned to the contractor several days
late.
Student:
o Invalidation of test scores
Teacher:
o Report to SLED for information or investigation
o Suspended/Revoked Certificate
School:
o Letter of Caution from the District Office
o Probation
o Revocation
Remember that failing to report a violation is also a violation!
o
o
o
o
o
Test tickets are secure; use testing roster, in lieu of security
checklist, to account for tickets.
Online test may not be viewed by anyone prior to the test session.
TAs are expected to ensure that visible online tests are not left
unattended.
Use of traditional desktop and laptop computers is
recommended for online testing.
If Chromebooks or iPads are allowed schools will be responsible
for ensuring test security on these devices and will be
accountable for any atypical impact on students test scores.
Mr. Edwards, a teacher at Springfield Middle School,
is very thorough. His students are taking the SCPASS
test online this year, and Mr. Edwards wants to make
sure that his students get as many points as possible
on the test.
During testing, as each student finishes, Mr. Edwards
asks them to go to the Review/End Test screen. If he
sees a blank response, he instructs the student to
return to the item and answer it.
This is a test security violation. TAs should not examine
an online test or a paper answer document to make sure
all of the questions were answered.
While moving around the classroom, it is permissible for
TAs to check that students are following the directions for
marking their responses on the computer screen or in the
answer document. It is not permissible to stop and read
test items or check students’ responses on the computer
screen or in their answer documents. The TA may make
general announcements to the class such as reminding
students to check their answers before exiting the test or
to do a good job of erasing on the paper answer
documents.
All
classrooms at High-Tec Middle
School have computers.
Ms. Twitter, a frequent user of her
computer, e-mailed her colleagues after
testing to ask if they noticed the
question in
the social studies test about the
Museum of Ancient History.

Ms. Twitter is guilty of several test security violations.
TAs and other personnel are not permitted to read test
items before, during, or after testing. Based on her email message, it appears that Ms. Twitter read a
question in one of her student’s test booklets. She
should not have done this unless she was conducting
an oral or signed administration using a secure script.
In addition, TAs are not permitted to disclose or discuss
the contents of any test with students, teachers, or
other personnel. Here again, Ms. Twitter committed a
test security violation by e-mailing her colleagues with
a reference to secure test content.
In order to save time, Mr. Fatica decided to have his
students practice the Online Tools Training (OTT) for the
End of Course test immediately before the actual test
administration
To be efficient, he handed out the Student Test Tickets as
soon as the students were seated. The class then began
to work on the OTT as a group, openly discussing the
practice items. Four students mistakenly used their test
tickets to login to their actual tests during the OTT
session. By the end of the OTT session, they had nearly
completed the entire test
 This
is a test security violation for several reasons.
As indicated in Appendix B of the SCPASS TAM, the
OTT should be used prior to the online testing
window, not immediately prior to an actual test
session. The TA failed to follow directions as
specified in the test manual, but the TA also
violated S.C. Code Annotated Section 59-1-445
(2004) by giving examinees access to the test
questions prior to testing.
Mrs. Hansel, the Special Education Coordinator, developed a plan
for ordering customized materials and arranging for SCPASS
testing accommodations. In December, she asked all teachers at
Stonehouse Middle School to provide her with a list of the testing
accommodations specified in each student’s IEP and/or 504
Plan. Teachers sent this information to Mrs. Hansel.
After testing was completed, however, it was discovered that one
of Mr. Gredler’s students had not received an accommodation for
science as specified in his IEP. A review of the situation revealed
that Mr. Gredler had provided Mrs. Hansel with the student’s IEP
accommodations for social studies, but not for science.
Not providing accommodations as
appropriate for students with IEPs or 504
Plans is a test security violation. Because
the student in Mr. Gredler’s class did not
receive the accommodation specified in his
IEP, an IEP team meeting must be convened
as specified in the SCPASS TAM to determine
whether or not the science test
administration should be considered valid.
o
Develop an effective system for ensuring that students receive
the correct accommodations.
o
Provide a comprehensive training for Test Administrators and
monitors.
o
Emphasize that test manuals must be read in their entirety. It is
not sufficient simply to attend training.
o
Encourage Test Administrators and monitors to contact you
immediately if there is a questionable situation. Make sure you
are available by phone. Testing is not the time for Test
Administrators to make independent decisions.
o
o
o
o
o
o
o
o
o
Use security checklists provided by test contractors.
Test Administrators sign out tests and sign them back in.
o Know exactly how many documents each TA is
responsible for.
o COUNT, COUNT, COUNT every time documents change
hands.
o Identify which student used which document.
Conduct a final inventory, then sign the security checklist.
Double-check all labeling.
Separate scorable from non-scorable.
Keep a count of scorable documents.
Follow diagrams in the TAM for packaging order.
Complete Header Sheets if required.
Return materials by the stated deadline.
PLEASE ASK…
o
If a student was not given the proper
accommodation, but this error was discovered and
the student is given a different form of the test,
does this still constitute a security violation?
12:00-12:45
o
District Test Coordinator emails to you and
emails sent to you from contractors will provide
guidance regarding deadlines and next steps.
Know your deadlines!
o
o
1. Precoding in PowerSchool
2. Contractor websites/portals
o
The Precode Process – Sends student information
in school databases to testing contractors for the
purpose of pre-assigning answer documents and
test booklets via barcoded documents and labels.
o
(Provides the same data for online testing)
o
Eliminates manual coding, which saves time and
labor and prevents errors.
o
Test contractors require state ID values
to be unique and have a value for each
student. Students with no state IDs and
students with duplicate state IDs will
not be precoded.
o
Communicate with your PowerSchool Administrator
about:
o Sorting materials
o Customized materials
o Paper vs. online administration
o Data Collections – whole school responsibility.
Work closely with PowerSchool Administrator,
Special Education Coordinator, and Title III
Coordinator to ensure that accurate data is
uploaded by Test Contractors.
o
Precode Data Collections:
o Kindergarten Readiness—August 24, 2015
o CogAT/Iowa Assessment – August 28, 2015
o Fall EOC: October
o Spring Print Phase: January
o Spring Update Phase: March
o
o
o
Communicate with your PowerSchool administrator!!
Communicate with your Special Ed coordinator!!
Pay attention to Precode vs. other ordering instructions to
ensure that accurate data is uploaded by Test Contractors.
o
Available Online:
o EOCEP
o SCPASS
o CogAt/IA (if your
school previously
signed up)
o Gr.3-8 assessment
and Gr. 11
summative
assessment
o
NOT Available Online:
o SC Performance Tasks
o Gr. 4 and 5 Readiness
o WorkKeys (no lockdown
browser)
o
Make sure that Student is
enrolled in a section with
the proper course code
o
o
o
o
o
o
o
o
o
o
o
o
4111 Algebra 1
3142 Math Tech 2
4117 Intermediate Alg
4114 Common Core Alg 1
3011 English 1
3024 Common Core Eng 1
3221 Biology 1
3227 Applied Biology 2
3320 US History
3372 AP US History
336D IB History of the Americas
3322 Dual Enroll. American Hist.
o
Will the student test online
or on paper?
o
o
1.
2.
3.
4.
As of October 2014, the Sort ID fields affect ONLY SCPASS
Use one of four options:
An Alphanumeric entry up to 9 characters to sort by teacher,
test administrator, or other grouping.
AWG to sort alphabetically within grade
If Sort ID is blank, materials will be sorted by Home Room.
If Sort ID & Home Room are blank, materials will be sorted
AWG.
Oral/Signed Administration
o
Teacher-level materials (Script and/or CD-Rom)
o Must be ordered via eDirect for SCPASS &
EOCEP
o
Student-level materials (Test booklet)
o Must be coded in PS for SCPASS
o Must be coded in PS for online EOCEP
For paper/pencil Oral Administrations, MAKE SURE the
student booklet is the correct form to match the script.
eDirect is the website for the test contractor Data Recognition
Corporation (DRC). DRC provides the SC PASS Assessments
(social studies and science) and EOCEP Assessments for our
state.
Each STC is provided with an account on eDirect
(https://sc.drcedirect.com). Contact the DTC for assistance
logging in or using eDirect. This account is used to:
o Order test materials
o View and download documents such as the TAM
o Access online software downloads and training tools for online
assessments
o View reports after testing is completed
ACT Testing: South Carolina
o www.act.org/aap/southcarolina/act/ht
ml
o Contains Checklist of dates, Manuals
and Supplements, Training, Score
Reporting, and Customer Services
contact information.
o Each STC is provided with an account.
o


Vamshi Rudrapati, Director of Federal Programs
o
A limited English Proficient (LEP) –a
student who has a primary language
other than English and is not proficient
in listening, speaking, reading, writing,
or comprehension in the English
speaking classroom as determined by a
language assessment instrument.
o
In PowerSchool, the appropriate code for
each student is based on the ACCESS or
ELDA test score.
o
For new students, coding in PowerSchool is
based upon performance on the assessment
used for initial placement.
o
Assessments are NOT available in
languages other than English.
o
Test Administrators may not translate
any part of the tests except the test
directions.
o
PowerSchool codes 1-7 can receive
accommodations.
o
PowerSchool codes 8 and 9 do not receive
accommodations.
o
Accommodations should be used only
as appropriate for individual students
and should not be applied to all LEP
students indiscriminately.
o
Generally, the same accommodations
that are available to Students with
Disabilities are available to LEP
students.
o
Accommodations should be recorded
on the student’s accommodations
form and kept with the student’s ESOL
folder.
•
An ELL student CANNOT be exited
from the ELL Program until the
student meets the state exit criteria
on the State English Language
Proficiency Assessment.


Beckie Davis, Director of Special Education Services
o Students
with disabilities must be
included in state and district
assessments.
o Assessments must provide for
accommodations for students with
disabilities.
o XO.
Not providing accommodations
(to include customized forms and
modifications) as appropriate for
students with IEPs or 504 Plans.
This includes providing more
accommodations (customizations,
modifications) than appropriate.
o Not
providing accommodations or
providing additional
accommodations jeopardizes the
validity of the inferences made on
the basis of test data.
o
All of the following accommodations must correlate:
o Stated in IEP or 504
o Received during regular instruction
o Received during testing
o Coded on answer document
o Coded in PowerSchool
o
o
o
o
Standard vs. non-standard (team decision)
Only route to accommodations is IEP or 504
Exception: temporary conditions
Violation requires review by IEP or 504 team
Oral
administration
Signed administration
Custom Materials (loose leaf, large
print
 Oral
administration scripts and Braille oral
administration script for paper testing
(for TEACHER USE: SCPASS and End of
Course.)
 Test booklets for paper testing (EOC)
o
o
o
o
Setting accommodations: preferential seating,
separate location, small group, and individual
administration
Timing Accommodations:-frequent breaks
Scheduling accommodations:-several sessions per day,
time of day, administering the test over several days.
Presentation Accommodations: reading test aloud to
himself, TA signing directions, TA highlighting key
words, etc.
If accommodations are on the IEP and
NOT listed in the Test Administration
Manual…..
o Contact Beckie and/or Jean
o


Courtney Mills, Director of Academic Programs
95% participation requirement is based on:
o First day of testing (FDT) data
o Students not tested (SNT) data
o Medically unable to attend school or receive instruction
o Homebound and physically or mentally unable to test
o Expulsion
o Withdrawal
o Death of the student or a family member
**All students not tested must have a reason entered in PowerSchool,
even if the reason does not qualify for an exclusion. For example,
parent or student refusal to test.
o
Every subgroup of at least 30 students
Test Participation
o
o
o
If a student is enrolled on the
first day of testing, he or she
MUST take the test
The goal is 95% participation
overall and in every subgroup
(gender, ethnicity, SES, etc.)
Applies to the new
assessments in ELA & Math
Test Performance
o
o
New Assessments
(ELA/Math): Students’
scores only count if they
are enrolled continuously
from the 45th day through
the first day of testing
EOC (Bio & USH): Every
score counts
o
Data will be extracted on or
about the first day of each
test
o
Student enrollment must be
up-to-date
o
Accountability implications
If a student misses any portion of PASS, NCSC, SC-Alt or the
new accountability exams that he or she was supposed to
take, you must complete the SNT fields on the Precode page.
o
If a student withdraws MORE THAN one week prior to
testing, he must be properly withdrawn in PowerSchool
before the first day of testing.
o
If a student withdraws LESS THAN one week prior to testing,
and you properly withdraw him in PowerSchool before the
first day of testing, there is nothing else you need to do.
o
If a student withdraws LESS THAN one week prior to testing,
and you do NOT withdraw him in PowerSchool before the
first day of testing, then you must complete the SNT fields
for that student.
ELA/Math
o 2015-16: Teach and assess SC College-and Career-Ready
Standards
Science
o 2015-16: Phase-in of 2014 standards continues
o 2015-16: Assess 2005 standards
o 2016-17: New standards will be assessed
Social Studies
o 2015-16: Teach & assess 2011 standards
True Grade
o
Make sure the True Grade Field is BLANK for all students!
Effect on Accountability
o Students are expected to test based on their true grade.
o There are consequences for incorrectly coding this field,
including reduced participation rates or incorrect
performance rates if students take the incorrect grade-level
assessment, or reduced graduation rates if a high school
student’s 9GR conflicts with the true grade.
o
Students are classified by the
Instructional Setting field in
PowerSchool
o Will include more students
o Some schools may now have a large
enough subgroup to count.
Jean Epps
Coordinator of
Assessment
o
o
o
o
o
jepps@sccharter.org
803-734-0117
Test administration
Test security/violations
Precode
Courtney Mills
Coordinator of Academic
Programs
o
o
o
o
o
cmills@sccharter.org
803-734-0525
Accountability Questions
First day of Testing
Students Not Tested
Download