PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
PAIUCC Meeting
Classroom Diagnostic Tools
and
Keystone Exams
September 17, 2010
Pennsylvania Department of Education
www.education.state.pa.us
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
Agenda
•
•
•
•
•
•
•
•
•
•
•
•
•
Introductions
Keystone Exams Overview
Keystone Exams Fall 2010
Keystone Exams Spring 2011
Keystone Exams Key Dates
Keystone Policy Impacts
Classroom Diagnostic Tool (CDT) Overview
CDT Field Test
CDT Key Dates
CDT Reporting
Fall 2010 Field Test -- Administrative Key Dates
Data Management
Questions
www.education.state.pa.us
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Keystone Exams Overview
The Keystone Exams are end-of-course assessments designed to assess proficiency in
the subject areas of Algebra I, Algebra II, Geometry, Literature, English Composition,
Biology, Chemistry, U.S. History, World History, and Civics and Government.
• One component of Pennsylvania’s high school graduation requirements
beginning for the graduating class of 2014-2015
• Taken as an end-of-course exam near the end of course completion that counts
for at least one-third of the final course grade
•
PDE recommends administering the English Composition Keystone Exam at the
end of English 9 and Literature at the end of English 10
• Available to students either online or paper-pencil
• Comprised of two (2) modules
• Multiple-Choice (MC) and Constructed-Response (CR) items
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Keystone Exams Fall 2010
• Field test of Algebra I, Biology, and Literature
• Available to mostly students in high school, but may include
middle school students
• Online and/or paper-pencil assessment comprised of two
modules
• Multiple-Choice (MC) and Constructed-Response (CR) items
• Approximately 2-2 ½ hours for each exam, 1-1 ¼ hours per
module
• Student should be assigned to an assessment based on course
enrollment in the 2009-2010 school year
• Field test results will be provided for participating districts
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Keystone Exams Spring 2011
• First operational administrations of Algebra 1, Biology, and
Literature
• Field test administrations of Algebra 2, Geometry, and English
Composition
• Testing window will be beginning of May 2011
(exact dates not yet finalized)
• Students nearing completion of a course are eligible to take the
course-specific Keystone Exam
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Keystone Exams Spring 2011
• Online and paper-pencil formats available
• Paper/pencil testing materials will arrive in two shipments
1.
2.
Administrative materials arrive four weeks prior to the window
Secure materials arrive two weeks prior to the window
• Paper-pencil testing materials are returned after each subject is
complete
• Preliminary results provided around the end of May
• Final results (with performance levels) provided later in
summer (Algebra 1, Biology, and Literature only)
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Keystone Exams Key Dates
Field Test and Operational Assessments
Field Test
Algebra I, Biology,
Literature
Algebra II, Geometry,
English Composition
Operational
November 1-19, 2010
May 2011
May 2011
Winter 2011
US History
Fall 2012
May 2013
Chemistry, Civics &
Govt., World History
May 2015
TBD
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Graduation Policy
Under the new regulation and beginning with the class of
2015, students can meet graduation requirements through any
of the following options determined by the district:
1. Successful completion of
courses and Keystone Exams
2. Rigorous, independentlyvalidated local assessments
3. AP or International
Baccalaureate Exams
OR ANY
COMBINATION
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Graduation Policy 2 Phases
Students in the graduating classes of 2015
and 2016 must demonstrate proficiency
in:
1.
2.
3.
4.
English Composition
Literature
Algebra I, and
Biology
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Phase 2- Class of 2017 and beyond
Students must demonstrate proficiency in six
of ten content areas:
• Both English Composition and Literature;
• Two of three Mathematics (Algebra I, Algebra II,
or Geometry);
• One of two Sciences (Biology or Chemistry); and
• One of three Social Studies (American History,
Civics and Government or World History).
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Chapter 4 Advisory Committees
Three advisory committees are specified in the
regulation:
Performance Level Advisory Committee
Local Assessment Advisory Committee
State Assessment Advisory Committee
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
District Choice
• Keystone Exams will count for at least 1/3 of
the final course grade; or NEW:
• Keystones used as a local assessment and
students must score proficient or advanced.
• Locally designed and independently validated
assessments
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
District Choice
Pass Rigorous National Assessments
• National assessments are the Advanced Placement
(AP) Exams and the International Baccalaureate (IB)
Exams
• PDE will release policy guidance regarding the
minimum score on each that is needed to satisfy
graduation requirements
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Project Based Alternative
• A student who does not score “proficient” on a
Keystone Exam after two attempts will be eligible to
complete a project-based assessment
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Project–Based Assessment
Projects will be:
• aligned with the Keystone Exam modules
• developed by the department
• administered by school staff
• scored by regional panels of educators
• developed so that points will be added to a student’s
highest Keystone score if his/her performance is
judged “satisfactory.”
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Eligibility for Projects
Students will qualify for projects if he/she:
1. has taken the course.
2. was unsuccessful after two attempts with the
Keystone exam.
3. has met the district’s attendance
requirements for the course.
4. has participated in supplemental instructional
services.
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
CDT Overview
The Classroom Diagnostic Tools provide a diagnosis of students’ strengths and
weaknesses to guide instruction and/or remediation.
• Available to students in grades 6 through high school
• Online assessments delivered in a Computer
Adaptive Test (CAT) format
• Multiple-choice items
• Multiple assessments a year
• Real-time reporting
• Reports dynamically linked to curriculum resources
in SAS
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
CDT Fall 2010
• Field Test Event for Science and Reading
•
•
•
•
•
•
Available to students in grades 4 through high school
Assesses content in Science and Reading grades 3-8, Biology,
Chemistry, Literature
Multiple-Choice (MC) items
Single assessment – approximately 1 class period (45-60 minutes)
Student should be assigned to an assessment based on course/grade
enrollment in the 2009-2010 school year
Field test results will be provided for participating districts
• Operational Mathematics Available to Schools –
October 18, 2010
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
CDT Key Dates
Field Test and Operational Assessments
Field Test
Mathematics
Operational
April 26-May 28, 2010
October 18, 2010
Literature
October 4-29, 2010
Winter 2010/2011
Science
October 4-29, 2010
Winter 2010/2011
Writing/Composition
May 2011
Fall 2011
Social Studies
Fall 2012
Winter 2012/2013
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
CDT Reporting
• Reporting for the CDT will be available on
DRC’s eDirect system
• Results will be linked to Materials and
Resources on SAS
• Three types of reports will be provided
1. Group Diagnostic Map
2. Student Diagnostic Map
3. Learning Progression Map
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Group Diagnostic Map – Algebra I
21
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Group Diagnostic Map – Mathematics
Zoomed In
Zoomed Out
22
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Group Diagnostic Map
Single Diagnostic Category
23
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Student Diagnostic Map
24
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Learning Progression Map
25
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Fall 2010 Field Tests -Administrative Key Dates
Key Dates
Description
PA Online Assessment Software
Date Available
CDT
Keystone
August 23
August 23
PA Online Assessment Test Tutorials
September 21
October 4
PA eDIRECT Test Setup System
September 13
September 13
September 13
September 13
PA eDIRECT District Student and Teacher file uploads
available
CDT User Guide and Directions for Administration
(electronically)
CDT User Guide and Directions for Administration
(hardcopy in districts and schools)
Keystone Handbook, User Guide, and Directions for
Administration (electronically)
Keystone Handbook, User Guide, and Directions for
Administration (hardcopy in districts and schools)
September 8
September 20
September 20
October 18
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Data Management
• PIMS data was uploaded to DRC’s test setup
system (eDIRECT)
– Student-level data
– Teacher-level data (not required for field test
events)
• School/district personnel will use eDIRECT to
set up and manage all online testing
PAIUCC Meeting, September 17, 2010
Classroom Diagnostic Tools and Keystone Exams
www.education.state.pa.us
Data Management
• For fall 2010, district personnel will be able to upload
student and teacher data directly to eDIRECT
• Any student data updated or uploaded in eDIRECT
must also be updated or uploaded in PIMS
• PIMS data and data uploaded into eDIRECT will be
used to generate student Precode Labels (paper-pencil
Keystone Exams)