# Faculty Presentation 1

```PPT Presentation Template:
This PPT includes all slides to
present a district-level
overview of PVAAS. This was
used with a district-wide
elementary faculty group.
PVAAS Overview:
Evaluating Growth,
Projecting Performance
Faculty Introduction
PVAAS IS:
• Analysis of existing assessment data
– Longitudinal PSSA scores in available
content areas
– Provides reliable estimates
• A measure of a school’s effectiveness
• Critical Relationship:
Growth Data vs. Achievement Data
PVAAS:
•
Is not another test
•
Is not a comparison of single test
scores
•
Critical concept:
Does not provide a measure of
growth for an individual student
Current Data Collection
Approaches
High Achievement
Average Achievement
Low Achievement
Achievement is based
on each student’s ending point.
To Achievement…Progress
Below
Growth
Standard
At or Above
Growth
Standard
Progress is based
on each student’s starting point.
Viewing Achievement and
Progress Together
Scatter Plots:
The Scatter Plot
Coordinate System
Vertical Axis
PSSA Percent
Proficient or
Achievement and Growth - 4th Math
AYP Percent
Proficient Target
Growth Standard
Boundary
One Year
Growth
56
0
-20
0
PVAAS Growth Measure
20
Horizontal Axis
PVAAS Growth
Measure
and Their Meanings
Negative Growth
Achievement and Growth - 4th Math
Achievement
Negative Growth
Positive Growth
56
Achievement
Positive Growth
0
-20
0
PVAAS Growth Measure
20
District Scatter Plots
District vs. IU Region vs. State
District Scatter Plot – Grade 4
District Scatter Plot – Grade 5
District Scatter Plot – Grade 6
District Scatter Plot – Grade 7
District Scatter Plot – Grade 8
Viewing Achievement and
Progress Together
Scatter Plots:
The PSSA-PVAAS Scatter Plots visually display the
following data from the statewide distribution of PSSA
results for the most current school year.

Achievement
• The mean predicted performance of the cohort.
• The actual mean performance of all students in the state is
displayed for reference

Growth
• School Effect ≈ Observed Mean – Predicted Mean
• Standardized School Effect = School Effect relative to its
error – displays degree of confidence
The following two slides explain the meaning of each
of the regions of an 11th grade scatter plot.
The Scatter Plot
Vertical Axis
Mean
Predicted
Scaled Score
2010 Mean
Scaled Score
Growth Descriptor
Boundaries (&plusmn;2SEs)
Horizontal Axis
Growth Measure in
Standard Errors
Scatter Plot Regions
and Their Meanings for Grade 11
District Scatter Plot – Grade 11
The TWO Types of
PVAAS Information
Looking
Forward/Planning…
Looking Back/Evaluation…
PVAAS Projection Reports
For Individual Students
and Cohorts of Students
Cohorts of Students
Today
NO individual measure of student growth.
.
Student Projections
PVAAS Reporting
Projections to Basic, Proficient, and Advanced
 3  4 or 5
 4  5 or 6
 5  6 or 7
 6  7 or 8
78
 8  11
Writing:
 35
45
58
68
78
 8  11
Science:
34
 4  NA
58
68
78
 8  11
How do I know that the projection
is accurate?

The projection is precise, and is created using a model
that has been reviewed and approved by four different
peer review panels and the GAO (US Government
Accountability Office).

The most recent 2008 growth model proposal to USDOE
includes information regarding the statistical model and
projection reliability study.

Recent studies have confirmed that the PVAAS
projections (even as far as 3 years into the future) are
more reliable at looking at the future performance of a
student than the most recent PSSA score.
PVAAS Student Projection Report
PVAAS Projections for
Groups of Students
Student Search
Identified Students
Meeting Search Requirements
Summary Report for Grade 3 to be
inserted here
Summary Report for Grade 4 to be
inserted here
Summary Report for Grade 5 to be
inserted here
Summary Report for Grade 6 to be
inserted here
Summary Report for Grade 7 to be
inserted here
Summary Report for Grade 8 to be
inserted here
Wouldn’t it be great
to know if you made at
least one year’s growth
with students last
Cohort Growth
• Comparison to a State Growth Standard
• The Growth Standard specifies the minimal
grade for a cohort of students.
• The use of a Growth Standard creates the
possibility that ALL schools can demonstrate
appropriate growth.
Four Important Issues
Difference in scores in
consecutive years.
1. Measuring Gain
2. Growth Standard
3. Comparing Scores
from year to year
Convert all scores to
same scale – NCE scale
4. Estimating
Achievement
Combine current observed
scores with all previous
scores in students’
histories.
Student Name
Quiz 1
Test 1
Quiz 2
Project 1
Test 2
Test 3
Cum
Possible
25
100
30
75
70
100
Percent
Joe
20
97
23
72
65
55
83
Betty
14
76
27
65
56
56
73.5
Elizabeth
21
96
25
60
64
78
86
Growth Descriptors – Grade 4 – 8
The PA Growth Standard specifies the minimal acceptable
Growth Standard is met when the students in a school or district on
average maintain their relative position when compared to the 2006
statewide distribution of student scores (2006 is the base year).
Estimated mean NCE gain equal or greater than zero. There is
evidence that the school has met or exceeded the Growth
Standard. All schools can achieve this rating.
Estimated mean NCE gain less than zero by one standard error or
less. There is slight evidence that the school has not met the
Growth Standard.
Estimated mean NCE gain less than zero by between one and two
standard errors. There is moderate evidence that the school has
not met the Growth Standard.
Estimated mean NCE gain more than two standard errors less than
zero. There is significant evidence that the school has not met the
Growth Standard.
PVAAS District Report
Cohort’s
Achievement
64.6
Cohort’s
Achievement
60.7
0
10
20
30
40
50
60
70
80
90
100
NCE Scale
State Mean = 50
PVAAS Gain ≈ Change in position from 5th to 6th grade
≈ 64.6 – 60.7 ≈ 4.0 NCE points
PVAAS School Report
Science and Writing
Based on a predictive methodology:
 A predicted score is calculated for each student;
 Mean of predicted scores is calculated for
students in a cohort;
 Mean of observed scores of students in the
cohort;
 School Effect is the difference between the
Observed and the Predicted Scores.
Progress is defined by the district or school
effect, which is a measure of the difference
between observed performance and predicted
performance.
Progress is significantly above the progress of
the average district in the state.
Progress is not detectably different from the
progress of the average district in the state.
Progress is significantly below the progress of
the average district in the state.
PVAAS District Report
Grades 4, 8 &amp; 11 – Science
Grades 5, 8 &amp; 11 – Writing
PVAAS Performance Diagnostic Report
The Key is the RED Whisker!
Growth Standard Methodology
What the whiskers tell us…
Exceeded Growth Standard;
More than One Year’s Growth
Green
Met the Growth Standard;
Yellow
Growth
Standard
(One Year’s
Growth)
Below Growth Standard;
Less than One Year’s Growth
Rose
Predictive Methodology
What the whiskers tell us…
ABOVE Expectations -Observed Score Was Greater
Than Predicted Score
NDD – No Detectable Difference
Between Observed Score and
Predicted Score
Observed –
Predicted
(One Year’s
Growth)
BELOW Expectations -Observed Score Was Less
Than Predicted Score
Performance Diagnostic Report
Greater Detail – based on % of students
Click on
Hot Keys
for lists of
students.
Student Lists from Performance
Diagnostic Reports
PA’s Intent for PVAAS



Another Tool for Continuous
Improvement
Measure of Growth to Add to
Achievement/Status Measures
Not to Be Used in Isolation
are designed around
Questions that the
Core Team and IU
Each Help Menu is organized into 5 common sections:
• Navigating: designed to help users navigate through the report and
access all available features.
• Understanding: designed to increase users’ understanding of the
key pieces of the report, as well as general assistance with correct
interpretation.
• Interpreting: designed to help users gain a deeper understanding of
the interpretation of the reports, including tips on analyzing the
report for patterns and trends.
• Using: designed to help users gain an understanding of how the
report can be used with other data sources for various decisionmaking purposes.
• Assistance: provides general information on the viewing and
printing of reports, as well as state and IU points of contact.
Questions and Feedback
Questions:
PVAAS Materials or
Statewide Implementation
pdepvaas@iu13.org
717-606-1911
PVAAS Report Web Site
https://pvaas.sas.com
www.pde.state.pa.us
333 Market Street
Harrisburg, PA 17126
```