PP.Assessment.MTSS.2015Final

advertisement
North Carolina Department of Public Instruction Multi-Tiered System of Support (MTSS)
Critical Component Practice Profile
CRITICAL COMPONENT: ASSESSMENT
The core elements of assessment include: comprehensive and efficient, valid and reliable, and adequate capacity.
ASSESSMENT: COMPREHENSIVE AND EFFICIENT
The assessment system is balanced, culturally appropriate and includes multiple sources.
CC: A1
EXPECTED
ACCEPTABLE
UNACCEPTABLE
IMPLEMENTATION
VARIATION
VARIATION
Assessment system includes all of these
areas but is not uniform across all schools
within elementary and secondary settings.
*District-wide data cannot be examined
using same metric.
Assessment system lacks any one of
these data sources.
Assessment system includes all critical
areas of literacy, math and
behavior/social-emotional but is not
uniform across all schools within
elementary and secondary settings.
District-wide data cannot be examined
using same metric.
Redundancy in district-wide
assessments (more than two
measuring the same critical area)
across critical areas of literacy,
math and behavior/social-emotional.
District-wide/school-wide assessment
system (behavior/social-emotional &
academics) that is uniformly utilized
across elementary and secondary settings
and includes:






Universal screening
Progress monitoring (Discrete
skills and general outcome
measures)
Common formative assessment
Diagnostic/functional
Common Core benchmark
assessments
Summative assessment data
District-wide/school-wide assessment
system is designed to measure critical
areas of literacy, math and
behavior/social-emotional while
eliminating redundancy of assessments
and is uniformly utilized across
elementary and secondary settings.
1
North Carolina Department of Public Instruction Multi-Tiered System of Support (MTSS)
Critical Component Practice Profile
District-wide assessment system is
designed to disaggregate data by
subgroups and is uniformly utilized across
elementary and secondary settings.
Assessment system includes
disaggregated data by subgroups but is
not uniform across all schools within
elementary and secondary settings.
District-wide data cannot be examined
using same metric.
District-wide assessment system
does not disaggregate data by
subgroups.
ASSESSMENT: VALID AND RELIABLE
CC: A2
EXPECTED
ACCEPTABLE
UNACCEPTABLE
IMPLEMENTATION
VARIATION
VARIATION
District-wide assessment tools meet the
following standards:
●
Demonstrates technical adequacy
for intended use across subgroups
● Peer-reviewed (as appropriate)
Assessment tools demonstrate technical
adequacy, but are not reviewed by a
district-wide panel that has psychometric
training/skills.
Assessments tools do not
demonstrate technical adequacy.
Standardized assessment tools are normed
nationally but not locally. Assessment
tools provide a criterion score (criterionreference) but do not have a norm group
for a performance reference. The criterion
score has demonstrated predictive validity
based on large-scale research.
Assessment tools have no norm
group on which to base district,
school and individual student
performance or any type of criterion
score that has demonstrable
predictive validity.
Select staff members are trained to
The staff responsible for
A district-wide team (with psychometric
training/skills) reviews technical
adequacy.
When data are interpreted with norms,
national and local norms (when
appropriate) will be considered.
For norm-referenced or standardized
assessments, the interpretation reference
to the relevant normative group
performance.
This does not include qualitative data that
may be gathered for problem solving.
A district-wide team will schedule on-
2
North Carolina Department of Public Instruction Multi-Tiered System of Support (MTSS)
Critical Component Practice Profile
going training, coaching and fidelity
checks in the following areas of
assessment:
●
●
Administration
Scoring and Inter-rater reliability
(as appropriate)
● Summarization
● Interpretation
Formative assessment data are utilized for
instructional decision making, not for
teacher evaluation purposes.
administer, score and interpret as a team,
and fidelity checks occur for each area of
assessment (administration, scoring,
summarization and interpretation).
administering, scoring and
interpreting assessments receives
information but no formal training.
No coaching or fidelity checks
occur.
Team members have achieved minimum
criteria for inter-rater reliability with a
team member who has psychometric
training/skills (as appropriate).
The assessment tools are used for decision Assessment tools are being used for
making to improve instruction, not for
purposes other than problem
staff evaluation.
solving. Data collected is used for
teacher evaluation.
ASSESSMENT: ADEQUATE CAPACITY FOR ASSESSMENT SYSTEM
CC: A3
EXPECTED
ACCEPTABLE
UNACCEPTABLE
IMPLEMENTATION
VARIATION
VARIATION
A district-wide team documents each
assessment tool and describes the purpose,
utility, and people responsible for
collecting, summarizing and analyzing
each.
A district-wide team has established
capacity for all schools to engage in
universal screening and score assessments
within an acceptable window of time
(within two weeks or as defined by
A district-wide team has aligned
assessment tools with intended purposes,
but has not clearly documented.
The district has not appropriately
matched data sources with the
intended purpose(s).
All schools within the district are able to
assess all students within an acceptable
window of time, as outlined by the
assessment guidelines, but the scoring and
summarization are not complete by the
end of that window (but is completed
within three weeks of the original
Schools within the district assess
only select students/student groups
for universal screening due to
insufficient capacity.
3
North Carolina Department of Public Instruction Multi-Tiered System of Support (MTSS)
Critical Component Practice Profile
publisher).
screening date).
A district-wide team has developed a
schedule for collecting, summarizing and
analyzing district level data at the
beginning of each school year.
A district-wide team is collecting,
summarizing, and analyzing district level
data, but has not clearly documented the
assessment plan in a schedule.
District level assessment plans for
collecting, summarizing, and
analyzing district level data are not
scheduled for the school year.
A district-wide team ensures behavioral &
academic district level data are
continuously collected, summarized, and
analyzed to support problem solving for
all assessment data collected.
A district-wide team collects,
summarizes, and analyzes behavioral and
academic district level data to support
problem solving, but not at regularly
occurring intervals or not for all
assessment data collected.
District level data are collected but
not summarized and analyzed or
used for problem solving for the
district.
A district-wide team ensures sufficient
capacity to consistently administer and use
information from diagnostic/functional
assessments and/or processes for literacy,
math and behavior/social-emotional skills.
A district-wide team has established
limited capacity within the district to
administer and use diagnostic and
functional assessments and/or processes
for literacy, math and behavior/socialemotional skills.
A district-wide team has not
developed capacity to administer
diagnostic and functional
assessments and/or processes for
literacy, math and behavior/socialemotional skills.
A district-wide team has not established
capacity to train team members at each
school, but district supports are being
provided while school capacity is being
developed.
Neither school nor district capacity
is being developed to support
progress monitoring.
A district-wide team has not established
capacity at each school, but district
supports are being provided while school
Neither school nor district capacity
is being developed to support
progress monitoring.
A district-wide team has ensured that
every school includes team members who
have been trained or coached about
current best practices regarding progress
monitoring (including the number of data
points and fidelity) that can make
decisions about progress monitoring for
literacy, math and behavior/socialemotional skills.
A district-wide team has established
capacity at each school to support the
effective use of progress monitoring data
that includes the use of brief, repeatable
4
North Carolina Department of Public Instruction Multi-Tiered System of Support (MTSS)
Critical Component Practice Profile
and psychometrically sound measures that
provide meaningful information as to the
status of student progress in targeted
areas.
A district-wide team has established
district level and school level capacity to
summarize and interpret student progress
monitoring data relative to both rate of
improvement and overall level of
performance.
capacity is being developed.
A district-wide team has not established
capacity at each school, but district
supports are being provided while school
capacity is being developed.
Neither school nor district capacity
is being developed to support
graphic and clear depictions of
student progress.
The frequency of progress monitoring of
learners receiving supplemental and
intensive instruction in academics and/or
behavior is documented, followed, and
based upon research.
*District-wide should be interpreted as “school-wide” when being applied to a Charter School Setting.
5
Download