Identifying and Analyzing District Data on

advertisement
A Self Assessment of District Policies, Procedures, and Practices
for Addressing Disproportionality in
Arkansas Public Schools
Mike Crowley, Administrator
Beverly Smart, Educational Consultant
Lynn Springfield, Educational Consultant
Susan Shurley, Supervisor
Jody Fields, Director IDEA Data & Research
Arkansas Department of Education, Special Education
Monitoring/Program Effectiveness
Updated September 2007
Table of Contents
Introduction ................................................................................................................................................................................................. 3
Process for Determining That a School District is Triggered in the Area of Disproportionality ............................................................... 4
Identifying and Analyzing District Data on Disproportionality ................................................................................................................. 5
Check list for Five Procedureal Areas: ....................................................................................................................................................... 7
Intervention ........................................................................................................................................................................................................ 7
Referral .............................................................................................................................................................................................................. 8
Evaluation .......................................................................................................................................................................................................... 8
Placement ......................................................................................................................................................................................................... 10
Procedural Safeguards...................................................................................................................................................................................... 10
Review of Policies, Procedures and Practices Effecting Disproportionality ............................................................................................ 12
Attach Evidence to Support Affirmative Responses
2
Addressing the Challenge of Disproportionality in Arkansas Public Schools
Introduction
The major issue surrounding the concept of disproportionality in special education is the probability of discriminating against students based on race,
ethnicity, and special education category. The Arkansas Department of Special Education has long been concerned about the excessive numbers of
students placed in special education programs. More recently there is a growing concern for the under identification of students based on race,
ethnicity, and special education category. In addition to the overall number of children receiving special education services, the number of culturally
and linguistically diverse students placed in special education has been and continues to be of concern.
The Individuals with Disabilities Education Act and the No Child Left Behind Act require a state agency to collect program information on
disproportionality in the state’s special education programs, specifically, Section 618 of the IDEA program information.
(C) Disproportionality requires the following:
(1) In general, each state that receives assistance under this part … shall provide for the collection and examination of data to determine if
significant disproportionality based on race is occurring in the State with respect to --(A) the identification of children as children with disabilities, including the identification of children as children with disabilities in
accordance with a particular impairment…; and
(B) the placement in particular educational settings of such children.
An understanding of the distinction between the percent of the program by group and the percent of group in the programs are crucial to
understanding disproportionate representation of culturally and linguistically diverse students in special education. Some have misunderstood the
“disproportionate representation” phenomenon to mean that large percentages of a culturally and linguistically diverse group, for example, African
American, are placed in a special education program, while in fact, the term means that the percentage of culturally and linguistically diverse students
in the program is larger than the percentage of that group in the educational system as a whole.
When a school district is cited for disproportionality of culturally and linguistically diverse students receiving special education services, being
placed in special education categories of mental retardation or emotionally disturbed and/or being served in pullout educational programs, the process
of self-evaluation should indicate to the district areas in which improvement can occur, as well as, areas in which the district excels. The process of
examining the district’s identification, evaluation, and placement procedures and practices will enable the district to plan and implement effective
interventions to remediate the situation.
The underlying assumptions of discrimination are associated with the normalization construct and the causation of poor performance being inherently
within the child. If children’s educational experiences are going to be affected by how they perform on norm-based assessment instruments, it is
important that these assessments be valid with regard to race and ethnicity. This suggests that culturally and linguistically diverse student
performance should be included in the normative sample of tests being used to determine student eligibility for special education services. Likewise,
before academic performances of students can be judged to be the result of student factors alone, it is important to assess the total learning
environment, which includes curriculum content, instructional materials, quality of instruction, and psychosocial climate of the classroom. It is
3
important to be aware that placing undo importance on norm-reference assessment and child centered constructs will tend to increase the probability
that students will be placed in district special education programs.
The purpose of this self assessment is to assist school districts in determining if identified disproportionality in the district is the result of
inappropriate policies, procedures, and practices. The inappropriate policies, procedures, and practices may cause over or under identification of
culturally and linguistically diverse students (a) being referred for special education services, (b) receiving special education, (c) being placed in
specific disability categories, and/or (d) receiving these services out of general education settings more than eighty percent of the school day.
Process for Determining That a School District is “Triggered” in the Area of Disproportionality
In order to demonstrate educational equity relative to opportunity, services, and decision making, the percentage of any ethnic/racial group of
students receiving special education services in a school district should be proportionally similar to the percentage of ethnic/racial group of students’
district wide. Thus, it is important to ensure that such students in a school district are not disproportionately represented in special education in
contrast with such students in the district.
The benchmark for disproportionality over-representation is the difference between district and special education percent by race/ethnicity. This
calculation is based on those districts with less than 95% and greater than 5% in any such group. For example, the three-year average percent
African American in the district for this subset of districts was 41.09% for the 2005 school year. The difference between district and special
education percent African American was 4.541%, with a standard deviation of 8.611%. These averages and standard deviations may change from
year to year because they are based on the three most recent years of district data.
The trigger for this indicator is 1 standard deviation beyond the difference for the state, or the mean difference (4.541%) plus 1 standard deviation
(8.611%) or 13.152%. Thus, for 2007, any district that had more than 13.152% of the African American ethnic/racial group of students in special
education than in general education triggered in the area of disproportionality.
Formula Example: Percent African American in special education – Percent African American in the district = Difference between special education
and district.
In 2007 if this value was greater than 13.152 for African American, then your district triggered on this indicator. If this value was negative, you
were within the acceptable range (see table below).
Focused Monitoring Disproportionality Over-Representation Trigger Calculation:
Baseline Fiscal Years: 2002, 2003, and 2004
4
Benchmark
Standard
Deviation
Trigger
Value
American Indian/
Alaskan Native
Asian/Pacific
Islander
African
American
Hispanic
Caucasian
0.040%
-0.065%
4.541%
-1.512%
-3.004%
0.451%
0.554%
8.611%
3.875%
9.972%
0.491%
0.489%
13.152%
2.364%
6.968%
The benchmark for disproportionality under-representation is similar to the over-representation calculations. Under-representation is the negative
value of the benchmark plus two-standard deviations (-(4.541% + 8.611% + 8.611%) = -21.763%). The reason for using two-standard deviations for
under representation lie with the implementation of early intervening services which is resulting in fewer referrals to special education and in turn
fewer placements.
Formula Example: Percent African American in special education – Percent African American in the district = Difference between special education
and district.
In 2007 if this value was less than -21.763 for African American, then your district would be identified as under-identifying African American
students for special education services.
Identifying and Analyzing District Data on Disproportionality
In order for interventions to be effective, it is necessary to know why problems are occurring. To discover why problems are occurring, districts
must look at data with regard to school policies, practices, and procedures currently in place in the district. Relevant data to examine may include (1)
district October 1, 2006 enrollment by race, (2) special education December 1, 2006 child count by race, (3) special education December 1, 2006
child count by disability and race, (4) the 2006/07 referrals and placements by race, (5) special education December 1, 2006 child count by
educational placement and race, (6) Focused Monitoring Profile, and (7) other data deemed necessary by the district. The District’s October 1, 2006
(and previous years) enrollment by race can be downloaded from ADE Data Administration website at http://adedata.k12.ar.us. The special education
data, as a series of reports, will be sent to districts required to submit a self assessment.
After an analysis of district data related to problem areas and possible causes have been completed, effective interventions to meet district needs can
be selected. If this analysis is not done, interventions may not be effective. The questions/probes on the following pages are designed to help a
district “drill down” on issues related to disproportionality. “Drilling down” on available information and data may reveal trends or patterns the
district had not been aware of previously, or it may simply confirm what was already suspected.
These questions/probes are not meant to be an exhaustive list, and the district may want to examine other factors. Another source of information to
consider is the district’s “Special Education School Self-Assessment” (SESSA) data completed during the 2003/2004 school year. Remember, the
5
purpose of examining all this information is to help districts discover why problems are occurring in order to provide direction in selecting effective
interventions.
Disproportionate representation is a problem when students receive low-quality instruction. This problem may arise in the regular classroom, where
opportunities for academic success may be restricted, or in the special education classroom, where a student’s educational progress may falter due to
lowered or inappropriate expectations and goals. At a minimum, a self-evaluation of disproportionate representation should include a review of the
district’s policies and procedures in five specific areas. These include general education intervention, referral, evaluation, placement, and procedural
safeguards.
6
Checklist for Review of Five Procedural Areas: Intervention, Referral, Evaluation, Placement, and Procedural Safeguards
Intervention
If no - provide
possible
If yes – provide recommendations
evidence
and solutions
Indicators
Does the district use a specific general education intervention program for students experiencing
difficulty in the regular education classroom? (e.g. peer tutoring, after-school remediation program,
etc.) If yes, identify where teachers and others interested in the process can find a written description
of the program
Does the district (and each building within the district) have a collaborative team structure in place to
engage in problem solving and data-based decision making for both behavior and academics?
Does the district provide assistance to regular classroom teachers in the development of specific inschool regular education program accommodations and interventions? If yes, describe the
activities/professional development conducted to accomplish this undertaking.
Is the effectiveness of the accommodations and interventions reviewed regularly? If yes, describe
when and how this is accomplished.
What does the district use to progress monitor the effectiveness of academic and behavioral
interventions?
Have educational intervention programs been implemented in all district schools? A building-bybuilding review of data may reveal that some school’s programs are not as effective as others as
noted by the disproportionate numbers of culturally and linguistically diverse students enrolled in its
special education program.
If yes, how is the effectiveness of those building interventions reviewed?
7
Personnel
Involved
Referral
Referrals are greatly improved when districts can answer “yes” to each of the following questions.
Indicators
If no - provide possible
If yes – provide evidence recommendations and solutions Personnel Involved
Does the district ensure consistent application of the referral
criteria? If yes, describe how referrals are monitored.
Does the district randomly review referrals to detect any pattern
that might indicate a problem with disproportionately large
numbers of children of one race referred by a teacher of another
race? If yes, describe how this is accomplished.
Is the effectiveness of the referral policy reviewed?
If yes, describe how that effectiveness is monitored.
Evaluation
This review is intended to provide a greater understanding of the evaluation process and assist district personnel as they monitor their special education culturally
and linguistically diverse enrollments.
Indicators
Identify all tests and other educational materials currently used in
the evaluation process. Has each been validated for the specific
purpose for which it is used?
Are tests and other evaluation materials administered by trained
personnel in conformance with the instructions provided by their
producer?
Are all tests utilized by the district tailored to assess specific areas
of educational need and not merely designed to provide a single,
general intelligence quotient?
8
If no - provide possible
If yes – provide evidence recommendations and solutions Personnel Involved
Evaluation
This review is intended to provide a greater understanding of the evaluation process and assist district personnel as they monitor their special education culturally
and linguistically diverse enrollments.
Indicators
Does the district have well written criteria for the identification of
special education students in its policy/procedure manual?
Have tests been selected to ensure an accurate reflection of the
student’s aptitude or achievement, or whatever factor the test
purports to measure?
In making placement decisions, does the district use a variety of
informational sources including: aptitude tests, achievement tests,
social or cultural background, adaptive behavior, teacher
recommendations, past educational history, physical conditions
Are all the district personnel who participate in placement
decisions knowledgeable about: the student, the meaning of the
evaluations, placement options, family perspectives
Is all information, regardless of its source, carefully considered and
documented?
Identify all tests and other educational materials currently used in
the evaluation process. Indicate if each been validated for the
specific purpose for which it is used?
Are those conducting the evaluations sensitive to cultural
differences between groups?
9
If no - provide possible
If yes – provide evidence recommendations and solutions Personnel Involved
Placement
The decision to place students in special education carries with it lifetime implications that are not easily overcome. Questions to address in this area include:
Indicators
If no - provide possible
If yes – provide evidence recommendations and solutions Personnel Involved
What steps does the district take to regularly review the ethnic
composition of its special education programs?
When racially disproportionate special education programs are
identified, how does the district determine that students are being
provided appropriate programs and services that meet their unique
educational needs?
When disproportionate representation exists among categories in
special education, how does the district examine its placement
decisions to detect any possible differences by ethnicity/race and
placement?
When racially disproportionate special education programs are
identified, what type of timely action is taken to review the
appropriateness of the program for those enrolled?
Procedural Safeguards
Procedural safeguards provide protection for students, parents, and educators alike.
Indicators
Are all records relevant to the identification, evaluation, or
educational placement of a disabled student made available to the
student’s parents?
Are district parents, staff and the community provided
demographic information about the ethnic/racial make-up of the
special education programs in the district?
10
If no - provide possible
If yes – provide evidence recommendations and solutions Personnel Involved
Procedural Safeguards
Procedural safeguards provide protection for students, parents, and educators alike.
Indicators
What steps are taken to ensure that parents of culturally and
linguistically diverse children understand the special education
process and potential benefits of participation in special education
services?
Are all evaluations conducted in a timely manner in accordance
with the state’s “Special Education Eligibility Criteria and
Program Guidelines for Children With Disabilities Ages 3-21?
In initiating the Procedural Safeguards required by the IDEA from
referral through developing and implementing IEPs, does the
district ensure that all timelines are strictly adhered to in
accordance with the state’s “Special Education and Related
Services: Procedural Requirements and Program Standards?”
11
If no - provide possible
If yes – provide evidence recommendations and solutions Personnel Involved
Review of Policies, Procedures, and Practices Effecting Disproportionality
Review of Policies, Procedures and Practices Effecting Disproportionality
If no - provide possible
If yes – provide evidence recommendations and solutions Personnel Involved
Indicators
The district provides peer tutoring, learning strategies, or other
similar programs.
1. Of the above programs, which programs are available for
grades K-12?
2. Are the above programs available in all schools within the
district? If no, in which schools are they provided?
Regular classroom teachers and administrators are trained in how
to make adaptations and accommodations within the regular
classroom to assist students who are experiencing problems.
Regular classroom teachers engage in consistent progress
monitoring and documenting the educational interventions and
the effects of such intervention(s) on a child experiencing
academic problems before referring the child for special
education.
The school district offers alternative compensatory programs
available to all students throughout the district, grades K-12.
The district has a systematic program to assist teachers in the
development of intervention strategies for students who are
experiencing problems.
Administrative personnel are involved with the multidisciplinary
team process.
The district reviews achievement scores of all students; scores
are reviewed in conjunction with (a) Identification of teachers
with high referral rates – for all ethnicities and gender; (b)
Population of individual classes by ethnicity; (c) and staffing
ratios.
The district provides internal monitoring for its special education
12
Review of Policies, Procedures and Practices Effecting Disproportionality
If no - provide possible
If yes – provide evidence recommendations and solutions Personnel Involved
Indicators
programs.
The district provides professional development and training for
changes in instructional techniques that match students’ learning
styles.
The schools evaluate how materials/instructions are presented to
students.
Schools check for mismatches of student skills/deficits to
teaching approaches.
The district keeps data on the amount of progress by students in
special education programs, i.e. pre and post evaluation using
criterion referenced instruments.
Data on student achievement in special education programs are
being kept according to student ethnicity/race, gender, grade,
school, class, and type of placement.
The district uses special education achievement data to identify
problem areas with the learning process.
The district has considered a variety of factors which may be
adversely impacting student learning, such as:
(a) lack of instruction and (b) lack of prerequisites for acquisition
of new skills or social factors such as: (a) the number of schools
attended (i.e. mobility) and (b) the support system
The district provides inservice to:
 review literature and research regarding teacher expectations
for all ethnic/cultural differences especially black males;
 observe/provide feedback to teacher; and
 monitor teacher behavior on an ongoing basis.
13
Review of Policies, Procedures and Practices Effecting Disproportionality
If no - provide possible
If yes – provide evidence recommendations and solutions Personnel Involved
Indicators
Regular classroom teachers and administrators are trained in the
characteristics of various disabling conditions.
Regular classroom teachers and administrators are trained in
what their responsibilities are prior to referral being made and
after a referral has been made.
The district keeps data that furnishes the following information
related to referrals:
 Number of referrals made by school and individual teacher;
 Number of referrals made according to student age, grade,
gender and ethnicity/race;
 Number of referrals made versus number of placements
made;
 Number of students transferring into the district that are
receiving special education services.
Psychological, Educational Examiners, and Speech/Language
Pathologists employed by or contracted with the district receive
inservice training concerning current best practices in evaluation
procedures.
A multidisciplinary team of professionals with knowledge in the
area of suspected disabilities conducts the evaluation.
Multidisciplinary team members have received training that
delineates for them each person’s specific areas of responsibility.
The district has effective procedures in place for acquiring and
disseminating to teachers and administrators significant
information concerning promising educational practices for
disabled students.
This may include such areas as:
 Identifying and evaluating new assessment instruments and
techniques;
14
Review of Policies, Procedures and Practices Effecting Disproportionality
If no - provide possible
If yes – provide evidence recommendations and solutions Personnel Involved
Indicators



Promising educational practices derived from educational
research;
Providing opportunity to attend outside district inservices,
workshops and conventions;
Professional literature accessible to teachers at a central
location.
Multidisciplinary team members are knowledgeable about the
meaning of evaluation data.
The person(s) responsible for interpreting assessment data has
received training concerning the interpretation and use of
assessment results
Assessment results are reported in standard scores for
appropriate comparison.
The multidisciplinary team has considered closely the results of
instruments that measure adaptive behavior when assessing all
students.
The adaptive behavior instruments are normed for the population
for which they are being used.
Adaptive behavior instruments in use provide for measuring
adaptive behavior in the following areas: School; Home; and
Community
Assessment instruments that evaluate speech/language are
normed for the population for which they are being used.
The comprehensive evaluation involves information from an
assortment of sources (classroom teachers, parents, counselors,
others) and utilizes a variety of evaluation techniques
(observation, interviews, informal and formal testing, etc.)
The multidisciplinary team addresses the areas of exclusion
15
Review of Policies, Procedures and Practices Effecting Disproportionality
If no - provide possible
If yes – provide evidence recommendations and solutions Personnel Involved
Indicators
under 34 CFR 300.309 in the criteria for determining the
existence of a specific learning disability, paying particular
attention to 34 CFR 300.311(a)(6) which addresses
environmental, cultural or economic disadvantages.
The school follows requirements for multidisciplinary team
members for students suspected of having a learning disability as
outlined under 34 CFR 300.308.
The multidisciplinary team considers cultural/ethnic, as well as
dialectal variations in selecting assessment procedures and
analyzing evaluation data, especially for culturally and
linguistically diverse students suspected of being
speech/language impaired.
The multidisciplinary team reviews/considers all school records.
The evaluation report describes the reason for referral.
The evaluation report lists the purpose of assessment and the full
names of all procedures used and who administered each test.
The evaluation report contains the student’s developmental
history.
The evaluation report contains the student’s educational history.
The evaluation report provides relevant and current information
about the student’s family/home environment and functioning
within that environment.
The evaluation report provides a statement of the student’s
current level of educational functioning.
Assessment results are reported as estimates showing standard
error of measurement, rather than exact indicators of skill or
16
Review of Policies, Procedures and Practices Effecting Disproportionality
If no - provide possible
If yes – provide evidence recommendations and solutions Personnel Involved
Indicators
ability.
Assessment results of standardized tests are reported in terms of
standard scores for appropriate norm groups.
Evaluation reports provide appropriate alternative explanations
of performance.
Evaluation reports indicate the presence of a specific disability(s)
and the basis for that determination.
Specific recommendations for instructional and/or behavioral
interventions are offered.
Persons who conduct evaluations participate in the decisionmaking process.
The district has procedures for exploring adjustments in the
regular education program to meet the student’s needs prior to
referral for special education.
The district provides for the student if he/she is not found
eligible for special education services.
Placement decisions are determined by each child’s individual
needs being met in the least restrictive environment rather than
by the disability.
The district routinely evaluates the effectiveness of special
education programs in relation to other alternatives.
Teachers are using a variety of alternative instructional
approaches appropriate to the varied developmental levels,
learning styles, and current levels of performance of students.
All special education students are accomplishing goals and
17
Review of Policies, Procedures and Practices Effecting Disproportionality
If no - provide possible
If yes – provide evidence recommendations and solutions Personnel Involved
Indicators
objectives on the IEP.
The district has a systematic method for evaluating program
effectiveness, staff behaviors and attitudes, program impact, and
student progress.
IEP goals and objectives are developed which address deficit
skills in the areas of adaptive behavior for children identified as
mentally retarded.
The district has systematic methods for monitoring the
reintegration of special education students into regular education
which insures that:
 Methods are reviewed annually
 Students are considered for lesser restrictive environments at
least annually (i.e. at annual review)
 IEPs of secondary students reflect vocational or transition
needs.
The district keeps data that reflects the movement of special
education students both to a more restrictive environment and to
a lesser restrictive environment according to age, gender, grade,
race, and individual school.
18
Download