Reporting and Presenting Data - Washington School Counselor

advertisement
Reporting and
Presenting Data
Washington School Counselors
Association
John Carey
National Center for School Counseling
Outcome Research
www.cscor.org
Reporting and Presenting Data
► 1.




Who is the audience?
How much information will you present?
What kinds of information will you present?
How sophisticated is this audience about data?
What do they already know?
Reporting and Presenting Data
► 2.
Why is the presentation being given?
 Give a status report-- here’s where we are
 Examine the effects of practices and programs–
here’s what we’ve been doing and how it makes
a difference
 Influence the direction of change– here’s what
we’d like to see happen
 Monitor progress– here’s our progress toward
our goal
Reporting and Presenting Data
► 3.
What do you want the audience to
know?
 What do you want the presentation to
accomplish?
 What are your goals in presenting the data?
 How much time do you have?
 How will you structure conversation about the
data?
Reporting and Presenting Data
► 4.
What data (of the data available to you)
will you show them to give them the needed
information?
 Demographic data
 Disaggregation data
 Outcome, Process and Perceptual Data
Reporting and Presenting Data
► 5.
What types of data presentation forms
will you use?
 Graphing can be done in Excel, PowerPoint,
Microsoft Word or SPSS
 The best way to learn is to play with it…
 Don’t use tables and graphs unless they
enhance the presentation!
Reporting and Presenting Data
► 1.




Tables
Present information in rows and columns
Organize data in meaningful ways
Make it possible to present lots of data
Useful for identifying patterns
Achievement Outcomes
2002 10th Grade MCAS English Language Arts
Advanced
Proficient
Needs
Improvement
Failing
Regular
Education
22%
44%
25%
9%
Special
Education
2%
16%
35%
45%
Limited
English
Proficient
1%
12%
33%
54%
Reporting and Presenting
► 2.
Graphs
 Present data in snapshot– more impact
 Use bar graphs to show differences among
groups over time
 Bar graphs are useful for disaggregation data
Percent of 11th and 12th Graders
Taking Advanced Math
35
30
25
Black
Hispanic
White
Filipino
20
15
10
5
0
1998
1999
2000
2001
Reporting and Presenting
► 2.
Graphs (con.)
 Use pie/circle charts to represent portions of
whole
 Pie charts show shifts in proportions between 2
points in time
10th Grade MCAS Math Test Scores
2001 and 2002
Advanced
Proficient
Needs Impr.
Failing
► From
Advanced
Proficient
Needs Impr.
Failing
2001 to 2002 the percentage of students
who received an Advanced or Proficient rating
increased from 45% to 52%.
Reporting and Presenting
► 2.
Graphs (con.)
 Line graphs show trends over time
 Line graphs are useful for showing achievement
gap data, as the gaps are evident
th
9
Grade Drop Out Rates
35%
30%
25%
Afro-Am
Asian-Am
Latino/a
White
20%
15%
10%
5%
0%
1999 2000 2001 2002 2003
Presenting and Reporting Data
► 3.
Anecdotal Data
 Use if data doesn’t fit logically or easily into
table or graph format
ACADEMIC
Career
Personal/ Social
Academic Results
Education (6-8)
►The
number of students who could
evaluate transcripts, identify
promotion retention criteria and apply
study skills increased from:
 55% to 98% (6th graders)
 52% to 92% (7th graders)
 38% to 98% (8th graders)
Presenting Data
► PowerPoint
Presentation Guidelines
 Use PowerPoint if the audience is larger than 100
people
 Light text on a dark background shows up best
 Use contrasting colors
 Write only basic concepts/an outline on the slide
 Use active words
 Keep phrases/sentences short
 Do not read off the slide
 Use large font size (18 pts. or larger)
Components of a Presentation
► Title:
Explains what presentation is about
► Start with general demographics of the
sample if audience doesn’t know this.
► Present findings/data
► What did you learn? Depending on
audience, this may need to be very explicit.
► Summary of findings (if presenting a lot)
► Next steps in data gathering
Presentation Guidelines
► Keep
it short and clear
► Relate data to school mission and goals
► Focus on 5-10 key points per presentation
► Pre-test your data presentation
► Presenter passion and commitment are a
key component of effective presentations
Comprehensive
School Counseling Program
Academic Development
1. Guidance Curriculum
•
ACADEMIC
Career
•
•
•
Personal/ Social
•
•
Developing Academic 4/6 year
Plans (VITA)
Promotion/Retention Criteria
Organization, Study and Testing
Taking Skills
Registration, College and High
School Graduation
Requirements
Post High School Options
Transition into the Real World
2. Intentional Guidance
• Individual and Group
Counseling
3. Monitoring Student Progress
Overall Program Goal
Promoting Academic Achievement
For Every Student
ACADEMIC
Career
Personal/ Social
Academic Results
Goal Setting (K-5)
After classroom guidance lessons
pre-post tests indicated…
student knowledge of goal setting
increased from 10% to 98%
90% achieved their identified goal
ACADEMIC
Career
Personal/ Social
Academic Interventions
Problem Solving (K-5)
PROBLEM:
Monthly After-School detentions increased from
65 to 120 students
Counselor determined reasons for detentions:
66% Missing Assignments
34% Inappropriate Behavior
SOLUTION:
Established a Homework Club and multiple
after-school tutoring classes
Academic
Career
PERSONAL/SOCIAL
Personal/Social Results
Conflict Resolution (K-5)
Number of students who could
peacefully resolve a conflict increased
from 55% to 88%
Following implementation of a Conflict
Manager program the number of suspended
students was reduced from 13% to 3%
over the period of 3 years
ACADEMIC
Career
Personal/ Social
Academic Results
Education (6-8)
The number of students who could
evaluate transcripts, identify promotion
retention criteria and apply study skills
increased from:
55% to 98% (6th graders)
52% to 92% (7th graders)
38% to 98% (8th graders)
ACADEMIC
Career
Personal/ Social
Academic Results
Interventions (6-8)
After Academic Counseling Groups:
37% of 6th graders (64)
24% of 7th graders (47)
72% of 8th graders (46)
157 Students Demonstrated
GPA Improvement!
ACADEMIC
Career
Personal/ Social
Academic Results
Intervention (6-8)
Counselors met with identified
students either individually, in
groups or in SST to analyze
grades, map outcome goals, and
teach skills necessary to avoid
retention.
72 Students Avoided Retention
ACADEMIC
Career
Personal/ Social
Academic Results
Knowledge Gained in
Test-Taking Strategies
100
90
80
70
60
50
40
30
20
10
0
Complete Heading
PIRATES on Paper
Allot Time
Order Sections
Underline What
Underline Where
Reduce Choices
Answered All ? 's
Abandoned
Estimated
Pre Test
Post Test
Total of 442 6th Graders
ACADEMIC
Career
Personal/ Social
Academic Results
Test-Taking (6-8)
Number of students demonstrating
knowledge of test-taking strategies
increased from 13% to 63%
Number of 6th graders completing the
SAT 9 test increased from 40% to 96%
Academic
CAREER
Personal/ Social
Career Development
Results (6-8)
At one site, the number of students who could
demonstrate career knowledge increased
from 24% to 79%
At another, the number of students setting a
career goal increased from 45% to 100%
Academic
Career
PERSONAL/SOCIAL
Personal/Social Results
Conflict Resolution (6-8)
At one site the number of students resolving
conflicts with the help of peer mediators
increased from 0 to 346
At another site, the number who took
advantage of peer mediation increased
from 47 to 149
ACADEMIC
Career
Personal/ Social
Academic Results (9-12)
Goal: Each ninth grader has a 4 year plan on file.
Over 90% of the ninth graders had a
4-year plan on file in the counseling
office by June of 2001.
ACADEMIC
Career
Personal/ Social
Moreno Valley High School
ELL Population Growth
1200
1,025
1000
800
800
600
650
400
200
MVHS
450
250
300
0
1991
1993
1995
1997
1999
2001
ACADEMIC
Career
Personal/ Social
Moreno Valley High School ELL
Academic Intervention Program
1991/1994 No Bilingual Counselors
1995
One Bilingual Counselor
Parent Conferences
1997
Two Bilingual Counselors
Parent Conferences
Parent Workshops
1999/2001 Three Bilingual Counselors
ACADEMIC
Career
Improved Programs and Services
Personal/ Social
 Started the Saturday Program with Field Work Students
 Started the UCR Student Mentor Program
 Started the 60 Day Recovery Program
 Increased Parent Conferences and Workshops
 Increased Home Visitations
 Increased Group Support
 Increased Guidance Lessons for ELL students
 Increased Parent Phone Contacts
 Utilized Parent Volunteers
ACADEMIC
Career
Personal/ Social
Closing the Gap
MVHS GPA vs. ELL GPA
3
2.5
1.91
2
2.19
2.1
2.18
1.95
1.9
2.01
1.56
MVHS
ELL
1.5
1
0.5
0
1997
1998
1999
2000
Academic
Career Development
CAREER
Personal/ Social
Canyon Springs High School
In the last three years the number of students
visiting the career center has increased from
30 to over 200 students per day.
Parent attendance at evening guidance events has
increased from 150 to 500 parents
Scholarship dollars for students increased from
$857,000 to $950, 000
Finally, graduation rates have improved from
84 % to 89%
Personal/ Social Development
Standard A-B-C
Academic
Career
PERSONAL/SOCIAL
Student Assistance Program
“Getting Help”
Academic
Career
PERSONAL/SOCIAL
48 Insight Groups (6-10 students per group)
Alcohol and Other Drug Use
Anger Management
Behavior Management
388 Referrals to Outside Agencies
Department of Mental Health (5150)
Juvenile Justice System
Mental Health Agencies and Services
Academic
Change in Student Behavior as Measured by
the Number of Referrals and Suspensions
at VVHS Before, During, and After
Involvement in SAP Insight Group
Career
PERSONAL/SOCIAL
60
55
59
55
50
40
33
37
40
30
20
10
0
Before
Referrals
During
After
Suspensions
From September
2000 to May 2001
Academic
Career
PERSONAL/SOCIAL
Change in Chemical Use
as a Result of SAP Insight Groups
70
60
70
50
40
Stopped
Decrease
30
20
23
10
0
Stopped
Decreased
93% of the Students Chose Healthier Behaviors
Academic
Career
Violence Prevention Education
PERSONAL/SOCIAL
453
“Time to Tell” Guidance Lessons
presented to students
11,525 Students Impacted
673
Staff Trained in recognizing the
“Early Warning Signs”of violence
Academic
Career
PERSONAL/SOCIAL
Documented Changes in Student Behavior
as a Result of Guidance Lesson at March
Mountain and March Valley Schools
First Semester:
Second Semester:
(Before lessons)
(After lessons)
Conflict Mediations 11
Conflict Mediations
59
Pre-Fights
11
Pre-Fights
12
Fights
27
Fights
9
Number of fights reduced by 200%
Academic
Improvement in Attendance at Bayside as
a Result of Classroom Presentations and
Attendance Intervention
Career
PERSONAL/SOCIAL
% Positive Attendance
90
80
83.59
74.29
70
81.79
74.38
69.47
66.46
60
50
2000-2001
2001-2002
40
30
20
10
0
September
October
November
Academic
Career
Personal/Social
Overall Program
Improvement
Aligning school counseling program with the
ASCA National Standards and state content
standards
Setting measurable goals
Implementing a consistent program district wide
Collecting results of the counseling program
Using results for program improvement
GOALS: Removing barriers to learning and
promoting academic success for every student
School Counselors
Thank you
for your support!
Closing the Math
Achievement Gap at the
R.M. Nixon School
Gina Franco
Fall 2004
Working toward change
“Schools are no
longer judged by
the
accomplishments of
their brightest
students; they are
held accountable
for every student’s
progress.”
(ASCA, 2003)
Seven steps in using data in
advocacy and systems change:







Describe the problem
Generate vision data
Commit to benchmarks
Identify places to intervene
Select interventions
Evaluate implementation
Monitor problem data
(Carey, 2004)
Step 1
Describe the problem
 School wide underperformance
is reflected in MCAS results
 MCAS Mathematics scores are
“Needs Improvement or Failing”
for more than 50% of students
 Disaggregated data shows a
significant achievement gap
between minority students and
white students
Describe the problem
Step 1
Achievement gap in MCAS math scores
100%
80%
W
60%
AA
40%
L
20%
0%
4th grade math 6th grade math 8th grade math
NI-F
NI-F
NI-F
Generate vision data
Step 2
MCAS pass rates for 4th grade mathematics in 2008*
Good vision data is
Agreed upon by
many in the system
Concrete & specific
Measurable
Outcome-oriented
Attainable
Tied to a deadline
Related to values
(Carey, 2004)
4th grade mathematics
W
AA
L
AsA
Adv-Pro
70%
70%
70%
70%
NI-F
30%
30%
30%
30%
*Can also apply to 6th grade and 8th grade data
Commit to benchmarks
Step 3
MCAS pass rates for 4th grade mathematics
What will
this look
like over
the
course of
5 years?
2003 2004 2005 2006 2007 2008
W 44% 49% 54% 59% 64% 70%
AA 11% 23% 35% 47% 59% 70%
L
13% 25% 37% 48% 59% 70%
As- 0%
A
14% 28% 42% 56% 70%
Step 4
“Quality teachers,
rigorous
curriculum, and
standards-based
assignments are
all variables that
literature has
shown influences
the achievement
gap.”
(ASCA, 2003)
Identify places to intervene
 Potential areas







Students
Peers
Teachers
Whole school
Family
Community
Culture
(Carey, 2004)
Step 5
Select interventions
Whole School
Students
Yearly Progress
Pro (Math)
Peers
Math PALS
Teachers
Specialized
Professional
Development
Step 5
Select interventions
Students
Yearly Progress
Pro (Math)
Yearly Progress Pro Math is…
 A computer-based program
for monitoring all students’
progress in math
 Aligned to state and
national standards
 Linked to data-based
management system so
teachers can track student
performance in real time
www.mhdigitallearning.com
Step 5
Select interventions
Students
Yearly Progress
Pro (Math)
YPP Math provides…
 Resources to assist
teachers in the classroom
 Curriculum-based
assessments delivered
weekly to all students
 Instructional exercises for
each skill addressed
 Accountability data for
decision-making regarding
student needs
Step 5
Select interventions
Students
Yearly Progress
Pro (Math)
YPP Math helps educators…
 Identify students in need of
additional or different forms
of instruction
 Design stronger
instructional programs
 Monitor progress of all
students toward
state/district standards
 Effect better achievement
outcomes for students
Step 5
Select interventions
Peers
Math PALS
Math PALS is…
 A structured approach for
peer tutoring in math
 Designed to complement
existing curricula and
instructional methods
 Developed to incorporate
research-based tutoring
methods
 A recipient of “best practice”
status by U.S. Dept. of Ed.
Program Effectiveness
Panel
http://www.k8accesscenter.org/training_resources/documents/PeerTutoringFinal.pdf
Step 5
Select interventions
Peers
Math PALS
Math PALS encourages…
 Peer Assisted Learning
Strategies (PALS)
 Student pairs to practice
skills in alternating roles of
player and coach
 Students to receive step-bystep feedback through peer
interactions
 Students to work on
different levels and different
types of problems
Step 5
Select interventions
Peers
Math PALS
Math PALS research shows…
 Statistically significant
increases in math
achievement scores
 Improvement in student
social skills
 Students’ abilities to create
more meaningful memories
of concepts
 Academic improvement in
both tutor and tutee
Step 5
Select interventions
Teachers
Specialized
Professional
Development
Specialized PD means...
 Providing diversity training
for teachers
 Providing training in higherorder thinking skills
 Offering incentives for
teachers to take classes in
their subject areas
 Providing consultation and
in-class support for teachers
Step 5
Select interventions
Teachers
Specialized
Professional
Development
PD is important because…
 Teachers have significant
impact on student learning
 Teacher effectiveness is a
factor that can influence
students’ gains in
achievement more than
poverty or per-pupil
expenditures
Step 5
Select interventions
Teachers
Specialized
Professional
Development
PD research shows that…
 Five aspects of teacher
quality can affect student
achievement:
 A teacher’s major
 Professional development in
higher-order thinking skills
 Diversity training
 Use of hands-on learning in
classroom
 Focus on higher-order
thinking skills in classroom
(Wenglinsky, 2002)
Step 6
Evaluate implementation
students teachers
Annual
evaluations will
include MCAS
results, school
climate data,
honor roll data
Sporadic
classroom
visits will be
conducted to
monitor
program
implementation
school
Year
1
Year
2
Year
3
Year
4
Begin Yearly
Progress Pro
(YPP)
Receive training in
YPP
Conduct school
climate survey
Continue YPP
Receive diversity
training
Evaluate YPP;
School climate
survey
Begin Math PALS;
Continue YPP
Receive training in
Math PALS
Evaluate YPP;
School climate
survey
Continue Math
PALS; Continue
YPP
Receive training in
higher-order
thinking skills
Evaluate Math
PALS; Evaluate
YPP;
School climate
survey
Year
5
Continue programs
Receive ongoing
PD and support
Evaluate
programs
annually
Monitor problem data
Step 7
Results from
math intervention
evaluations will
determine
decision-making
for English
Language Arts
(e.g. Reading
PALS,
Renaissance
Learning
management
software for
reading & writing
akin to YPP)
4th grade English Language Arts vision data
Adv-Pro
NI-F
W
70%
30%
AA
70%
30%
L
70%
30%
AsA
70%
30%
Intended Results
Math PALS
“We need to be the
change we want to
see happen. We
are the leaders we
have been waiting
for.”
- Mahatma Gandhi
Yearly Progress
Pro (Math)
Increased
math
achieveme
nt
Enhanced
social skills
Improved
attitudes
toward
school
Specialized
Professional
Development
More
effective
classroom
practices
Higher
expectations
Less
absenteeis
m
Fewer
minority
students in
special
education
References & resources
 American School Counselor Association (2003).
The ASCA National Model: A Framework for
School Counseling Programs. Alexandria, VA:
Author.
 Carey, John. (Fall 2004). R. M. Nixon School
Using Data. [Lecture notes]
 Wenglinsky, H. (2002). How schools matter: The
link between classroom practices and student
academic performance. Education Policy
Analysis Archives, 10(12).
Useful websites:
 http://www.mhdigitallearning.com
 http://www.k8accesscenter.org/training_resource
s/documents/PeerTutoringFinal.pdf
Thank You!
Center for School Counseling
Outcome Research
www.cscor.org
Download