Needs Assessment

advertisement
A focus on Title I, Part A
Jan Mahowski
Senior Coordinator Evaluation, Title I,
Pinellas County Public Schools
Richard Janiak, Ph.D.
Title I Evaluator
Charlotte County Public Schools
Needs Assessment
Overview of Title I Part A,
 Ten Components
Needs Assessment Intro
Needs Assessment
Building on Florida’s complimentary
model for school improvement
Step Zero
8 Step Problem Solving Model
5 Essentials
CIMS website (hands-on)
Title I Primary focus
 The Elementary and Secondary
Education Act (ESEA) requires
all Title I schools to include the
following:
Ten Components
(Annual Documentation)
1. Comprehensive Needs Assessment
2.
3.
4.
5.
6.
7.
8.
9.
10.
Reform Strategies
Instruction by Highly Qualified Teachers (HQT)
High Quality Professional Development
Strategies to Attract HQT
Strategies to Increase Parent Involvement
Transition
Teacher Decision Making Regarding Assessments
Effective and Timely Assistance to Students
Coordination and Integration of Federal, State, and Local
Services and Programs
Required:
(A) A comprehensive needs assessment of the entire
school (including taking into account the needs of
migratory children as defined in section 1309(2))
based on information which includes the
achievement of children in relation to the State
academic content standards and the State student
academic achievement standards described in section
1111(b)(1).
But FIRST…..
•
How comfortable are you
working with data?
Is it just another 4 letter word?
Activity #1: Synectics
Purpose: To determine a baseline for your
current comfort level in discussing
data/evaluation.
Test Your Knowledge
Activity #2: Term Match
 In small
groups, match the data
terms with the correct definitions.
 Refer to Data Terms
handout for
clarification and confirmation.
Hmmm….
What is a Comprehensive
Needs Assessment (CNA)?
What is a Need?
 “Need” = gap or discrepancy between a
present state (what is) and a desired
state (what should be). The need is
neither the present nor the future state;
it is the gap between them.
Desired
Current
Need
65% Reading
Proficiency (AMO)
59% Reading
Proficiency
6% More Reading
Proficient
Do you currently conduct a
Title I Needs Assessment?
• In the real world, there is never
enough money to meet all needs.
Needs assessments are conducted to
help program planners identify and
select the right job before doing the
job right.
A CNA…
• A “needs assessment” is a
systematic set of procedures
that are used to determine
needs, examine their nature
and causes, and set priorities
for future action.
Focus on the end…….
NEEDS are not Solutions
Needs Assessment focuses on the
ends (i.e., outcomes) to be
attained, rather than the means
(i.e., process). For example, reading
achievement is an outcome
whereas reading instruction is a
means toward that end.
The Needs Assessment Model (Phases & Key Steps)
Phase
Phase 1
Pre-Assessment
Key Steps
Overarching Phase Descriptor
Focusing the NA and What do we know
about possible needs?
1.Focusing the Needs Assessment
2.Forming a NAC Committee
3.Learn as Much as we can about preliminary what
should be and what is conditions from available
data sources
4.Moving to Phases 2 and/or 3 or Stopping
1.Conducting
Phase 2
Assessment
Do we need to know more, will we have
to conduct a much more intensive data
collection effort, and do we have ideas
about what are the causes of needs?
a Full NA about what should be and
what is conditions
2.Identifying Discrepancies (Levels 1, 2, and 3)
3.Prioritizing Discrepancies
4.Causally Analyzing Needs
5.Preliminary Identification of Solution Criteria and
Possible Solution Strategies
6.Moving to Phase 3
1.Making
Phase 3
Post-Assessment
Are we ready to take action and have we
learned enough about the need to feel
comfortable with our proposed actions?
Altschuld & Kumar (2010) Sage Publishing
Final Decisions to Resolve Needs and
Selecting Solution Strategies
2.Developing Action Plans for Solution Strategies,
Communicating Plans, and Building Bases of
Support
3.Implementing and Monitoring Plans
4.Evaluating the Overall NA Endeavor (document
with an eye to revisit and reuse)
3 PHASES of Needs…
1. Explore “What IS?”
2. Gather and Analyze Data
3. Make Decisions
PRE-ASSESSMENT
Phase 1: Explore “What IS?
 investigate what is already known about
the needs of the target group (students,
parents, teachers)
 determine the focus and scope of the
needs assessment;
 gain commitment for all stages of the
assessment; including the use of the
findings for program planning and
implementation
Key Elements of Phase 1
Form a Needs Assessment
committee
Create a timeline
Identify Major Concerns
Determine data (what do we need)
ASSESSMENT
Phase 2: Gather/Analyze Data
 Document “what is” of the concerns/issues
 Compare “what is” to “what should be”
 Determine magnitude of the needs and
their causes
 Develop a set of needs statements in
tentative order of priority, based on the
criticality of the need, and its causes.
Key Elements of Phase 2
 Determine target groups (3rd grade
students, parents)
 Gather data
 Prioritize the needs (based on the data)
 Root cause*****
 Summarize and share
Gather Data
 Title I Audit Box
 Title I Application
 Demographics
 Student Achievement
 School Culture and Climate
 Staff Quality Recruitment and Retention
 Curriculum, Instruction, and Assessment
 Family and Community Involvement
 Technology
Root Cause Analysis:
Five Whys
Asking the question ‘Why’ 5 times, can help
identify the root cause of the need.
Steps:
1. Identify the need.
2.Ask why the need exists.
3.Repeat 5 times – 5 ‘Whys’, until the essential
cause of the need is identified.
Five Whys
Handout 1 (Yellow Folder)
The Case of the Pokey
Elevators
“Well,” he began, “you told me that your
problem was slow elevators. What that said to
me was that your solution to tenant complaints
was faster elevators. But that wasn’t really your
problem. What those folks were trying to tell
you is that they are bored stiff while waiting for
the elevators. That’s your real problem.” So for
less than $1,000, mirrors were installed beside
the elevators on every floor. Women
straightened their hair, men their ties. There
were no more complaints.
Problem Statement
You’re not getting wet
because it’s raining…
You’re getting wet
because your umbrella
has a hole in it.
DATA COLLECTION
5 WHYS
Root Cause
POST-ASSESSMENT
Phase 3: Decision Making
 Bridge from the analysis to action—to use
needs assessment findings
 It answers important questions:
 What needs are the most critical? What
are some possible solutions? Which
solutions are best?
Key Elements of Phase 3
Prioritize
Identify possible solutions
Select solutions
Propose Action Plan (SIP) (Title I
Application)
Florida’s Complimentary
model for Assessing and
addressing Needs
The Continuous Improvement
Management System (CIMS)
 Data visualizations for needs assessment and goal
development
 School and district improvement plans
 School Improvement Grant 1003(g) proposals
 Registration for BSI-hosted professional
development opportunities
 Resources, tools and guidance to support
continuous improvement
CIMS
• 8 Step Planning and
Problem Solving
• Step Zero
5 Essentials
 Effective Leadership
 Supportive Environment
 Problem Analysis
 Ambitious
Instruction/Learning
 Data Analysis
Visualization Tool
 Collaborative and Public
Teaching
 Strategic Goal
Formulation
 Involved Families and
Community
Engagement
 Problem Identification
8 Step Planning & Problem Solving
Criteria
• Collaborative Nature
• District Familiarity
• Flexibility
• Explicit Structures
It fit the bill!
Data Source: FLDOE
8 Step Planning & Problem Solving: Evolution
Step Zero
Problem ID
(what)
Data
visualizations;
Guiding
Questions
Problem
Analysis (why)
5 Whys; Guiding
Questions Organized
by 5Essentials
Domains; Situational
Awareness
NEEDS ASSESSMENT
Strategic
Goal
Formulation
POWERFUL
criteria
HOW DOES IT ALL FIT TOGETHER?
SWP 10
Components
5
Essentials
CNA
Step Zero
Handout 2 (Yellow Folder)
Phases 1 and 2 CNA
Review the 5 Essentials
Focus on elements/ facets
Develop guiding questions
Examine possible data sources
Establish useful indicators
Supportive
Environment
Examine components of an
“essential”
Teacher Support for
Students
Safety
High Expectations
for Student Success
Student-Teacher
Trust
Develop Needs assessment
Question(s) for each component
Supportive Environment
High Expectations for Student Success
• Do the school leadership and faculty
have high expectations for the success
of all students?
• Does the school implement support
systems and procedures such as MTSS
that most effectively support student
success in the classroom?
Consider Possible Data Sources
• Do the school leadership
and faculty have high
expectations for the
success of all students?
• Climate surveys
• Parent surveys
• Student surveys
• Does the school implement
support systems and
procedures such as MTSS
that most effectively
support student success
in the classroom?
• List of interventions
and support
programs
• MTSS procedures
Develop Useful indicators
• Do the school leadership
and faculty have high
expectations for the success
of all students?
Climate surveys
Parent surveys
Student surveys
Survey results showing school
leadership and teachers support
the academic success of all
students
Suggestions
Assign data collection roles
Seek multiple data sources
Use available – plan for
future
Extend and add to questions
Navigating CIMS
Building on Florida’s complimentary
model for school improvement
FLDOE CIMS
https://www.floridacims.org/
 LOGIN
 DISTRICTS
 School

Performance Data
PHASE 1
Problem ID
(what)
Data
visualizations;
Guiding
Questions
PHASE 2
Step Zero
Problem
Analysis (why)
5 Whys; Guiding
Questions Organized
by 5Essentials
Domains; Situational
Awareness
PHASE 3
Strategic
Goal
Formulation
POWERFUL
criteria
Step Zero
Problem
Problem ID
Analysis
(why)
• Does (what)
our strategic goal form
a credible
theory
5 Whys; Guiding
of action? That is, is it causal?
•
Data
Questions Organized
5Essentialsby
visualizations;
Will
reaching our goal servebystudents
Domains; Situational
Guiding
making
teaching better?
Awareness
Questions
• Can we measure progress toward our
strategic goal?
• Could our goal arguably have a positive
impact
on outcomes in multiple grades and
subjects?
• Would effective implementation result in
improvements across multiple 5Essentials
domains?
Strategic
Goal
Formulation
POWERFUL
criteria
Step Zero
Problem ID
(what)
Data
visualizations;
Guiding
Questions
Problem
Analysis (why)
5 Whys; Guiding
Questions Organized
by 5Essentials
Domains; Situational
Awareness
Strategic
Goal
Formulation
POWERFUL
criteria
Explore – PHASE 1
Click on PROBLEM ID
Select “ACCEPT”
Problem ID
(what)
Data visualizations;
Guiding Questions
Handout 3 (Yellow Folder)
Handout 4 – Yellow Folder
Handout 5 – Yellow Folder
Handout 6 – Yellow Folder
Handout 7 – Yellow Folder
Last Handout– Yellow Folder
Sample CNA Template
Aligned to 10 components
Lists 5 Essentials and elements
Follows the process described
Includes a worksheet
Adapt as needed
A Part of the school improvement process
“But Wait, That’s not all….”
SWP 10
Components
CNA
Evaluation
Step Zero
5
Essentials
Needs Assessment KIT (2010)
Books
1: Needs Assessment: An Overview Altschuld & Kumar
2: Needs Assessment Phase I: Getting Started
Altschuld & Eastmond
3: Needs Assessment Phase II: Collecting Data Altschuld
4: Needs Assessment: Analysis & Prioritization
Altschuld & White
5: Needs Assessment Phase 3: Taking Action for Change
Stevahn & King (A is editor)
Witkin & Altschuld (1995), A & W (2000), and New Directions Issue
(2014), Altschuld & Watkins (Eds) with chapter by Engle and A
Download