Prevent-Teach-Reinforce (PTR)

advertisement
PREVENT-TEACH-REINFORCE (PTR):
AN EFFICACIOUS TIER 3 BEHAVIOR
INTERVENTION
Presented at the 2010 PBIS Leadership Forum
Chicago, IL
Rose Iovannone, Ph.D., BCBA-D
University of South Florida
iovannone@fmhi.usf.edu
813-974-1696
The contents of this training were developed under grant H324P04003 from the Department of Education.
OBJECTIVES

Participants will:
Describe the 5-step PTR Tier 3 support model
 Identify the critical components that enhance the
success of Tier 3 behavior supports
 Discuss application at district level

AGENDA
Rationale and conceptual foundation
 Research method/outcomes
 Overview of PTR process
 Suggestions for district-wide application

TIER 3 FUNCTION-BASED BEHAVIOR
INTERVENTIONS IN SCHOOLS
Issues






Absence of uniform policies & practices
Form versus a process
Expert driven versus collaborative effort
Occasionally contextual fit considered
Limited support/follow-up/training for teacher
provided
Result--limited impact on student behavior
WHAT IS PREVENT-TEACH-REINFORCE
(PTR)?

Research project funded by U.S. Department of
Education



University of South Florida
University of Colorado, Denver
Evaluate effectiveness of PTR process vs.
“business as usual”


Randomized controlled trial
Intervention “Package”
 ONE ‘P’revent; ONE ‘T’each; ONE ‘R’einforce
 Based on ABA principles and individual Positive
Behavior Support
WHAT IS PREVENT-TEACH-REINFORCE
(PTR)?

Primary Research Questions:

Is the PTR intervention more effective than control
conditions (‘business as usual’) in decreasing severe
problem behaviors and increasing pro-social and
academic skills of students?

Repeated measures—baseline, post-test, follow-up
 Social Skills Rating System (SSRS)-Problem Behavior
and Social Skills subscales
 Academic Engaged Time (AET)
PARTICIPANTS
 K-8th grade
 Behavioral difficulties
 Intensity– disruption to


the learning
environment
Frequency— minimum of 1 time per week
Duration– minimum 6 months
 General or Special Education
 All cognitive levels
 All disabilities
 Teachers volunteered & nominated
students


1-3
Top externalizers
Systematic Screening for Behavior Disorders
(SSBD)
PROCESS
Standardized Individual Positive Behavior
Support approach
 Intervention teams provided manual,
assignments, homework
 Five step process aligned with problem solving
facilitated by PTR Consultant






Team Development
Goal Setting
Assessment
Intervention and Coaching
Evaluation
OUTCOMES OF PTR PROCESS
STUDENT DEMOGRAPHICS BY PRIMARY DISABILITY
Disability
Autism
N
Percent
25
9.8
Developmental Delay
5
2.0
Emotional Disturbance
38
14.9
Mental Retardation
28
11.0
Multiple Disabilities
4
1.6
OHI (not ADD/ADHD)
1
.4
OHI (ADD/ADHD)
8
3.1
Specific Learning Disability
20
7.8
Speech/Language Disability
10
3.9
2
.8
99
245
38.8
Visual Impairment
General Education
TOTAL
STUDENT DESCRIPTION
Grade Level
K
1
2
3
4
5
6
7
8
N
34
53
53
41
30
16
7
8
3
%
13.9
21.6
21.6
16.7
12.2
6.5
2.9
3.3
1.2
77
150
31.4
61.2
45
200
18.4
81.6
Lunch Status
Regular
Free/Reduced
Gender
Female
Male
AET
0.7
AET ratio
0.6
Treatment n =
126
0.5
Control n=98
0.4
0.3
p<..01
g = .51
0.2
0.1
0
Baseline
Post-test
Time Interval
Cross-Over Treatment Results
Social Skills
90
88
86
84
82
Social Skills
80
p <.01
d = .85
78
76
AET
60
50
Baseline
Post-test
40
30
AET
20
Problem Behavior
124
10
122
0
p <.01
d = .64
Baseline
120
118
Problem Behavior
116
114
p <.00
d = 1.03
112
110
Baseline
Post-test
Post-test
TEACHER OUTCOMES

Fidelity
Majority of teachers achieved .80
 Mean # coaching/training sessions = 3.5
 Prevention higher than Teach and Reinforce


Social Validity
Modified Teacher Acceptability Rating Form (TARF;
Reimers & Wacker, 1988)—15 items
 5-point Likert Scale
 124 teachers
 Overall—4.16 (.52)

Willingness to carry out plan—4.80 (0.42)
 Like the procedures—4.46 (0.64)

PTR: THE PROCESS
STEP 1:

Purpose:




TEAMING
Evaluate strengths and weaknesses of team functioning
Outline roles and responsibilities
Determine a consensus-making process
Members (desired
Person with knowledge of student (e.g., Classroom teacher,
instructional assistant, parent)
 Someone with expertise in functional assessment,
behavioral principles (PTR consultant, school-based
consultant)
 Someone with knowledge of context (e.g., administrator or
designee)


Tools

Work style survey


Teacher and Teacher Assistant
Teaming survey
STEP 2:
GOAL SETTING

Purpose:
Identify behaviors of greatest concern to the team
and possible replacement behaviors (teach)
 Prioritize and operationalize behaviors
 Develop teacher friendly baseline data collection
system


Targeted Areas:
Problem behaviors
 Social skills
 Academic behaviors

Case Study—Step 2: Goal Setting
Increase
Decrease
Broad
Behavior
Social
Academic
Mike will communicate his Mike will interact with
wants and needs
peers appropriately
appropriately
Mike will comply with
non-preferred activities
and requests
Mike will decrease
screaming, hitting, and
getting out of his seat
Mike will decrease
hitting, screaming at,
and bossing his peers
Mike will decrease
screaming and hitting
Mike will ask for a break
or for attention when
needed
Mike will initiate peer
interactions using his
Dynamite
Mike will engage in nonpreferred activities and
communicate his
frustration using his
Dynamite or an
appropriate tone
STEP 2: DATA COLLECTION SYSTEM

Behavior Rating Scale





Direct Behavior Rating (DBR)—Hybrid assessment
combining features of systematic direct observations
and rating scales
Efficient and feasible for teacher use
Provides data for decisions
Prioritized and defined behaviors measured
Requires minimum of 1 appropriate and 1 inappropriate
behavior
CASE STUDY - MIKE: OPERATIONAL
DEFINITIONS

Problem behaviors
Screaming—loud, high pitched noise heard outside
the classroom
 Hitting—anytime Mike touches peers or adults with
an open hand, fist, foot, or object while screaming or
protesting


Replacement/Appropriate Behaviors
Express frustration appropriately using Dynamite,
pictures, or signs to ask for a break or attention
 Transition to non-preferred activities: Moving to nonpreferred activity and engaging with appropriate
verbal expression

Date
Case Study- Mike: Behavior Rating Scale
Behavior
Screaming
9+ times
7-8 times
5-6 times
3-4 times
0-2 times
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
Hitting
8+ times
6-7 times
4-5 times
2-3 times
0-1 times
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
Expressing
Frustration
40%+
30-40%
20-30%
10-20%
0-10%
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
Transition to
Non-preferred
Whimper or squeal
Louder than indoor voice
Outdoor play voice
Louder than outdoor play
Ear penetrating
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
5
4
3
2
1
BRS PSYCHOMETRICS (PRELIMINARY)

Kappa coefficients of:
Problem Behavior 1 (n = 105): .82
 Problem Behavior 2 (n = 90) : .77
 Appropriate Behavior 1 (n = 103): .65
 Appropriate Behavior 2 (n = 56): .76

STEP 3: PTR ASSESSMENT
(FBA)

PTR Assessment (FBA)

Each team member independently answers a series of
questions related to:
Observed antecedents/triggers of problem behaviors
 Functions of the problem behaviors
 Consequences ordinarily associated with the problem
behaviors

PTR facilitator summarizes input and develops draft
hypothesis
 Team reaches consensus

STEP 3: CASE STUDY – MIKE
ASSESSMENT SUMMARY TABLE OF PROBLEM
BEHAVIOR
Prevention Data
Screaming, Hitting
Non-preferred task
Reading,
Math
 Other students upset/mad
Teacher attending to others
Transition
Preferred to
non-preferred
Change in schedule
Denied item, told no, or to
fix something
Teach Data
Gain attention
Reinforce Data
Redirected
Peers,
Reprimanded
adults
Calm/soothe
Delay
Personal space
Later must
complete task
Access to items
Loss of or delay in
reinforcement
STEP 3: CASE STUDY – MIKE
ASSESSMENT OF APPROPRIATE BEHAVIOR
Prosocial
Prevention Data
Teach Data
Reinforce Data
Independent work
Peer interaction
Treasure box
One-on-one
Getting attention
Movie
attention
Specials
Raising hand
Attention
Sharing attention
Helping teacher
Conversation skills
Going to media
Taking turns
center
Going outside
Walk
Food
Waiting
Self-management
Asking for break
Expressing
emotions
STEP 3: CASE STUDY – MIKE HYPOTHESES
Appropriate
Inappropriate
When….
he will
As a result…
Mike is asked to complete nonscream and hit
preferred tasks (Reading, Math),
stop preferred activity or transition
to non-preferred activity, fix an
error, or when teacher is attending
to other students
Mike is able to
gain attention and
delay the
transition/activity
Mike is asked to complete nonpreferred task (Reading, Math),
stop preferred activity or transition
to non-preferred activity, fix an
error, or when teacher attending to
other students
express his
frustrations
appropriately
Mike is able to
delay the
transition/activity
complete the
assigned task
Mike is able to
gain attention
STEP 4: BEHAVIOR INTERVENTION PLAN
 Team
selects interventions from
each component (P-T-R)
 Detailed behavior plan developed
 Consultant provides training and onsite assistance with plan
implementation
 Implementation fidelity evaluated
Step 4: Case Study – Mike’s BIP
Prevent
Strategies
Environmental
Support
Specific Strategy steps
A wait card will be placed on Mike’s desk to assist him in
remembering to wait his turn.
1. Prior to group work, tell Mike, “Remember, when it is
someone else’s turn, you sit quietly and wait,” while pointing to his
card.
2. If Mike calls out, point to his visual to remind him what to do.
3. Use a verbal prompt if the point prompt does not work.
Mike’s Intervention Plan
Prevent
Strategies
Environmental
Support
Specific Strategy steps
Mike’s visual schedule will be modified to detail the number of
and type of activities he is to complete during non-preferred
activities. For example, if math involves listening to a lesson,
doing a hands-on activity, and completing a worksheet, his visual
schedule will list each activity under math using either a picture of
the type of activity or using numbers that correspond to a number
on the worksheet.
1. Prior to the start of the activity, Mike should review the visual
schedule.
2. As Mike completes an activity, he should X off the activity.
Mike’s Intervention Plan
Prevent
Strategies
Curricular
Modification
Specific Strategy steps
Mike will be given an easy, independent activity, such
as a worksheet, to complete upon transitioning to a
non-preferred activity or an activity that requires him to
wait, such as group activities
30
Teach
Strategies
Replacement
Behavior
Specific Strategy Steps
Mike will be taught to use his voice output device to
express his need to calm down.
Steps:
1.
2.
3.
4.
5.
6.
7.
Mike’s device will be programmed to say “I need to calm
down.”
Prior to transitioning to a non-preferred activity or at the end
of a preferred activity, say “If you start to get mad, you can
choose to calm down.”
As soon as Mike starts to get upset, prompt him to use his
device (hierarchy—hand-over-hand, gesture, verbal).
Once Mike communicates “I need to calm down”, present
him with the choice board of calming strategies and ask him,
“What do you want?”
As soon as he is calm, praise him (e.g., “You made a good
choice.”.
Allow Mike to engage in his choice until he is calm for 1minute.
If Mike does not want to leave his choice, then start
becoming animated with students in the non-preferred
activity.
Teach
Strategies
SelfManagement
Specific Strategy Steps
Mike will be taught to independently use his calming
strategies.
1. A tracking sheet with smiley faces and sad faces will be
given to Mike at the start of each day.
2. Role-play with Mike about when he needs to make the
choice to calm down.
3. Practice completing the tracking sheet.
4. Set and review the daily goal for using the calming
strategies.
5. Prompt Mike to complete the tracking sheet if needed
Reinforce
Strategies
Specific Strategy Steps
Replacement
Behavior
Anytime Mike “says” “I need to calm down”, his choice board
should be given.
1. Praise Mike for communicating (“thank you for telling me
what you need.”)
2. Provide his choice board.
3. Allow him to calm for 1 minute
4. Praise him as soon as he is quiet
5. Praise him for returning to the group
SelfManagement
Anytime Mike scores his behavior, attention should be given.
1.
2.
3.
4.
Waiting
When Mike marks his tracking sheet, praise him for
doing so.
At the end of the day, review the sheet with Mike.
Talk about the sad faces.
Provide his reward if his goal is met.
Mike will earn a skittle paired with attention if he waits. This
will be faded to an intermittent schedule.
Reinforce
Strategies
Specific Strategy Steps
Transition Mike will earn stars during Reading Centers if he
transitions and completes his work without screaming.
1.
2.
3.
4.
5.
A social story will be reviewed prior to Reading
Centers to remind Mike that he can earn a star if he
comes to centers and works.
At the end of each reading center, an adult will review
Mike’s behavior with him and ask him if he earned his
stars.
Provide his stars if earned.
During the teacher’s group, Mike can earn 2 stars: 1 for
transitioning to the group and 1 for working during
group.
Allow Mike to participate in his chosen activity if he
earned his stars.
STEP 4: PTR INTERVENTION
COACHING/FIDELITY
Provide training to practice the plan without
student (30-90 min.)
 PTR Consultant present first day of
implementation with student
 Provide support in the classroom

Model the plan
 Provide feedback
 Discuss need for modifications if applicable

Task Analysis of Intervention
Discuss
Q&A
Verbal
Role-play
Observe
Feedback
Case Study: Sample Coaching
Checklist/Fidelity for Mike
PREVENT – Environmental Support
1. Mini schedule of group & center time available
2. Schedule reviewed prior to task
3. Schedule reviewed & items crossed off
TEACH – Replacement Behavior
1. Remind to use Dynamite prior to transition
2. Provided choice board and honored choice
REINFORCE –Replacement Behavior
1. Verbally or gesturally acknowledge ASAP
2. Allowed to cool off for 1-minute
TOTAL (# Yes/ # Total)
Fidelity Score ( .00 – 1.00)
Training
Review
Yes
No
Yes
No
Yes
No
Yes
No
Yes
No
Yes
No
Yes
No
Yes
No
Yes
No
Yes
No
Yes
No
Yes
No
Yes
No
Yes
No
STEP 5: EVALUATION

Is it working?
Daily ratings of behavior
 Continuous progress monitoring

BRS
 Other data collection forms


Is it being implemented consistently and
accurately?

Fidelity ratings
Do we need more data?
 Does the plan need to be modified or expanded?
 Plan for generalization and maintenance

ar
M
b
-M
a
16 r
-M
a
29 r
-M
ar
4Ap
12 r
-A
p
18 r
-A
p
24 r
-A
p
30 r
-A
p
4- r
M
a
10 y
-M
ay
12
1-
.
b
-F
e
22
-F
e
15
Rating
5
15
ec
-D
ec
8Ja
12 n
-J
a
22 n
-J
a
26 n
-J
an
1Fe
b
D
8-
ec
-D
14
Step 5: Mike Evaluation
Screaming
Baseline
Intervention
4
Definition
Changed
3
2
1
Step 5: Evaluation
Hitting
Intervention
Baseline
5
Rating
4
3
2
1
ec ec ec Jan Jan Jan Jan Feb
D
- 8-D 5-D 8- 2- 2- 6- 11
2
2
14
1
.
b eb
ar ar ar ar Apr Apr Apr Apr Apr ay ay
e
M
M
-F -F 1-M 2-M 6-M 9-M 4- 2- 8- 4- 04- 101
1
2
3
15 22
1
1
2
7- c
D
12 ec
-D
e
3- c
Ja
8- n
J
11 an
-J
a
18 n
-J
23 an
-J
26 an
-J
31 an
-J
a
5- n
Fe
7- b
F
15 eb
-F
21 eb
-F
26 eb
-F
e
2- b
M
12 ar
-M
15 ar
-M
27 ar
-M
30 ar
-M
a
4- r
A
11 pr
-A
16 pr
-A
19 pr
-A
24 pr
-A
27 pr
-A
2- pr
M
a
7- y
M
10 ay
-M
ay
-D
e
14
Rating
Step 5: Evaluation
Expression of Frustration
5
Baseline
Intervention
4
3
2
1
STEP 5: EVALUATION
Transition to Non-Preferred
Baseline
5
Rating
4
3
2
1
Intervention
STEP 5: EVALUATION
MIKE OUTCOME DATA
Measure
Baseline
Post-test
Change
SSRS-PB
123
112
-11
SSRS-SS
87
102
+15
AET
.34
.57
+23
42
REVIEW PTR PROCESS
Five-step team-based process
 Teacher/team driven
 Support provided to teacher/team to implement
interventions
 Mean number of days for PTR process = 71

References
• Manual
• Dunlap, G., Iovannone, R., English, C., Kincaid, D., Wilson, K., Christiansen,
K., & Strain, P. (2010). Prevent-Teach-Reinforce: A school-based model of
individualized positive behavior support. Baltimore:Paul H. Brookes
• Journal articles
• Iovannone, R., Greenbaum, P., Wei, W., Kincaid, D., Dunlap, G., & Strain, P.
(2009). Randomized controlled trial of a tertiary behavior intervention for
students with problem behaviors: Preliminary outcomes. Journal of Emotional
and Behavioral Disorders,17, 213-225.
• Dunlap, G., Iovannone, R., Wilson, K., Strain, P., & Kincaid, D. (2010).
Prevent-Teach-Reinforce: A standardized model of school-based behavioral
intervention. Journal of Positive Behavior Interventions, 12, 9-22
• Iovannone, R., Greenbaum, P., Wei, W., Kincaid, D., & Dunlap, G. (in review).
Reliability of the Individualized Behavior Rating Scale-Strategy for Teachers
(IBRS-ST): A Progress Monitoring Tool. Manuscript submitted for publication.
• Next steps:
• Facilitating schools to scale up
• Training key school staff and team members to do process
APPLICATION OF TIER 3
DISTRICT LEVEL
STEP 1: ASSESS
CURRENT STATUS
PBS TEAM STRUCTURE

Goals:





Teams to support all students (general ed. and ESE)
throughout tiered (levels) continuum of support
System for monitoring outcomes at all levels
Access to technical assistance
Link between all three tiers of behavior support
Link between school, home, community
PBS TEAM STRUCTURE IN A SCHOOL

SWPBS team—for all students (gen. ed. & ESE)




Monitor implementation of universal intervention
Monitor school-wide data
Guide implementation of new initiatives, braid with
SWPBS
Tier 3 PBS team—“Standing team”—for all
students (gen. ed. & ESE)
Progress monitor students in targeted and intensive
interventions
 Guide intervention selection for students selected for
IPBS


Student-focused teams—“Ad hoc” for all students
(gen. ed. & ESE)

Conduct FBAs and build support plans
TIER 3 BEHAVIOR SUPPORT IN A SCHOOL:
TEAM OPTION

“Ad-hoc” team—student focused (both gen. ed. & ESE)

Responsibilities of team (problem solving process)






Conduct FBA
Build function-based support plan
Provide coaching/support to teacher to implement interventions
Collect and review fidelity and student outcome data
Make decisions based on data
Membership—Three levels of knowledge represented



Someone with expertise in FBA and function-based intervention plans
(school psychologists, CABAs, BCBAs, behavior specialists, counselors,
social workers……)
Someone with knowledge of the student and his or her behaviors
(Teacher(s), aides, parents, students)
Someone with knowledge of the context in which the support plan will
be implemented (administrators or designees)
TIER 3 PROCESS—CONSISTENT AND FEASIBLE
MULTIPLE LEVELS OF TIER 3 (FBA)
 Brief
FBA
FBA/BIP developed in one meeting (60 minutes or
less)
 Best used for high frequency/low intensity
behaviors (e.g., noncompliance, minor disruptions,
etc.)


Example: Brief PTR, ERASE
 Comprehensive
FBA
More complex FBA/BIP procedure
 May take 2 or more meetings or one lengthy
meeting (>1 hour)
 Best used for chronic, durable, intense behaviors


Example: PTR
MULTIPLE LEVELS OF TIER 3

Wraparound
Involves multiple agencies
 Support plan includes practices that may go beyond
scope of school
 Best used for students with mental health issues
and/or complex life events

DATA TRACKING—TIER 3

Systemic Data Tracking Examples

Florida School Districts
Monroe
 Martin
 University of Oregon

QUESTIONS?
FOR COPIES OF FORMS, E-MAIL:
iovannone@usf.edu
Download