Operant Conditioning
Shaping



shaping = successive approximations toward
a goal
a process whereby reinforcements are given
for behavior directed toward a goal
reinforcement is given for approximations
toward a desired goal
Types of Shaping


1) topographical shaping
the individual or organism did
not engage in the behavior
previously, but then is
reinforced for successive
approximations toward a goal
Types of Shaping

2) quantitative shaping: here reinforcement is dependent on
either increasing or decreasing the quantity of some behavior

an adjusting schedule of reinforcement

a new response is not learned

the individual already is engaging in the behavior and you either
want to increase or decrease it via shaping
Making Shaping Effective




1)
2)
3)
4)
Define the goal
Determine a starting point
Pick a reinforcer
Determine the steps
Dissociative Identity Disorder

What is DID? - replace MPD


two or more distinct identities
at least two of these personalities take control of
behavior

unable to recall important information

not due to medical or substance
Dissociative Identity Disorder

some alters are aware of others, some are not

the host is the primary identity (the person)

the alters can be the exact opposite of the host

e.g., host = passive, alters = aggressive
handwriting and drawing is different
Dissociative Identity

recognized since 1800s

Benjamin Rush described DID

Included in DSM-III for first time,
set stage for clinical research
Explanations for DID?




True disorder
Another disorder
Possession
Iatrogenically induced disorder
Shaping and DID




Condition 1 (C1)
Increased attention (e.g., media, research) to DID.
Condition 2 (C2)
Therapist strongly believes in the existence of DID.
Therapist is fascinated by the dissociative experience.
Condition 3 (C3)
Patient is psychologically fragile.
Patient believes the therapist is competent.
Patient is highly suggestible and or personality disordered.
DID symptoms = C1 * C2 * C3
Schedules of reinforcement

1. Continuous (CRF)


good to start with when shaping behavior
2. Non continuous (intermittent, partial)


is one in which only some responses are
reinforced
four basic types
Intermittent Reinforcement




1. Fixed Ratio (FR): reinforcement delivered after
fixed number of correct responses.
e.g., FR 3 = 3 responses to get reinforcer
period of steady, rapid rate of responding until
reinforcement, then a brief pause before starting
again
low resistance to extinction
PRP longer with lean reinforcement (i.e., FR 100 v FR 3)
Post reinforcement pause (PRP)
Ratio strain = too much responding required, behavior stops.
Fixed Ratio
Intermittent Reinforcement

2. Fixed Interval: Reinforcement for next

initially, a slow rate of responding, gradually
increasing to rapid responding

pause after reinforcement

low resistance to extinction
correct response after a fixed amount of time
since last reinforcement.
Fixed Interval
Intermittent Reinforcement

3. Variable Ratio: reinforcement after
varying number of correct responses


moderate levels of responding with little
or no pause.
high resistance to extinction
Variable Ratio
Variable Ratio
Initially…
interaction
“good behavior”
victim
lots of positive reinforcement
victimizer
Abusive Relationships
Later…
Little positive
reinforcement
interaction
Lots of good behavior
victim
victimizer
stretching the ratio
Intermittent Reinforcement



4. Variable Interval: reinforcement
after varying time since the last
reinforcement.
moderate levels of responding with little
or no pause
high resistance to extinction
Variable Interval
Mixed Schedules

Fixed Duration (FD)


The behavior must be performed
continuously for a fixed predictable
amount of time.
Variable Duration (VD)

The behavior must be performed
continuously for a varying,
unpredictable amount of time.
DRL


Differential Reinforcement of Low Rate Behaviour
Reinforcement is delivered after
individual behaves undesirably to a
lower rate than their normal rate for
that behaviour
DRL Example
DRH


Differential Reinforcement of High Rate of Behaviour
Reinforcement for responding above a
specified level.
DRH Examples
DRP


Differential Reinforcement of Paced Responding
Reinforced for an amount below and
above a certain range.
DRP Example
Intermittent Reinforcement


Can you come up with examples of
each type of intermittent reinforcement
(FR, VR, FI, VI) DRP, DRL, and DRH?
Get together in groups and come up
with some examples.
DRO


Differential Reinforcement of Zero Behavior
Delivery of a reinforcer for not engaging in a specific
behavior for a period of time.
DRO Application




Define behavior to be changed.
Count frequency of behaviors in specified time frame.
The average is the interval for reinforcement.
If there are no behaviors during the period, reinforce.
If there are behaviors during the period, start the
timer again.
DRO Example
Temper Tantrums
DRI


Differential Reinforcement of Incompatible Behaviour
An undesirable behaviour is weakened,
while a desirable behaviour is reinforced
DRI Example
Extinction


1) B C
2) B  nothing
Result: decrease in B
Extinction

B (tantrum)  C (being picked up/ attention)

Problem:



Positive reinforcement for the child: to continue
having tantrums.
Negative reinforcement for the parent: pick up
child: avoid tantrum
Called a Reinforcement Trap
Types of Extinction

1. Social:

e.g: telling jokes  no reinforcement =
no telling jokes


2. Non Social:


B  C (social reinforcement)
B  C (non social reinforcement)
e.g: looking at broken watch  no time
info. = stop looking at broken watch.
Side Effects of Extinction





1.
2.
3.
4.
5.
increase in variability
emotional behavior – frustration
aggression
resurgence
depression
A practical example of an extinction burst.
6. Behaviour that is
being extinguished
will get worse
(extinction burst)
before it gets better
Resistance to Extinction

1. Schedule of reinforcement


2. History of reinforcement


Continuous versus intermittent
More reinforcement over time, the harder
to extinguish behavior
3. Magnitude of reinforcer

Larger hard to extinguish
Resistance to Extinction

4. Degree of Deprivation


More deprived, greater resistance to
extinction
5. Previous experience

With experience, extinction is quicker