
Classical
◦ Reflexive Behavior
◦ Extinction
◦ Spontaneous
Recovery
◦ Generalization
◦ Discrimination

Operant
◦ Voluntary Behavior
◦ Extinction
◦ Spontaneous
Recovery
◦ Generalization
◦ Discrimination

Classical Conditioning:
◦ Pavlov, Watson, Rescorla




Animal Intelligence – Cats
Trial and Error Learning
Instrumental Conditioning
Law of Effect

Susquehanna, Pennsylvania

B.A. in English

MA and PhD from Harvard in 1930-1931



1936 @ U of Minnesota
1945 @ U of Indiana
1948 @ Harvard

Died in 1990


Operant Behaviour: a type of behaviour
that operates on the environment to
have a particular effect.
Operant Conditioning: a form of
learning whereby voluntary behaviour
comes to be controlled by
consequences.
Voluntary
“Operant”
Punishment
Reinforcement
Positive
Negative
Give
Positive
Reinforcement
Positive
Punishment
Take Away
Negative
Punishment
Negative
Reinforcement
Positive
Give
Take Away
Negative
Tell Joke
In Class
Laugh
Students Take Notes
Professor Talks
Better Grades
Positive
Give
Take Away
Negative
Take Aspirin
Headache
Relief
Put seat belt on
Car buzzing
Relief
Positive
Give
Take Away
Negative
Positive
Punishment
Eat Too Fast
Food at Table
Pain
Say something
Inappropriate
Social Situation
Embarrassment
Positive
Give
Take Away
Negative
Punishment
Negative
Drive to Fast
On Highway
Money Taken Away
Tantrum
At Home…
Timeout



successive approximations toward a goal
a process whereby reinforcements are given for
behavior directed toward a goal
reinforcement is given for approximations toward a
desired goal




1)
2)
3)
4)
Define the goal
Determine a starting point
Pick a reinforcer
Determine the steps

1. Continuous (CRF)
◦ good to start with when shaping behavior

2. Non continuous (intermittent, partial)
◦ is one in which only some responses are reinforced
◦ four basic types

Fixed Ratio (FR): reinforcement delivered after fixed
number of correct responses.

low resistance to extinction

2. Fixed Interval: Reinforcement for next

low resistance to extinction
correct response after a fixed amount of
time since last reinforcement.

3. Variable Ratio: reinforcement after varying

high resistance to extinction
number of correct responses

4. Variable Interval: reinforcement after

high resistance to extinction
varying time since the last reinforcement.


1) B C
2) B  nothing
Result: decrease in B

B (tantrum)  C (being picked up/ attention)

Problem:
◦ Positive reinforcement for the child: to continue
having tantrums.
◦ Negative reinforcement for the parent: pick up
child: avoid tantrum
◦ Reinforcement Trap
anxiety is a CR to environmental events




1st Phase (acquisition)
Classical Conditioning
2nd Phase (maintenance)
Operant Conditioning

observational learning

Phase 1 – watch a model
◦ acquisition

Phase 2 – operant conditioning
◦ maintenance