Myers’ PSYCHOLOGY (7th Ed) Chapter 8 Learning James A. McCubbin, PhD Clemson University Worth Publishers 1 Learning: p. 308 Learning: relatively permanent change in an organism’s behavior due to experience Shapes thoughts language motivations attitudes Personalities emotions Even the simplest of species learn by associating 2 things2 Association We learn by association Association: how our minds naturally connect events that occur in sequence How we associate 1 thing with another thing that happens AFTER it Aristotle 2000 years ago & John Locke & David Hume 200 years ago knew about learning from association… Associative Learning learning that two events occur together…expecting 2nd thing to happen if the 1st happens two stimuli = a response & its consequences 3 1) Lightening 2) BOOOM!!! = fear (Response) Association: Can be automatic OR by choice Event 1 Event 2 Sea snail associates splash with a tail shock Seal learns to expect a snack for its showy antics Learning to associate 2 events Snail: just water, will habituate If shock added, response is stronger & continues… Get automatic response Seals: chooses to do something to gain something b/c associates reward w/ some activity (SL 46... eyes!) 4 Classical or Pavlovian (associative) Conditioning Learning to associate 2 stimuli (flash + BOOM) Conditioning: process of learning associations 3 types: 1. Classical conditioning (involuntary) 2. Operant conditioning 3. Observational learning if voluntary (2 & 3 = voluntary)5 Operant Conditioning We learn to associate a response & its consequence If we do something, we cause something else to happen 6 Classical Conditioning Ivan Pavlov 1849-1936 Russian physician/ neurophysiologist Nobel Prize in 1904 Studied digestive secretions (salivating reflex) in animals… especially using dogs 7 Classical Conditioning Pavlov’s device for recording salivation 8 Classical Conditioning: Basic Terms Unconditioned Stimulus (UCS…aka…US) stimulus that unconditionally--automatically and naturally--triggers a response Unconditioned Response (UCR…aka…UR) unlearned, naturally occurring response to the unconditioned stimulus salivation when food is in the mouth Neutral stimulus (NS): originally irrelevant stimulus that, after association with an unconditioned stimulus, becomes the conditioned stimulus CONDITIONED Stimulus (CS) & triggers a conditioned response Conditioned Response (CR): learned response to a previously neutral conditioned stimulus 9 Pavlov’s Classic Experiment: UCS, UCR; NS; CS, CR (note: NS not in yr bk but does show up) Before Conditioning UCS (food in mouth) UCR (salivation) During Conditioning Neutral stimulus (tone) No salivation After Conditioning UCS (food in mouth) Neutral stimulus (tone) UCR (salivation) CS (tone) CR (salivation) 10 Classical Conditioning organism comes to associate two stimuli a neutral stimulus (NS) that signals an unconditioned stimulus begins to produce a response that anticipates and prepares for the unconditioned stimulus UCS = UCR (naturally occurring) NS = no response at 1st UCS + NS = UCR then CS = CR For Pavlov’s dog & salivation on the board: ID the following: UCS Food = UCS + Food UCR saliva (NS) bell = NS = bell UCR then saliva CS = bell CR saliva 11 Behaviorism: Look at observable behaviors ONLY John B. Watson: Watson was 1 of very 1st behaviorists Developed the with the terms “behaviorism” & “behaviorist” relating to this type of study Viewed psychology as objective science Psychologists still agree w/ this today recommended study of behavior w/o reference to unobservable mental processes This is Not still accepted by all psych schools of thought today (cognition? emotion?) 12 Neat little trick! 13 Classical Conditioning Acquisition: You acquire (gain) an association Initial (1st) stage in classical conditioning Phase associating a neutral stimulus (NS) with an unconditioned stimulus (UCS) so that the NS begins to elicit (bring on) a conditioned response (CR) It is how you paired UCS + NS to get CS In operant conditioning, the strengthening of a reinforced response 14 Acquisition of sexual response to onion breath!! UCS (passionate kiss) UCR (sexual arousal ) CS (onion breath) UCS (passionate Kiss) CS (onion breath) CR (sexual arousal) UCR (sexual arousal) 15 Conditioning Extinction Getting rid (diminishing) of a CR in classical conditioning, when a UCS does not follow a CS…may be 1 time…or more…lessens then stops EX: Dog hears footsteps (bell, etc…..) but does NOT get the conditioning stimulus…like the food in operant conditioning, when a response is no longer reinforced 16 Classical Conditioning Spontaneous Recovery reappearance, after a rest period, of an extinguished (or extincted) CR Generalization tendency for stimuli similar to CS to elicit similar responses Discrimination: only responding to a specific stimulus - “can tell the difference between…” in classical conditioning, the learned ability to distinguish between a CS and other stimuli that do not signal a UCS 17 Classical Conditioning Strength of CR Acquisition (CS+UCS) Extinction (CS alone) Spontaneous recovery of CR Extinction (CS alone) Pause 18 Generalization Drops of saliva in 30 seconds 60 50 40 30 20 10 0 Pelvis Hind paw Thigh Shoulder Trunk Part of body stimulated Front paw Foreleg 19 Nausea Conditioning in Cancer Patients: Taste Aversion comes from associating last food ingested (or a situation) b4 throwing up… learns to avoid that food…or situation UCS (drug) UCR (nausea) CS (waiting room) CS (waiting room) UCS (drug) UCR (nausea) CR (nausea) 20 Classical conditioning in Cancer patients: How our brain makes a biological connection: Taste Aversion 21 Pavlov’s legacy: Why it’s still important today: 1) classical conditioning: 1 way that virtually all organisms learn to adapt to their environments 2) showed how a mental process such as learning can be studied objectively, & this provided a scientific model of isolating elementary building blocks of complex behaviors & studying them w/ objective lab procedures --------------- Real EX’s: of Classical conditioning: *Baby w/ intense nausea *“Our song!” *Anabuse (w/ alcohol) *good food + flu = ugh! 22 Biological Predispositions: Certain animals are affected more quickly & strongly by certain things that help them to learn to adapt to their environments -Rats: taste aversion -Birds: sight aversion 23 Practice: ID in each given situations UCS UCR 1. Little Albert NS CS CR : 2. Ms. Uptight yells at Mary. Now when M. comes to class, she gets nervous, feels nauseated, & her palms get sweaty 3. Tom & Ernie think it would be funny to train their brother’s horse to jump and buck when he hears “Whoa!” HOW would they do this??? And ID each of the 5 above… ?: What is the MAJOR way in which Classical & Operant Conditioning vary? (V?) 24 Scaring the birds! “Copying” poisonous or dangerous animals ... 25 Operant Conditioning behavior strengthened if followed by reinforcement OR diminished (lessened) if followed by punishment Person makes a choice to do something in order to get something or to avoid something Law of Effect Thorndike’s principle: rewarded behaviors are more likely to recur. Then Skinner developed “behavior technology,” that outlined principles of behavior control Thorndike came up with a way to show this…Thorndike’s Puzzle Box (See DMA: 8) 26 Operant Behavior: operates (acts) on environment to produce consequences Respondent Behavior (like Pavlov) occurs as an automatic response to stimulus behavior learned through classical conditioning is respondent Which is which? Ask: Voluntary response or an involuntary response? O or R? EX’s: -Be quiet for 30 min.? -Shriek at a loud sound? -Get nauseated smelling a food that made you sick once? -Study harder to pull up a grade? 27 Operant Conditioning B.F. Skinner (1904-1990): most famous of behaviorists elaborated Thorndike’s Law of Effect developed behavioral technology (equipment) EX: the operant chamber (Skinner box) to study responses of animals Wrote Walden Two: perfect society using operant principles…also wrote Beyond Freedom & Dignity 28 Operant Chamber Skinner Box: Operant chamber chamber with a bar or key that an animal manipulates to obtain a food or water reinforcer contains devices (bar, light, button, etc.) to record responses & counter to keep a record of responses frequently used w/ 29 rats & pigeons Operant Conditioning Reinforcer: an event that strengthens the behavior it follows Shaping: operant conditioning procedure in which reinforcers guide behavior toward closer approximations of a desired goal -little by little, step by step, w/ small rewards (reinforcers) along the way until you get the behavior you want 30 Chaining: putting together, in a series, different tasks that have been shaped, to form a longer task… *P. 324: Read & find 2 EX’s on that page of shaping (See DMA: # 9) 31 Operant Conditioning (p. 325..note a few differences) 32 Punishment: NOT negative reinforcement! aversive event that decreases the behavior that it follows powerful controller of unwanted behavior (p. 328) 33 34 Principles of Reinforcement: A “Contingency of Reinforcement” Primary Reinforcer: innately (?) reinforcing stimulus….i.e., satisfies a biological need Conditioned Reinforcer (a.k.a. secondary reinforcer) stimulus that gains its reinforcing power through its association with primary reinforcer Schedules of Reinforcement Continuous Reinforcement reinforcing the desired response each time it occurs Do 1, get 1 Partial (Intermittent) Reinforcement reinforcing a response only part of the time results in slower acquisition (takes longer) 35 !) But…greater resistance to extinction (stays stronger Schedules of Reinforcement Fixed Ratio (FR) reinforces a response only after a specified number of responses faster you respond the more rewards you get different ratios very high rate of responding EX: piecework pay: make 3 dresses, get $5; buy 5 get 1 free Variable Ratio (VR) reinforces a response after an unpredictable number of responses average ratios EX: gambling; or …. maybe…fishing (casts)? very hard to extinguish because of unpredictability: 36 …we tend to keep on trying to get it again Schedules of Reinforcement Fixed Interval (FI) reinforces a response only after a specified time has elapsed response occurs more frequently as the anticipated time for reward draws near EX: paycheck Variable Interval (VI) • reinforces a response at unpredictable time intervals • produces slow steady responding • EX: pop quiz…or fishing (time sitting)? 37 38 Skinner’s 4 Schedules of Reinforcement: Each black “tic” = a reinforcer RATIO = gets higher # responses than Interval…. And VARIABLE (unpredictable) = higher than Fixed Number of responses 1000 Fixed Ratio Variable Ratio Fixed Interval 750 Rapid responding near time for reinforcement 500 Variable Interval 250 Steady responding 0 10 20 30 40 50 Time (minutes) 60 70 80 39 40 A Question Answered from AP Psy Listserv: Is a kid’s “time-out” negative reinforcement OR negative punishment”… What do YOU think?? Some students might consider "time out" a negative reinforcement technique, but traditional time out is not actually a negative reinforcement technique. Sitting a child in a chair in the corner for a period of time is really omission training--depriving that child of something he or she wants in order to teach them not to do the undesired behavior. Omission training is a form of punishment--not reinforcement. If getting out of time out were tied to a behavior, then it would qualify as negative reinforcement. EX: if kids can get out of time out if they agree to comply with parental requests, then they would be negatively reinforced to be compliant. If time out were used as a negative reinforcement technique, then it would be a more powerful behavior modification technique. (See p.231) 41 What does each pic have to do w/ operant conditioning? Training Lions Training Rats Training Men… 42 Learned Helplessness Learned helplessness was discovered accidentally by psychologists Martin Seligman and Steven F. Maier They initially observed helpless behavior in dogs classically conditioned to expect an electrical shock after hearing a tone. Later, the dogs were placed in a shuttlebox with 2 chambers separated by a low barrier. Floor was electrified on one side, but not on the other. Dogs previously subjected to the classical conditioning made no attempts to escape, even though they could avoid shock simply by jumping over the low barrier. In People: EX: child who performs poorly on math tests & assignments quickly begins to feel nothing he does will have an effect on his math performance. Later when faced with math-related tasks, he may experience a sense of helplessness. 43 Learned Helplessness: WHY even TRY??? 44 Cognition & Operant Conditioning Intrinsic Motivation Desire to perform a behavior for its own sake Comes from something inside of us driving us Extrinsic Motivation Desire to perform a behavior due to some possible rewards …or punishments Comes from something outside (ex-) driving us 45 Biological Predispositions (p. 331): like Classical Conditioning, the ability to be trained a certain way has limits… ….Ya’ can’t teach pigs to fly… Hamsters: Why is it easier to get it to dig or stand on hind legs than to wash its face even though it does all naturally? What are the biological predisposition of the following? Rats? Cats? Pigs? See: Problem w/ pigs & instinctive drift? 46 Skinner’s legacy: Critics: He dehumanized ppl by saying we could “train” them to behave however we wanted using reinforcements… Also in Beyond Freedom & Dignity -- he didn’t accept concept of “free-will”…our choices He completely rejected cognitive psychology as any form of science…believed it was a newer form of Wilhelm Wundt’s (“father of psych:” 1st psych lab ,1879: “birthday of psy”) ideas of introspection, which had been totally discounted 1) At school: said using computers to teach lets each kid work at his own pace & reinforces automatically (“Good job! Go to the next problem!” “Try that one again...”) 2) Techniques at work? 3) At home? 47 Operant vs Classical Conditioning p.335 Note: is Table 8.3 , not 8.2 KNOW this! 48 Observational Learning aka “Social Learning” learning by observing others Modeling process of observing and imitating a specific behavior (Role models) Albert Bandura (t-337) (DMA # 11 -Bobo doll) Pro-social Behavior positive, constructive, helpful behavior opposite of antisocial behavior 49 Observational Learning Mirror Neurons Frontal lobe neurons that fire when we perform certain actions… BUT these also fire when observing another performing the actions Monkey see, monkey do? May enable imitation, language learning, and empathy Remember the BoBo Doll ... DMA 50 ….An individual is likely to act in the same ways that others act. …Is seen…. benefit for sports training ….watching experts perform. 51 MIRROR Neurons: Babies will copy adults… Also…remember the video of one baby starting to cry… then another… & another… & another… until all crying? What were they showing? (“E-word???”) 52 53 Over-justification Effect: Effect of promising a reward for doing what we enjoy doing, such as volunteering …or a hobby It then becomes an extrinsic reward (you now expect a reward), not the intrinsic reward (b/c I enjoy it/makes me feel good) interest, as motivation 54 Cognition & Operant Cond. Skinner resisted idea of cognitive learning , (figuring out stuff, using past experience & making new connections…EX: McGyver?) Cognitive Map: E.C. Tolman: cogn. learning mental representation of the layout of our environment (DMA velephants 10A video) Ex: after rats exploring a maze, then seem to have developed a cognitive map (DMA 10B video) Latent Learning: Learning occurs, but we don’t realize it until there is incentive to demonstrate it (“I just picked it up”) 55 Latent Learning: cuts # of errors 56 Cognitive learning(aka & Latent learning Insight) Cognitive maps (E.C. Tolman) EX: Using map & figuring new route if obstacles block your usual way ”Eureka!/AHA!” moments... “McGyver” learning: Taking previous info & thru trial/error, learning new behaviors that work better This is a newer aspect—and it ties operant (previous learning) + observational + thinking b/c it requires previous learning in order to occur. 57 Which kind of Conditioning is this below? Explain your answer! Darken the room as much as possible if you have outside windows. Divide into pairs. Watch partner's pupils as you turn out the lights in the room. Ask them what’s expect to be seen. MOST ppl likely to say , "Nothing, because it will be dark." To condition pupils to expand before the lights go out: • Say "Ready“ • Pause a few seconds, then shut off the lights. • After 7 or 8 repetitions, should see partner's pupils enlarge before the lights go out. 58