Types of learning: ● Event-alone learning: habituation and sensitization - The event being presented on its own allows learning - Single eliciting stimulus causing changes to a behavioral response that follows. ● Event-event learning: classical(pavlovian) conditioning - Association between 2 events - Conditioned stimulus and unconditioned stimulus ● Behaviour-event learning: instrumental(operant) conditioning - Consequence and stimulus - Behaviour response and the event or consequence that follows. ● Social learning: observational learning ● Classical: Elicits involuntary, automatic, or reflexive responses (e.g., salivating, blinking). ● Operant: Shapes voluntary behaviors or actions (e.g., studying, pressing a lever). Event-Alone learning Habituation Process by which we respond less strongly over time to repeat stimuli - Highly specific to the stimulus producing it Not habituation ● Sensory adaptation: reduction in sensitivity of these organs caused by repeated stimulation. - Sensory receptors become tired so they no longer react. ● Fatigue: decrease in behaviour due to repeated or excessive use of muscles. - Reflex arcs become less sensitive and no longer react and send signals to the brain. Eliminate sensory adaptation and fatigue to determine where it is habituation or not. Sensitization Process by which we respond more strongly to a repeated stimulus over time - - - Not specific to one stimulus Can result from repeated presentations of a stimulus or by arousal from extraneous stimuli Any threat should produce a response Event-Event learning Classical conditioning(respondent or Pavlovian): form of learning in which a neutral stimulus comes to signal the occurrence of a second stimulus - Behaviours are elicited (brought about by) antecedent stimulus - Conditioning process involves manipulation of antecedent stimuli ● Unconditioned stimulus(US): biologically significant stimulus that already has a response associated with it. ● Unconditioned response(UR): response naturally associated with the unconditioned stimulus - Food (US) → Salivation (UR) - Usually has a survival value ● Natural stimulus(NR): a stimulus that does not naturally elicit a response - Anything that doesn't already have a response associated with it. - Usually start with a neutral stimulus, as we learn it becomes a conditioned stimulus. - EX: Bell, doesn’t have anything specifically associated with it so we do not know how to react to it exactly. ● Conditioned stimulus(CS): previously neutral stimulus that has been paired with an unconditioned stimulus and now comes to elicit a conditioned response - EX: Salivation caused by the sound of a bell would be a (CS) ● Conditioned response(CR): learned response to an environmental stimulus(CS) - Search classical conditioning examples to be able to label for exam Antecedents: - Unconditioned stimulus - Conditioned stimulus Behaviours - Unconditioned response - Conditioned response Terminology ● Elicits: brings about ● Stimulus: anything in the environment that (a) we can detect, (b) is measurable, and (c) can evoke a response or behaviour. ● Association: a relationship between two stimuli - Connect unconditioned stimulus and conditioned stimulus. ● Acquisition: time while an association is being learned. Behaviour-Event learning: ● E.L Thorndike’s Law of Effect - If the presence of a stimulus, is followed by a satisfying state of affairs, the bond between stimulus and response will be strengthened - Satisfaction = stamping in - Discomfort = stamping out - Ex: if something good happens we’re going to make a stronger link between the stimulus and response. ● B.F. Skinner’s free operant procedure - Unlike Thorndike’s puzzle boxes which need to be reset each trial, Skinner’s operant boxes allowed for continuous, ongoing trials. ● Operant(instrumental) conditioning: learning that is controlled by the consequence of the organism's behaviour. - Classical is focusing in the moment - Operant is focused on the future, consequences drive future learning. Key terms ● Antecedent: something detectable in the environment that sets the occasion to respond. ● Behaviour: activity that can be repeated, measured, and has an impact on the environment ● Consequences: stimuli or events that can increase or decrease the probability of future behaviour Reinforcement Contingencies: ● Reinforcement: increase the frequency of desirable behaviours, more likely to occur in the future. - In order to call it reinforcement there needs to be an increase in good future behaviour. ● Positive reinforcement: Applies stimulus: giving something good in return for the desired behaviour to continue to increase in the future. - EX: giving a dog a treat so they can learn how to sit. The more they respond, the more treats you’ll give them. ● Negative reinforcement: Removes stimulus: taking away something bad to gain desired behaviour. - Ex: take away headaches(A)--> take medication(B) your pain goes away(C). In the future you’ll continue to take medication when you have a headache because you realize it removes the undesired stimulus. The consequence is the decrease in pain. 1. Find behaviour 2. Find consequence ● Punishment: decreases the frequency of undesirable behaviour ● Positive punishment: Applies stimulus, focus on the consequence of exposure not the intention. - EX: yelling at a child and they stop their undesirable behaviour and it eventually decreases in the future. If you yell at a child and their behaviour continues and increases in the future then it becomes positive reinforcement. ● Negative punishment: removes stimulus: taking something away will lead to a decrease in behaviour. - EX: putting a child in time out by taking away their screen time, over time their undesirable behaviour will decrease because they know the consequence will be taking away something enjoyable. To know the difference note: are we adding a consequence or are we taking away a consequence? - Did the behaviour increase or decrease? Operant vs. Classical ● Operant behaviours: controlled or influenced by their consequences. ● Operant conditioning: involves the manipulation of consequences. ● Focuses on behaviour and consequences - Behaviour is more or less likely to happen in the future based on consequences that follow when it happens presently. ● Classical behaviors: controlled(elicited) by antecedent stimuli, mostly automatic… ● Classical conditioning: involves the manipulation of antecedent stimuli. ● Focuses on antecedent and behavior: manipulate stimulus to control behaviour in the moment. Social learning ● A. Bandura: studied kindergarten students to establish observational learning. ● Social(observational) learning: we understand what to do by watching others. ● Vicarious conditioning: occurs by an organism watching another organism(a model) be conditioned ● Bobo doll: children acted the same way they saw adults who were being praised. The unconditioned stimulus Can be classified as: ● Appetitive: a stimulus the animal finds pleasant - Ex; food, play.. ● Aversive: a stimulus the animal finds unpleasant - Ex: loud sounds, darkness.. A good unconditioned stimulus ● To be effective, the unconditioned stimulus should elicit a strong bodily response - Ex: pain, drugs, loud noise… ● The more intense the unconditioned stimulus, the easier to produce a conditioned response - There is a limit The acquisition process: Conditioned stimulus + unconditioned stimulus —> elicits unconditioned response Measuring the respondent behavior ● Latency of the conditioned response - The interval of time between presentation of the CS and occurrence of the CR ● Intensity of the conditioned response - Conditioned responses tend to get stronger as conditioning proceeds. ● Test or probe trials - Present the conditioned stimulus alone( with no US) Higher order conditioning US + CS → elicits UR and CR same response different stimulus Cs + CS2 → elicits CR Nature of the NS and US - The more intense the unconditioned stimulus, the easier to produce a conditioned response - The intensity of neutral stimulus is also important, needs to be noticeable - Higher intensity = more salient(more important) - NS-US relevance(belonginess): do the CS and US “go together” naturally? ● Stimulus features” physical characteristics affect the pace of conditioning - Overshadowing: when a compound stimulus is used as a CS, but only a particular element of that compound(typically the more intense stimulus) is able to elicit a CR. - Overshadowing: When two or more stimuli are presented together during classical conditioning, the more salient or intense stimulus produces a stronger, dominant response, hindering or "overshadowing" learning of the weaker stimulus - Ex: A trainer uses a bright light (visual) and a quiet whistle (auditory) simultaneously to signal food. The dog associates the light with food but ignores the whistle because the light is more salient. The light overshadows the whistle. ● 2 feature compound stimulus - Ex: neutral stimulus: bell and light, can combine them together to get a CR and then can test them out separately to see which one elicits the CR. Therefore it overshadows because of salience or environmental factors. Temporal relationship ● Short-delayed conditioning: CS presentation alone, but Us overlaps shortly after onset. Usually the most effective conditioning procedure. ● Long-delayed conditioning: CS and US overlap, but CS is on for a longer time. CS becomes an imprecise predictor of the US. ● Trace conditioning: No overlap between CS and US, temporal contiguity matters. Important for judging strength of association ● Simultaneous conditioning: CS and US onset is at the same time. Less common in the real world very rare, less effective than delayed and trace conditioning ● Backward conditioning: US occurs before CS, results are inconsistent Can also apply to time between pairings - Ex: how long between one NS+US exposure and the next NS+US exposure - Interval-interval: interval between one CS-US exposure(a trial) and another CS-US exposure( a different trial) - can vary from seconds to years - in general, longer intervals are better than short intervals Contingency between the NS and the US means that the NS and US co-occur reliably - NS doesn’t happen without the US following it - US doesn't happen without the NS having first occurred ● Contiguity: events are close together in time and space ● Contingency: rule sets, what rules exists Number of pairings: more pairings of the NS and US usually forms a stronger association - Though first pairing produces the strongest learning effect ● Roscorla-Wagner Model - Change in V = trial-by-trial change in associative learning strength of US(ex; learning) - K = constant related to salience of US - Upside down v = maximum possible associative strength of US(what occurs) - V = current associative strength of US(what is expected) - Illustrates: fast learning at the beginning and beings slower movements as we go on Conditioned taste aversion(CTA) ● Taste aversions (and preferences) are learned ● Eat a (novel) food → aversive consequence - Ex: food poisoning ● Can occur with just one pairing (single trial) ● Can occur even if illness occurs hours later Previous experience ● Latent inhibition: once you learn that the stimulus is associated with nothing, you’ve learned it's linked to nothing. So you’’l be less likely to learn it connects to some relevant stimulus once you’re exposed to it again later - Harder for conditioned stimulus to form because of our pre-exposure to it - Pre-exposure blocks the new learning you are trying to form ● Blocking: failure of a stimulus to become a CS when it's part of a compound stimulus that includes an already effective CS. - Blocking because of our previous knowledge of stimulus, maximum learning has already occurred - Ex: early training, try to modify previous knowledge ● Sensory preconditioning: two neutral stimuli (a&B) occur together - One of those stimuli (B) is conditioned to become a CS - When A is presented alone, it too will elicit the same CR as B. - Original pre-association of our two neutral stimuli, we link them together even though we don’t have any associated responses. - Ex: a food aversion to one will give u a food aversion to another food because you always ate it together. - Ex: A person consumes a dish with two new, mild flavors (e.g., lemongrass and cumin) together, creating an initial association. Later, one of those flavors (e.g., lemongrass) is paired with a strong, satisfying food (unconditioned stimulus). The person may develop a preference for the other flavor (cumin) as well, even though they only ate it with the now-liked flavor. ● Conditioned emotional responses: an emotional response to a stimulus that is acquired through respondent conditioning. Differences: Overshadowing: “One stimulus is louder than the other.” Latent inhibition: “I’ve seen this before—it means nothing.” Blocking: “I already know what predicts this.” Feature Overshadowing Prior experience matters? ❌ Multiple stimuli involved? Latent Inhibition Blocking ✔ ✔ ✔ (same time) ❌ ✔ Main factor Salience Familiarity Predictability Learning fails because… One cue dominates Cue seems irrelevant No new info added Operant conditioning: learning that is controlled by the consequence of the organism's behaviour - look ahead ● Reinforcement: process in which a behavior is strengthened by the immediate consequence that reliably follows its occurrence - Strengthened = more likely to occur again in the future ● Reinforcer: the consequence itself ● Occurrence of a behaviour (response) → immediate consequence(reinforcer) → result = strengthen the behaviour (more likely to occur again in the future) ● Positive reinforcement: Occurrence of a behaviour (response) → immediate consequence produce an appetitive stimulus → result = strengthen the behaviour (more likely to occur again in the future) ● Negative reinforcement: Occurrence of a behaviour (response) → immediate consequence Eliminate/prevent an aversive stimulus→ result = strengthen the behaviour (more likely to occur again in the future) ● Thorndike’s Law of Effect: if response in presence of stimulus is followed by a satisfying event, the association between S and R is strengthened. - If a response is followed by an annoying event, association is weakened. ● Operant learning: a change in a behaviour as a function of the consequence that followed it. ● Operant behaviour: a behaviour that is strengthened through the process of reinforcement - Aka operant response; instrumental behavior - Acts on the environment to produce a consequence Is the behaviour strengthened Do we observe: - Increase in frequency - Increase in duration - Increase in intensity - Increase in speed(decrease in latency) Escape and avoidance ● Escape behaviour: when operant behaviour increases by removing an ongoing event or stimulus. - Ex: pressing lever to stop a electric shock - Ex: have a headache(antecedent) so you take medication(behaviour) as a result you feel better(consequence), the aversive stimulus decreases. As a result you’ll be more likely to take the medication in the future for a headache, you escaped uncomfortable stimulus. Same to normal negative reinforcement. ● Avoidance behaviour: when operant behaviour increases by preventing the onset of the event or stimulus - Only can happen if you had some sort of experience so you can avoid it in the future. Also counts as negative reinforcement, removing behaviour before it happens to avoid it, for ex I take medication before a certain event because I know I would get a headache later. Examining operant behaviour ● Discrete trial procedure - instrumental response produced per trial - Each trial ends with removal of the animal from the apparatus - Similar to Thorindike, you reset trial ● Free-operant procedure - Animals remain in apparatus( specific equipment) and can make many responses - No intervention by the experiment, developed by BF Skinner. Can run continuously having multiple trials without restarting. ● Cumulative record: based on old cumulative recorder device(1957) - Constant paper output, pen jumps with each - Plot of cumulative response (y-axis) over time (x-axis) Two types of reinforcer 1. Unconditional(primary) reinforcer: a reinforcer that acquired its properties as a function of species evolutionary history - Ex: food.. - Biologically relevant function, primary to survival - Species specific 2. Conditional(secondary) reinforcer: otherwise neutral stimuli or events that have acquired the ability to reinforce due to contingent relationship with other, typically unconditional reinforcers. - As long as there is some aspect of learning to acquire that value it becomes conditioned or secondary reinforcer. Variables affecting reinforcement ● Immediacy: a stimulus is more effective as a reinforcer when it is delivered immediately after the behavior ● Specific reinforcer used - Your current state might influence how desirable something is. ● Task characteristics: reinforce a pigeon pecking for food vs hawk pecking for food ● Contingency: a stimulus is more effective as a reinforcer when it is delivered contingent on the behavior. - The degree of correlation between a behaviour and its consequence. ● Contiguity: nearness of events in time(temporal contiguity) or space(spatial contiguity) - High contiguity often referred to as “pairing” - Less contiguity(longer delays) between the operant response and the reinforcer, diminishes the effectiveness of the reinforcer ● Motivating operations: establishing operations make a stimulus more effective as a reinforcer at a particular time - Ex: deprivation ● Abolishing operations make a stimulus less potent as a reinforce at a particular time - ex: satitaion: feeling full ● Reinforcer magnitude: generally a more intense stimulus is a more effective reinforcer - Relationship between size and effectiveness is not linear ● Schedule of reinforcement: a rule of the describing the delivery of reinforcement - Schedule effect:particular pattern and rate of behaviour over time - Over the long term, effects are very predictable - Occur in numerous species (including humans) ● Continuous reinforcement(CRF) schedule: behaviour is reinforced each time it occurs - Rate of behavior increases rapidly, useful when shaping new behaviour - Rare in the natural environment ● Intermittent reinforcement schedule: 4 main types: - Fixed ratio(FR), are the number of actions fixed or vary across time? - Generates post-reinforcement pause(PRP), pausing technically increases with ratio size and reinforcer magnitude. Faster you respond faster is called ‘run rate’ - ex: FR-120 - Variable-ratio(VR), do we care about the number of actions taken? - Ratio-requirment varies around an average, ex: VR-360 - PRP are very rare and short - Fixed-interval(FI), do we care about the amount of time that elapsed(passed)? - Behaviour is reinforced when it occurs after a given period of time -Produce PRP - Variable-interval(VI) - variable amount of time that has to elapse before the next response is reinforced - PRP are rare and short Be able to draw and differentiate between them - Ratio: rate of responding is the important part, steeper slopes - Interval: there is still a response after a specific amount of time has passed, time needs to pass, then a response needs to be made, and then it could be called reinforcement. Antecedents ● Controlling stimulus(S): a stimulus that changes the probability of an operant behavior - More intentional - Influencing the likelihood of a behaviour occurring - Setting a stage for us to be able to make responses ● Discriminative stimulus(S^D): a stimulus or event that precedes an operant and sets the occasion for its reinforcement. (occasion setter) - When it is present, if you make a particular response this specific consequence will occur - Therefore we are more likely to make this response in the presence of this discriminative stimulus ● Extinction stimulus(S delta): a stimulus or event that precedes an operant and sets the occasion for its non-reinforcement - You can still respond but nothing is going to happen - Make a response and no consequence follows Competing contingencies: different rule sets that are placed at the same time - Should I watch youtube or study ● Premack principle: in nature, different behaviours have different probabilities of occurring - L → H, reinforces L, H probability behaviour reinforces L probability behaviour because you need to do more L in order to get to H - H → L, does not reinforce H - H = high probability response - L = low probability response - Ex: eating → high probability; lever pressing → low probability - Anything can become a reinforcer even if it’s not desirable How to test Premack Principle 1. Figure out which behaviours are low and high probability - Less likely to occur is L 2. Instrumental conditioning procedure with: - L → H - H → L ● Implications: Any high probability response can serve as a reinforcer for a lower probability response - Any behaviour can serve as a reinforcer ● High probability behaviour reinforcer low probability behaviour - Ex: if a child prefers playing pinball to eating candy, you can reinforce eating candy by letting them play pinball each time they eat some candy ● Problems: - doesn’t nicely account for conditional reinforcement effects - Low probability behaviour can reinforce high probability behaviour when the organism has been deprived of the low probability behaviour. Telling controlling stimuli apart from other concepts ● Establishing operation: makes a stimulus more effective as a reinforcer at a particular time - Ex: deprivation - Modifying the effectiveness of our consequence, making us more likely to engage in that behaviour ● Discriminative stimulus: a stimulus present when a behaviour is reinforced - Ex: cue light - Antecedent is present in the environment and when it is present we are more likely to engage in that behaviour because we’ve learned from previous stimuli that when you make a response a particular consequence will follow. ● Both make a behaviour more likely to occur in the moment - Discriminative: happening because stimuli is present - Establishing: having to modify ● Abolishing operation: makes a stimulus less potent as a reinforce at a particular time - Ex: satiation - Make it less reinforcing, therefore they are less motivated to engage in a behvaiour that would get them that reinforcer ● Extinction stimulus: a stimulus present when a behavior is not reinforced - Ex: No cue light ● Both make a new behaviour less likely to occur in the moment Antecedents: include establishing and abolishing operation, as well as control stimuli - They evoke a behavior, more intentional, come before behavior - They alter the current probability of a behavior VS Consequences: include reinforcers and punishers - They strengthen or weaken a behaviour - They alter the future probability of a behavior ● Discrimination occurs when the presence (or absence) of stimuli is the occasion on which a response will be followed by reinforcement - Be able to tell the difference between them in order to be able to treat them differently - Note: “setting the occasion for reinforcement” is a description of an environmental contingency - Refers to the effect an occasion setting contingency has on behaviour Learning to discriminate - - rats(n = 8) median rate of lever pressing in the presence and absence of light across training sessions Light = S^D - No light = S delta ● Stimulus control: a change in operant behaviour that occurs when either S^D or S^delta is presented Learning terminology: ● “Light colour” is functioning as a discriminative stimulus ● “The pigeon” is discriminating between the two situations ● “The light has acquired stimulus control over the pigeon’s behaviour ● The light is controlling the pigeons behaviour ● The pigeon is responding differentially (ex: making a differential response) ● Discrimination index (ID): a measure of the stimulus control exerted by an S^D or S^delta - aka : discrimination ratio - ID = S^D rate / (S^D rate + S^delta rate) - S^D rate = rate of responding during S^D - S^delta rate = rate of responding during S^delta - Lower than 0.5, responding more in the presence of extinction stimulus than to the discriminative stimulus - Can describe if discriminating more to S^D or more to S^delta Stimulus generalization ● Generalization and discrimination refer to the precision of stimulus control ● Discrimination is precise control - Can tell apart, only respond to some stuff ● Generalization is less precise control - Respond to everything ● Generalization is obtained by training in a wide array of settings/stimuli - Treating stuff the same Generalization gradients - The higher the peak the more discrimination occurs - The flatter the curve, there is more generalization - Generalization: similar response to a similar stimulus ● Stimulus generalization 1. Process where once a CS been established, similar stimuli may also produce a CR 2. Process where once an operant response occurs to one discriminative stimulus, it also occurs to other similar stimuli. - Try and have a behaviour trained under certain conditions, so a particular response is in the presence of specific stimuli. ● Stimulus discrimination 1. Process where we exhibit less pronounced CR to CSs that differ from the original CS - CR occurs to CS but not to another stimulus 2. Process where less responding occurs to stimuli that are different from the original trained stimulus - Operant response to trained stimuli but not others Concept formation ● Ex: teaching pigeons the "concept" of humans - Discriminate between categories, and generalize within a category ● Concept formation is: 1. The generalization within classes of stimuli; and 2. The discrimination between classes stimuli ● Generalization in practice: generalization has occurred when the target behaviour occurs in situations other than the specific training conditions - Ideally it involves having the target behaviour occur in all relevant situations. - We can say it's generalized once the behavior is happening in other different scenarios as well. Generalization is important ● The real world unlikely to exactly match the controlling stimuli from training ● Training typically occurs in one place - Ex: therapist office, classroom ● Training typically involves a narrow range of stimuli - Ex: use manners with your parents Strategies to promote generalization ● ● ● ● ● Reinforce occurrence of generalization Reinforce instances of generalization The training setting and the criterion setting should be quite similar The training and criterion should gradually become more dissimilar. Train skills that contact naturally occurring contingencies of reinforcement: - Must analyze the natural contingencies at the outset of behaviour modification - Train skills that have their own naturally occurring reinforcers - If the particular skills have no naturally occurring reinforcers then train the learner to solicit reinforcement. ● Modifying contingencies of reinforcement and punishment in the natural environment: - Requires control over the natural environment ● Incorporate a variety of relevant stimulus situations in training: - Sample all relevant S^Ds and S^deltas for the target behaviour - Stimulus exemplar: stimuli that represent the range of relevant stimulus situations in which the response should occur after training ● Incorporate common stimuli: from real world (criterion/target) setting into training setting - Ex: make the two different contexts similar ● Train a range of functionally equivalent responses - Different S^ds may require different responses to obtain the same reinforcer - General case programing - Knowing that you can vary those responses can be part of what you’re training ● Providing cues in the natural setting: - May include people or aspects of the physical environment - Useful if irrelevant aspects of the training scenario are controlling the behaviour ● Incorporating self-generated mediators of generalization - Self-recrosing - Self-instruction Punishment leading to a decrease in instrumental response ● Punishment: occurrence of a behavior is followed by an immediate consequence that results in weakening of the behaviour - The procedure ● Punisher: the consequence being delivered contingent upon the behaviour - Any event or stimulus that follows an operant response and decrease its future portability Effect of consequences - Reinforce: increase behavior - Punish: decrease behaviour ● Positive punishment: adding something aversive after a behaviour occurs decrease likelihood of that behavior under the same conditions in the future - This aversive stimulus is delivered contingent upon the behaviour. When the behaviour occurs it causes this consequence to follow - Results in the suppression or decrease of a response ● Negative punishment: removing something appetitive after a behaviour occurs decreases likelihood of that behaviour under the same conditions in the future - Results in the suppression or decrease of a response ● Positive punisher: any event or stimuli that, when presented as a consequence of a behaviour, decreases the future probability of that behaviour - Consequence thats being delivered because punisher ● Negative punisher: any event or stimuli that, when removed as a consequence of a behaviour, decreases the future probability of that behaviour - Tell difference between all 4 punishment and punishers - Punishers are defined by their effect on behavior - if it doesn’t decrease the behaviour it’s not a punisher - Punishers are things we will escape or avoid given the opportunity - when using punishment, need to account for these escape and avoidance tendencies. Premack principle for reinforcement ● If the low-probability behavior must be completed in order to get to perform the high-probability behaviour, then the low-probability behavior will be more likely to occur as time goes on. - Ex: piano(low-prob) → Coffee(high-prob) = High-prob for piano - Low-probability does not reinforce high-probability Premack principle for punishment ● Low-probability behaviour punishes high-probability behaviour ● If the low probability behaviour must be completed if the high-probability behaviour has occurred, then the high-probability behaviour will be less likely to occur as time goes on - Ex: coffee(high-prob) → piano(low-prob) = low-prob coffee ● High-probability does not punish low-probability - Differ between non-premack specific Variables affecting punishment ● Contingency: the degree of correlation between a behaviour and its consequence - If the behaviour occurs, the punisher always follows - The punisher only occurs after the behaviour ● High-contingency behaviour and punisher have a predictive association(strong learning) ● Low-contingency = weak association between behavior and punisher (weak/slow learning) ● Contiguity: nearness of events in time (temporal contiguity) or space (spatial contiguity) - If the behaviour occurs, the punisher should be delivered immediately and in the same location ● The longer the delay or larger the distance between the behaviour and the punisher (less contiguity), the slower the learning ● Intensity: magnitude or severity of a punisher - More intense punishers produce stronger learning ● Introductory intensity of punishment matters - If the punishment is to be used, it must be intense enough to suppress the behaviour dramatically ● Risk of not using intense punishers: - Behaviour does Not get suppressed - More instances of punishment are required - Greater intensities end up being required ● Effectiveness of reinforcers maintaining a behaviour influence effectiveness of punisher - Behaviours do not occur in isolation - Magnitude of the punishment needs to be sufficient in order to overcome the reinforcer that is maintaining it. - Providing other means of obtaining reinforcement that maintained a behaviour will suppress the behaviour more effectively than not providing one - Behaviour decreases more rapidly - Punishment may not be necessary Cumulative record of responding - No punishment: behaviour will continue - Punishment, no alternative response available: behaviour will continue but not as fast or as much as when there’s no punishment - Punishment, alternative response available: behaviour drops more dramatically Motivating operations affect punishment - Establishing operations make a punisher more effective - Abolishing operations make a punisher less effective Aversive contingencies Positive punishment: Overcorrection ● Contingent on the problem behaviour, individual has to engage in effortful behaviour related to the problem behaviour ● Positive practice: Just do the correct form of a behaviour for a period of time ● Restitution: must fix the environment distributed by the problem behaviour Contingent exercise ● Contingent on the problem behaviour, the individual engages in some effortful behaviour for a specified period of time ● The effortful behaviour is unrelated to the problem behavior - Ex: if not listening, do 10 push ups Guided compliance ● Contingent on the problem behaviour that occurs following a request, the individual is physically guided to comply with the request ● Positively punishes non-compliance ● Negatively reinforces compliance ● Positive reinforcement of compliance is easily incorporated Physical restraint ● Contingent on the problem behaviour, the body part involved in the behaviour is held immobile for a specified period of time ● Response blocking: physically stopping a behavior - Can prevent problems generated by the behaviour - May prevent the behaviour from being reinforced. Negative punishment: have appetitive stimulus, but take it away which makes it negative punishment Time out from positive reinforcement ● Behaviour results in loss of access to a positive reinforcer that is maintaining that behavior ● Exclusionary: completely removed from the location ● Nonexclusionary: prevented from participating, but still in the location ● If behaviour has successfully decreased, then we know it has worked. But if the behaviour continues or gets worse then it might not have been punishing Response cost ● Contingent on a problem behaviour occurring, a specified amount of reinforcer is removed - If you engage in the problem behaviour, then this amount of a thing will be taken away - Ex: swear jar ● Conditioned reinforcers helpful to provide immediate consequence when there is a delay in delivery of punisher Negative reinforcement Escape learning ● When an operant changes the environment from a situation where a negative reinforcer(aversive stimulus) is present to one where it is absent ● Compatibility with reflexive unconditioned responses affects how quickly a response occurs - Conditioning escapes easiest when operant is similar to the reflexive (UR) behaviour elicited by the aversive stimulus. - We want a match between the type of response that would be elicited and the type of automatic reflexive behaviour that would be coming about when this painful stimulus starts Avoidance learning ● When an operant prevents the occurrence of an aversive stimulus - Need to have a reliable stimulus in the environment(an antecedent) that warns of upcoming delivery of the aversive stimulus ● Escape responses are typically learned faster than avoidance responses - Must be experiencing aversive stimulus in order to make a response to make it stop Learned helplessness ● When an inescapable aversive situation is repeatedly encountered, individuals learn that it cannot be escaped and stop trying ● Come to believe that they are unable to influence the situation, they are helpless ● Model for depression and anxiety - Lack of new learning because your previous experiences that no response is going to help you alleviate this aversive situation Overcome learned helplessness ● Treatment: - Create new situation in which failure of avoidance is not possible ● Prevention: - Pre-exposure to escape and avoidance contingencies can block the learned helplessness brought on by inescapable aversive events Concerns and considerations with punishment Punishment can be reinforcing ● Someone who successfully uses punishment to reduce the occurrence of an undesired behaviour is negatively reinforced by the removal of that aversive behaviour and is therefore more likely to engage in that behaviour in the future ● Can also lead to imitation or modelling in the individual being punished ● People who are punished are more likely to use the same actions, Ex: child being yelled at home then yells at school because they see how effective yelling is. Avoiding and escaping punishment ● Punishment can induce escape and avoidance behaviour like lying, hiding, learning when it’s safe to engage in the behaviour without being caught, avoiding the individual delving the punishment ● Aggression can also be a form of escape - Lash out when being punished - Ex: crying stops parents from yelling at you.. - Learning when it’s safe to engage in behaviour to avoid certain consequences and getting caught, which turn into antecedents that let us know when it’s safe or not safe to make those responses. Alternative behaviours ● Punishment alone doesn’t teach acceptable behaviours that could be done instead - Punishment only decreases behaviour - Acceptable behaviors still need to be reinforced ● If no alternative behaviours are reinforced the organism may just ‘do nothing’ at all and exhibit a malaise or apathy Punishment as a last resort ● Use functional interventions first ● Differential reinforcement with punishment ● Consider the function of the problem behaviour ● Choose the aversive stimulus with care ● Collect data to make treatment decisions ● Address the ethical considerations of punishment Effective punishment ● Do not delay punishment ● Use consistent contingency and intensity - Intense enough to stop behavior ● Explain punishment (especially if delayed) ● Negative punishment is preferable - Way better to take away some appetitive stimulus than to deliver something aversive ● Provide alternatives for reinforcement - Consistent contingency and intensity Ethics of punishment ● Informed consent ● Alternative treatments ● Recipient safety ● Problem severity ● Implementation guidelines ● Training and supervision ● Peer review - - Punishment is our last resort Ethical issues we have to be cautious about Extinction ● Operant extinction: the procedure of withholding reinforcers that maintain a behaviour - In the past doing this behaviour in this situation has led to this specific consequence but now it is no longer going to result in this specific consequence - Changing contingencies, so engaging in the behaviour no longer results in getting that consequence. ● Classical (respondent) extinction: the procedure of presenting the conditioned stimulus without the unconditioned stimulus - Ring the bell without giving the dog food over and over again - Therefore we should see a decrease in our conditioned response, because of the change in our rule sets - Extinction stimulus is like a modifier, while extinction in general is using the same scenario and same behaviour but changing the rules. - Changing the contingencies and full rule set is extinction Negative punishment: if you engage in the behaviour, the consequence is the removal of the reinforcement Operant extinction - The steeper the slope shows how quickly the response is because behaviour is being reinforced - Less steep slopes, slower rate of responding, goes flat meaning they are no longer responding, Extinction occurs because we are changing the rules so there is no longer a reinforcer so behaviour less likely to occur across time 1. A behavior that has been previously reinforced 2. Is no longer followed by the reinforcing consequences 3. And as a result, the behaviour is weakened(decreases, or stops occurring) in the future - We have a need contingency: A and B stay the same, but the C has changed - We are not actively taking something away in the moment, we’ve just changed the rules so they don’t expect a reinforcer ● Extinction for a positively reinforced behavior involves no longer delivering the positive reinforcer - Ex: no longer getting attention for crying - Rule that used to exist, and new rule set that says there should be no consequence, no reinforcer that follows the behaviour ● Extinction of a negatively reinforced behaviour no longer removing the aversive stimulus - No longer allowing them to do this negative reinforcement - Ex: no longer getting out of eating vegetables when you cry - Double negatives - Ex: if a kid cries they get to stop doing their homework, we are going to stop letting them stop doing their homework, so force them to keep doing their homework, no longer removing aversive stimulus so they have to continue with their homework performance. Classical (respondent) extinction - - How much suppression happens which means how much freezing occurs 0.5: equal amounts of movements before and after the tone, so no suppression - Separating CS and US eventually start seeing a reduced conditioned response 1. A conditioned stimulus that has been previously paired with an unconditioned stimulus and produces a conditioned response - Our tone has been trained up as a CS by pairing it with the US of that shock 2. Is no longer followed by the Unconditioned stimulus 3. And as a result, the conditioned response is weakened (decreases, or stops occurring) Properties of operant extinctions ● Extinction burst: increase in frequency, duration, and/or intensity of the unreinforced behaviour during the extinction process. - Ex: vending machines: once you don’t get the snack after putting in money, you’ll start pressing multiple buttons to get what you want. Frequency will increase, press buttons faster and harder, keep trying because you’re used to a specific consequence. - Incorrect application of the extinction procedure is actually a way of shaping undesired behaviours, basically you can make the behaviour worse without meaning to do so. Eventually after the extinction burst the behaviour will slowly decrease - Extinction burst at the beginning is specifically exclusive to operant extinction. ● Increase in operant variability: other behaviours are more likely to occur during extinction - Can be completely new behaviours, or different dimensions of existing behaviors ● Greater likelihood of reinstating reinforcement or contacting other sources of reinforcement ● Emotional responses: heightened emotional state during extinction can lead to aggression - A response used to lead to a particular consequences but does not any longer; violates expectations - Exclusive to operant conditioning ● Spontaneous recovery: the tendency for extinguished behaviour to occur again in situation the same as or similar to those where it had been previously reinforced - Can occur after a span of time elapsed - Re-acquisition of an extinguished behaviour occurs quicker than during initial training - We’re learning that the thing that used to be the case is just no longer happening Preventing spontaneous recovery ● Repeated sessions of extinction (usually in multiple settings) are required to prevent spontaneous recovery Resistance to extinction ● Partial reinforcement effect (PRE): schedules that reinforce more intermittently take longer to extinguish than schedules that reinforce less intermittently - If we want to protect behaviours and prevent extinction we would switch over to intermittent schedules of reinforcement ● Driven in large part by contact with the contingencies ● The occurrence of reinforcement following the initiation of extinction ● Reinforcement of functionally-equivalent behaviours Why chose extinction ● Extinction, like differential reinforcement and antecedent manipulation, is classified as functional and nonaversive ● Functional = based on functional assessment information - Alter antecedents and/or consequences identified in the functional assessment - Functional helps us determine how a system is working ● Nonaversive = doesn’t involve punishment procedures ● Punishment is our last resort so extinction would be attempted first if we can manage it Functional assessment process 1. Identify and define target behaviour(s) that needs to be increased and/or decreased - Indirect assessment (ex: interviews) 2. Initiate baseline date collection 3. Complete functional assessment - Hypothesize about antecedents and consequences 4. Develop and implement treatment 5. Evaluate - Effectiveness of treatment itself - Effectiveness of its implementation ● Manipulate antecedents and consequences (possible reinforcers) ● Observe changes in the behaviour ● Replicate Two types of Functional assessment - Exploratory: test a range of possible functions - Hypothesis testing: test hypothesis from descriptive assessment ● Was the treatment effective? - Did problem behaviors decrease and desirable behaviours increase? ● If yes then: first we check treatment fidelity - Was treatment implemented correctly? - If No: retrain staff, adjust components and/or procedures - If yes: return to step 3 Important considerations - Have you identified the reinforcer - Is it possible to eliminate the reinforcer? - Is it safe to use extinction? - Emotional responses - Extinction burst, can make it worse - Behavioral variability - - - Can you apply extinction consistently Can you prevent reinforcement every time the behaviour occurs? Do you have the procedures to promote generalization and maintenance. Categories of reinforcement ● Mediated by the actions of others: - Social positive reinforcement - Social negative reinforcement ● Not mediated by others - Automatic positive reinforcement - Automatic negative reinforcement Consider schedule of reinforcement ● How was the problem behaviour being maintained - Continuous reinforcement is more prone to extinction - Intermittent reinforcement is more resistant to extinction ● Same logic applies to schedule of extinction - Continuous extinction most effective - Early on we should use continuous reinforcement because it’s great for fast learning, if every single behavior is followed by a consequence it’s going to lead to really fast learning. - Early on we want our continuous then will switch to intermittent which is good for maintenance because it helps build resistance to extinction, so if you want a behaviour to be resistant to extinction we want that pattern. Reinforce alternative behaviours ● Stopping one problem behaviour in isolation is not very effective. Just like punishing a problem behaviour, putting one through extinction can only tell the individual what not to do. ● Incorporate reinforcement of alternative behaviours to encourage shift of behavior to more desirable actions - Ex: we are not going to punish a child for drawing on the walls instead give them zero attention for it, but redirect them and give them attention for colouring in a colouring book, giving them that reinforcer for some new acceptable behaviour: - Decrease in problem behaviour through extinction and increase in desired alternative through reinforcement. Side by side these should shift behaviour more rapidly than by just putting it through extinction. ● Generalization: shift in behaviour, decreasing problem behaviour in multiple environments - Have extinction affect the behaviour in multiple locations and situations - Use extinction in all relevant circumstances - Have all people who are enacting treatment(relevant agents) use extinction all the time - People in charge of delving treatment are (change agents) - Continue to use extinction over time long after the problem behaviour has decreased. Change agents - Problems with acceptability - Importance of a good rationale - Getting buy-in - Modeling extinction Need to address - What should the change agent do if they do not have control over the reinforcer? - How should a change agent respond to a problem behaviour with multiple reinforcing stimuli? - Describe criteria for assuring that success is achieved during extinction - What does it mean to make sure an extinction burst is tolerable? Overestimate how bad it could be - What should a change agent do to prepare for an extinction burst? - Is extinction possible with self-injurious behavior? Concerns and considerations - Must be able to identify reinforcer for problem behaviour, step 1 is always figure out what is driving this behaviour - Variety of stimuli may reinforce problem behaviour - Reinforcers differ person-to-person - Automatic reinforcement presents a challenge - Extinction may cause harm to change agent or learner, so cannot always be applied Differential reinforcement: two or more different ways of having some other contingency apply ● An operant training procedure in which some behaviours are systematically reinforced and others are not ● Basically reinforcement and extinction together - Though in practice, can have punishment rather than extinction Types of differential reinforcement Differential reinforcement of low rates of responding(DRL) ● Reinforcer is delivered contingent upon a low rate of responding during a certain period of time - Create a new rule set that says as long as you can do this behaviour within this limited number of times then we’re going to give you this reinforcer - The behaviour is reinforced only if it occurs no more than a set maximum number of times in a set time period ● Results in less of the behaviour, but not none - Only used if behavior can be tolerated in low levels Ex: on a road trip, a child will get ice-cream at the end if they don’t ask “are we there yet?” more than once an hour - If they exceed the limit, then no reinforcement ● Full-session DRL: reinforcement is delivered if fewer than our specified number of responses occur in a period of time ● Differential reinforcement of other behaviours (DRO) later will be similar, but require no responses to be made during the time period. ● Spaced-responding DRL: reinforcement delivered if the set amount of time passes between responses - Ex: child raises hand only after 15 minute passes - Low rates come because we force them to spread out when their responses are occurring. So both of them have the same overall outcome. Reinforcing behavior as long as it happens in small enough amounts ● If a behaviour is decreasing but not being eliminated helps indicate its a DRL procedure ● Interval DRL: session divided into time intervals and reinforcement delivered if behavior does not occur more than one per interval - Mix between full-session and spaced-responding Using DRL 1. Identify target behaviour 2. Evaluate if DRL is best procedure 3. Determine acceptable rate of the behaviour 4. Full-session or spaced-responing DRL - Does the rate of response matter? If so, spaced-responding DRL is a better option - If it’s only the total number of responses you care about, then full-session DRL is better - EX question: somebody is looking to decrease but not eliminate this specific behaviour, and we are really concerned about having spread out fairly consistent low rates of responding, what should we use? Spaced-responding DRL is a perfect fit in that scenario 5. One plan is set, inform the client 6. Implement treatment and provide feedback - Make it clear and transparent why or why not they are being reinforced Immediate indicators of why it’s DRL: - Useful for reducing, but not eliminating, rates of undesired behaviors - Longer intervals and lower thresholds produce lower rates of responding - Can start with less strict criteria and change over time - Concerns with superstitious behaviors - Reinforcement is delivered not contingent on the behaviour happening, but it's not happening. Ex question: once we’ve figured out what the acceptable maximum rate of responding should be, what comes next? Differential reinforcement of high rates of responding (DRH) ● Reinforcer is delivered contingent upon a high rate of responding during a certain period of time - The behaviour is reinforced only if it occurs at least a set minimum number of times in a set time period - Ex: getting a shy child to speak more, they have to raise their hand at least three times during class, set a minimum of three and once surpassed they get a treat - EX: a child will get ice cream at the end of the day if they answer at least two questions during class ● Looking to increase something that is not happening enough ● Results in more of the behaviour, so only useful to increase rates of desired behaviour ● Complete opposite of DRL Differential rate of reinforcement of other behaviors (DRO): ● Aka differential reinforcement of zero responding ● Reinforcer is delivered contingent upon the absence of the behaviour during a certain period of time ● Reinforced only occurs if the behaviour is absent in a set time period ● Decrease responding to zero, unlike DRL ● Useful if extinction isn’t possible ● DRL: decreasing but not eliminating because small amounts of the behaviour are still going to be reinforced. Lowered but not comely eliminated. Vs. DRO: none of this behavior can occur. ● EX: On a roadtrip a child will get ice-cream at the end if they don’t ask “are we there yet?” at all - If they make the response, no reinforcement ● Extinction of the underside behaviour - If it happens, no reinforcement delivered - Only applies if we’re able to withhold reinforcer ● Not reinforcing a specific “other behavior” - Reinforcement of the absence of the behaviour - However, will engage in other behaviors naturally if avoiding the undesired behaviour ● Can change interval length as behavior occurs less and less - Start with interval that works for the initial baseline of the behaviour - Frequent problem behaviour = short DRO interval - Infrequent problem behaviour = long DRO interval 1. Identify the target behavior 2. Evaluate if DRO is the best procedure 3. Determine effective reinforcer 4. Choose initial DRO interval 5. Once plan is set, inform the client 6. Implement treatment and provide feedback ● Implementing treatment will involve delivery of reinforcement when criteria are met. (behavior does not occur during set interval) ● Implementing treatment can involve extinction of original reinforcer of target behavior ● Gradually increase length of interval ● If you are doing literally anything other than the problem behaviour then we will reinforce you. Type of DRO ● Whole interval DRO: the problem must be absent for the whole interval of reinforcement (simply DRO) ● Momentary DRO: the problem must be absent at the end of the interval for reinforcement Differential reinforcement of alternative behaviour (DRA): ● Reinforcement is delivered contingent upon the occurrence of a desirable behaviour ● Occurrence of the undesired behavior is put on extinction - Reinforcement of wanted behaviour and extinction of unwanted behaviour 1. Identify target behaviors to increase and decrease 2. Evaluate if DRA is the best procedure 3. Determine effective reinforcer 4. Determine method of extinction (or devaluation) 5. Once plan is set, inform the client 6. Implement treatment and provide feedback Concurrent schedules of reinforcement - Two types of reinforcement that are going to run side by side A: ( child wants to colour and get attention) : B (colour on walls) → C: no reaction A: (child wants to colour and get attention) : B colour in coloring book → C: praise and attention - Extinction of first behavior, and positive reinforcement of desired alternative Is DRA appropriate? ● To use DRA, we need to be sure that we have a desirable behavior that we want to increase - That behavior needs to happen at least sometimes so that we can reinforce it. ● Can the undesirable behavior be extinguished? - Can we withhold the reinforcer that has maintained it in the past ● Desirable behavior should require less effort than the undesirable behaviour - Especially important if we can’t use extinction on undesirable behaviour Identifying effective reinforcers ● Could use the reinforcer maintaining the underside behaviour - Know that it is effective - Giving another behaviour that leads to that reinforcer can reduce occurrence of undesired behaviour ● Observe what the subject enjoys - High probability behaviors ● Can ask subject what they like Preference assessment Single stimulus assessment ● Potential reinforcers presented individually multiple times in random ordering ● On each exposure, record if stimulus was approached or not ● Percentage of approaches are calculated Paired stimulus assessment ● Potential reinforcers are presented in pairs ● Each stimulus is presented with every other stimulus multiple times ● Percentage of approaches/selections are calculated Multiple stimulus assessment without replacement ● Potential reinforcers are presented in a full array ● Items are removed as they are chosen ● Process is repeated with varied item orderings ● Items chosen first are likely more reinforcing Reinforcement of alternative behaviors ● Reinforcer desirable behaviour immediately and consistently - Contingency and contiguity are important ● If desirable behaviour is rare, can prompt to make the behavior more likely to occur - More occurrences of the behavior gives more encounters with the reinforcing contingency Prompting desired behaviour ● Prompt the desirable behavior before undesirable behavior occurs, not after. ● Prompt when EOs and S^Ds are present - Draw attention to presences of antecedents that should make the behaviour more likely to occur - Establishing operations (EOs) make reinforcer more appealing - S^Ds tell subject that if the behavior occurs, it will be reinforced Extinction or (devaluation) of undesirable behaviour - Identify reinforcers maintaining undesirable behaviour - Functional assessment, testing - If reinforcer can be withheld by change agent, use extinction as normal ● If reinforcer cannot be withheld, get creative - Increase effort required to complete undesirable behaviour - Use differential reinforcement of Low Rates of responding (DRL) to reduce the occurrence of the undesirable behaviour - Use differential reinforcement of other behaviour (RO) to eliminate the undesirable behaviour Maintenance and generalization ● Switch from continuous reinforcement during leaning to intermittent reinforcement for maintenance - Intermittent reinforcement schedules more resistant to extinction ● Generalization produces to help ensure the desirable behaviour occurs in all relevant situations and with all relevant agents DRA when problem behaviour is negatively reinforced ● Differential negative reinforcement of alternative behaviour (DNRA) - When reinforcement is the removal of an aversive stimulus (escape behaviour) A (child asked to do homework) : B (child cries, hits head on desk) → C (child escapes from homework) - Outcome: child is more likely to engage in undesirable behaviour when asked to do homework - Solution: use “escape from homework” as reinforcer ● Self-injurious behaviour(SIB): behaviour in which the subject causes harm to themselves - DRO: give them attention for how many times they don’t cause this behvaiour Variations of DRA ● Differential reinforcement of incompatible behavior (DRI) - Behaviour that is incompatible with the unwanted behavior is reinforced - Increasing rate of desired behaviour also decreases the rate of desired behaviour also decreases the rate of undesired behavior because the two cannot occur simultaneously - If a behavior is incompatible and DRI isn’t an option then DRA also works, still reinforcing an alternative. ● Differential reinforcement of communication (DRC): - A communication response delivers the reinforcer more rapidly than the problem behaviour \the communication response delivers the reinforcer more rapidly than the problem behavior - Also called "functional communication training” Summary: ● DRL: when you want to decrease but not necessarily eliminate target behaviour ● DRO: when you want to eliminate a problem behaviour ● DRA: when you want to increase the frequency of an existing desirable behaviour, also decreases problem behaviour ● DRH: when you want to increase a behaviour - What's the behaviour - What's the desired behavior - How are these alternative behaviors changing relative to one another - Can you adjust the scenario to make it a different case ● Remember that behaviors exist (are maintained) because they are reinforced, some behaviours are maintained by the presence of reinforcers ● Extinction and punishment are often insufficient without differential reinforcement training - If you decrease a behaviour, a new behaviour will take its place - Extinction and punishment do not teach new behaviours, they only decrease current ones, if used in isolation, not as effective. Shaping (AKA behavioral selection) ● Shaping: differential reinforcement of successive approximations of a target behaviour - A behavior that a person typically does not currently exhibit (novel behaviour, something we haven’t done before) - Reinstating a behavior that has previously occurred, but does not occur any longer - A change in dimension of an existing behaviour - Slowly change what gets reinforced Shaping procedure - Successive approximations are the steps between the starting behaviour and the target behaviour - Differential reinforcement refers to reinforcing approximations that get us closer to the target behaviour while not reinforcing behaviors that don’t - Previous approximations no longer reinforced (extinction) - Extinction for old behaviours no longer getting attention for them, more extreme behaviours getting attention is shaping and reinforcing the successive approximations. Start with it doesn’t happen and how did we get there 1. Define the target behaviour, figure out where you want to end, end goal - Is this a behavior that happens now? If yes then shaping can work. If no then we can have promoting a behavior to occur so we can shape it 2. Determine whether shaping is the most appropriate procedure - Does the behaviour occur already? 3. Identify the starting behavior - What behaviour are they capable of that is closest to the target behavior? (now) Behavioural “selection” ● Reinforcing certain variations in behavior that are closer to our goal than we are presently ● Reinforced variations are “selected” for - Become more likely to occur in the future ● Non-reinforced variations are “selected” against ● ● ● ● ● - Become less likely to occur in the future Natural selection: Artificial selection: humans are driving that selective pressure, what our preferences are, not genetics, instead of reinforcing the trait they choose the species that have them and breed them Behaviour is changed by the consequences they produce in the environment - Behaviour affects the environment; changes in the environment in turn affect the future behavior Simply, behaviors become more or less likely to occur in the future based on how well they work when we use them. Broken door knob example: turning key and turning handle won’t work - operant extinction - variation in key turning. More force, wiggle back and forth - variation in knob turning. More force, other direction - new behaviours, next time use the behaviour that worked last time not originally.. Rat pressing a lever example 1. Reinforce facing correct direction 2. Reinforce approaches to lever 3. Reinforce sniffing lever 4. Reinforce touching with paw 5. Reinforce full depression of the level - Only reinforcing towards one direction, select that behaviour and refine it towards our final goal. Important points - Approximations are not too big or too small - Use continuous reinforcement during acquisition, switch to intermittent for maintenance - Immediate reinforcement is best - Contingency and contiguity continue to be important - Small or continued reinforcers are often preferred. Because if not we will then see extinction.. - Prevents station; keeps focus on task - Skip ahead when possible - Go back when necessary, but we don’t want to, only needed if the subject is unable to encounter reinforcement by producing the next approximation. Marking the behaviour ● “Clickers” are used so that an immediate conditionally reinforcing consequence is provided - Aids learning by providing immediate reinforcement and preventing accidental reinforcement of other behaviours Shaping undesired behaviors - Unknowingly using differential reinforcement of successive approximations - - - Parents telling → yelling Crying → full temper tantrum Begging for/stealing food Chaining behvaiour - All of the components are all relevant when it comes to chaining process - Stimulus response chain ● A complex behaviour consistent of two or more component behaviors that occur together in a sequence - Each component of chain has S^D and a corresponding response to that S^D - Each response creates a new situation that functions as an S^D for the next response - Our discrimination is our antecedent to let us know that we should make a particular response - S^D1 → R1 - Sets stage for next response S^D2→R2 ● Unlike shaping where you discard earlier baby steps, chaining each step has to keep happening. - Keep bouncing back from A’s to B’s until get to C’s to end Task analysis: ● Breaking down a task into its component elements - Establishing the discriminative stimuli(S^D), response, and reinforcers ● Prior to chaining, subject must be capable of each component ● Revise as necessary (break down or combine steps, include shaping) Forward chaining 1. Reinforce performance of first component - repeat until behaviour is performed reliably 2. Reinforce performance of first two components - Repeat until behaviour is performed reliably 3. Continue until whole chain is completed before reinforcement delivered after terminal(end behavior) ● Requires reinforcement of each component which can be impractical ● Issues can arise because at first, step one is reinforced - Extinction of previously reinforced behaviour ● Prompting and fading may be needed to elicit new components. Backward chaining 1. Reinforce performance of last component - Repeat until behavior is performed reliably 2. Reinforcer performance if last two components 3. Continue until whole chain is completed before reinforcement delivered after terminal(end behavior) ● Opposite of forward chaining because start from end to beginning. ● Components are added from back-to-front - Avoid issues of extinction pointed out in forward chaining procedure Total task presentation ● Use promoting to get the learner to perform the whole chain from start to finish - Use graduated guidance ● Need to consider: - Task complexity - Learners ability - Teacher’s ability Types of prompts: - Written prompts - Picture prompts - Video modelling - Self-instructions Long-term considerations ● If a chain is too long responding may decrease over time due to - Weak conditional reinforcers - Weak terminal/primary reinforcers ● Potential remedies: - use a stronger terminal reinforcer - Shorten the chain - Highlight natural rewards the chain provides (if any) - Intermittently reinforce small actions of the chain
0
You can add this document to your study collection(s)
Sign in Available only to authorized usersYou can add this document to your saved list
Sign in Available only to authorized users(For complaints, use another form )