Schedules of Reinforcement
advertisement
ESSPED 5742 Agenda Q and As on last week’s lecture and readings 20-min in-class quiz 3 Application HW 1 revisit Lecture SD and MO Positive and Negative Reinforcement Schedules of Reinforcement ESSPED 5742 Schedules of Reinforcement ZIWEI XU Objectives ESSPED 5742 Compare and contrast definitions, applications, and advantages of 1) continuous schedule of reinforcement, 2) intermittent schedule of reinforcement, 3) extinction and generate novel examples of each Define four basic intermittent schedules of reinforcement and describe examples and effects of each Given a scenario, describe how to use schedules of reinforcement to produce behavior change ESSPED 5742 Schedule and Schedule of Reinforcement ESSPED 5742 Ahhhhhhhhh … Schedule and Schedule of Reinforcement ESSPED 5742 ESSPED 5742 Schedule and Schedule of Reinforcement Schedule of Reinforcement A rule that describes a contingency of reinforcement Contingency: environmental arrangements that determine conditions by which behaviors will produce reinforcement A rule that establishes the probability that a specific occurrence of a behavior will produce reinforcement https://www.youtube.com/ watch?v=LK8XOTQ01Mo ESSPED 5742 A Continuum of Schedule of Reinforcement Continuous Schedule of Reinforcement (Every response is reinforced.) Intermittent Schedule of Reinforcement (Some, selected responses are reinforced.) Extinction (No responses are reinforced.) ESSPED 5742 A Continuum of Schedule of Reinforcement Continuous Schedule of Reinforcement Intermittent Schedule of Reinforcement (Some, selected responses are reinforced.) Extinction (No responses are reinforced.) ESSPED 5742 A Continuum of Schedule of Reinforcement Continuous Schedule of Reinforcement Intermittent Schedule of Reinforcement Extinction (No responses are reinforced.) ESSPED 5742 A Continuum of Schedule of Reinforcement Continuous Schedule of Reinforcement Intermittent Schedule of Reinforcement Extinction ESSPED 5742 Continuous Schedule of Reinforcement Application Strengthen behavior, primarily during the initial stages of learning new behaviors The World’s Deepest Bin https://www.youtube.com/watch?v=qRgWttqFKu8 Teaching Matching https://www.youtube.com/watch?v=lUDSrX1HbJY (0:12-1:06) ESSPED 5742 Continuous Schedule of Reinforcement Limitations Behavior quickly degrades when the reinforcer is absent Behavior is unable to maintain or generalize in natural settings The reinforcer may lose its value (vulnerable to satiation) ESSPED 5742 Continuous Schedule of Reinforcement Limitations Behavior quickly degrades when the reinforcer is absent Behavior is unable to maintain or generalize in natural settings The reinforcer may lose its value (vulnerable to satiation) It may be difficult to detect and reinforce every response What if you are working with ten students at the same time? You are here! ESSPED 5742 Continuous Schedule of Reinforcement Limitations Behavior quickly degrades when the reinforcer is absent Behavior is unable to maintain or generalize in natural settings The reinforcer may lose its value (vulnerable to satiation) It may be difficult to detect and reinforce every response You may be broke… ESSPED 5742 Intermittent Schedule of Reinforcement Application Maintain established behavior ESSPED 5742 Intermittent Schedule of Reinforcement Application Maintain established behavior Progress to naturally occurring reinforcement ESSPED 5742 Intermittent Schedule of Reinforcement Application Maintain established behavior Progress to naturally occurring reinforcement Teaching Matching https://www.youtube.com/watch?v=lUDSrX1HbJY (1:10-1:56) ESSPED 5742 Intermittent Schedule of Reinforcement Advantages Behavior may persist for an extended period of time Facilitates maintenance The reinforcer may maintain its value (resistant to satiation) Some schedules can produce high levels of responding Instructors can use resources (i.e., attention, tangibles) efficiently Successful administration requires programming and planning!! ESSPED 5742 Extinction Application Decrease the frequency of behavior until it reaches a prereinforced level or ultimately ceases to occur To administer an extinction procedure, you have to know the function of the behavior Will be discussed in details next week ESSPED 5742 Question Time! A B C D ESSPED 5742 Question 1 Watch the video “Funny Bridge” https://www.youtube.com/watch?v=sWYFaPDHCqs The pedestrian’ response, taking a step on the bridge, was under which schedule of reinforcement? A. Continuous B. Intermittent C. Extinction D. I don’t know ESSPED 5742 Question 2 Watch the video “Knocking on the Door” https://www.youtube.com/watch?v=rKrh5uytRKY (0:08-0:21) The girl’s behavior, knocking on the door, was under which schedule of reinforcement? A. Continuous B. Intermittent C. I don’t know D. Extinction ESSPED 5742 Question 3 Watch the video “Knocking on the Door” https://www.youtube.com/watch?v=rKrh5uytRKY (0:31-0:45) The girl’s behavior, knocking on the door, was under which schedule of reinforcement? A. Continuous B. Intermittent C. I don’t know D. Extinction ESSPED 5742 Question 4 __________ schedule may lead to satiation. A. Continuous B. Intermittent C. I don’t know D. Extinction ESSPED 5742 Question 5 When we start teaching a new skill, we should use __________ schedule of reinforcement. A. Continuous B. Intermittent C. I don’t know D. Extinction ESSPED 5742 Question 6 When we start teaching a new skill, we should use continuous schedule of reinforcement. To maintain a new skill, we should use __________ schedule of reinforcement. A. Continuous B. Intermittent C. I don’t know D. Extinction ESSPED 5742 Basic Intermittent Schedules of Reinforcement Ratio and Interval Schedules Ratio schedules: requiring a number of responses before one response produces reinforcement ESSPED 5742 Basic Intermittent Schedules of Reinforcement Ratio and Interval Schedules Ratio schedules: requiring a number of responses before one response produces reinforcement The individual’s response rate determines the rate of reinforcement. ESSPED 5742 Basic Intermittent Schedules of Reinforcement Ratio and Interval Schedules Ratio schedules: requiring a number of responses before one response produces reinforcement Interval schedules: requiring an elapse of time before a response produces reinforcement The individual’s response rate determines the rate of reinforcement. ESSPED 5742 Basic Intermittent Schedules of Reinforcement Ratio and Interval Schedules Ratio schedules: requiring a number of responses before one response produces reinforcement Interval schedules: requiring an elapse of time before a response produces reinforcement The individual’s response rate determines the rate of reinforcement. The individual’s response rate does NOT determine the rate of reinforcement; the availability of reinforcement is time-controlled. ESSPED 5742 Basic Intermittent Schedules of Reinforcement Fixed and Variable Schedules Fixed schedules: the response requirement or the time requirement remains constant. ESSPED 5742 Basic Intermittent Schedules of Reinforcement Fixed and Variable Schedules Fixed schedules: the response requirement or the time requirement remains constant. ESSPED 5742 Basic Intermittent Schedules of Reinforcement Fixed and Variable Schedules Fixed schedules: the response requirement or the time requirement remains constant. Variable schedules: the response requirement or the time requirement varies. ESSPED 5742 Basic Intermittent Schedules of Reinforcement Fixed and Variable Schedules Fixed schedules: the response requirement or the time requirement remains constant. Variable schedules: the response requirement or the time requirement varies. ESSPED 5742 Basic Intermittent Schedules of Reinforcement Fixed Variable Ratio Fixed Ratio Reinforcement requires the completion of a constant number of responses Variable Ratio Reinforcement requires the completion of a variable number of responses Interval Fixed Interval Reinforcement is provided upon the first response following a fixed duration of time Variable Interval Reinforcement is provided upon the first response following a variable duration of time Basic Intermittent Schedules of Reinforcement: Fixed-Ratio ESSPED 5742 Definition The completion of a constant number of responses produces a reinforcer The elapse of time does NOT influence reinforcement. 7 pages FR 7 15-min break Basic Intermittent Schedules of Reinforcement: Fixed-Ratio ESSPED 5742 Definition The completion of a constant number of responses produces a reinforce The elapse of time does NOT influence reinforcement. 3 phone calls FR ? Basic Intermittent Schedules of Reinforcement: Fixed-Ratio Effects ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Fixed-Ratio Effects The first response is emitted ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Fixed-Ratio Effects The first response is emitted High rates of responses ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Fixed-Ratio Effects The first response is emitted High rates of responses Delivery of reinforcement ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Fixed-Ratio Effects The first response is emitted High rates of responses Delivery of reinforcement Postreinforcement pause ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Fixed-Ratio Effects The first response is emitted High rates of responses Delivery of reinforcement Postreinforcement pause ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Fixed-Ratio Effects Size of the ratio influences rate of response To a degree, larger ratio is likely to produce high rates of responses, however, the rate of response may decrease if the ratio requirements are too large. Size of the ratio influences duration of post reinforcement pause Large ratio produces long pauses. Larger ratio Higher responding rate ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Variable-Ratio Definition The completion of a variable number of responses produces a reinforcer The elapse of time does NOT influence reinforcement. ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Variable-Ratio Starting my 2003, 133000 miles, Dodge Neon DAY-1 DAY-2 DAY-3 ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Variable-Ratio ESSPED 5742 Starting my 2003, 133000 miles, Dodge Neon DAY-1 VR? DAY-2 DAY-3 Basic Intermittent Schedules of Reinforcement: Variable-Ratio ESSPED 5742 Starting my 2003, 133000 miles, Dodge Neon DAY-1 VR2 (2+1+3)/3 = 2 DAY-2 Every 2nd key-turning on the average produces reinforcement. DAY-3 Basic Intermittent Schedules of Reinforcement: Variable-Ratio Marnie & Ziwei in Atlantic City, NJ 1st Win X3 2nd Win X5 3rd Win X 10 4th Win X 20+ Never happened… ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Variable-Ratio ESSPED 5742 Marnie & Ziwei in Atlantic City, NJ 1st Win X3 2nd Win X5 3rd Win X 10 4th Win X 20+ VR? Never happened… Basic Intermittent Schedules of Reinforcement: Variable-Ratio ESSPED 5742 Marnie & Ziwei in Atlantic City, NJ 1st Win X3 2nd Win X5 3rd Win X 10 VR? Basic Intermittent Schedules of Reinforcement: Variable-Ratio Marnie & Ziwei in Atlantic City, NJ 1st Win X3 2nd Win 3rd Win ESSPED 5742 VR6 (3+5+10)/3 = 6 X5 X 10 Every 6th lever-pulling on the average produces reinforcement. Basic Intermittent Schedules of Reinforcement: Variable-Ratio Effects High, steady rates of response No postreinforcement pause Size of the ratio influences rate of response To a degree, larger ratio is likely to produce higher rates of responses, however, the rate of response may decrease if the ratio requirements are too large. ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Fixed-Interval ESSPED 5742 Definition The first correct response after a designated, constant amount of time produces the reinforcer FI 1-week Responses emitted during the interval do NOT influence reinforcement • Mails are delivered at 7AM every Friday morning. • The response “checking the mailbox” emitted before 7AM is NOT reinforced. • The first response “checking the mailbox” after 7AM on Friday morning produces reinforcement (i.e., getting the mails). • 1 week passes before the next scheduled reinforcer (i.e., mails) is available – Fixed Interval. Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use FI 2-min; Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use FI 2-min; Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Reinforcer Response Time elapsed 0’ 2’ 4’ 6’ 8’ Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use FI 2-min; Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Reinforcer Response Time elapsed 0’ 2’ 4’ 6’ 8’ Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use FI 2-min; Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Reinforcer Response Time elapsed 0’ 2’ 4’ 4’30’’ 6’ 8’ Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use FI 2-min; Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Reinforcer Response Time elapsed 0’ 2’ 4’ 6’ 8’ Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use FI 2-min; Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Reinforcer Response Time elapsed 0’ 2’ 4’ 6’ 30 sec limited hold 8’ Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use FI 2-min; Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Reinforcer Response Time elapsed 0’ 2’ 4’ 6’ 8’ Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use FI 2-min; Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Reinforcer Response Time elapsed 0’ 2’ 4’ 6’ 8’ Basic Intermittent Schedules of Reinforcement: Fixed-Interval Effects Slow to moderate rates of response Scallop effect ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Fixed-Interval Effects Slow to moderate rates of response Scallop effect Postreinforcement pause ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Fixed-Interval Effects Length of interval influences rate of response To a degree, larger interval is likely to produce lower rates of responses. Length of interval influences duration of post reinforcement pause Larger interval produces longer pauses. ESSPED 5742 Basic Intermittent Schedules of Reinforcement: Variable-Interval ESSPED 5742 Definition The first correct response following varying intervals of time produces the reinforcer Responses emitted during the interval do NOT influence reinforcement • The response “checking the phone” emitted before a text message arrives is NOT reinforced. • The first response “checking the phone” after a text message arrives produces reinforcement (i.e., getting the text). • The intervals of time between two incoming text messages is unpredictable– Variable Interval. Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use VI 2-min (2, 1, 3 min); Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use VI 2-min (2, 1, 3 min); Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Reinforcer Response Time elapsed 0’ 2’ 4’ 6’ 8’ Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use VI 2-min (2, 1, 3 min); Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Reinforcer Response Time elapsed 0’ 2’ 4’ 6’ 8’ Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use VI 2-min (2, 1, 3 min); Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Reinforcer Response Time elapsed 0’ 2’ 4’ 6’ 8’ Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use VI 2-min (2, 1, 3 min); Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Reinforcer Response Time elapsed 0’ 2’ 4’ 6’ 8’ Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use VI 2-min (2, 1, 3 min); Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Reinforcer Response Time elapsed 0’ 2’ 4’ 6’ 30 sec limited hold 8’ Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application ESSPED 5742 Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. How to use VI 2-min (2, 1, 3 min); Limited Hold 30 sec to improve Marnie’s behavior “taking notes” ? Reinforcer Response Time elapsed 0’ 2’ 4’ 6’ 8’ Basic Intermittent Schedules of Reinforcement: Variable-Interval Effects Slow to moderate rates of response No postreinforcement pause Length of interval influences rate of response To a degree, larger interval is likely to produce lower rates of responses. ESSPED 5742 ESSPED 5742 Basic Intermittent Schedules of Reinforcement Fixed Ratio Interval Variable High Rates of Response ESSPED 5742 Basic Intermittent Schedules of Reinforcement Fixed Variable Ratio Interval Moderate-Slow Rates of Response ESSPED 5742 Basic Intermittent Schedules of Reinforcement Fixed Ratio Postreinforcement Pause Interval Variable ESSPED 5742 Basic Intermittent Schedules of Reinforcement Fixed Variable Ratio No Pause Interval ESSPED 5742 Question Time Again! A B C D ESSPED 5742 Question 1 Which schedule of reinforcement? Doing piecework in factories: Holly makes 5 dollars on every twenty aprons she has sewed. A. FR B. VR C. FI D. VI ESSPED 5742 Question 2 Which schedule of reinforcement? Surfers look around on a surfing board, expecting a big wave. A. FR B. VR C. FI D. VI ESSPED 5742 Question 3 Which schedule of reinforcement? Ziwei checks her bank account for monthly stipend paid by OSU. A. FR B. VR C. FI D. VI ESSPED 5742 Question 4 Which schedule of reinforcement? It is hunting season. Hunters look around in the forest, searching for bucks. A. FR B. VR C. FI D. VI ESSPED 5742 Question 5 Which schedule of reinforcement? Jenny is fundraising to try to raise money so she can go on the annual band trip. She goes door to door in her neighborhood trying to sell popcorn tins. She eventually sells some. A. FR B. VR C. FI D. VI Applying Intermittent Schedules of Reinforcement: Thinning Intermittent Schedules ESSPED 5742 Schedule Thinning Gradually increasing the response ratio or the duration of the time interval Assessing the student’s current performance level Applying Intermittent Schedules of Reinforcement: Thinning Intermittent Schedules ESSPED 5742 Schedule Thinning Gradually increasing the response ratio or the duration of the time interval Assessing the student’s current performance level Setting the ratio/interval requirements close to the current performance level Applying Intermittent Schedules of Reinforcement: Thinning Intermittent Schedules ESSPED 5742 Schedule Thinning Gradually increasing the response ratio or the duration of the time interval Assessing the student’s current performance level Setting the ratio/interval requirements close to the current performance level Setting schedule-change criterion and using small increments of schedule changes Applying Intermittent Schedules of Reinforcement: Thinning Intermittent Schedules ESSPED 5742 Schedule Thinning Gradually increasing the response ratio or the duration of the time interval Assessing the student’s current performance level Setting the ratio/interval requirements close to the current performance level Setting schedule-change criterion and using small increments of schedule changes Guided by the student’s performance (ABA is a data-driven science/practice) Applying Intermittent Schedules of Reinforcement: Thinning Intermittent Schedules ESSPED 5742 Schedule Thinning Gradually increasing the response ratio or the duration of the time interval Assessing the student’s current performance level Setting the ratio/interval requirements close to the current performance level Setting schedule-change criterion and using small increments of schedule changes Guided by the student’s performance (ABA is a data-driven science/practice) Using instructions to clearly communicate the schedule of reinforcement ESSPED 5742 Application Question If you are using gummy bear as a reinforcer to teach eye-contact to a 3 years old with autism. The kid responds well to VR 2 and meets the schedule-change criterion you set. Then you move to VR 5… What will you do if the rate of eye contact decreases? What will you do if the rate of eye contact maintains or increases? ESSPED 5742 After-Class Tasks Reading assignment Chapter 13 (305-314) Don’t Shoot the Dog (20-29) SAFMEDS practice Application HW 2 Hardcopy will be due on next class ESSPED 5742 References Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis (2nd ed.). Upper Saddle River, NJ: Pearson.
