This article was downloaded by: [Western Michigan University] On: 10 January 2012, At: 11:35 Publisher: Routledge Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer House, 37-41 Mortimer Street, London W1T 3JH, UK Journal of Organizational Behavior Management Publication details, including instructions for authors and subscription information: http://www.tandfonline.com/loi/worg20 Behavior-Based Safety and Working Alone a Ryan Olson & John Austin a a Western Michigan University, USA Available online: 12 Oct 2008 To cite this article: Ryan Olson & John Austin (2001): Behavior-Based Safety and Working Alone, Journal of Organizational Behavior Management, 21:3, 5-43 To link to this article: http://dx.doi.org/10.1300/J075v21n03_02 PLEASE SCROLL DOWN FOR ARTICLE Full terms and conditions of use: http://www.tandfonline.com/page/termsand-conditions This article may be used for research, teaching, and private study purposes. Any substantial or systematic reproduction, redistribution, reselling, loan, sub-licensing, systematic supply, or distribution in any form to anyone is expressly forbidden. The publisher does not give any warranty express or implied or make any representation that the contents will be complete or accurate or up to date. The accuracy of any instructions, formulae, and drug doses should be independently verified with primary sources. The publisher shall not be liable for any loss, actions, claims, proceedings, demand, or costs or damages whatsoever or howsoever caused arising directly or indirectly in connection with or arising out of the use of this material. Downloaded by [Western Michigan University] at 11:35 10 January 2012 EXPERIMENT Behavior-Based Safety and Working Alone: The Effects of a Self-Monitoring Package on the Safe Performance of Bus Operators Ryan Olson John Austin ABSTRACT. Experimental evaluations of Behavior-Based Safety (BBS) processes applied with lone workers are scarce. Clinical and organizational researchers alike have studied the effectiveness of self-monitoring as a performance improvement strategy, but further work is needed to determine the power of such interventions for improving safe behavior and Ryan Olson and John Austin are affiliated with Western Michigan University. Address correspondence to Ryan Olson, 3308 Miami Avenue, Kalamazoo, MI 49048 (E-mail: ryan.olson@wmich.edu). The authors would like to thank Adam VanAssche and Lisa Olson for implementing critical aspects of the intervention. They would also like to recognize Alicia Alvero and Scott Traynor for their helpful input regarding the design of the study. Journal of Organizational Behavior Management, Vol. 21(3) 2001 2001 by The Haworth Press, Inc. All rights reserved. 5 Downloaded by [Western Michigan University] at 11:35 10 January 2012 6 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT to explore the best practices for using such processes with lone workers. In the current study, four male bus operators (20.5 years average experience) self-monitored their safe performance and received feedback based on self-monitoring data. Dispatch supervisors used radio communication to prompt participants to complete self-monitoring forms and also conducted special observations of participants to measure target performances. Both operators and supervisors were unaware of experimental observers who measured the performance of each participant by riding on busses as passengers. A multiple baseline design across performances was used to assess the effects of the intervention on four performance targets. The intervention resulted in a 12.3% increase in safe performance for the group, with individual increases in performance ranging from 2% to 41% for specific target performances. The results are discussed in terms of the value of BBS processes for employees who work alone and the research needed to determine the components of self-monitoring processes that are most critical for generating improvements in safe performance. [Article copies available for a fee from The Haworth Document Delivery Service: 1-800-HAWORTH. E-mail address: <getinfo@haworthpressinc.com> Website: <http://www.HaworthPress.com> © 2001 by The Haworth Press, Inc. All rights reserved.] KEYWORDS. Self-monitoring, behavior-based safety, safe driving, lone workers, bus transit safety, bus operator performance Over the past 20 years behavioral research in the field of Behavior-Based Safety (BBS) has grown steadily. Some of the first conceptual articles discussing the application of behavior analysis technology to improve occupational safety were published in the late 1970’s (e.g., Smith, Cohen, H., Cohen, A., & Cleavland, 1978). The first experimental applications of behavioral technology applied to occupational safety occurred during the same time period (Komaki, Barwick, & Scott, 1978; Smith, Anger, & Uslan, 1978; Sulzer-Azaroff, 1978). The central foundation of all BBS research since these early applications has been the identification and measurement of safe and at-risk behaviors and conditions, and the use of behavioral technology to increase the frequency of those safe behaviors and conditions. The body of research has demonstrated the effectiveness of many different intervention packages designed to achieve these effects. Studies have evaluated experimentally the effectiveness of training (Cohen & Jensen, 1984; Komaki, Heinzmann, & Lawson, 1980; Reber & Wallin, 1984; Reddell, Congleton, Huchingson, & Montgomery, 1992), Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 7 goal setting and/or prompts (Austin, Alvero, & Olson, 1998; Berry, Geller, Calef, R. S., & Calef, R. A, 1992; Engerman, Austin, & Bailey, 1997; Fellner & Sulzer-Azaroff, 1986; Ludwig & Geller, 1991, 1997; Phillips, Sutherland, & Makin, 1994: Reber & Wallin, 1984; Reber, Wallin, & Chhokar, 1990; Saarela, 1989), verbal and graphic feedback (Alavosius & Sulzer-Azaroff, 1986, 1990; Babcock, Sulzer-Azaroff, & Sanderson, 1992; Chhokar & Wallin, 1984; DeVries, Burnette, & Redmon, 1991; Fellner & Sulzer-Azaroff, 1984; Komaki, Heinzmann, & Lawson, 1980; Nasanen & Saari, 1987; Phillips, Sutherland, & Makin, 1994; Sulzer-Azaroff & de Santamaria, 1980), contingent incentives and reinforcement (Austin, Kessler, Riccobono, & Bailey, 1996; Fox, Hopkins, & Anger, 1987; Komaki, Barwick, & Scott, 1978; McAfee & Winn, 1989; Petersen, 1984), and self-monitoring procedures (McCann & SulzerAzaroff, 1996) at increasing safe behaviors and conditions. For a recently published, more thorough, review of BBS in manufacturing settings, see Grindle, Dickinson, and Boettcher (2000). For a review of the impact of BBS on injury rates, see Sulzer-Azaroff and Austin (2000). Studies by Geller and colleagues have clear relevance when discussing driving safety. For example, Ludwig and Geller (2000) described a series of seven studies designed to improve the safe driving of pizza deliverers. The interventions they evaluated included public and private feedback, corporate policy changes, commitment card strategies, participative and assigned goal setting, competition and rewards, and involving the deliverers as community intervention agents. Ludwig and Geller (2000) reviewed these seven studies in terms of the multiple intervention level (MIL) hierarchy. The MIL is characterized by a continuum of intervention intrusiveness and cost, where the least intrusive and most inexpensive interventions tend to reach the most people and the most intrusive and most costly interventions tend to impact the fewest people. The MIL is not unlike other discussions of treatment intrusiveness in applied behavior analysis (e.g., Meinhold & Mulick, 1990), but the MIL specifically applies these concepts to organizational behavior. Ludwig and Geller (2000) recommended that least intrusive interventions be applied to create large-scale change and that those individuals who remain unaffected by non-intrusive interventions should be exposed to successively more intrusive interventions. Although discussed in theory by the MIL, experimental evaluation of self-monitoring procedures to improve safe behavior is a relatively new development. The field of BBS is growing and reports of successful commercial applications with lone workers have begun to surface (e.g., Krause, 1997; Pettinger, Click, & Geller, 2000). The research base exam- Downloaded by [Western Michigan University] at 11:35 10 January 2012 8 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT ining the best practices for improving the safe performance of lone workers is small, however, self-monitoring has been widely used in other contexts as a behavior change technique. SELF-MONITORING Richman, Riordan, Reiss, Pyles, and Bailey (1988) conducted a study that demonstrated the power and utility of self-monitoring procedures for improving organizational performance. Richman et al. (1988) used in-service training, self-monitoring, and self-monitoring plus feedback to improve the on-schedule and on-task performance of staff at a residential setting for persons with mental disabilities. A multiple baseline design across groups was used to assess the effects of the different intervention phases. Three months prior to the study, participants were informed that a special project was going to take place where staff/client interactions would be observed. Under this guise, experimental observers collected data for on-schedule and on-task behavior for the duration of the study. After baseline data were collected, an in-service training session was held to review job responsibilities that included topics related to on-schedule and on-task performance. During the self-monitoring phase, staff members carried individual schedule cards during the workday and self-recorded the extent to which they were on-schedule and on-task during the shift. These self-recorded data were handed in at the end of each shift. For the self-monitoring plus feedback component, supervisors provided periodic on-the-spot feedback regarding target performances while the self-monitoring procedure continued as before. Two houses participated in the study and were labeled A and B. For house A, on-schedule behavior averaged 50%, 50%, 80%, and 94% across baseline, in-service, self-monitoring, and self-monitoring plus feedback conditions respectively. For house B, on-schedule behavior averaged 39%, 39%, 75%, and 81% across baseline, in-service, self-monitoring, and self-monitoring plus feedback conditions respectively. For on-task behavior, baseline for both houses combined was 28%. In-service increased the on-task performance of staff in house A to 36% but did not affect the performance of staff in house B. For house A, on-task behavior averaged 72% and 88% for self-monitoring and self-monitoring plus feedback respectively. For house B, on-task behavior averaged 77% and 80% for self-monitoring and self-monitoring plus feedback respectively. Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 9 Self-monitoring, as part of intervention packages, has also been used to improve academic performance (Dean, Malott, & Fulton, 1983; DiGangi, Maag, & Rutherford, 1991; Kneedler & Hallahan, 1981; Lan, 1996; Stecker, Whinnery, & Fuchs, 1996), to improve the performance of teachers (Browder, Liberty, Heller, & D’Huyvetters, 1986), to improve the performance of athletes (Kessler, 1985; Srikameswaren, 1992; Whelan, Mahoney, & Meyers, 1991), to increase interactions between staff and patients at an institution (Burgio, Whitman, & Reid, 1983), and to help individuals stop smoking and reduce their caloric intake (Moinat & Snortum, 1976). Only some of the research listed above was conducted with adults and targeted “workplace” performance. However, self-monitoring procedures are potentially relevant across a broader scope of organizational behavior for people who work alone and for people who work in groups. This broader scope includes support for improving the quality, quantity, or timeliness of the performance of salespeople or consultants working outside of the home office with clients. People working in teams could use self-monitoring procedures in concert with peer feedback to track progress on long-term projects or to target specific “team relevant” skills. In relation to the topic of the current paper, self-monitoring procedures could complement or substantially improve the current performance management strategies utilized to support and improve the performance of people operating any number of different vehicles in the general transportation and product delivery industries. For example, the first author has been exploring supplementary performance measurement systems for student pilots during the early phases of flight training. An especially risky phase of flight training involves the first series of solo flights without an instructor on board. As part of the exploratory research mentioned above, volunteer students have been self-monitoring aspects of landing performance on dual (with an instructor) and on solo (without an instructor) flights. This produces data that would otherwise not be available and could potentially improve learning and performance, thereby reducing risk. Students have reported that the procedure has enhanced the learning process. If these self-monitoring procedures were used in combination with instructors rating the same performances, such systems could prompt feedback and coaching for specific critical performances. Down the road when these students become professional pilots working in the cockpits of planes for major airlines, self-monitoring procedures and peer feedback and discussion could be used to target critical crew resource management skills. With these potential applications in mind, we can predict that self-monitoring procedures will probably prove Downloaded by [Western Michigan University] at 11:35 10 January 2012 10 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT valuable across a wide variety of contexts. However, as self-monitoring research and practices expand in organizational settings, we should also predict limits to the effectiveness and relevance of self-monitoring procedures in organizational settings. Self-monitoring procedures have contributed to performance improvement across many settings and represent a set of methods that may be especially relevant for improving learning and performance in workplace environments. However, the question of which components of self-monitoring procedures are most critical for generating behavior change is still being explored. For example, the extent to which self-monitoring data need to be reliable is not clear. Some research suggests that self-monitoring procedures produce performance improvement even when the self-recorded data are not accurate (Hayes & Nelson, 1983; McCann & Sulzer-Azaroff, 1996). However, when self-monitoring data are more reliable, effects seem to be enhanced (Baskett, 1985; Kanfer, 1970; McCann & Sulzer-Azaroff, 1996). It would be useful to know whether training participants to reliably self-monitor is a worthy investment. An additional consideration related to the effectiveness of self-monitoring procedures is identifying the behavioral functions of the stimuli generated by such procedures. Some of the potential behavioral functions of stimuli produced by self-monitoring processes include: (a) an antecedent function (i.e., informational or task clarification), (b) a consequence function (conditioned reinforcement or punishment), (c) a rule generating function (i.e., contingency specifying, function-altering stimuli are evoked), and (d) a conditioned establishing operation function. When a participant is asked to record aspects of his or her behavior, looking at the form, and filling it out may clarify performance expectations or prompt the most appropriate performance. Based upon subsequent observations of behavior with respect to such informational stimuli, we would say that participants “know” or “do not know” the safe manner in which to behave (Skinner, 1953). If self-monitoring functions primarily as information or a prompt it would make sense to ask participants to self-monitor at the beginning of the workday or just prior to opportunities to perform. Antecedents without consequences are likely to have only temporary effects due to habituation or extinction (Daniels, 1989). Therefore, it would also make sense to ensure that positive consequences were correlated with the antecedent process and that the self-monitoring procedure was periodically changed. Aspects of self-monitoring processes may also function as consequences. Scoring oneself high or low may function as analogs to rein- Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 11 forcement or punishment for the desired performance depending upon the quality of the most recent relevant performance (Malott, R., Malott, M., & Trojan, E., 1999). Thinking of the potential consequence function of self-monitoring procedures may also explain in part why compliance with self-monitoring processes is normally less than perfect. Because performance varies, scoring aspects of one’s own performance might sometimes reinforce and sometimes punish filling out a self-monitoring form. Due to the fact that management systems utilize numerous performance management strategies, filling out self-monitoring forms may also cause participants to generate rules related to those strategies. If an organization regularly uses aversive consequences to discourage unsafe practices, filling out a self-monitoring form might evoke rules such as, “If I improve this performance, I can avoid punishment from my supervisor (because the performances on this form are what he/she cares about right now).” Schlinger (1993) proposed that a rule such as this one might produce behavioral effects because it specifies contingencies and alters the function of stimuli in the immediate environment. For example, the rule above specifies a new contingency (i.e., my supervisor will punish me if I don’t improve these behaviors on the form) and might alter the function of stimuli in the immediate environment (a previously ineffective stop sign now evokes behavior that results in a complete stop). Another way of accounting for the effects of verbal behavior describing contingencies is the concept of the conditioned establishing operation (CEO). An establishing operation is a stimulus or procedure that has at least two effects; it (1) momentarily alters the effectiveness of a reinforcer or punisher, and (2) momentarily alters the frequency of behavior that has been correlated with the consequence whose effectiveness has been altered (Michael, 1993). Michael has delineated three types of CEOs with specific characteristics, but discussing these types is beyond the scope of this paper. In most cases, CEOs alter the effectiveness of conditioned reinforcers or punishers, and given the fact that most organizational performance is maintained and shaped by such consequences, we should consider the CEO concept a potentially important motivational variable. When approaching a relevant opportunity to perform, a rule statement related to the performance being self-monitored might be evoked. The covert verbal behavior, or perhaps the stimulus that evoked the covert behavior, may then function as a CEO that alters the effectiveness of salient consequences. For example, a bus driver may perform rolling stops at stop signs because the brakes Downloaded by [Western Michigan University] at 11:35 10 January 2012 12 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT squeal less than when he/she performs a complete stop. Participating in a self-monitoring procedure that targeted complete stopping might cause the sight of a stop sign and/or evoked rule statements to function as a CEO that momentarily alters the value of the squealing sound, making it less aversive (weakening motivation to escape or avoid the squealing). Alternatively, CEOs could momentarily establish the squealing sound as an effective reinforcer, thereby evoking behavior (firm foot pressure on the brakes) that had produced that consequence in the past. It is likely that performance improvement generated by self-monitoring procedures is caused by a complex set of contingencies and behavioral mechanisms. Considering these mechanisms and explanatory concepts may guide future research and help discover the most effective practices. With self-monitoring research in BBS being scarce, the field may require more studies that demonstrate the effectiveness of self-monitoring procedures to improve safe performance before technical questions can be addressed. Below we review two applications of self-monitoring procedures to improve safe performance that informed the design of the current study. BBS APPLICATIONS OF SELF-MONITORING PROCEDURES Preventing Cumulative Trauma Disorders McCann and Sulzer-Azaroff (1996) used a behavioral approach to prevent cumulative trauma disorders with employees who spent much of each workday typing in an office setting. Part of the intervention package required typists to self-monitor performance along particular behavioral dimensions. Participants were divided into two groups where one group monitored hand and wrist position and the other monitored posture. Each participant was exposed to conditions in the following sequence: (a) baseline, (b) training and self-monitoring, and (c) feedback, goal setting, and reinforcement. During training, participants were taught discriminations between safe and at-risk performance and were required to pass a discrimination test with a score above 80% correct. Self-monitoring procedures required participants to estimate the percentage of time they performed target behaviors safely. During the final phase of intervention participants met prior to each session and were given both graphic and verbal feedback based on levels of safety observed by experimenters on the previous days. The graphic feedback was in the form of transparencies that, when laid over the participants’ self-monitored data, revealed the accuracy of participants’ reports. Ex- Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 13 perimenters guided participants as they set goals to ensure that goals were not set higher than the highest data point from the previous session. And finally, praise was provided for progress and attainment of goals. The study produced consistent improvements in safe performance across all participants with moderate to high improvements during the training and self-monitoring phase, and very high improvements during the feedback, goal setting, and reinforcement phase. Posture ultimately improved to near perfect levels for all participants in the posture group. Hand and wrist position improved to levels clearly above baseline for all participants in the hand/wrist position group. Participants were not initially given information about the accuracy of their self-estimations of safe performance. Without accuracy information participants achieved acceptable levels of agreement between self-monitored data for posture and experimenter data for posture. However, self-monitoring data for hand and wrist position did not agree with experimenter data at this stage. Researchers postulated that the “gross motor” nature of the movements involved with posture made the behavior easier to self-monitor than the “fine motor” hand and wrist position movements, which resulted in the different agreement levels between posture and hand/wrist position. The goal setting, feedback, and reinforcement phase increased the agreement between self-monitoring data and experimental data for hand and wrist position. The reinforcement component (verbal praise) was contingent upon performance improvement and accurate self-estimations of performance. The researchers reported that high agreement between typists and experimenters was associated with enhanced performance improvement of safe hand and wrist position. Improving the Safe Performance of Bus Operators Krause (1997) reported a Behavioral Science Technology, Inc. (BST) consultation effort with a public transportation system where self-monitoring procedures were utilized. Thirty drivers and several supervisors participated in the project. Interviews with drivers were utilized to develop a checklist that contained 34 performances. Drivers estimated their safe performance on these 34 targets once or twice daily and plotted their own data on graphs. Every two weeks a supervisor rode with each driver and collected data using the same checklist. When the intervention was initially implemented drivers reported high percent safe scores that did not agree with supervisors’ scores of Downloaded by [Western Michigan University] at 11:35 10 January 2012 14 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT driver performance. Supervisors discussed these discrepancies with drivers and plotted the self-monitoring data and supervisor data together on feedback graphs. Over a period of 20 weeks, supervisor data trended upward and driver data began to trend downward slightly to almost match supervisor data. Agreement between employees and supervisors appeared to take place over time and Krause (1997) reported a 66% decline in injuries and accidents in the organization over the 20-week time period. However, the project did not employ an experimental design and did not include any formal assessment of the reliability of either supervisor or driver data. Therefore, the degree to which driver’s behavior actually changed because of the intervention could not be evaluated. In order to evaluate experimentally the degree to which self-monitoring procedures can improve the safe performance of lone workers, a demonstration study similar in design to the McCann and Sulzer-Azaroff (1996) study is needed. The current study was an attempt to synthesize aspects of Krause (1997) with McCann and Sulzer-Azaroff (1996) and experimentally evaluate the effectiveness of self-monitoring procedures for improving the safe performance of bus operators. METHOD Participants and Setting A public transportation system serving two midwestern cities with a combined estimated population of 160,000 was the sponsoring organization for the study. In addition to operating and maintaining 17 bus routes, the organization operated rail and other public transportation systems. Within the bus system an operations supervisor managed the performance of seven dispatch supervisors, who in turn supervised 65 bus and other vehicle operators. A university campus route serving a campus of approximately 26,000 students was the location for the study where two to eight busses operated from 7 a.m. to 12 midnight on weekdays. The bus route consisted of two directional patterns, each lasting about 30 minutes, and served all major campus locations including on-campus housing. Four experienced drivers who worked a 10-hour shift (about 6:30 a.m. to about 4:30 p.m.) were selected by the operations supervisor to participate in the study (male, ages approximately 40-50; average experience 20.5 years, range: 19-23 years). Organizational leadership was inter- Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 15 ested in this shift because of its duration and the busy pedestrian and traffic conditions of the university campus. Prior to the study, the transit system used five methods to motivate safe driving after drivers were initially trained upon hire. These methods were (a) a $25 bonus for all drivers who worked an entire quarter without having a preventable collision, (b) a 7 step progressive discipline program for moving violations and preventable collisions, (c) hiring private investigators to monitor drivers receiving serious complaints, (d) yearly safety awards at a banquet, and (e) bi-monthly general performance evaluations by dispatch supervisors. The operations supervisor reported that this general management strategy had produced a plateau in total collisions per year that had remained relatively stable over the past five years. Dependent Variables Dependent variables were identified through an assessment that included a review of one year of collision reports from the organization’s records. Passenger and pedestrian injury reports were also reviewed but were so infrequent that no patterns could be discerned from them. Given the high pedestrian traffic conditions of the campus bus route, it is likely that risk for these kinds of events was high when compared to other routes within the transit system. The degree to which acceptable IOA could be achieved was the final consideration for the selection of dependent variables. Performances observed were divided into three categories: (a) loading/unloading passengers, (b) bus in motion, and (c) complete stop. Bus in motion performances related to cornering safely and maintaining adequate following distance were excluded from the study due to ceiling effects. Loading/unloading performances included bus stopping position, remaining motionless for two seconds after an unload/load instance, and mirror checking. The assessment discovered that 20% of preventable collisions had occurred at loading zones and another 12% of preventable collisions had occurred at parking lots or driveways. Checking mirrors was identified as a behavior that may have helped prevent 56% of the collisions reviewed in the assessment. The route involved in the study passed through six major campus parking lots. Moreover, many loading zones were located near parking lot exits and various other throughways. Bus stopping position was defined as “bus doors must remain shut until the bus is completely stopped, and the bus should be positioned so no cars can pass on the right.” Observers scored this performance by Downloaded by [Western Michigan University] at 11:35 10 January 2012 16 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT watching the front doors of the bus as it slowed. If the bus was still moving when the doors separated, or if a car could pass on the right, the performance was scored at-risk. Two seconds motionless was defined as “the bus should remain motionless for at least two seconds after the last loading/unloading passenger either steps behind the yellow line on the bus, steps off the bus to the right, or steps clear of the front left corner of the bus.” Observers were instructed to count “one-thousand one, one-thousand two,” to themselves to measure this performance and used a wristwatch to periodically calibrate the pace of their counting. If the observer was able to reach “two” before the bus moved the performance was scored correct while any movement before the observer reached “two” was scored as at-risk. Mirror checking was defined as “the driver should visually check both side mirrors after loading/unloading passengers as the bus pulls out of a loading zone.” Observers were instructed to mark this performance as correct if both mirrors were checked before or as the bus started moving. Checking mirrors after the back of the bus cleared the original load/unload location was scored at-risk. From the driver’s right hand side of the bus in the second row of forward facing seats his eyes were visible in the center mirror and head movement could be viewed. If a driver looked in the general direction of either mirror it was assumed he checked that mirror. Complete termination of forward motion at stop signals is a legal requirement and was considered an important safe performance for the campus route. Drivers making complete stops have a better opportunity to scan traffic and pedestrian conditions at busy intersections. There were over 20 stop signals during each 30-minute loop regardless of the direction the bus was traveling. Rolling stops and jumping a traffic signal were scored as at-risk. The observation technique that achieved reliability for complete stops involved picking out an outside object like a pole and watching it as the bus slowed. If the outside object stood still in the observer’s field of vision the performance was scored as safe. A percent safe score for each dependent measure was calculated by counting the number of correct scores and dividing that number by the total number of observations for that dependent measure, and then multiplying by 100. An overall percent safe score for each observation session was also calculated in a similar fashion. Observers and Observation Procedures The first author and two undergraduate research assistants worked as experimental data collectors over the course of the study. Undergradu- Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 17 ate research assistants were selected on the basis of good performance in an organizational psychology class, interest, and availability. All three researchers worked for research credits at Western Michigan University. Observers sat at the driver’s right hand side of the bus in the second row of forward facing seats about 10 feet from the driver’s chair. Bus schedules were marked with color codes to locate participants and each driver was identified by their color code throughout the study for confidentiality reasons. As an additional measure of confidentiality color codes were changed to participant numbers for this paper. Each driver was generally observed at least once each day for at least 30 minutes (i.e., one directional loop of the route). However, observers were required to monitor at least 10 instances of loading/unloading of passengers per session, resulting in some sessions longer than 30 minutes. On average, there were 10 or more load/unload instances and over 20 stops observed each session. Once or twice each week all four participants were observed by two observers to assess IOA, which was calculated by dividing the number of agreements by the number of agreements + disagreements, and then multiplying by 100. During reliability sessions, the first author was the primary observer. To protect the independence of observations, the observer sitting on the right hand seat next to the window used a three-ring binder with the left cover held upright to block the visibility of the data sheet. The observer sitting on the left hand seat covered his/her data sheet with his/her right arm and hands (all observers were right handed). Methods to Minimize Driver Reactivity to Experimental Observers Participating drivers were not informed of experimental observers until a post-experiment debriefing.1 However, it was odd for passengers to ride an entire loop of the route without arriving at a destination and drivers occasionally asked questions. Observers, who were earning research credits for participation, were instructed to answer such questions by saying “I’m collecting a survey for a class.” Surveys on bus ridership had taken place recently and this proved to be an effective strategy. To further reduce the possibility of untoward interactions with drivers observers were instructed to wear headphones when collecting data by themselves. Independent Variables Project Kick-Off Meeting. After an initial baseline phase intervention began with an hour and a half meeting at the transit station hub that Downloaded by [Western Michigan University] at 11:35 10 January 2012 18 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT consisted of an introduction to BBS and the rationale for piloting such a process at the transit system, an introduction to and rationale for a self-monitoring process, and finally a description of the details of running the project. The meeting was conducted by a doctoral student (male, age 26) not involved in data collection and by the operations supervisor. The student was introduced as an external safety consultant without mentioning his ties to the university. Participants were informed that their input about the project would be solicited at a post-project lunch and that organizational leadership had signed an agreement that information obtained during the project could not be used for disciplinary purposes. Drivers were also told that one or two additional meetings with the consultant would be scheduled over the next few weeks. Immediately after the kick-off meeting, the student consultant and the operations supervisor met with dispatch supervisors to introduce them to the project. Supervisors were not informed of the presence of experimental observers. Self-Monitoring. Three different self-monitoring forms were used over the course of the study and were introduced during meetings at the transit hub (see Experimental Design section below). Drivers used these forms twice each day during their 10-hour shift to estimate the percentage of time they performed each of the target performances safely. Blank squares were provided on the form for writing estimations, which is one strategy suggested by research to avoid shaping respondent answers (Schwarz, 1999). At the drivers’ request the locked drop box for self-monitoring forms was located in the drivers’ lounge at the transit system hub. Drivers were also told that they would be prompted twice a day by their dispatch supervisors via radio when it was time to self-monitor. Feedback. The first author generated daily color-coded individual and group graphs based on self-monitoring data from the previous day. A research assistant posted a new set of graphs each evening between 8 and 9 p.m. in the drivers’ lounge near the drop box and collected completed self-monitoring forms. Each driver was asked to initial the group graph at the conclusion of each shift to demonstrate that the feedback had been viewed. Supervisor Prompts and Observations. Dispatch supervisors were instructed to prompt participating drivers via radio twice each day to use the self-monitoring forms and record the date and time of their prompts on a chart posted in the dispatch office. In addition to delivering prompts, supervisors conducted special observations of drivers using a data sheet (identical in format to experimental data sheets) limited to the performances currently being self-monitored by drivers. Experimental Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 19 observers arranged to measure performance concurrently with supervisor observations. On these occasions, experimental observers boarded the bus prior to the supervisor visit and left the bus one or two stops after the supervisor left the bus. This procedure was added to the design of the study as a type of probe, where performance changes generated by the presence of a supervisor could be measured and compared to data collected on the same day without supervisor presence. To create this comparison, each driver was observed for an additional session on the same day either before or after the supervisor probe was completed. Independent Variable Integrity. Three measures of independent variable integrity were calculated. Percentage of compliance with the self-monitoring procedure was calculated by counting the actual number of self-monitoring forms completed by each driver, dividing that number by the expected number of completed self-monitoring forms for each driver (two per day), and then multiplying by 100. Percentage of compliance with feedback procedures was calculated by counting the number of days each driver signed the feedback graph, dividing that figure by the number of days the driver was expected to sign the feedback form, and then multiplying by 100. And finally, the percentage of supervisor compliance with delivering prompts was calculated by counting the number of prompts recorded on the supervisor form, dividing that figure by the number of prompts that were expected to be given, and then multiplying by 100. Experimental Design A multiple baseline design across performances was used to assess the effects of the intervention. Intervention began after a baseline of 9 to 11 sessions for each individual driver (group baseline sessions totaled 13 because individual driver baseline sessions were obtained across different days). Intervention was first implemented for complete stop performance and lasted for eight workdays while baseline conditions continued for the remaining dependent variables. Phase two added the performance of remaining motionless for two seconds after loading/unloading passengers and lasted for five workdays while baseline conditions continued for the remaining dependent variables. The third and final phase of intervention introduced checking mirrors and bus stopping position. After five more working days using this final form, the route stopped running for the semester and the study was concluded. 20 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT Downloaded by [Western Michigan University] at 11:35 10 January 2012 RESULTS Group Performance Group performance was calculated by creating a group percent safe score for each day of the experiment for each dependent measure. For practical purposes, average improvement percentages for each dependent measure were then summed and divided by four to obtain a simple overall improvement percentage. Using this method, the group improved safe driving by an average of 12.3% over baseline conditions. The dependent variable realizing the largest improvement for the group was complete stop, which improved by an average of 21.2% (range: 14%-41%). Two seconds motionless after loading/unloading passengers improved by an average of 11.8% (range: 3%-19%), mirror check improved by an average of 10% (range: 3%-15%), and bus stopping position improved by an average of 6.2% (range: 2%-12%). Figure 1 represents the grouped data (i.e., averaged across the four drivers for each day of data collection) for each of the four dependent variables in the multiple baseline design. As can be seen during visual inspection of group data, calculations of average “improvement” may not indicate clear effects, especially with regard to the last phase of the intervention. For example, visual inspection does not indicate any clear effect for bus stopping position (patterns in intervention data closely resemble patterns in baseline data). For mirror check, an up trend in the data suggests an effect, but more data would be required to draw this conclusion. Individual Performance The results of individual participants are presented in order of largest to smallest overall improvement. The word “improvement” is used throughout the discussion of individual performance, although it should be understood that small average increases for specific dependent measures do not necessarily indicate clear effects of the intervention. For example, average improvement percentages for phase 3 of the intervention are based on only 3 to 4 data points and should therefore be interpreted conservatively. Overall improvement percentages for each participant are necessarily influenced by this characteristic of the experiment, and should also be interpreted conservatively. Several alternatives for computing overall improvement were considered, but for practical purposes, the same method used to calculate overall group improvement was applied to individual participants. Percentages related 21 FIGURE 1. Group results in multiple baseline design format. Closed circle data points are experimenter data averaged for each day of the experiment and open circle data points are self-monitoring data averaged for each day of the experiment. COMPLETE STOP 86.5% Percent Safe 100 80 60 40 20 0 68% 46.8% 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 Days LOAD/UNLOAD 2 SECONDS MOTIONLESS Percent Safe 100 60% 80 60 40 20 0 57.1% 45.3% 3 1 5 7 9 11 13 15 17 19 21 23 25 27 29 Days LOAD/UNLOAD MIRROR CHECK Percent Safe 100 99% 80 60 40 20 0 58.3% 1 3 5 68.3% 7 9 11 13 15 17 19 21 23 25 27 29 Days LOAD/UNLOAD STOPPING POSITION 100 Percent Safe Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 95.5% 80 60 40 20 0 79% 72.8% 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 Days Downloaded by [Western Michigan University] at 11:35 10 January 2012 22 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT to individual performance have been rounded to the nearest whole number to make them easier to read. Participant 1 improved by an average of 14% over baseline levels. The largest average improvement was for two seconds motionless with a 19% improvement (baseline, 43% safe; intervention, 62% safe). Bus stopping position improved 8% (baseline, 70% safe; intervention, 78% safe), mirror check improved 15% (baseline, 73% safe; intervention, 88% safe), and stopping improved 14% (baseline, 63% safe; intervention, 77% safe). A supervisor probe on the first day of phase two of the intervention created systematic effects on the performance of participant 1. Complete stop and two seconds motionless, which were being self-monitored, improved to over 20% above the levels measured on the same day without supervisor presence. Mirror check and bus stopping position, which were still under baseline conditions, did not change in the presence of the supervisor. For a graphic display of these data see Figure 2. Participant 2 improved by an average of 13% over baseline conditions. His largest average improvement was for complete stop with a 41% improvement (baseline, 51% safe; intervention, 92% safe). This improvement stands out as the most clear and dramatic effect of the intervention procedures. Bus stopping position improved 3% (baseline, 49% safe; intervention, 52% safe), two seconds motionless improved 3% (baseline, 28% safe; intervention, 31% safe), and mirror check also improved 3% (baseline, 38% safe; intervention, 41% safe). For a graphic display of these data see Figure 3. Participant 3 improved by an average of 12% over baseline conditions. His largest average improvement was for mirror check with a 15% improvement (baseline, 65% safe; intervention, 80% safe). Bus stopping position improved 12% (baseline, 81% safe; intervention, 93% safe), two seconds motionless improved 12% (baseline, 47% safe; intervention, 59% safe), and complete stop improved 9% (baseline, 38% safe; intervention, 47% safe). For a graphic display of these data see Figure 4. Participant 4 improved by an average of 10% over baseline conditions. His largest average improvement was for complete stop with a 19% improvement (baseline, 38% safe; intervention, 57% safe). Bus stopping position improved 2% (baseline, 94% safe; intervention, 96% safe), two seconds motionless improved 5% (baseline, 66% safe; intervention, 71% safe), and mirror check improved 15% (baseline, 58% safe; intervention, 73% safe). For a graphic display of these data see Figure 5. 23 FIGURE 2. Participant 1 results in multiple baseline design format. Closed circle data points are experimenter data, open circle data points are self-monitoring data, closed triangles are experimenter data during supervisor probes, and open triangles are supervisor data. COMPLETE STOP 100 Percent Safe 60 40 20 0 Percent Safe 100 63% 77% 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Sessions LOAD/UNLOAD 2 SECONDS MOTIONLESS 100 83 80 60 40 20 0 43% 62% 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Sessions LOAD/UNLOAD MIRROR CHECK 100 Percent Safe 100 89 80 80 60 40 20 0 88% 73% 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Sessions LOAD/UNLOAD STOPPING POSITION 100 Percent Safe Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 80 60 40 20 0 70% 78% 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Sessions JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT FIGURE 3. Participant 2 results in multiple baseline design format. Closed circle data points are experimenter data, open circle data points are self-monitoring data, closed triangles are experimenter data during supervisor probes, and open triangles are supervisor data. COMPLETE STOP 100 Percent Safe 100 80 100 51% 92% 60 40 20 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 Sessions LOAD/UNLOAD 2 SECONDS MOTIONLESS Percent Safe 100 80 28% 31% 57 55 60 40 20 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 Sessions LOAD/UNLOAD MIRROR CHECK Percent Safe 100 80 93 38% 64 60 40 20 0 41% 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 Sessions LOAD/UNLOAD STOPPING POSITION 100 100 91 80 Percent Safe Downloaded by [Western Michigan University] at 11:35 10 January 2012 24 60 40 20 49% 52% 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 Sessions 25 FIGURE 4. Participant 3 results in multiple baseline design format. Closed circle data points are experimenter data, open circle data points are self-monitoring data, closed triangles are experimenter data during supervisor probes, and open triangles are supervisor data. COMPLETE STOP 100 Percent Safe 80 76 67 60 40 20 38% 47% 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Sessions LOAD/UNLOAD 2 SECONDS MOTIONLESS 100 86 70 Percent Safe 80 60 40 20 59% 47% 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Sessions LOAD/UNLOAD MIRROR CHECK 100 100 86 Percent Safe 80 60 40 80% 65% 20 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Sessions LOAD/UNLOAD STOPPING POSITION 100 80 Percent Safe Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 100 75 60 40 93% 81% 20 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Sessions JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT FIGURE 5. Participant 4 results in multiple baseline design format. Closed circle data points are experimenter data, open circle data points are self-monitoring data, closed triangles are experimenter data during supervisor probes, and open triangles are supervisor data. COMPLETE STOP Percent Safe 100 80 100 80 60 38% 40 57% 20 0 1 2 3 4 Percent Safe 5 6 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 Sessions 7 8 LOAD/UNLOAD 2 SECONDS MOTIONLESS 100 80 60 71% 40 66% 20 0 3 4 1 2 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 Sessions LOAD/UNLOAD MIRROR CHECK Percent Safe 100 80 60 40 58% 20 73% 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 Sessions LOAD/UNLOAD STOPPING POSITION 100 Percent Safe Downloaded by [Western Michigan University] at 11:35 10 January 2012 26 80 60 96% 40 94% 20 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 Sessions Experiment 27 Downloaded by [Western Michigan University] at 11:35 10 January 2012 Results of Self-Monitoring Estimations It should be noted that drivers estimated their performance for an entire day with two self-observations, and experimenters only sampled their behavior between 30 minutes to 60 minutes each day. Therefore, the comparison between experimenter and self-monitoring data is not an exact comparison. Drivers’ self-estimations are plotted as open circles on individual results figures. For participant 1, the average of percent safe estimations across all intervention phases was 72% (complete stop, 79%; two seconds motionless, 67%; mirror check, 94%; bus stopping position, 81%). His actual overall percent safe score, as calculated from experimental observations, was 73% (complete stop, 77%; two seconds motionless, 62%; mirror check, 88%; bus stopping position, 78%). The largest discrepancy between his self-monitoring data and experimenter data occurred for mirror check, with a difference of 6%. The smallest discrepancy occurred for complete stop, with a difference of 2%. For participant 2, the average of percent safe estimations across all intervention phases was 98% (complete stop, 99%; two seconds motionless, 100%; mirror check, 100%; bus stopping position, 81%). His actual overall percent safe score as calculated from experimental observations was 53% (complete stop, 92%; two seconds motionless, 31%; mirror check, 41%; bus stopping position, 52%). The largest discrepancy between his self-monitoring data and experimenter data occurred for two seconds motionless, where the difference was 69%. The smallest discrepancy occurred for complete stop, where the difference was 7%. For participant 3, the average of percent safe estimations across all intervention phases was 78% (complete stop, 85%; two seconds motionless, 99.9%; mirror check, 100%; bus stopping position, 100%). His actual overall percent safe score as calculated from experimental observations was 65% (complete stop, 47%; two seconds motionless, 59%; mirror check, 80%; bus stopping position, 93%). The largest discrepancy between his self-monitoring data and experimenter data occurred for two seconds motionless, where the difference was 40.9%. The smallest discrepancy occurred for bus stopping position, with a difference of 7%. For participant 4, the average of percent safe estimations across all intervention phases was 74% (complete stop, 82%; two seconds motionless, 18%; mirror check, 100%; bus stopping position, 100%). His actual overall percent safe score as calculated from experimental observations was 71% (complete stop, 57%; two seconds motionless, 71%; Downloaded by [Western Michigan University] at 11:35 10 January 2012 28 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT mirror check, 73%; bus stopping position, 96%). The largest discrepancy between his self-monitoring data and experimenter data occurred for two seconds motionless, where the difference was 53%. The smallest discrepancy was for bus stopping position, where the difference was 4%. Independent Variable Integrity Group compliance with the rule to fill out two estimations of safe performance each day was 76.5%. During phases one, two, and three of the intervention, compliance was 91.5%, 72.5%, and 60.5% respectively. Group compliance with the rule to sign the feedback graph at the end of each shift was 58.8%. During phases one, two, and three of the intervention, compliance was 43.3%, 52%, and 85.5% respectively. Drivers received 68.3% of the supervisor prompts via radio that were planned. During phases one, two, and three of the intervention, supervisor compliance with the prompting procedure was 66%, 81.5%, and 57.5% respectively. Individual participants received at least one prompt on 88.3% of the days during the project, and received two daily prompts on 48.3% of the days during the project. Independent variable integrity for individual participants is summarized in Table 1. Reliability A total of 99 experimental observations of driver performance took place over the course of the study. Two independent observers collected data simultaneously for 30 sessions (30.3% of total sessions). The average agreement percentage was 89.8% (range: 70-100). IOA scores were calculated for each dependent variable for every IOA session. Agreement scores under 80 percent were limited to 11 out of 120 total IOA calculations. Table 2 shows ranges of IOA scores for each dependent variable over the course of the study. Debriefing At the conclusion of the study the participants met with the operations supervisor and student consultant for lunch and debriefing. A survey was administered to the drivers to investigate issues related to the study and solicit their opinions about the process, and afterwards, participants were informed about experimental observers and were each provided with a coded summary of self-monitoring results and the average percent improvement for each individual as observed by experi- Experiment 29 Downloaded by [Western Michigan University] at 11:35 10 January 2012 TABLE 1. Independent Variable Integrity Participant and Variable Phase One Phase Two Phase Three All Phases Participant 1 100.0 100.0 33.0 Feedback Self-Monitoring 50.0 33.0 67.0 82.0 50.0 Supervisor Prompts 80.0 66.7 66.7 73.0 Overall IV Integrity 76.7 66.6 55.6 68.3 83.0 Participant 2 100.0 69.0 67.0 Feedback Self-Monitoring 83.0 75.0 100.0 85.0 Supervisor Prompts 58.3 87.5 50.0 65.0 Overall IV Integrity 80.4 77.2 72.3 77.7 Participant 3 Self-Monitoring 83.0 63.0 67.0 73.0 Feedback 40.0 75.0 75.0 62.0 Supervisor Prompts 58.3 75.0 50.0 62.0 Overall IV Integrity 60.4 71.0 64.0 65.7 Participant 4 Self-Monitoring Feedback 83.0 38.0 75.0 68.0 0.0 25.0 100.0 38.0 Supervisor Prompts 80.0 75.0 62.5 73.0 Overall IV Integrity 54.3 46.0 79.2 59.7 mental observers. Participant responses to this information were positive. After discussing all questions that were raised during debriefing the operations supervisor left the room while consent was obtained for the use of data. Survey results showed that participants believed their self-monitoring estimations were accurate to slightly high. Participants also identified which performances had actually changed the most and which had changed the least over the course of the study. Drivers were given opportunities in the survey to describe why they thought their performance had improved or stayed the same. Comments on this topic were informative and will be presented when relevant in the discussion section. Participants rank-ordered aspects of the project from most to least useful in the following order: (1) being able to share opinions about the project, (2) talking with co-workers about safety and aspects of the route, (3) meetings to discuss the project, (4) using self-monitoring forms, (5) graphs of safe performance, (6) process not attached to disci- 30 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT Downloaded by [Western Michigan University] at 11:35 10 January 2012 TABLE 2. Inter-Observer Agreement Percentages for Each Dependent Variable Average % IOA Range % IOA Sessions < 80% Bus Stopping Position Dependent Variables 93.2 70.0-100 2 2 Seconds Motionless 90.0 73.0-100 0 Mirror Check 84.1 70.0-100 8 Complete Stop 91.8 77.2-100 1 pline in any way, (7) supervisors observed the same behaviors we did, and (8) more frequent contact from supervisors. All four participants recommended extending the use of customized self-monitoring processes to other parts of the organization for both new and experienced drivers. They also responded favorably to having the union participate in choosing target behaviors. DISCUSSION The results of the study suggest that a self-monitoring package can change the safe performance of bus operators. Furthermore, the study represents a rare empirical evaluation of lone worker performance. However, because of the small number of participants and short duration of the study, it cannot be concluded that changes in safe behavior led to an important decline in collisions. All four participants were “collision free” for five weeks, but the transit system as a whole had three separate months without collisions in 1997. The overall effects of the intervention were small to moderate (12.3% overall average improvement; individual performance improvement on specific targets range: 2% to 41%). This may have been due in part to the lack of participant involvement in activities such as performance target selection and design of the process (i.e., “buy-in” activities). The fact that participants were aware of the short-term nature of the project may have also contributed to this effect and, for some participants, may have been the reason for low treatment compliance. Perhaps some did not take the procedures “seriously” because the process was presented as temporary rather than permanent. Only future research can answer these questions conclusively. However, the results of this study do sug- Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 31 gest that there are limits to the effectiveness of self-monitoring interventions (i.e., not all behaviors improved; certain antecedent conditions or additional variables may be necessary to ensure that all behaviors improve). Indeed, it may be very difficult to ensure that self-monitoring packages produce substantial behavior change. The Cumulative Benefits of Small Effects In the current study the intervention phases were relatively short, with the entire intervention lasting only three weeks. Without any opportunity to significantly involve participants or to allow participants to become familiar with the new process, a 12.3% improvement in overall safe performance was achieved. It is possible that larger effects would occur under more supportive circumstances. This fact notwithstanding, we should consider the possible practical importance of the level of behavior change observed in the current study. Mawhinney (1999) noted that it is important to consider how small to moderate improvements would impact an organization over time. To investigate this issue we will consider the potential impact of the changes made by participant 3, whose overall average improvement of 12% was not clearly visible to us in graphic form until after mean lines were added (see Figure 4). As suggested by Mawhinney (1999), we agree that “cumulatively large benefits can result from incrementally small intervention effects” (p. 83). On the campus route there were usually about 10 instances of loading/unloading passengers every 30 minutes. During a ten-hour shift with a regular flow of passengers, each driver could stop to unload or load 200 times each day. During baseline conditions, participant 3 checked both side mirrors 65% of the time when loading/unloading passengers. This would represent 130 safe mirror checks out of 200 opportunities each day. During brief intervention conditions, he checked both side mirrors 80% of the time. This would represent 160 safe mirror checks out of 200 opportunities each day. During one month performing at baseline levels participant 3 would achieve 2080 safe mirror checks out of 3200 opportunities whereas one month of intervention level performance would achieve 2560 safe mirror checks out of 3200. So a 15% average improvement on checking mirrors could result in as many as 480 fewer at-risk load/unload instances each month. If the remaining 64 drivers working in the transit system were also participating and improved to similar levels (assuming similar passenger rates), the transit system could realize 31,200 fewer at-risk behaviors each month and 374,400 fewer at-risk behaviors each year. Managers and practitio- 32 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT Downloaded by [Western Michigan University] at 11:35 10 January 2012 ners applying BBS with lone workers should find moderate effect sizes promising, especially when maintained over longer periods of time. Behavioral Functions of the Self-Monitoring Package The effect size and variability produced in this study are similar to effects and variability generated with antecedent interventions targeting safety (e.g., Austin, Alvero, & Olson, 1998; Engerman, Austin, & Bailey, 1997; Ludwig & Geller, 1997; Streff, Kalsher, & Geller, 1993). Although the performance targets of the above studies are not identical to the targets in the current study, all seem to involve a common safety dilemma where immediate and probable consequences support risky performance, while delayed or improbable consequences fail to support safe performance. Given the similar behavioral underpinnings of performance targets, it is interesting to note that the self-monitoring package generated effects similar in magnitude to purely antecedent strategies. In contrast to antecedent strategies, most safety studies that use programmed consequences have demonstrated much larger changes in behavior (e.g., Austin, Kessler, Riccobono, & Bailey, 1996; SulzerAzaroff & de Santamaria, 1980). These results, combined with the effect size and variability issues discussed above, leads us to believe that our self-monitoring procedure might have served an important antecedent function. One may also argue, in line with Hayes and Nelson (1983), that the whole self-monitoring package (the instructions, the sheets, the prompts, and posted feedback) made more effective the natural consequences of the particular performances we measured. That is, monitoring complete stops, for example, could have made the potential consequences of behaving unsafely (e.g., colliding with student pedestrians or other vehicles) more salient. One driver’s answer to a survey question highlights this issue. When explaining why some of his behavior did not change very much, participant 2 circled the statement “accidents/collisions just don’t happen often enough to warrant any extra effort to prevent them.” Alternatively, participant 1 reported the following with regard to the self-monitoring package, “It caused me to consider the effects on others (students) of my errant behavior (rolling stops).” Aversive outcomes like collisions, as horrific as they may be, tend to be too improbable to motivate safe behavior. In addition, the safest way of doing things often requires the person to endure immediate aversive conditions (taking longer to complete a task, wearing uncomfortable personal protective equipment, etc.). Reports such as those Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 33 from participant 1 suggest that the self-monitoring package, in some cases, overcame the contingencies favoring risk-taking by making the consequences for unsafe acts more salient. From a molecular analytic perspective, the self-monitoring package may have generated CEOs that altered the effectiveness of direct-acting reinforcers or punishers (Malott, R., Malott, M., & Trojan, E., 1999; Michael, 1993). Discussion of Individual Performance It was hoped that very consistent effects would be observed across participants, or at least systematic improvements related to the degree to which participants complied with intervention procedures. However, each participant’s largest improvement was not necessarily the most accurately self-estimated performance. Among individual participants there were very small to very large improvements for specific target performances. Understanding these individual differences in performance requires a consideration of the accuracy of each participant’s self-monitoring estimations, the extent of exposure to the independent variables (i.e., independent variable integrity) for each participant, the self-report data obtained from each participant, and anecdotal information obtained by experimental observers. Because aggregate data can obscure intervention effects and relationships between variables, we chose to provide more detailed analyses of the data for participants 1 and 4. Participant 1 Performance Participant 1 realized the greatest average improvement (14%) and the most consistent improvements of any participant. He was also the most accurate self-estimator of safe performance. Upon visual inspection of his data, it is clear that his estimations closely tracked his actual performance (see Figure 1). The data from participant 1 support the findings of McCann and Sulzer-Azaroff (1996), suggesting that the greatest improvements in safe performance occur when participants are most accurate in their self-estimations. Overall independent variable integrity for participant 1 was 68.3% (Phase one, 76.7%; Phase two, 66.6%; Phase three, 55.6%). The decline in integrity percentages was largely the result of decreased participation in self-monitoring procedures (he was 33% compliant during phase three). This may explain the sharp drop in his performance on bus stopping position during the last two days of intervention (see Figure 1). Downloaded by [Western Michigan University] at 11:35 10 January 2012 34 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT Anecdotally, participant 1 appeared to be deliberate and conscientious and seemed to take great pride in his profession. It is possible that certain “personality characteristics” (i.e., verbal responses to questions on valid psychometric instruments) could predict the effectiveness of or compliance with self-monitoring procedures in some cases. Participant 1 also responded very systematically to supervisor observations, during which his performance on the variables being self-monitored was about 20% higher than his performance on the same day without supervisor presence. During supervisor observations, dependent variables that were not being self-monitored remained at baseline levels. This effect suggests relatively low reactivity to experimental observers as compared to reactivity to supervisor presence. Participant 4 Performance Participant 4 achieved the smallest overall improvement for the group (10%) and also had the lowest overall independent variable integrity of all participants (59.7%). The clearest effects for this participant occurred during the first phase of intervention. During baseline conditions he seemed to come to a complete stop only when he was forced to do so by traffic conditions. His typical pattern of performance was to roll slowly through stop signs. This distinctive performance during baseline made behavior changes observed on the first day of intervention very dramatic. The deterioration of this improvement in performance was also distinctive as it gradually returned to baseline levels over the six sessions of phase one (see Figure 5). Contributing to this effect may have been the fact that participant 4 did not ever sign the feedback graph during phase one of the intervention, suggesting he did not view the graphs, which may have eliminated a consequence component from the self-monitoring package. Another clear effect achieved during the first phase of the study for this participant occurred during the supervisor probe. He scored 30% higher on complete stops when the supervisor was present than he did when the same performance was measured on the same day without the presence of a supervisor. In addition, the baseline dependent measures all showed slightly lower performance with the supervisor present than they did without the presence of the supervisor, showing that the participant was reactive only to the performance being self-monitored. At the onset of phase two, participant 4’s performance dropped to 20% and 16% safe on 2 seconds motionless and complete stop respectively. At that time we hypothesized that this might represent counter-controlling Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 35 behavior in response to the intervention procedures (Ludwig & Geller, 1999; Skinner, 1953). However, this low performance did not continue beyond the first day of phase two of the intervention. We selected participant 4’s performance to analyze because it demonstrates the fact that grouping data across behaviors within a single participant can conceal true effects; just as effects can be concealed by grouping the performance data of several individual participants (as in group research). To clarify, we consider his performance relative to the accuracy of his estimations in more detail. Although his estimations were the least accurate and his overall performance changed the least of all participants, the accuracy of participant 4’s self-estimations did not seem to systematically vary with his performance improvement. The smallest discrepancy between his self-estimations and experimenter data occurred for bus stopping position with an average difference of 4%. However, this performance improved by only 2% over baseline levels (see Figure 5). In contrast, his estimations differed from experimenter data by 25% for complete stop, where he realized his greatest improvement (19% over baseline levels). Another large discrepancy occurred for two seconds motionless, which improved by only 5%, where his self-estimations were 53% lower than experimenter data. If we were to look only at his overall behavior change and his overall estimations (i.e., data grouped across behaviors), the data would suggest a clear relationship between his estimations and the resulting behavior change (i.e., he had the smallest overall effect size and reported the least accurate data), especially in light of participant 1’s results discussed above (i.e., who reported the most accurate data and had the largest overall effect size). However, as one can see from the more detailed analysis that considers each behavior singly, the relationship between estimations and behavior change is far from clear. It is logical that accuracy of self-estimations would affect the degree to which behavior changes. However, the degree of agreement between self-monitoring and experimenter data in our study did not predict the degree of improvement for each participant on particular performance targets. Accuracy is only estimated by assessing IOA (Johnston & Pennypacker, 1993). Therefore, with regard to the importance of the accuracy of self-monitoring data, we have only scratched the surface of the topic. FUTURE RESEARCH There are many unanswered questions regarding applications of self-monitoring procedures to improve the performance of lone work- Downloaded by [Western Michigan University] at 11:35 10 January 2012 36 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT ers. The most important question in terms of safety is the effectiveness of these kinds of procedures at reducing accidents and/or injuries. Krause (1997) reported a 66% reduction in accidents and injuries in his application with bus drivers, but methodological issues prevent drawing firm conclusions about the degree of behavior change generated by the self-monitoring procedure. While we were able to successfully build upon the consultation effort reported by Krause (1997) by experimentally evaluating behavior change, we were not able to answer questions about accident/injury reduction. In order for researchers to draw conclusions about accident/injury reduction, it may be necessary to partner with companies or consulting firms implementing behavior-based safety processes with lone workers on a large scale. Academic parties could ensure reliable assessment of behavior change and companies or consultation firms could ensure a large-scale implementation with a long duration that could impact accident/injury rates. An additional question that still remains unanswered is the extent to which accuracy of self-monitoring influences its effectiveness (McCann & Sulzer-Azaroff, 1996). Such research could begin by training participants to accuracy at the beginning of a study and then assessing drift and concurrent performance levels with confederate observers or some other unobtrusive measurement system over time. Some electronic forms of driving performance measurement are now becoming available that might be of use in such research. The issues discussed above are excellent research questions, however, both require that behavior change be produced reliably by a self-monitoring procedure. It is hoped that the successes and failures of the current study will inform the development of self-monitoring procedures that can reliably produce substantial changes in safe behavior. Several methodological improvements are needed in order for extensions and/or replications of this work to (a) more clearly assess behavior change and (b) generate greater behavior change. First, baseline and intervention phases of longer duration would allow researchers to discern behavioral effects more reliably. This is especially relevant for the third phase of the intervention that targeted mirror check and bus stopping position, which lasted for only a few sessions. Even if methodological improvements indicate no effect for any one dependent measure, this enables researchers to draw stronger conclusions about the “boundaries” of the effectiveness of an intervention. In other words, researchers could then explore questions about why some performances improved while others did not. Research of this kind would be costly in terms of labor and time, but would enable researchers to draw stronger Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 37 conclusions about behavioral changes. Second, potentially more powerful intervention variables should be tested. An obvious choice would be the addition of valuable consequences that were dependent upon some aspect of driver performance (e.g., participation or performance levels as assessed by observers). In addition to adding more powerful consequences to such interventions, we feel that there are at least two less costly or less intrusive conditions that might add power to the intervention: these are (a) participants selecting performance targets of personal value or interest and (b) evaluating an implementation that was perceived as permanent rather than temporary. We discuss these two issues, as well as research that might reveal the behavioral functions of stimuli generated by self-monitoring procedures, below. A key component missing from the current study was the absence of employee participation in the design stages of the project and other activities said to generate “buy in.” Both Krause (1997) and McSween (1995) heavily promote employee participation in BBS processes. Aspects of such employee involvement may function as motivational variables where the value of consequences related to safety improvement is increased and behaviors correlated with those improvements are more frequently evoked. When behavior is analyzed on a molecular scale (i.e., behavior is analyzed in terms of its immediate antecedents and consequences), Michael’s (1993) taxonomy of CEOs may be relevant. Participant comments on the debriefing survey suggest that employees may make the greatest improvements when they “value” the target performance. Technically, values can be defined as a set or constellation of conditioned reinforcers (Malott, R. Malott, M., & Trojan, 1999). Participant 2 improved complete stops by 41% and his survey comments regarding the self-monitoring process emphasized this specific target performance. He wrote, “Complete stops are important. A lot can happen in a short amount of time at an intersection. Really have to stop completely to see the whole picture.” These results and self-report comments concur with McSween (1995), who suggested that learning experiences prior to the onset of a BBS initiative may be important strategically and that individuals’ values should be incorporated into performance improvement initiatives. Future research should examine more closely this potential relationship between employee “buy-in” activities and the effectiveness of and compliance with treatment protocols. Whether self-monitoring procedures with lone workers tend to function primarily as antecedents, as does a prompt for safety belt use, is an interesting research question. Researchers have suggested that self-moni- Downloaded by [Western Michigan University] at 11:35 10 January 2012 38 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT toring is effective as a result of an individual applying consequences contingent upon his or her own behavior (Kanfer, 1970). Future research could explore this question by requiring the self-monitoring to take place either just before (antecedent function), or just after (consequence function) a work shift and/or by measuring the use of self-delivered consequences through talk-aloud procedures. If self-monitoring tends to function primarily as an antecedent, practitioners should emphasize the addition of programmed reinforcement to ensure prolonged effectiveness. Future researchers should also consider the clinical literature on self-monitoring. For example, some clinical research suggests that the power of self-monitoring procedures is enhanced when participants monitor the frequency of undesired, rather than desired, performance (Kopp, 1988). DISCUSSION AND CONCLUSION Strengths of the current study include measures of independent variable integrity, collection of self-report measures at the conclusion of the study, and supervisor probes. In some cases IV integrity measures provided insight into unusual patterns in the data. The survey instrument gave participants a chance to express their opinions about aspects of the process, and gave us a chance to collect information about covert behavior that may have impacted their performance. Supervisor probes affected performance systematically across all participants and may represent one method for assessing participants’ understanding of the target performances. For some participants the probes demonstrated that they understood and were capable of performing the target behaviors at high percent safe levels. For participant 2, however, the probe showed that he may not have understood or discriminated certain target behaviors. His performance improved when the supervisor was present, but only to 55% and 64% for 2 seconds motionless and mirror check, respectively. In general, the probes demonstrated that supervisor presence was a more powerful intervention than self-monitoring, and that participants improved only the behaviors that supervisors were observing. Weaknesses of the current study include the relatively short duration of the intervention, the absence of meaningful outcome measures (also due to the short duration), the small number of participants, the lack of employee “buy-in,” and the small to moderate effect size of the intervention. The study was cut short because the particular bus route terminated for summer break, so we could not determine whether performance changes maintained, improved, or deteriorated over time. As mentioned Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 39 previously, future researchers should consider methods that provide more time for the stabilization of performance under each experimental condition. In addition to concerns about the ability to assess behavior change, a reduction in collisions or injuries is not possible unless more participants are involved over long periods of time. With regard to “buy-in,” our participants started off “cold” with self-monitoring procedures. This feature does not resemble real world BBS consultation efforts where employees are often heavily involved in the planning stages of the process. In the current study, participant “buy-in” was compromised for the sake of ensuring dependent variables that could be measured reliably, although it is possible that using video cameras to tape lone worker performance could expand the range of dependent measures that can be reliably evaluated. An intervention that included more salient motivational operations (e.g., employee participation in the planning stages; expression of support from upper managers), more powerful antecedent prompts (e.g., the presence of a video camera), or more powerful consequences (e.g., incentives or praise contingent upon reaching participation goals) may have generated larger performance improvements. The results of the current study suggest that self-monitoring is a promising strategy for improving the safe performance of lone workers such as bus operators. However, these types of interventions are difficult to study and future advances in improving the safe performance of lone workers must address important methodological challenges. These challenges include (a) participant reactivity to experimental observers, (b) reliability of behavioral/performance data, (c) scale and duration, and (d) expense. NOTE 1. The authors obtained approval to conduct the research from the Human Subjects Institutional Review Board at Western Michigan University. The proposal was submitted under the category of exempt from full review because the measurement system targeted public behavior. REFERENCES Alavosius, M. P., & Sulzer-Azaroff, B. (1986). The effects of performance feedback on the safety of client lifting and transfer. Journal of Applied Behavior Analysis, 19, 261-267. Alavosius, M. P., & Sulzer-Azaroff, B. (1990). Acquisition and maintenance of health-care routines as a function of feedback density. Journal of Applied Behavior Analysis, 23, 152-162. Downloaded by [Western Michigan University] at 11:35 10 January 2012 40 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT Austin, J., Alvero, M. & Olson, R. (1998). Prompting patron safety belt use at a restaurant. Journal of Applied Behavior Analysis, 31, 655-657. Austin, J., Kessler, M. L., Riccobono, J. E., & Bailey, J. S. (1996). Using feedback and reinforcement to improve the performance and safety of a roofing crew. Journal of Organizational Behavior Management, 16 (2), 49-75. Babcock, R. A., Sulzer-Azaroff, B., & Sanderson, M. (1992). Increasing nurses’ use of feedback to promote infection control practices in a head injury treatment center. Journal of Applied Behavior Analysis, 25, 621-627. Baskett, L. M. (1985). Self-monitoring in children: Accuracy and reactivity. Journal of Genetic Psychology, 146, 107-116. Berry, T. D., Geller, E. S., Calef, R. S., & Calef, R. A. (1992). Moderating effects of social assistance on verbal interventions to promote safety belt use: An analysis of weak plys. Environment and Behavior, 24 (5), 653-669. Browder, D. M., Liberty, K., Heller, M., & D’Huyvetters, K. K. (1986). Self-management by teachers: Improving instructional decision making. Professional School Psychology, 1 (3), 165-175. Burgio, L. D., Whitman, T. L., & Reid, D. H. (1983). A participative management approach for improving direct-care staff performance in an institutional setting. Journal of Applied Behavior Analysis, 16, 37-53. Chhokar, J. S., & Wallin, J. A. (1984). A field study of the effect of feedback frequency on performance. Journal of Applied Psychology, 69 (3), 524-530. Cohen, H. H., & Jensen, R. C. (1984). Measuring the effectiveness of an industrial lift truck safety program. Journal of Safety Research, 15, 125-135. Daniels, A. (1989). Performance management (3rd ed.). Tucker, GA: Performance Management Publications. Dean, M. R., Malott, R. W., & Fulton, B. J. (1983). The effects of self-management training on academic performance. Teaching of Psychology, 10 (2), 77-81. DeVries, J. E., Burnette, M. M., & Redmon, W. K. (1991). AIDS prevention: Improving nurses’ compliance with glove wearing through performance feedback. Journal of Applied Behavior Analysis, 24, 705-711. DiGangi, S. A., Maag, J. W., & Rutherford, R. B. (1991). Self-graphing of on-task behavior: Enhancing the reactive effects of self-monitoring on on-task behavior and academic performance. Learning Disability Quarterly, 14 (3), 221-230. Engerman, J. A., Austin, J., & Bailey, J. S. (1997). Prompting patron safety belt use at a supermarket. Journal of Applied Behavior Analysis, 30, 577-579. Fellner, D. J., & Sulzer-Azaroff, B. (1984). Increasing industrial safety practices and conditions through posted feedback. Journal of Safety Research, 15, 141-151. Fellner, D. J., & Sulzer-Azaroff, B. (1986). Occupational safety: Assessing the impact of adding assigned or participative goal setting. Journal of Organizational Behavior Management, 7, (1/2), 3-24. Fox, D. K., Hopkins, B. L., & Anger, W. K. (1987). The long term effects of a token economy on safety performance in open pit mining. Journal of Applied Behavior Analysis, 20, 215-224. Grindle, A. C., Dickinson, A. M., & Boettcher, W. (2000). Behavioral safety research in manufacturing setting: A review of the research. Journal of Organizational Behavior Management, 20 (1), 29-68. Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 41 Hayes, S. C., & Nelson, R. O. (1983). Similar reactivity produced by external cues and self-monitoring. Behavior Modification, 7 (2), 183-196. Johnston, J. M., & Pennypacker, H. S. (1993). Strategies and tactics of behavioral research. New Jersey: Lawrence Earlbaum and Associates, Inc. Kanfer, F. H. (1970). Self-monitoring: Methodological limitations and clinical applications. Journal of Consulting and Clinical Psychology, 35, 148-52. Kessler, D. L. (1985). The effectiveness of different sources of feedback on outcome and behavior in improving the performance of university baseball pitchers. Dissertation Abstracts International, 45 (8-B), 2733-2734. Kneedler, R. D., & Hallahan, D. P. (1981). Self-monitoring of on-task behavior with learning disabled children: Current studies and directions. Exceptional Education Quarterly, 2 (3), 73-82. Komaki, J. L., Barwick, K. D., & Scott, L. W. (1978). A behavioral approach to occupational safety: Pinpointing and reinforcing safe performance in a food manufacturing plant. Journal of Applied Psychology, 63 (4), 434-445. Komaki, J. L., Heinzmann, A. T., & Lawson, L. (1980). Effect of training and feedback: Component analysis of a behavioral safety program. Journal of Applied Psychology, 65 (3), 261-270. Kopp, J. (1988). Self-monitoring: A literature review of research and practice. Social Work Research and Practice, 24, 8-20. Krause, T. R. (1997). The behavior-based safety process: Managing involvement for an injury free culture (2nd ed.). New York: Van Nostrand Reinholdt. Lan, W. Y. (1996). The effects of self-monitoring on students’ course performance, use of learning strategies, attitude, self-judgement ability, and knowledge representation. Journal of Experimental Education, 64 (2), 101-115. Ludwig, T. D., & Geller, E. S. (1991). Improving the driving practices of pizza deliverers: Response generalization and moderating effects of learning history. Journal of Applied Behavior Analysis, 24, 31-44. Ludwig, T. D., & Geller, E. S. (1997). Assigned versus participative goal setting and response generalization: Managing injury control among professional pizza deliverers. Journal of Applied Behavior Analysis, 82 (2), 253-261. Ludwig, T. D., & Geller, E. S. (1999). Behavioral impact of a corporate driving policy: Undesirable side effects reflect countercontrol. Journal of Organizational Behavior Management, 19 (2), 25-34. Ludwig, T. D., & Geller, E. S. (2000). Intervening to improve the safety of delivery drivers: A systematic behavioral approach. Journal of Organizational Behavior Management, 19 (4), 1-124. Malott, R. W., Malott, M. E., & Trojan, E. (1999). Elementary principles of behavior. Upper Saddle River, NJ: Prentice Hall. Mawhinney, T. C. (1999). Cumulatively large benefits of incrementally small intervention effects: Costing metacontingencies of chronic absenteeism. Journal of Organizational Behavior Management, 18 (4), 83-95. Downloaded by [Western Michigan University] at 11:35 10 January 2012 42 JOURNAL OF ORGANIZATIONAL BEHAVIOR MANAGEMENT McAfee, R. B., & Winn, A. R. (1989). The use of incentives/feedback to enhance work place safety: A critique of the literature. Journal of Safety Research, 20, 7-19. McCann, K. B., & Sulzer-Azaroff, B. (1996). Cumulative trauma disorders: Behavioral injury prevention at work. Journal of Applied Behavioral Science, 32 (3), 277-291. McSween, T. E. (1995). The values-based safety process: Improving your safety culture with a behavioral approach. New York: John Wiley & Sons. Meinhold, P. M., & Mulick, J. A. (1990). Risks, choices, and behavioral treatment. Behavioral Residential Treatment, 5 (1), 29-44. Michael, J. (1993). Establishing operations. The Behavior Analyst, 16 (2), 191-206. Moinat, S., & Snortum, J. R. (1976). Self-management of personal habits by female drug addicts: A feasibility study. Criminal Justice & Behavior, 3 (1), 29-40. Nasanen, M., & Saari, J. (1987). The effects of positive feedback on housekeeping and accidents at a shipyard. Journal of Occupational Accidents, 8, 237-250. Petersen, D. (1984). An experiment in positive reinforcement. Professional Safety, 29 (5), 30-35. Pettinger, C., Click, R., & Geller, E. S. (2000, May). Behavior-based safety for solitary workers: Using self-management to improve safe driving behaviors. In J. Agnew (Chair), Self-observation in behavior-based safety. Symposium conducted at the 26th Annual Convention for the Association of Behavior Analysis, International, Washington, DC. Phillips, R. A., Sutherland, V. J., & Makin, P. J. (1994). Reducing accidents using goal setting and feedback: A field study. Journal of Occupational and Organizational Psychology, 67, 219-240. Reber, R. A., & Wallin, J. A. (1984). The effects of training, goal setting, and knowledge of results on safe behavior: A component analysis. Academy of Management Journal, 27 (3), 544-560. Reber, R. A., Wallin, J. A., & Chhokar, J. S. (1990). Improving safety performance with goal setting and feedback. Human Performance, 3 (1), 51-61. Reddell, C. R., Congleton, J. J., Hutchingson, R. D., & Montgomery, J. F. (1992). An evaluation of a weightlifting belt and back injury prevention training class for airline baggage handlers. Applied Ergonomics, 23 (5), 319-329. Richman, G. S., Riordan, M. R., Reiss, M. L., Pyles, D. A. M., & Bailey, J. S. (1988). The effects of self-monitoring and supervisor feedback on staff performance in a residential setting. Journal of Applied Behavior Analysis, 21 (4), 401-409. Saarela, K. L. (1989). A poster campaign for improving safety on shipyard scaffolds. Journal of Safety Research, 20 (4), 177-185. Schlinger, H. D. (1993). Separating discriminative from function-altering effects of verbal stimuli. The Behavior Analyst, 16 (1), 9-23. Schwarz, N. (1999). Self reports: How the questions shape the answers. American Psychologist, 54 (2), 93-105. Skinner, B. F. (1953). Science and human behavior. New York: Macmillan. Smith, M. J., Anger, W. K., & Uslan, S. S. (1978). Behavioral modification applied to occupational safety. Journal of Safety Research, 10 (2), 87-88. Smith, M. J., Cohen, H. H., Cohen, A., & Cleavland, R. J. (1978). Characteristics of successful safety programs. Journal of Safety Research, 10 (1), 87-88. Downloaded by [Western Michigan University] at 11:35 10 January 2012 Experiment 43 Srikameswaren, S. M. (1992). Standardized coaching sessions and a self-evaluation package for improving performance of figures by young figure skaters. Dissertation Abstracts International, 53 (1-B), 554. Stecker, P. M., Whinnery, K.W., & Fuchs, L. S. (1996). Self-recording during unsupervised academic activity: Effects on time spent out of class. Exceptionality, 6 (3), 133-147. Streff, F. M., Kalsher, M. J., & Geller, E. S. (1993). Developing efficient workplace safety programs: Observations of response covariation. Journal of Organizational Behavior Management, 13 (2), 3-14. Sulzer-Azaroff, B. (1978). Behavioral ecology and accident prevention. Journal of Organizational Behavior Management, 2, 11-44. Sulzer-Azaroff, B., & Austin, J. (2000). Does BBS work? Behavior-based safety and injury reduction: A survey of the evidence. Professional Safety, 45 (7), 19-24. Sulzer-Azaroff, B., & de Santamaria, M. (1980). Industrial safety hazard reduction through performance feedback. Journal of Applied Behavior Analysis, 13, 287-295. Whelan, J., Mahoney, M. J., & Meyers, A. W. (1991). Performance enhancement in sport: A cognitive behavioral domain. Behavior Therapy, 22 (3), 307-327.