TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 1 A Systematic Review of Training Educational Staff in Functional Behavioral Assessment John McCahill1 Olive Healy2 Sinéad Lydon2 Devon Ramey3 1 National University of Ireland, Galway, Ireland Trinity College Dublin 3 Texas State University 2 Corresponding Author: Olive Healy, School of Psychology, Trinity College Dublin, College Green, Dublin 2, Ireland. Tel: 00353 1 896 1175, Fax: 00353 1 671 2006, olive.healy@tcd.ie TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 2 Abstract Interventions for challenging behavior are more likely to be effective when based on the results of a functional behavioral assessment. Research to date, suggests that staff members in educational settings may not have the requisite levels of expertise or support to implement behavioral assessment procedures and design corresponding behavior support plans. The current review sought to examine the nature and effectiveness of Functional Behavioral Assessment (FBA) training described in the literature. Twenty- five studies were examined in relation to type of FBA method used, training procedure, behavioral function and intervention outcome. Training was provided in indirect, observational and experimental functional assessment procedures. Video modeling, lectures, feedback and written protocols were some commonly used training procedures. Interventions derived from results of these assessments were used in twelve studies to treat problem behavior. Social validity and treatment integrity across all studies are reported. The implications of these findings for research and practice are discussed along with directions for future research. Keywords: functional behavioral assessment; functional analysis; staff training; teacher training; challenging behavior TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 3 Training Educational Staff in the Use of Functional Behavioral Assessment: A Systematic Review Challenging behavior can have multiple negative effects by impeding learning and skill acquisition in individuals emitting the behavior, disrupting the environment for other students, and may result in injury to oneself or others (Division of Early Childhood, 2007; Emerson, 2001). Challenging behavior has also been found to have detrimental effects on teachers. Hastings and Bham (2003) found that burnout and stress levels were higher among teachers dealing with behavioral problems. These negative effects may be more pronounced in schools staffed by individuals unfamiliar with the technology and strategies of Applied Behavior Analysis. Student expulsion or suspension has been found to be more common in settings where teachers report high levels of stress and challenging behavior in their classrooms, and who lack knowledge of behavioral intervention, or the support of behavioral experts (Gilliam & Shahar, 2006). Further, research suggests that perceived self-efficacy may be higher among teachers working in schools in which positive behavior support is widely utilized (Kelm & McIntosh, 2012). The consideration of operant theory and Applied Behavior Analysis in the treatment of challenging behavior in the classroom yields benefits for both students and teachers. Operant theory attempts to explain challenging or problem behavior in terms of observable environmental events. Identifying the stimuli and settings that evoke problem behavior, and the variables responsible for its maintenance, enables a practitioner to alter the environment and to teach functionally equivalent appropriate behaviors which should render the target behaivor no longer necessary. The events supporting problem behavior can be identified through informant methods (Durand & Crimmins, 1988), direct observation (Bijou, Petersen & Ault, 1968) or experimental environmental manipulation typically referred to as functional analysis (Iwata, Dorsey, Slifer, Bauman & Richman, 1994). These procedures taken together TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 4 are known as Functional Behavioral Assessment (FBA; Healy & Brett, 2014). While functional analysis is typically considered the “gold standard” (Delfs & Campbell, 2010, p. 5) for ascribing function and subsequently developing function-based interventions, a recent review of the utility of FBA procedures indicated that treatment efficacy did not differ according to the FBA methodology used (Delfs & Campbell, 2010; Healy, Brett & Leader, 2013). However, the importance of utilizing some form of FBA is evident; research has consistently demonstrated that behavioral interventions derived from prior functional assessment or analysis are more effective than non function-based interventions (e.g., Campbell, 2003; Devlin, Healy & Leader, 2009; Devlin, Healy, Leader & Hughes, 2011; Didden, Korzilius, Van Oorsouw, & Sturmey, 2006; Ingram, Lewis-Palmer, & Sugai, 2005). Behavior analysts have successfully applied FBA procedures in controlled conditions since their development (Hanley, Iwata & McCord, 2003). However, transitioning their use to educational and clinical settings has taken place relatively recently (Hanley et al., 2003). This is partly because of the training and expertise required to conduct these procedures (Iwata et al., 2000; Scott, McIntyre, Liaupsin, Nelson, Conroy & Payne, 2005). In recent years, there has been an increased focus on improving the applicability and dissemination of these procedures. The implementation of FBA by individuals other than behavior analysts is desirable for many reasons. Reducing the “artificiality” of experimental functional analysis techniques is considered a key aim; research has demonstrated that inaccurate functional analysis results may be less frequent when the experimental conditions are implemented by persons familiar with the individual exhibiting the challenging behavior, possibly due to the more naturalistic conditions involved (Huete & Kurtz, 2010; Martens, Parks, Clark, & Call, 2012). Added to this, the Individuals with Disabilities Education Act (IDEA, 2004) requires the application of FBA for children who are at risk of expulsion due to unmanageable behavioral problems (Yell & Shriner, 1998). This law aims to bring school policies into line TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 5 with best practice in behavioral treatment. However, research has shown, that teachers and other educational staff are typically inadequately prepared and often lack the skills necessary to conduct effective FBAs with challenging behavior that they encounter (e.g., Couvillon, Bullock, & Gable, 2009; Mortenson, Rush, Webster, & Beck, 2008; Pindiprolu, Peterson, & Berglof, 2007; Van Acker, Boreson, Gable, & Potterton, 2005). Conroy and colleagues (1999) noted that some practitioners have implemented FBA without adequate training, often resulting in subjective definitions of target behaviors, aversive procedures used by default, and a frequent failure to use FBA data in interventions (see also Van Acker et al., 2005). Mortenson et al. (2008) assessed the ability of 88 teachers to identify the behavioral function of challenging behaviors described in three vignettes. The results indicated that participants struggled to correctly identify the function of the specific behaviors and to propose appropriate behavioral interventions. Such findings highlight the need for staff training in FBA methodologies in educational settings. However, obstacles to such training programs have also been identified; some have questioned whether teachers can efficiently conduct FBA procedures while still attending to their regular classroom tasks (Scott, Bucalos, Liaupsin, Nelson, Jolivette & DeShea, 2004). Teachers’ ability to implement the functional analysis conditions with integrity (Scott et al., 2004) and to accurately assess multiply controlled behaviors (Witt, VanDerHeyden, & Gilbertson, 2004) has also been called into question. Such findings have led scholars in the field of FBA to call for an increased focus on staff training in functional analysis and assessment methodologies in order to promote the utilization of such procedures as well as subsequent implementation of function-based behavioral interventions for challenging behavior (Iwata & Dozier, 2008; Pindiprolu et al., 2007; Van Acker et al., 2005). Previous research has demonstrated that college students (e.g., Iwata et al., 2000; Trahan & Worsdell, 2011), parents (e.g., Feldman & Werner, 2002; TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 6 Najdowski et al., 2008), and residential care workers (e.g., Lambert, Bloom, Kunnavatana, Collins, & Clay, 2013; Phillips & Mudford, 2008) can be trained to effectively utilize functional assessment or analysis techniques. According to Van Acker et. al. (2005) an adequate FBA and intervention plan require clearly defined behaviors, multiple sources of information on the behavior and generation of functional hypotheses that lead to the development of Behavior Intervention Plans. Currently, many variations of FBA training exist including: training manuals (Cipani & Schock, 2012); instructional videos (LaVigna & Willis, 2005) and in-school consultation (Renshaw, Christensen, Marchant & Anderson, 2008). Training may comprise instruction in indirect assessment, observational assessments, experimental functional analysis or any combination of the three. Regardless of the training method used, educators must be trained in functional behavioral assessment procedures which are acceptable to them, feasible within their organizational context and usable with a high degree of procedural integrity (McKenney, Waldron & Conroy, 2013). Treatment integrity and social validity are therefore important dependent variables in many training programs (McKenney et al., 2013). To date there remains a lack of consensus on which FBA methodologies should be taught to educational and clinical staff. Some have suggested that informant (indirect) and descriptive (direct observation) methods are sufficient sources of functional assessment data. Such methods involve for example, interviews, behavior rating scales, recording antecedent and consequent environmental variables as well as temporal events. Others contend that functional analysis provides the most accurate assessment of behavioral function, because it facilitates a demonstration of a causal relationship between social consequences and challenging behavior (Hanley, et al., 2003; Iwata & Dozier, 2008). Regardless of method employed, effective training in FBA can be demanding in relation to time and resources (Scott et al., 2005). TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 7 The current review sought to critically examine the extant literature on training in FBA training in general educational or clinical settings. Specifically, we aimed to evaluate studies which reported training in the utilization of functional assessment methodologies among educational or clinical staff, to assess the efficiency of staff implementation of FBA methods, to evaluate the effectiveness of reported training procedures, and to determine the social validity of the assessments and interventions described. Method Search Procedures Comprehensive literature searches were conducted using the following electronic databases: EBSCO Academic Search Complete, SCOPUS, PsycINFO, ERIC, and Psychology and Behavioral Sciences Collection. Systematic searches were carried out by inputting the keywords “training”, “staff”, and “teacher” in combination with the following keywords: applied behavior analysis, functional behavior* assessment, functional assessment, functional analysis, positive behavior support. Searches were limited by year of publication, excluding papers published prior to 1999; in order reflect the most recent trends in research. Inclusion and Exclusion Criteria Studies were selected for inclusion in this review if they met the following criteria: a) the implementation and description of training in functional assessment or functional analysis procedures for school staff; b) participating trainees had no prior experience using functional assessment or analysis procedures; c) student participants were all of school age (<18 years old); d) use of a single subject design; e) implementation of the assessment procedures in natural (educational/clinical) settings by trainees; and f) publication in an English language, peer-reviewed journal. Studies that employed behavioral consultation models, in which TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 8 researchers collaborated with teachers on a FBA but did not allow the trainee to perform the procedures independently, were excluded from this review. Results Twenty-five studies met the criteria for inclusion in this review. Table 1 provides information on the sample sizes, settings, and participant characteristics across these studies. Participant Characteristics Studies reviewed reported a total of 78 school staff as trainees. Trainees included teachers (n=53); special education teachers (n=14); classroom staff (n=3); psychology graduates (n=3); classroom assistants (n=3); paraprofessionals (n=2); school principal (n=1); assistant teacher (n=1); reading intervention provider (n=1) and one classroom aide (n=1). Trainee experience in education was reported in 16 studies and ranged from 0-36 years (m=6.40 years). Educational levels were not reported for all trainees but the majority had at least, a BA in a field relevant to education, and had all appropriate licensing. Only four of the trainees had yet to complete their course of education and ten were working on or had completed a Master’s degree in their field. Some trainees had attended seminars on challenging behavior or were involved in an ABA Master’s programme. None of the trainees had any prior experience of Functional Assessment or Behavior Support Planning (see Table 1). A total of 112 participants received a functional assessment across the 25 studies reviewed. Ages ranged from three to 15 years (M=7.42 years). Participants presented with a range of diagnoses. Two children were diagnosed with Emotional and Behavioral Disorder (EBD), five with Autism Spectrum Disorder (ASD), ten children had unspecified developmental disabilities, one participant was diagnosed with Down Syndrome and one with TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 9 learning disability. Three participants were each reported with diagnoses of Attention Deficit Hyperactivity Disorder (ADHD), Intellectual Disability and Angelman’s Syndrome. Forty eight typically developing children were reported across studies reviewed and 24 participants were included without a description of their diagnosis (see Table 1). -----------------------------------------Insert Table 1 about here ------------------------------------------Table 2 reports targeted behaviors, type of functional assessment or functional analysis employed, experimental design, baseline assessments, training methods and duration, post-training assessments, treatment integrity and social validity. Disruption was the most commonly assessed behavior reported in ten studies. This was followed by aggression, reported in nine studies, SIB in five studies and inappropriate vocalizations/crying/ screaming/verbal outbursts reported in four studies. Each of the following behaviors was reported in two studies: off task, tantrums, arbitrary non-challenging behaviors, inappropriate touching, throwing, out of seat, property damage and non-compliance. Each of the following behaviors was reported by one study: non completion of work, stereotypy, inappropriate attention seeking, and mouthing (see Table 2). Trainee Conducted Functional Assessments and Functional Analyses Multiple variations of functional behavioral assessment methodologies were used in the studies reviewed. Instruction in the implementation of indirect, direct assessments and experimental analyses of behavior was provided to trainees across studies. Of the 25 studies reviewed, four trained school staff in some variation of indirect and direct functional behavioral assessment including: Function Based Support (FBS; Renshaw, Christensen, TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 10 Marchant & Anderson, 2008); the Functional Assessment Hypothesis Formulation Protocol (Maag & Larson, 2008); standard functional behavioral assessment (FBA; Lane, BartonArwood, Spencer & Kalberg, 2007) and a “truncated FBA” (Packenham, Shute & Reid (2004). These studies generally involved using the Antecedent-Behavior-Consequence (ABC) assessment and a protocol that allowed the trainee to develop functional hypotheses about problem behavior. The trainee subsequently used these hypotheses to generate a function-based Behavior Support Plan (BSP). The remaining studies (n=21) utilized a variation of analogue functional analysis (Iwata et al., 2000) to train school staff in behavioral assessment. Analogue functional analysis involved the systematic manipulation of controlled environmental variables considered representative of those occurring within the natural environment. None of the studies reviewed involved training staff in all three (indirect, direct and experimental) levels of FBA (see Table 2). Among studies which trained participants in functional analysis methodologies, Brief Functional Analysis (BFA) was the most popular method used. Twelve studies used some variation of the BFA procedure with session duration across these studies ranging from 5-10 minutes. Five studies reported staff training in Trial Based Functional Analysis (TBFA) with analogue functional analysis employed in four studies. One study (Rispoli et al., 2013) compared the results of a trial-based to analogue functional analysis. -----------------------------------------Insert Table 2 about here ------------------------------------------Baseline Assessments TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 11 All studies reported that none of the trainees had any experience relevant to behavioral assessment or intervention prior to onset of training. Twelve studies did not implement baseline measures of trainee knowledge or skill in behavioral assessment (see Table 2). Three studies asked trainees to attempt to implement functional analysis conditions with participants after reading a written protocol and a role-play of FA conditions as a baseline measure (McKenney et al. 2013; Pence, St. Peter & Giles, 2013; Ward –Horner & Sturmey, 2012). Simulated baselines for these studies returned variable results across participants and conditions. Low to moderate procedural fidelity was reported during baseline conditions and until training commenced. Kunnavatana, Bloom, Samaha and Dayton, (2013) asked trainees to implement FA conditions on non-challenging responses as a baseline test. The authors used the percentage of correct interactions, according to FA protocol, per condition as the dependent variable. Results at baseline were variable across all conditions for the participants. A further baseline measure included participants’ attempts to graph and analyze hypothetical trial-based functional analysis data. Wallace, Doney, Mintz-Resudek and Tarbox (2004) also examined baseline percentage correct interactions during a Brief Functional Analysis protocol. Participants reviewed the method section of the Iwata et al., (1994) study prior to conducting the test sessions. During the simulated assessments, none of the three participants scored above 50% correct. Three studies (Bessette & Wills, 2007; Christensen et al., 2012; Renshaw et al., 2008) administered a written test before intervention. Average scores at baseline were 45%, 43% and 61% respectively. Moore and Fisher (2007) administered both a written test and a probe FA as a baseline condition. The written test ensured all participants had knowledge of the procedures before implementing conditions with participants. Scores on written tests TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 12 averaged 95% but this was not reflected in the low scores on the FA probe conditions using naturalistic baselines. Two studies (Christensen, Renshaw, Calderella & Young, 2012; Renshaw, et al., 2008) reported using the FBS Knowledge Test as their baseline measure. This is a 30 item multiple-choice quiz adapted from Umbreit et al. (2007) and contains direct and applied questions on principles and procedures of behavior assessment. Where baseline measures were reported, performance was significantly below the mastery criterion. For example, mean probe performance across trainees for Erbas et al. (2006) was 5.01% at baseline and Wallace et al. (2004) found that no participant scored above 50% in any condition prior to training. Ward-Horner and Sturmey (2012) also found that no participant in their study scored over 22% during baseline conditions. Method and Duration of Training Fifteen studies reported training duration ranging from ten minutes (Schumate & Wills, 2010) to 12 weeks (Renshaw et al., 2008). Studies reported in hours lasted a mean duration of 7.81 hours and those reported in weeks lasted a mean of 6.19 weeks (see Table 2). There was some evidence to suggest that studies reporting longer training duration resulted in outcomes reporting greater detail on behavioral function, hypothesis testing and behavior support evaluation (Christensen et al., 2012; Maag & Larson, 2008; Renshaw et al., 2008). Studies reporting shorter training duration were primarily used with functional analysis procedures (e.g., Moore, Edwards et al., 2002) or truncated FBA (Packenham & Schute, 2004). Schumate and Wills (2010) reported the shortest training duration with their participants learning to implement a Brief Functional Analysis protocol following a 10 minute training session. Duration of training did not affect treatment integrity or intervention success across studies (see Table 3). TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 13 Studies utilized the following combination of training methods across individual and group instructional sessions: written protocols (e.g., Bessette & Wills, 2007 ; Doggett et al., 2001; Lambert et al., 2012; Moore et al., 2002; Radstakke et al., 2013; Schumate & Wills, 2010); personal reading (e.g., Christensen et al., 2008; Renshaw et al., 2008); instructor feedback (e.g., Kunnavatana et al., 2013; Lambert et al., 2012; Moore et al., 2002; Pence et al., 2013; Poole et al., 2012; Rispoli et al., 2013; Watson et al., 1999) ; role-play (e.g., Kunnavatana et al., 2013; Lambert et al., 2012; McKenney et al., 2013; Pence et al., 2013; Rispoli et al., 2013; Schumate & Wills, 2010; Skinner et al., 2009; Wallace et al., 2004) ; modeling, video modeling and in-vivo coaching (e.g., Moore et al., 2002; Moore & Fisher, 2007; Rispoli et al., 2013; Schumate & Wills, 2010; see Table 2). The schedule of training across the majority of studies involved the presentation of written protocols, followed by group or individual instruction on the rationale for FBA, practice in writing operational definitions and information on the content of FA conditions. Following lectures/workshops, modeling (video/ in vivo) and/ or role-play were delivered (Bessette & Wills, 2007; Erbas et al, 2006; Lambert et al., 2012; Moore & Edwards et al., 2002; Skinner et al., 2009; Wallace et al., 2004.) Some studies (e.g., Watson et al., 1999) attempted implementation at this point or used role-play (Moore & Edwards et al., 2002; Wallace et al., 2004) to simulate FA conditions. Feedback and error correction to increase implementation accuracy were frequently used following initial training sessions. Feedback took the form of video review (Erbas et al. (2006); direct feedback following implementation (Wallace et al., 2004); feedback during practice sessions employing functional analysis conditions (Bessette et al., 2006; Pence et al., 2013; Watson et al., 1999) and video tele-conferencing (O’Reilly et al., 2010). Feedback, during or following implementation of FBA procedures, was effective at increasing proficiency to mastery levels, where modeling or rehearsal was shown to have less success TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 14 (Moore et al., 2007; Ward-Horner and Sturmey, 2012). When procedural integrity was below mastery levels, Pence et al. (2013) also used feedback to correct errors during classroom implementation. For the majority of studies reviewed the researcher carried out direct observations before the trainee conducted an experimental analysis to verify hypotheses. Some idiosyncrasies were present across studies. Schumate and Wills (2010) used color coded written protocols as a prompt for the trainee during Brief FA conditions and used a rapid training procedure (10 minutes) involving role-play before the trainee conducted the FA conditions. Moore and Fisher (2007) compared the relative efficacy of complete and partial video modeling. Participants were exposed to partial video modeling or complete video modeling counterbalanced across conditions and participants. Complete video modeling was effective in teaching FA conditions to mastery in all but one case, in which feedback was used to correct errors. Renshaw et al. (2010) conducted a twelve-week training program in FBA procedures, behavior support preparation, monitoring and implementation. Training in the use of the Functional Assessment Hypotheses Formulation Protocol (based on Maag & Larson, 2008) was conducted in two phases of individualized instruction. Phase I delivered lectures on rationale and procedures of FBA and hypothesis generation. Phase II involved a review which dealt with difficulties in data collection and correct definitions of antecedents and consequences. Ward-Horner and Sturmey (2012) conducted a component analysis of Behavioral Skills training. The component analysis was in accordance with outcomes of Moore et al (2002; 2007) and Machalicek et al. (2010). Feedback and modeling were the most effective components of training, while instruction and rehearsal were partially effective. This finding TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 15 is consistent with those of other studies in the review, in which written protocols and roleplay alone, did not result in trainees reaching mastery (Erbas et al., 2006). Pence, St. Peter and Giles (2013) used pyramidal training in which trainees “passed on” skills to a second set of learners. Pyramidal training allows skills to permeate through an organization or group of professionals while maintaining good procedural integrity (Kuhn et al., 2003). Pence et al. (2013) used didactic instruction, role-plays and feedback to impart training in functional analysis to an initial group of educators. Having learned both in implementation and skills teaching, the initial group trained a second group of school staff. The same techniques of role-play, feedback and instruction were effective in “passing on” functional analysis competencies to a second generation of trainees. Post Training Assessments, Treatment Integrity and Social Validity Twenty four studies evaluated training according to the outcomes of trainee conducted FBA procedures. The outcomes of these procedures included the behavioral function identified and the function-based intervention that followed. These data are summarized in Table 2. Written tests were used by four studies (Bessette & Wills, 2007; Erbas et al., 2006; Renshaw et al., 2008; Skinner et al., 2009). The percentage of correct responses on FA conditions was an outcome measure for 11 studies (see Table 3). A verbal quiz was used by Moore et al. (2002) and evaluations of BSPs produced by trainees were used by Renshaw et al. (2008). Treatment integrity was reported for 23 studies across FA conditions and/or intervention phases and ranged from 83% - 100% (m= 94.75%; treatment integrity means were available for 23 studies, see Table 2). Social validity was reported for eight of the twelve studies that evaluated outcomes (see Table 2). In all cases procedures were rated as: “favorable”; “highly favorable”; TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 16 “acceptable” or “highly acceptable”. Erbas et al. (2006) reported “positive changes in viewpoints” from participants. Other trainees stated that the FBA skills would be useful during the school year (McKenney, et al., 2013) and useful with additional students (Schumate & Wills, 2010). The only negative opinion expressed was reported by Packenham et al. (2004) whereby the trainee found the procedures “a little intrusive”. Interventions Based on Trainee Conducted FBAs Table 3 describes behavioral function, treatment types and outcomes for studies that reported such data. Twelve studies involved intervening on CB after ascertaining behavioral function. Of these, six studies utilized functional analysis data and six involved nonexperimental data e.g., ABC observations (see Table 3). -----------------------------------------Insert Table 3 about here -----------------------------------------Attention was the most commonly identified function of targeted CB. Ten participants’ behaviors were maintained by attention from teachers or peers. Behaviors maintained by attention were treated using: Functional Communication Training, (FCT; Christensen, Renshaw et al., 2008; Lambert et al., 2012); contingent teacher praise (Maag & Larson, 2008); altered reinforcement schedules and social skills training (Christensen et al., 2008); choice of seat, praise and extinction (Renshaw et al., 2008) and DRO and DRA (Schumate & Wills, 2010). Maag and Larson (2008) and Schumate and Wills (2010) reported reductions in problem behavior to zero or near zero levels. Renshaw et al. (2008) reported modest reductions in problem behavior and gains in on task behavior as a collateral result of intervention. TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 17 Multiply controlled CBs were the second most prevalent. Multiply controlled behaviors were displayed by six participants (Bessette & Wills; 2007; Lambert et al., 2012; Renshaw et al., 2008; Skinner et al., 2009). Combinations of attention and escape maintained behavior targets were shown for all but one of these participants (Lane et al., 2007). This participant showed behaviors maintained by both social positive reinforcement, in the form of attention, and automatic reinforcement. Multiply controlled behaviors were also treated successfully in the studies reviewed. Treatment packages included interventions such as: praise, token exchange and FCT, (Renshaw et al., 2008); fixed time attention and extinction (Skinner et al., 2009) and FCT and extinction (Bessette & Wills, 2010). Skinner et al. (2009) reduced problem behavior from a mean rate of 3.58/min at baseline to 0.6/min at maintenance. Bessette and Wills (2010) reduced inappropriate vocalizations from a mean of 40% of intervals to 3.9% and aggression from 7.8% to 1.3%. Collateral gains in on-task behaviors were also reported despite not being targeted for intervention. Renshaw et al. (2008) reported modest decreases in problem behavior .Christensen et al. (2008) used noncontingent attention and a token economy to reduce behaviors controlled by escape and attention. Lane et al. (2007) treated multiply controlled behavior with a combination of social skills training and a token economy. Lambert et al. (2012) reported that two of their participants’ problem behaviors were susceptible to multiple sources of reinforcement but selected the most differentiated function for intervention. Escape was the third most prevalent behavioral function, (n= 5; Lambert et al., 2012; Radstakke et al., 2013; Watson et al., 1999). Escape maintained behaviors were treated using: FCT and extinction (Lambert, Bloom & Ervin, 2012); FCT alone (Radstakke, et al., 2013) and DRA and escape extinction (Watson, et al., 1999). These intervention packages were highly successful in reducing problem behavior. Lambert et al. (2012) reported decreases in problem behavior to zero levels and increases in alternative behaviors for two participants. TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 18 Radstakke et al. (2013) reported large and medium effect sizes for three participants with the using FCT in the reduction of problem behaviors. The researchers also noted a decrease in known precursor behaviors across participants. Watson et al. (1999) used a DRA intervention to decrease SIB from a mean rate of 16 instances per minute to zero within four sessions and demonstrated generalization across settings. Discussion The current review examined the methods and effects of training staff in natural educational settings to apply FBA and experimental functional analysis procedures. Intervention outcomes were also examined where reported. Among the key aims of the present review were to assess whether onsite training addressed issues raised by Scott, Meers, and Nelson (2000), Scott et al., (2004) and Witt et al., (2004). These concerns were centred on the ability of educators to learn procedures to the required skill level, their level of independence from consultants and researchers, and the effectiveness and efficiency of the assessment procedures in the educational setting. A further issue was the need to reconcile the demands of empiricism and pragmatism. As such, procedures needed to deliver a high level of procedural integrity while limiting disincentives to the future use of functional assessment by the trainees. A wide variety of trainees took part in the studies reported. People with a range of experience levels and various competencies within the school system were able to master the skills in functional behavioral assessment to a high standard. This indicates that such skills can be effectively taught to staff members regardless of training levels or prior experience of applied behavior analysis. Trainees included teachers, classroom aides and school principals, among others suggesting that the methods are within the compass of many members of the education service. Although relatively small numbers of participants are reported across TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 19 studies, the outcomes demonstrate that it may be possible to broaden the utility of behavioral assessment in natural settings. Participants across studies generally presented with relatively mild symptoms of challenging behavior, such as yelling, disruption or off task (e.g., Kodak et al., 2010; McKenney et al., 2013; Moore et al., 2002; Renshaw et al., 2008). More severe behaviors, such as SIB were reported less often (e.g., Machalicek et al., 2010; Moore et al., 2007; Wallace et al., 2004; Watson et al., 1999). The studies reviewed did not indicate whether teachers or staff dealing with more severe problem behavior can be trained with equal effectiveness. No studies examined low rate or episodic challenging behaviors. The focus on less severe problem behavior may reflect “real world” settings whereby teachers encounter less severe or dangerous challenging behavior. In terms of effectiveness, the outcomes of training packages were relatively similar. Treatment integrity across the review was 93.8%. While not all studies proceeded to intervention, trainees who performed interventions were successful in reducing problem behaviors to near zero levels in many cases (Maag & Larson, 2008; Schumate & Wills, 2010, Watson et al, 1999). However, Moore et al., (2007) and Ward-Horner and Sturmey (2012) found that some aspects of training were more effective than others. In both these studies lectures and written protocols were found insufficient to achieve mastery, while modeling and feedback were more effective components. Several studies (e.g., Bessette et al., 2007; Erbas et al., 2006; Lambert et al., 2012; Machalicek et al., 2010; Moore et al., 2002; Wallace et al., 2004; Watson et al., 1999) found that at least one trainee required performance feedback to reach mastery criteria. Although the training procedure outlined by Schumate and Wills (2010) lasted only ten minutes, the use of modeling and color-coded written protocols may have contributed to the accuracy of the implementation of functional analysis. This suggests that future research could prioritize feedback and modeling over lectures and TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 20 workshops, especially when time is limited. No study taught participants to conduct all three levels of functional behavioral assessment. Although the protocols used were successful, it was not demonstrated that teachers could conduct informant, observational and experimental functional behavior analysis methods and develop a behavior support plan based on those findings. Studies that implemented experimental functional analysis conditions (e.g. Doggett et al., 2001) first used a functional assessment to generate functional hypotheses for problem behavior. However, these functional assessments were conducted by the researchers and not the trainees. Future research should incorporate hypothesis generation into staff training in experimental functional analysis to a greater degree. Training in observational and experimental functional assessment techniques was mutually exclusive. This means there is a gap in the current research body because trainees were not provided with skills to develop functional hypotheses through observation and test them with a functional analysis. The majority of studies reviewed did not report follow-up data to assess maintenance of skills in behavioral assessment with trainees. Periodic retraining may be necessary and research should aim to find an optimal means of refreshing educators’ knowledge and skills in functional behavioral assessment. Target behaviors for reduction may initially increase in intensity (extinction burst) or may reappear after being absent for a time (spontaneous recovery). Future research should examine protocols to prepare trainees to respond appropriately to these phenomena. Few studies assessed generalization of skills in functional assessment to new behaviors, behavioral functions and students. Christensen et al., (2008) trained one teacher who assessed three different students at staggered stages of the training, demonstrating a level of generalization. Poole et al., (2012) examined generalization following training whereby a teacher was required to assess behavioral function across a whole class, while Packenham et TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 21 al., (2004) and Schumate and Wills (2010) examined the effects of training across small groups of children. Most other studies, however, trained only individual student-teacher dyads, without testing the trainee’s skills with additional students, behaviors or settings. A further compounding limitation is that only 12 of 25 studies trained staff members to conduct an intervention linked to their behavioral assessment. Where interventions were applied, the trainees selected functionally equivalent interventions based on the results of their functional assessment or experimental functional analysis. They subsequently implemented these interventions and recorded data on outcomes. All studies that attempted intervention reported moderate to good success. Despite reports of high performance on measures of treatment integrity with functional analysis procedures, more than half of the studies reviewed did not report teacher led intervention on participant problem behavior. Limitations on measures of training effectiveness with regard to behavior reduction may impact a teacher’s preparedness for new situations or students and could conceivably reduce the acceptability of behavioral interventions for such trainees. Only three studies (Packenham et al., 2004; Poole et al., 2012; Skinner et al., 2009) reported maintenance probes where intervention was implemented. While the gains made during intervention were maintained at follow-up, information was not available to draw any conclusions about maintenance of skills taught in the natural environment. Future research should examine maintenance of intervention gains. Other methodological issues included a lack of baseline measures for trainee skills prior to training across several studies. Those studies that did report baseline data demonstrated low levels of knowledge and procedural integrity prior to training. However for research purposes a low skill level at outset should not be taken for granted, especially as some trainees had a certain level of exposure to behavioral methods. A further issue includes the limited numbers of probes examining outcomes of training in natural settings. TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 22 Future Directions There is currently little consensus on what FBA procedures are necessary and sufficient for classroom use on a regular basis. There is also little data on the maintenance of FBA and behavioral interventions in the long term within schools. Scott and colleagues (2004) recommend that researchers demonstrate the ability of general education teachers to perform experimental functional analyses as part of their regular duties. The studies reported here have shown that school staff can perform several variants of the procedure, including newer protocols such as the trial-based and brief functional analyses. Future research should focus on long-term maintenance of skills and relative efficiency across the various modes of functional analysis. Research should also focus on generalization across students, behavioral functions and topographies and the type of refresher training needed to maintain high fidelity. The use of behavioral methods in school or clinical settings, may generate a tension between pragmatism and empirical rigor. What is most suitable to the end user is not always the most desirable from the point of view of efficacy. Scott et al., (2004) point out that the balance between efficiency and efficacy is a major determinant of a procedure’s validity within a setting. Efficiency in specific training models could also be aided by a parametric analysis of the time required to train staff effectively. Training time in the studies reviewed ranged widely (from 10 minutes to 12 weeks). Future research in the area should aim to determine optimal training times in order to maximize time available for intervention (Schumate & Wills, 2010). A parametric analysis of training duration in the FBA and intervention process could contribute to a rapid training model suitable for widespread use in school and clinical settings. McKenney and colleagues (2013) argue that it may not be necessary to use experimental functional analysis if other methods produce reliable and useful data, which TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 23 may guide intervention (see also Healy et al., 2013). Studies that reported training in experimental functional analyses demonstrated that trainees were able to perform various experimental functional analyses with high integrity. Trial-based functional analysis offers a strong compromise between effectiveness and efficiency in the classroom and has several advantages over analogue functional analysis. This type of functional analysis is able to operate under natural EO’s present in the classroom, has shown at least 60% concordance with analogue functional analysis, takes less time to implement and is terminated with fewer incidences of challenging behavior (Lydon, Healy, O’Reilly & Lang, 2012). Given these advantages and its demonstrated efficiency in the natural setting, trial-based functional analysis could make up a large part of future research on functional assessment training within educational and clinical settings. Scott et al. (2004) raised concerns about treatment integrity while conducting FBA in natural settings. The studies reported here found that educators may be trained to conduct functional assessment, including experimental analysis, with high treatment integrity and a subset of studies demonstrated implementation of effective, function-based interventions. These findings suggest a high degree of utility within natural settings. However, although positive outcomes of FBA training programs were widely reported, there remain some limitations to the current body of research. Future research should focus on developing standardized models of training in assessment and intervention, incorporating all levels of behavior assessment and support. TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 24 References *Bessette, K. K., & Wills, H. P. (2007). An example of an elementary school paraprofessional- implemented functional analysis and intervention. Behavioral Disorders, 32, 192-210. Bijou S. W, Peterson R. F, Ault M. H. (1968). A method to integrate descriptive and experimental field studies at the level of data and empirical concepts. Journal of Applied Behavior Analysis. 1, 175–191. *Bloom, S. E., Lambert, J. M., Dayton, E., & Samaha, A. L. (2013). Teacher conducted trial based functional analysis as the basis for intervention. Journal of Applied Behavior Analysis, 46 (1), 208-218 Campbell, J. M. (2003). Efficacy of behavioral interventions for reducing problem behavior in persons with autism: a quantitative synthesis of single-subject research. Research in Developmental Disabilities, 24, 120-138. Couvillon, M. A., Bullock, L. M., & Gable, R. A. (2009). Tracking behavior assessment methodology and support strategies: a national survey of how schools utilize functional behavioral assessments and behavior intervention plans. Emotional and Behavioral Difficulties, 14, 215-228. *Christensen, L., Renshaw, T. L., Caldarella, P., & Young, J. R. (2012). Training a General Educator to Use Function-Based Support for Students at Risk for Behavior Disorders. Education, 133(2), 313-335. Cipani, E., & Schock, K. M. (2011). Functional behavioral assessment, diagnosis, and treatment: A complete system for education and mental health settings. Springer Publishing Company. TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 25 Conroy, M., Clark, D., Gable, R., & Fox, J. (1999). Building competence in the use of functional behavioral assessment. Preventing School Failure, 43(4), 140-147. Delfs, C. H., & Campbell, J. M. (2010). A quantitative synthesis of developmental disability research: The impact of functional assessment methodology on treatment effectiveness. Behavior Analyst Today, 11, 4-19. Devlin, S., Healy, O., Leader, G. & Hughes, B.M. (2011) Comparison of behavioral intervention and sensory-integration therapy in the treatment of challenging behavior. Journal of Autism and Developmental Disorders, 10, 1303-20. Devlin, S., Leader, G., & Healy, O. (2009). Comparison of behavioral intervention and sensory-integration therapy in the treatment of self-injurious behavior. Research in Autism Spectrum Disorders 3, 223-231. Didden, R., Korzilius, H., van Oorsouw, W., & Sturmey, P. (2006). Behavioral treatment of CBs in individuals with mild mental retardation: Meta-analysis of single-subject research. American Journal on Mental Retardation, 111, 290-298. Division for Early Childhood. (2007). Division for Early Childhood (DEC) concept paper on the identification of and intervention with CB. Retrieved from http://www.decsped.org/ *Doggett, R. A., Edwards, R. P., Moore, J. W., Tingstrom, D. H., & Wilczynski, S. M. (2001). An approach to functional assessment in general education classroom settings. School Psychology Review, 30, 313–328. Durand, M.V., & Crimmins, D. B. (1988). Identifying the variables maintaining self-injurious behavior. Journal of Autism and Developmental Disorders, 18, 99-117. TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 26 Emerson, E. (2001). CB: Analysis and intervention in people with severe intellectual disabilities. Cambridge, UK: Cambridge University Press. *Erbas, D., Tekin-Iftar, E., & Yucesoy, S. (2006). Teaching special education teachers how to conduct functional analysis in natural settings. Education and Training in Developmental Disabilities, 41, 28-36. Feldman, M. A., & Werner, S. E. (2002). Collateral effects of behavioral parent training on families of children with developmental disabilities and behavior disorders. Behavioral Interventions, 17, 75-83. Gilliam, W. S., & Shahar, G. (2006). Preschool and child care expulsion and suspension: Rates and predictors in one state. Infants & Young Children, 19, 228-245. Hanley, G. P., Iwata, B. A., & McCord, B. E. (2003). Functional analysis of problem behavior: A review. Journal of Applied Behavior Analysis, 36, 147–185. Hastings, R. P., & Bham, M. S. (2003). The relationship between student behavior patterns and teacher burnout. School Psychology International, 24, 115–127. Healy, O. & Brett, D. (2014). Functional assessment of problem behavior in Autism Spectrum Disorder, pp 2881-2901. In Vinood B. Patel, Victor R. Preedy & Colin R. Martin (Eds.), The Comprehensive Guide to Autism. Springer. Healy, O., Brett, D., & Leader, G., A comparison of experimental functional analysis and the Questions About Behavioral Function (QABF) in the assessment of challenging behavior of individuals with autism, Research in Autism Spectrum Disorders, 7, (1), 2013, p66 - 81 Huete, J. M., & Kurtz, P. F. (2010). Therapist effects on functional analysis outcomes with TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 27 young children. Research in Developmental Disabilities, 31, 804-810. Ingram, K., Lewis-Palmer, T., & Sugai, G. (2005). Function-Based Intervention Planning Comparing the Effectiveness of FBA Function-Based and Non-Function-Based Intervention Plans. Journal of Positive Behavior Interventions, 7, 224-236. Individuals with Disabilities Education Act (IDEA). (2004). Retrieved from http://idea.ed.gov/ Iwata B.A, Dorsey M.F, Slifer K.J, Bauman K.E, Richman G.S. (1994). Toward a functional analysis of self-injury. Journal of Applied Behavior Analysis, 27, 197–209. Iwata, B. A., & Dozier, C. L. (2008). Clinical application of functional analysis methodology. Behavior Analysis in Practice, 1, 3-9. Iwata, B. A., Wallace, M. D., Kahng, S., Lindberg, J. S., Roscoe, E. M., Conners, J., ... & Worsdell, A. S. (2000). Skill acquisition in the implementation of functional analysis methodology. Journal of Applied Behavior Analysis, 33, 181-194. Kelm, J. L., & McIntosh, K. (2012). Effects of school‐wide positive behavior support on teacher self‐efficacy. Psychology in the Schools, 49, 137-147. *Kodak, T., Fisher, W. W., Paden, A., & Dickes, N. (2013). Evaluation of the utility of a discrete‐trial functional analysis in early intervention classrooms. Journal of Applied Behavior Analysis, 46, 1-21. Kuhn, S. A. C., Lerman, D. C., & Vorndran, C. M. (2003). Pyramidal training for families of children with problem behavior. Journal of Applied Behavior Analysis, 36, 77–88. *Kunnavatana, S. S., Bloom, S. E., Samaha, A. L., & Dayton, E. (2013). Training Teachers to TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 28 Conduct Trial-Based Functional Analyses. Behavior Modification. 37, 707-722. *Lambert, J. M., Bloom, S. E., & Irvin, J. (2012). Trial based functional analysis and treatment in an early childhood setting. Journal of Applied Behavior Analysis, 45, 579-584. Lambert, J. M., Bloom, S. E., Kunnavatana, S. S., Collins, S. D., & Clay, C. J. (2013). Training residential staff to conduct trial‐based functional analyses. Journal of Applied Behavior Analysis, 46, 296-300. *Lane, K. L., Barton-Arwood, S. M., Spencer, J. L., & Kalberg, J. R. (2007). Teaching elementary school educators to design, implement, and evaluate functional assessmentbased interventions: Successes and challenges. Preventing School Failure: Alternative Education for Children and Youth, 51(4), 35-46. LaVigna, G. W., and Willis, T. J. (2005). A Positive Behavioural Support Model for Breaking the Barriers to Social and Community Inclusion. Learning Disability Review Positive Behaviour Support, 10(2), 16-23. Lydon, S., Healy, O., O’Reilly, M. F., & Lang, R. (2012). Variations in functional analysis methodology: a systematic review. Journal of Developmental and Physical Disabilities, 24, 301-326. *Maag, J. W., & Larson, P. J. (2004). Training a general education teacher to apply functional assessment. Education and Treatment of Children, 27, 26-36. *Machalicek, W., O'Reilly, M. F., Rispoli, M., Davis, T., Lang, R., Franco, J. H., & Chan, J. M. (2010). Training teachers to assess the challenging behaviors of students with autism using video teleconferencing. Education and Training in Autism and Developmental Disability, 45, 203-215. TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 29 *McKenney, E. L., Waldron, N., & Conroy, M. (2013). The Effects of Training and Performance Feedback During Behavioral Consultation on General Education Middle School Teachers' Integrity to Functional Analysis Procedures. Journal of Educational and Psychological Consultation, 23(1), 63-85. *Moore, J. W., Edwards, R. P., Sterling-Turner, H. E., Riley, J., DuBard, M., & McGeorge, A. (2002).Teacher acquisition of functional analysis methodology. Journal of Applied Behavior Analysis, 35, 73–77. *Moore, J. W., & Fisher, W. W. (2007). The effects of videotape modeling on staff acquisition of functional analysis methodology. Journal of Applied Behavior Analysis, 40, 197-202. Mortenson, B. P., Rush, K. S., Webster, J., & Beck, T. (2008). Early career teachers accuracy in predicting behavioral functioning: A pilot study of teacher skills. International Journal of Behavioral Consultation and Therapy, 4, 311-318. Najdowski, A. C., Wallace, M. D., Penrod, B., Tarbox, J., Reagon, K., & Higbee, T. S. (2008). Caregiver‐conducted experimental functional analyses of inappropriate mealtime behavior. Journal of Applied Behavior Analysis, 41, 459-465. *Packenham, M., Shute, R., & Reid, R. (2004). Truncated Functional Behavioral Assessment Procedure For Children With Disruptive Classroom Behaviors. Education and Treatment of Children, 27(1), 9-25. Martens, B.K., Parks, N. A., Clark, S. B., & Call, N. A. (2012). Differential responding across therapists in a functional analysis: A case study. Behavioral Interventions, 27, 236-243. *Pence, S. T., Peter, C. C. S., & Giles, A. F. (2013). Teacher Acquisition of Functional TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 30 Analysis Methods Using Pyramidal Training. Journal of Behavioral Education, 1-18. Phillips, K. J., & Mudford, O. C. (2008). Functional analysis skills training for residential caregivers. Behavioral Interventions, 23, 1-12. Pindiprolu, S. S., Peterson, S. M., & Bergloff, H. (2007). School personnel's professional development needs and skill level with functional behavior assessments in ten midwestern states in the United States: Analysis and issues. The Journal of the International Association of Special Education, 8, 31-42. *Poole, V. Y., Dufrene, B. A., Sterling, H. E., Tingstrom, D. H., & Hardy, C. M. (2012). Classwide functional analysis and treatment of preschoolers’ disruptive behavior. Journal of Applied School Psychology, 28(2), 155-174. *Radstaake, M., Didden, R., Lang, R., O’Reilly, M., Sigafoos, J., Lancioni, G. E., & Curfs, L. M. (2013). Functional analysis and functional communication training in the classroom for three children with Angelman Syndrome. Journal of Developmental and Physical Disabilities, 25(1), 49-63. *Renshaw, T.L., Christensen, L., Marchant, M., Anderson, T. (2008). Training elementary school general educators to implement function-based support. Education and Treatment of Children, 31, 495-521. *Rispoli, M. J., Davis, H. S., Goodwyn, F. D., & Camargo, S. (2013). The Use of Trial-Based Functional Analysis in Public School Classrooms for Two Students With Developmental Disabilities. Journal of Positive Behavior Interventions, 15(3), 180-189. *Schumate, E. D. & Wills, H.P. (2010). Classroom-Based Functional Analysis and Intervention for Disruptive and Off-Task Behaviors. Education and Treatment of Children 33, 23-48. TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 31 Scott, T. M., Bucalos, A., Liaupsin, C., Nelson, C. M., Jolivette, K., & DeShea, L. (2004). Using Functional Behavior Assessment in General Education Settings: Making a Case for Effectiveness and Efficiency. Behavioral Disorders, 29(2), 189-201. Scott, T. M., McIntyre, J., Liaupsin, C., Nelson, C. M., Conroy, M., & Payne, L. (2005). An examination of the relation between functional behavior assessment and selected intervention strategies with school-based teams. Journal of Positive Behavior Interventions, 7, 205-215. Scott, T. M., Meers, D. T., & Nelson, C. M. (2000). Toward a consensus of functional behavior assessment for students with mild disabilities in public schools: A national survey. Education and Treatment of Children, 23, 265–285. Scott, T. M., Nelson, C. M., & Zabala, J. (2003). Functional behavior assessment training in public schools facilitating systemic change. Journal of Positive Behavior Interventions, 5, 216-224. *Skinner, J.N., Veerkamp, M.B., Kamps, D.M. & Andra, P.R. (2009). Teacher and peer participation in functional analysis and interventions for a first grade student with attention deficit hyperactivity disorder. Education and Treatment of Children, 32, 243-266. Trahan, M. A., & Worsdell, A. S. (2011). Effectiveness of an instructional DVD in training college students to implement functional analyses. Behavioral Interventions, 26, 85102. Van Acker, R., Boreson, L., Gable, R., & Potterton, T. (2005). Are we on the right course? Lessons learned about current FBA/BIP practices in schools. Journal of Behavioral Education, 14(1), 35-56. TRAINING IN FUNCTIONAL BEHAVIORAL ASSESSMENT 32 *Wallace, M. D., Doney, J. K., Mintz-Resudek, C. M., & Tarbox, R. S. (2004). Training educators to implement functional analyses. Journal of Applied Behavior Analysis, 37, 89-92. *Ward‐Horner, J., & Sturmey, P. (2012). Component analysis of behavior skills training in functional analysis. Behavioral Interventions, 27(2), 75-92. *Watson, T. S., Ray, K. P., Sterling, H. E., & Logan, P. (1999). Teacher-implemented functional analysis and treatment: A method for linking assessment to intervention. School Psychology Review, 28, 292-302. Witt, J. C., VanDerHeyden, A. M., & Gilbertson, D. (2004). Troubleshooting behavioral interventions: A systematic process for finding and eliminating problems. School Psychology Review, 33, 363–383. Yell, M. L., & Shriner, J. G. (1998). The Discipline of students with disabilities: Requirements of the IDEA amendments of 1997. Education and Treatment of Children, 21, 246–257. * indicates studies included in the review Table 1 Demographic and clinical characteristics for students and trainees. Student Study Settings n Trainee Diagnoses Age range Position n Experience/ Qualifications Bessette, Wills & Howard (2007) Elementary school 1 EBD 8 Paraprofessional 1 7 years Bloom et.al. (2013) Public preschool, University ASD Preschool 3 Developmental Delay; Autistic Disorder; Autistic Disorder 4-5 Teacher 3 In training, working towards teacher certification Christensen et al. (2008) Title 1 Elementary School 3 Neurotypically developing. At risk due to disruptive and off task behaviours 4th grade Teacher 1 Bachelor’s degree elementary education. Doggett et al. (2001) Elementary school 2 None reported 6 -7 Teachers 2 1 year, BA degree. 4 years, Master’s. Erbas et al. (2006) Special Education 6 Developmental Disabilities Not reported Teachers 6 3 - 14 years Kodak et al. 2013 University based EI center, elementary school classroom 5 Autism 4 -9 Classroom staff (Therapists) 3 BA Psychology, undergraduate trainee Kunnavatana et al. 2013 Secondary special education, elementary special education. 5 Not reported Not reported Teachers 4 1 -13 years experience. All had special ed. licensing & BA or M. Ed Lambert, Bloom & Irvin (2012) Special ed. preschool 3 Developmental Disabilities 3-4 Teacher 1 MA. Special Ed., Student Study Lane et al. (2007) Settings Elementary schools n 2 Diagnoses Study 1: ADHD Trainee Age range Position n Experience/ Qualifications 6-7 Principal, special educator, general educator 8 Not reported Study 2: ADHD & OCD Maag & Larson (2008) Elementary school 2 EBD; Learning Disability 5th grade Teacher 1 15 years Machalicek et al. (2010) Developmental Disorder & ASD Special School 6 Autism for 5 P’s; 1 with “autistic like tendencies,” & expressive language delays 5-9 Teacher 6 4-10 years; Bachelor’s degree in special ed. McKenney et al. (2013) Middle School 3 Not reported 6th -8th grade Teacher 3 1-24 years Moore and Edwards (2002) Elementary school 3 Learning Disability; No diagnosis; no diagnosis “appeared developmentally normal” 5th grade Teachers 3 “Very limited experience” Moore & Fisher (2007) Behaviour Disorder Treatment Facility 3 Not reported Not reported BA Psych Graduates 3 BA Psych, 1 MSc. ABA student Packenham et al. (2004) Elementary School 2 No formal diagnoses; One suspected learning disability. Other participant typically developing 8-9 Teacher 1 8 years elementary level. Pence, St. Peter & Giles, (2013) Not reported 6 Not reported Not reported Trainers: Special ed. teachers 6 1-25 years. Enrolled in ABA course, not yet certified, no FBA experience prior to training Student Study Settings n Diagnoses Pence, St. Peter & Giles, (2013) Training occurred in local library and FBA’s in teachers’ classes (3 elementary, 2 middle, 1 high school) 6 Not reported Poole et al. (2012) Head Start Classroom 34 Renshaw et al. (2008) Elementary school Radstaake, et al. 2013 Trainee Age range Experience/ Qualifications Position n Not reported Trainees: Special ed. teachers 6 1-16 years, special education teachers enrolled in ABA training. Trained during a course in behavioural assessment, no FBA experience Typically developing 3-5 Teacher, assistant teacher 2 3 years college, 4 years work experience; 2 years education, 1 year experience 4 Typically developing 1st - 5th grade Teachers 4 0 - 15 years Specialized daycare centre 3 All P’s had severe intellectual disability, Angelman Syndrome 6-15 Teachers 3 Not reported Rispoli et al. (2013) Public School 2 Autism; Down’s Syndrome & intellectual disability. 5-15 Teacher, Paraprofessional 2 15 yrs., working on M.Ed.; 5 yrs., working on MSc. Counseling Schumate & Wills (2010) Elementary school 3 None 7–8 Reading Intervention Provider 1 3 years; not qualified. Skinner et al. (2009) Elementary school 1 ADHD 1st grade Teacher 1 36 years Wallace et al. (2004) ABA Workshop 1 Not reported Not reported Special Ed. Teacher & General Educator 1 General and special education certified Student Study Settings n Diagnoses Trainee Age range Position n Experience/ Qualifications Ward-Horner & Sturmey (2012) School 2 Autistic disorder 9-10 Teacher assistants 3 High school degree; bachelor’s degree & enrolled in Masters in Special Education Watson et al. (1999) Special Education 1 Intellectual disability, dwarfism, hypoplastic thorax syndrome, nystagmus, polydactly, psychomotor retardation 10 Special Ed. Teacher, Classroom aide, replacement teacher 3 6 years; 2 years; 0 years. Table 2 Summary of Functional Assessment and Functional Analysis Training Procedures. FBA (Functional Behavioral Assessment), BFA (Brief Functional Analysis), TBFA (Trial Based Functional Analysis), AB (Baseline-Intervention),CB (challenging behavior), SIB (self-injurious behavior), BCBA® (Board Certified behavior Analyst), FCT (functional communication training), BSP (Behavior Support Plan). Study Bessette & Wills (2007) Problem Behavior FA Method Experimental Design AB Baseline Skill Assessment Disruption, aggression, property damage Brief Functional Analysis 20 item quiz Bloom et al. 2013 Aggression, property destruction, tantrums, mouthing Trial Based Functional Analysis Multiple Baseline Across Participants. ABAB during intervention None taken Christensen et al. 2008 Disruption, Function Based Support (FBS) Study 1: Multiple Baseline across behaviors FBS Knowledge Test Training Duration Not reported Training Methods Written protocols, in vivo coaching. One training unit per condition BFA outcome 45-90 min Presentation, review of procedures & data collection methods. Coaching during FA Approx. 10 weeks Group work, independent reading, applied activities, individual consultation Out of seat, inappropriate attention seeking Brief Functional Analysis Multi Element Design Social validity None taken, no previous teacher experience Not reported Review of descriptive assessment, discussion, model conditions, written protocol Treatment Integrity Rated Acceptable 96.6% TBFA Outcome & Intervention results Not recorded 96% FBS Knowledge Test, completion of applied activities High social validity as rated by teacher and students Study 1: 90% Knowledge Quiz re-test Teacher developed BSP Studies 2 & 3: ABAB Doggett et al. (2001) Post Training Assessments BFA outcome Study 2: 94% Study 3: 100% Rated Acceptable 96% Study Problem Behavior FA Method Experimental Design Erbas et al. (2006) Non compliance, throwing objects, screaming, out of seat, tantrums Brief Functional Analysis Multiple Probe across Participants Percentage correct interactions per BFA condition Not reported Kodak et al. (2013) Inappropriate vocalisations, hand to body contact, aggression, Trial Based Functional Analysis Multi element design No formal baseline Kunnavatana et al. (2013) Not reported, arbitrary behavior used in some cases e.g., foot tapping Trial Based Functional Analysis Multiple baseline across participants Lambert, Bloom & Ervin (2012) Aggression and tantrums Trial Based Functional Analysis Multiple Baseline across Participants Baseline Skill Assessment Training Duration Post Training Assessments Social validity Phase I: Group instruction, video model, Phase II: individual training, video review Quiz after Phase 1. Re-test of BFA Implementation accuracy Positive changes in viewpoints 89.9% Not reported Protocol review, Q&A session, brief supervised practice of procedures TBFA outcome Not reported 97.5%, only available for one participant Accuracy graphing & analyzing hypothetical data, TBFA trials on arbitrary behaviors Presentati on & group work: 1 hr. 20 min Presentation on principles and functions of behavior, fitting TBFA trials into class activities, data collection/ analysis. Group practice, Q&A. Role plays, feedback & error correction. In situ TBFA of student behavior, accuracy of graphing and analyzing data Not reported 86% None taken, teacher had limited knowledge of ABA 1 hour Written protocols, role play and feedback Probed correct implementation of BFA conditions (Percentage correct interactions per condition) Not reported 92% Follow up at 1-3 months Training Methods Treatment Integrity Study Lane et al. (2007) Problem Behavior Study 1: disruption FA Method Functional Assessment Study 2: inappropriate touching Experimental Design Study 1: ABAB Baseline Skill Assessment Training Duration Training Methods Not reported 18 hours instruction Group instruction, on site follow up Post Training Assessments FBA and intervention outcome 10-12 hours on site support Study 2: multiple baseline across settings Social validity Rated acceptable and useful by student & teacher Treatment Integrity Study 1: 100% Study 2: 83-100% Varied across settings Maag & Larson (2008) Disruption Functional Assessment Hypotheses Formulation Protocol (FAHFP) Multiple Baseline across Participants None, no previous teacher experience 5.5 hours Two sessions of 1:1 training in FAHFP FAHFP Outcome Rated Favorable P1 83% P2 92.5% Machalicek et al. (2010) Aggression, crying, screaming, SIB, stereotypy Brief Functional Analysis Multiple Baseline across participants Percentage correct interactions per FA condition 75 minutes (60-95 min range) Performance feedback delivered through video teleconferencing Percentage correct interactions per FA condition Procedures rated highly Teachers: 97% Frequent, low intensity disruptive behavior Analogue Functional Analysis Non concurrent multiple baseline across participants Read FA protocol & performed mock FA with researchers Not reported Presentation on FA, quizzes, operational definition of CB & replacement behavior, development of peer attention condition, role play Integrity of FA implementation Rated Acceptabl; Skills described as useful during school year McKenney et al. (2013) Supervisor: 98% Reported as outcome variable across FA conditions. High for all participants Study Moore et al. (2002) Problem Behavior Yelling FA Method Brief Functional Analysis Play condition excluded Experimental Design Baseline Skill Assessment Training Duration Multiple Baseline across Participants None, no previous teacher experience 1 day Training Methods Post Training Assessments Phase I: Group instruction, written protocols Phase II: Rehearsal, Modelling & Feedback Verbal questions after each phase. Social validity Treatment Integrity Not reported 95% 94% Percentage correct interactions per BFA condition Moore & Fisher (2007) SIB Brief Functional Analysis Multiple Baseline across Participants Written test. Percentage correct interactions per BFA condition Not reported Lecture training, complete video modelling, partial video modelling Percentage correct interactions per FA condition Not reported Packenham et al. (2004) Disruption, off task and non completion of work “Truncated FBA” interview, function identification hypothesis formation, intervention planning Multiple baseline across participants None reported, no previous teacher experience Approx. 2 hours per student (4h total) Prompt sheets provided guidelines to aid FBA process Treatment outcome Positive responses, also reported as a “little intrusive” Study Pence, St. Peter & Giles (2013) Poole et al. (2012) Radstakke et al. (2013) Problem Behavior Not reported Disruptive behavior Aggression, SIB, throwing materials, precursor behaviors FA Method Analogue Functional Analysis Brief Functional Analysis Brief Functional Analysis Experimental Design Baseline Skill Assessment Multiple baseline across participants Attempted to role play conditions given materials and written protocol ABAB & Multielement design FA: multielement design FCT: ABAB design None taken None Training Duration Not reported Training Methods Not reported Social validity Treatment Integrity Pyramidal training. Trainees learned FA skills from BCBA®s and then taught skills to new learners. Trainers: workshop 9 months before experiment. Didactic instruction, role-play, feedback. Coaching and feedback provided during classroom FA. Refresher before expt. Began. Practiced feedback & coaching skills 40 min Post Training Assessments No specific mastery criteria Not reported Not reported Trainees: modeling, trainee attempted condition. Feedback & role-play as error correction. Generalized to classroom implementation Percentage steps correct per condition Not reported Reported as outcome variable in study, high across all conditions. Modeling, prompting, rehearsal, performance feedback (based on Moore et al., 2002) Percentage steps correct per condition “Strong satisfaction with procedure” Room 1: 95.1% Meeting, written protocols and verbal coaching. Researcher present during FA sessions FA/ FCT outcomes Not reported Not reported Room 2: 95.1% Study Renshaw et al. (2008) Problem Behavior Disruption, off task FA Method Experimental Design Baseline Skill Assessment Training Duration Function Based support (FBS). (Assessment, BSP design & implementation Multiple Baseline across Behaviors (training units) FBS Knowledge Test (derived from Umbreit et al. (2007) 12 weeks Training Methods Group lectures, Personal reading, 1:1 consultation Post Training Assessments FBS Knowledge test after each training unit Social validity Treatment Integrity Rated Highly Favorable 100% FA outcome BSP Quality Rispoli et al. (2013) Aggression, screaming, pushing etc. Verbal outbursts: “No” “Stop it” Trial Based Functional Analysis & Analogue Functional Analysis Comparison of FA & TBFA outcomes Not reported Not reported Modelling, role play, corrective feedback Fidelity of condition implementation Not reported 100% Schumate & Wills (2010) Disruption, Off task Brief Functional Analysis Multiple Baseline across Participants None taken, no previous teacher experience 10 mins Lecture training, modelling and role-play. Colour coded written protocol BFA outcome Rated Favorable 95% ABC None required Approx. 45 mins Two sessions of discussion and role play 25 item test after each session Rated Highly Favorable 92.5% Play condition excluded Skinner et al. (2009) Disruption and aggression Brief Functional Analysis FA outcome Study Wallace et al. (2004) Problem Behavior Head hitting (moderate rates) FA Method Brief Functional Analysis Experimental Design Multiple Baseline across Participants Baseline Skill Assessment Percentage correct interactions per BFA condition Training Duration 3 hours Training Methods Demonstration of FA conditions. Role-play of FA conditions. Feedback from researchers Post Training Assessments Percentage correct interactions per BFA condition Social validity Treatment Integrity Not reported 100% Participant s preferred the more effective methods of teaching FA conditions 99% (95%100%) Not reported 94% Generalisation probes for one participant Ward-Horner & Sturmey (2012) Challenging responses: Aggression: hitting & kicking. Analogue functional analysis Alternating treatments design combined with ABC and ABCD designs Written instructions, quiz, attempt to perform mock FA Not reported Nonchallenging responses: Chin tapping, hand tapping, spitting Watson et al. (1999) SIB Component analysis: P’s assigned to learn each FA condition through video modeling, rehearsal or feedback. Counterbalanced across participants and conditions Subsequent conditions taught using 2 of above methods. Any condition below criterion trained using all 3 methods Brief Functional Analysis AB None taken, teacher had limited knowledge of ABA 20 days Model of BFA with client, Teacher attempted FA with feedback Percentage correct interactions per FA condition Effectiveness of given component reported BFA outcome Table 3 Summary of interventions derived from trainee conducted Functional Assessments and Functional Analyses. FA (functional assessment), CB (challenging behavior), FCT (functional communication training), PECS (Picture Exchange Communication System), SIB (self-injurious behavior), DRO/DRA (differential reinforcement of other/alternative behavior. Study Problem Behavior Trainee conducted Functional Assessment Trainee conducted FA Behavioral Function Interventions Implemented Outcome of Intervention Bessette & Wills (2007) Disruption, aggression, property damage No Yes Multiply controlled: attention & escape FCT & Extinction Decreased CB and increased on task behavior Christensen et al. (2008) Study 1: disruption Yes No Attention from peers and teacher Social skills teaching, FCT for hand raising, altered reinforcement schedules Decrease in disruptive behavior post intervention Study 2: off task Yes No Escape from academic tasks Token economy. Tokens exchanged for extra recess time Increase in on task behavior for student, improved with greater fidelity to procedures Study 3: off task Yes No Attention from teacher and escape from task demands Non-contingent teacher attention, token economy. Tokens exchanged for extra recess time Decrease in problem behavior maintained and reinforcement schedule reduced Aggression and tantrums Not reported Yes P1: attention, escape, tangible FCT & extinction Increase in appropriate behavior and reductions in CB for two clients. Inconclusive outcomes for third client Lambert, Bloom & Ervin (2012) P2: escape P3: attention Study Lane et al. (2007) Problem Behavior Study 1: interruptions Trainee conducted Functional Assessment Yes Trainee conducted FA No Disruption Renshaw et al. (2008) Disruption, off task Study 1: teacher attention & escape Yes Yes No No Yes Outcome of Intervention Study 1: Decrease in interruptions, no consistent pattern of hand raising (replacement behavior) post intervention Study 2: social skills teaching, token economy for appropriate requests Study 2: decrease in touching in special and general classrooms, increases in requests did not generalize to the general ed. classroom P1: peer attention P1: choice of seat Decreased CB to zero P2: teacher attention P2: contingent teacher praise P1, P3, P4: attention P1: choice of seat, praise, extinction P2: praise, token exchange P3 praise, token exchange, get out of centre card P4 praise, token exchange Modest reductions in CB. Collateral gains in non target appropriate behaviors FCT using PECS or object exchange Amy: Large effect of FCT, (d=-4.5) Bob: Medium effect of FCT, (d=-0.6) Cody: Medium effect of FCT, (d=-0.5) P2: attention & escape Radstakke et al. (2013) Interventions Implemented Study 1: Self monitoring, curricular changes, hand raising as replacement behavior Study 2: attention, sensory stimulation Study 2: Maag & Larson (2008) Behavioral Function Aggression, SIB, throwing objects. Precursors: pushing materials, touching person/ food No Amy: escape from task Bob: tangibles Cody: escape from task Schumate & Wills (2010) Disruption, Off task No Yes Attention for all participants DRO & DRA CB to near zero Skinner et al. (2009) Disruption and aggression No Yes Multiply controlled: Attention & escape Fixed time attention & extinction Decreasing trend in CB Decreases in precursor behavior also shown for majority of topographies Study Watson et al. (1999) Problem Behavior SIB Trainee conducted Functional Assessment No Trainee conducted FA Yes Behavioral Function Escape Interventions Implemented Escape extinction & DRA Outcome of Intervention Generalized reductions to near zero across 3 staff