Doctorate in Educational and Child Psychology Kim O’Connor Case Study 1: An Evidence-Based Practice Review Report Theme: Interventions for children with Special Educational Needs What are the effects of video modelling interventions on the social and communication skills of children with autism spectrum disorders who can attend to an electronic screen? Summary Children with autism spectrum disorders (ASD) typically face difficulties developing appropriate social and communication skills. Video modelling (VM) interventions have emerged as a way to teach a range of behaviours and many studies have explored the impact they may have for children with ASD. Such interventions may offer children with ASD the opportunity to develop important life skills and learn behaviours that will support their effective integration into mainstream schools or specialist provision. A search of the literature identified six journal articles which met inclusion criteria. These studies explored a variety of VM interventions to support social and communication skills development. The target behaviours the research addressed included play, imitation, gesturing and responding to an instructional cue. The studies were evaluated and critiqued and the evidence subsequently weighted according to Gough’s (2007) ‘Weight of Evidence’ Framework. General support for the positive impact of VM interventions on social and communication skills was found. Recommendations for implementation of VM interventions and areas for future research are outlined. 1 Doctorate in Educational and Child Psychology Kim O’Connor Introduction Video Modelling This review aims to systematically investigate the effects of VM interventions on the social and communication skills of children with ASD. VM interventions first emerged in the 1990s as a teaching strategy for children with ASD. VM involves a child watching a model in a short video perform a target behaviour from a third person perspective and subsequently imitating the behaviour (Charlop-Christy, Le & Freeman, 2000). Researchers have explored variations in this format, such as video self-modelling, where editing is used to show the child themselves performing a target behaviour that is slightly above their current functioning level (Buggey, Hoomes, Sherberger & Williams, 2011) or point-of-view modelling, where the camera angle and scene is from the participant’s perspective (Tetreault & Lerman, 2010). VM has been used to teach children with ASD a variety of skills, including academic skills (Jowett, Moore & Anderson, 2012) and functional living skills (Shipley-Benamou, Lutzker & Taubman, 2002). However, the majority of studies focus on teaching social and communication skills (Mason, Ganz, Parker, Burke & Camargo, 2012). One of the benefits of VM is that it requires limited training of staff to deliver and is low in cost, both important considerations when weighing the practical implications of an intervention. 2 Doctorate in Educational and Child Psychology Kim O’Connor Basis in Psychological Theory Bandura’s (1977) work on social learning theory emphasises the role that observation and modelling play in learning experiences. The concept of behaviour modelling as outlined by Bandura has formed the basis of many of the intensive behavioural interventions developed to help children with ASD (Corbett, 2003). VM evolved as a variation of in vivo modelling and research has demonstrated it is comparably more effective because skill acquisition is faster in VM interventions (Charlop-Christy et al., 2000). Autism is characterised by impairments in verbal and non-verbal communication, social behaviour and interaction, and flexible thinking and behaviour, which may be shown in restricted or repetitive activities (DfES, 2002). Often described as a triad of impairments, these difficulties mean that children with ASD may engage in socially inappropriate behaviours or may appear unresponsive. Given its documented impact as a behaviour modelling intervention, VM is well-placed to target the difficulties that children with ASD face. The efficacy of VM may be explained by a number of factors, including the fact that it reduces the range of stimuli to which a child is exposed, which may be particularly effective for children with ASD who have difficulties responding to multiple cues in their environment (Charlop-Christy et al., 2000), and the preference individuals with ASD often display for electronic screen media (Mineo, Ziegler, Gill & Salkin, 2009). 3 Doctorate in Educational and Child Psychology Kim O’Connor Rationale Understanding and applying evidence-based practice is an important element of the distinctive contribution educational psychologists can make (Cameron, 2006). The increased government focus on accountability and re-structuring of many local authority services means that thorough reviews of practice are both necessary and desirable. When considering the future direction of educational psychology work, Fallon, Woods & Rooney (2010) predict the need for specialist assessment, advice and intervention for the most vulnerable children and young people with long-term complex needs. A focus on interventions for children with special educational needs and disabilities (SEND) is therefore timely. In 2013, 16% of pupils in all schools in England were classified as having SEND without a statement, and 2.8% with a statement (DfE, 2013). Of those pupils with a statement, 22% were identified with ASD as the primary need, by far the most frequently identified primary need. The prevalence of autism, and the continued imperative for effective inclusion, suggests the need for educational psychologists to have a thorough understanding of a wide range of effective provision in order to make useful recommendations to schools on how best to support children with ASD. Shukla-Mehta, Miller and Callahan (2010) reviewed the effectiveness of video instruction on social and communication skill acquisition for children with ASD and concluded that it was a promising intervention which required further research. VM with other as model was found to be more efficient than video self-modelling, a finding 4 Doctorate in Educational and Child Psychology Kim O’Connor supported by a later review of the effects of different types of VM interventions which found VM with adult as model to be most effective (Mason et al., 2013b). A metaanalysis of point-of-view VM concluded that it was highly effective in improving independent living skills for participants with ASD, though the evidence base did not extend to social and communication skills (Mason, Davis, Boles & Goodwyn, 2013a). A recent review of school-based interventions for ASD which focused on adolescents and young adults (De Bruin, Deppeler, Moore & Diamond, 2013) concluded that VM had a sufficient research base to be considered an evidence-based practice for this age group. In considering the different effect sizes produced by the studies in the review, the authors focus on the role of participant prerequisite skills in facilitating effective learning from VM. They suggest that the ability to attend to a screen may be necessary in order for the intervention to be effective, a finding echoed by Mason et al. (2012) and Mason et al. (2013a). Further research on the specific conditions that facilitate effective learning from VM is clearly needed, and with this in mind the present review will focus on studies which demonstrate that participants were able to attend to an electronic screen. The proposed question for this review is: What are the effects of video modelling interventions on the social and communication skills of children with autism spectrum disorders who can attend to an electronic screen? 5 Doctorate in Educational and Child Psychology Kim O’Connor Critical Review of Evidence Base A comprehensive literature search was carried out in December 2013 to locate all studies relevant to the research question. A search was undertaken on three databases (PsychINFO, ERIC and Medline) using the search terms outlined in Table 1. Table 1 Search Terms Intervention Population Video model* ASD VIG Autis* video-based* Asperger* autism spectrum disorders Following Durlak (2003), article titles and abstracts which contained a term from the ‘intervention’ column and a term from the ‘population’ column were identified. The searches were limited so that only articles in peer-reviewed journals (as a control for quality of research) and written in English (as resources for translation were not available) were included in the search results. This search identified 373 articles, of which 122 were duplicates. Using the inclusion and exclusion criteria outlined in Appendix 1, 231 articles were excluded based on titles or abstracts. Twenty articles were left for full-text screening, of which 14 of were excluded for reasons outlined in Appendix 2. See Figure 1 for a flow diagram of the study selection process. 6 Doctorate in Educational and Child Psychology Kim O’Connor Ancestral searches were conducted to identify papers within selected studies that might be relevant to the review. No further papers were selected for full-text screening or inclusion in this study. Figure 1 Flow Diagram of Study Selection Process Records identified (n = 373) Duplicates (n = 122) Abstracts screened (n = 251) Excluded, with reasons (n = 231): Publication type (n = 25) Language (n = 4) Study type (n = 30) Intervention (n = 18) Participants (n = 14) Date (n = 107) Outcome measures (n = 33) Full-text articles assessed for eligibility (n = 20) Excluded, with reasons (n = 14): Intervention (n = 4) Participants (n = 10) Studies included in synthesis (n = 6) This review is based upon six papers (see Appendix 3). These studies were critically analysed using Gough’s (2007) ‘Weight of Evidence’ Framework, summarised in Table 2. This appraises each paper in terms of its methodological quality, methodological relevance and relevance to the review question. The weights for each factor are averaged, giving an overall weight of evidence and providing a comprehensive foundation for comparing all studies with respect to the review question. 7 Doctorate in Educational and Child Psychology Kim O’Connor Table 2 Weight of Evidence Framework (Gough, 2007) Weight of Evidence Weight of Weight of Evidence Weight of A Evidence B C Evidence D Generic judgement about the coherence, quality and integrity of the evidence Review-specific judgement about appropriateness of the evidence for answering the review question Review-specific judgement about the relevance of the focus of the evidence for the review question Overall assessment of the extent to which a study contributes evidence to answer the review question (Methodological relevance) (Study focus relevance) (Methodological Quality) (Overall weighting) A summary of each paper is detailed in Appendix 4, followed by details of the Coding Protocol in Appendix 5. The weighting criteria are detailed in Appendix 6. The weighting of each study is presented in Table 3. Table 3 Weight of Evidence Authors Methodological Methodological Quality Relevance Study Focus Relevance Overall Weight of Evidence Medium Kleeberger & Mirenda (2010) Medium Medium Medium MacDonald et al. (2009) High Medium Medium Medium High Medium Medium Medium Medium Medium Medium Nikopoulos et al. (2009) Ozen et al. (2012) Medium 8 Doctorate in Educational and Child Psychology Kim O’Connor Palechka & MacDonald (2010) Medium Low Medium Medium Wilson (2013) Medium Low High Medium Participants The number of participants in each study ranged from one to four and ages ranged from three to nine years old. The ethnic and socioeconomic background of participants was not usually explained, although Wilson (2013) and Nikopoulos, Canavan and Nikopoulou-Smyrni (2009) gave these details. Participants in four studies were partially integrated into mainstream classrooms as well as receiving additional individualised teaching (MacDonald, Sacramone, Mansfield, Wiltz & Ahearn, 2009; Kleeberger & Mirenda, 2010; Ozen, Batu & Birkan, 2012; Palechka & MacDonald, 2010). This was usually in the form of an intensive behavioural intervention programme. In the case of Wilson (2013) and Nikopoulos et al. (2009), participants attended special schools. Some studies detailed the additional support participants received in their routine schooling. Wilson (2013) explains that all participants received speech-language and occupational therapy services at school, while MacDonald et al. (2009) and Palechka and MacDonald (2010) refer to participants’ prior experience with VM as an element of their curriculum. Design & Measures All six papers used single-case design (SCD), which is a rigorous, scientific methodology that can explore treatment effects with a small sample size (Horner et al., 2005). SCD involves manipulation of an independent variable together with repeated 9 Doctorate in Educational and Child Psychology Kim O’Connor measurement of a dependent variable before, during and after introduction of the independent variable. The systematic structure of such a design provides a strong basis for establishing causal inference (Kratochwill et al., 2010). Each study utilised a slightly different design structure, though all included three demonstrations of experimental effect (Horner et al., 2005). Each study’s weighting in terms of methodological quality was assessed using an adapted version of the SCD coding protocol devised by Kratochwill (2003). All six studies were rated as fairly strong in their use of outcome measures that produce reliable scores. This is due to the fact that all designs operationalized the target behaviours to be measured as dependent variables as observable incidences and used more than one assessor to record observations. Such practice is recommended as a quality indicator for SCD, as is reporting inter-observer agreement rates, which should be a minimum of 80% (Horner et al., 2005). Again, all six studies clearly document this information. However, none of the studies triangulated observation data with another method of measuring the same dependent variables, such as a checklist or rating scale, which would have further increased the reliability of results obtained. Most studies received a high rating for the quality of baseline data, which in SCD functions as a form of within-participant control. It is recommended that a minimum of three data points are collected during baseline phase in order that intervention effects are clear demarcated (Kratochwill et al., 2010) which all studies achieved with the exception of Palechka and MacDonald (2010) for one participant. In Wilson (2013), one participant’s baseline data were hugely variable and, as a result, the study author 10 Doctorate in Educational and Child Psychology Kim O’Connor decided to eliminate her from further analyses. As a result of this, her data were not considered when giving a methodological quality rating to this study. Variability, level and trend of baseline data were difficult to establish for one participant in Palechka and MacDonald (2010). Behaviours that are repetitive and limited in range are considered characteristic of autism (Howlin, 2006). In reviewing the selected studies, it was therefore important to consider the extent to which intervention effects were shown to be generalised or maintained beyond the specific conditions of the intervention itself. Wilson (2013) and Palechka and MacDonald (2010) were rated as low for methodological relevance because they did not investigate generalisation or maintenance effects. Two weeks after the treatment phase, Wilson (2013) did measure maintenance of behaviours but only on two occasions which, for a single-case design, is insufficient to establish experimental control (Horner et al., 2005). Two studies were rated as medium weight because they collected follow-up data which allowed for maintenance of treatment effects to be explored (MacDonald et al., 2009; Ozen et al., 2012). Kleeberger and Mirenda (2010) were also rated as medium-weight evidence because they collected data on the extent to which imitation behaviour generalised to actions that had not been included in the intervention videos. Nikopoulos et al. (2009) included phases to explore generalisation to new toys and to new subjects (where a different unknown adult replaced the experimenter). Additionally, robust follow-up data was recorded. As a result, this study was weighted as strong evidence for methodological relevance. 11 Doctorate in Educational and Child Psychology Kim O’Connor Some studies included additional measures that increase the extent to which a judgement can be made on how relevant the methodology was to establish treatment effects of a VM intervention. Three studies reported reliability data on intervention fidelity, where intervention sessions were recorded and assessed for how closely they followed the intervention as planned (Kleeberger & Mirenda, 2010; Ozen et al., 2012; Wilson, 2013). All three studies reported very high levels of intervention fidelity which increases judgements of reliability. Intervention All studies made use of a VM intervention with other as model (Mason et al., 2012). Intervention sessions were usually held daily and all studies described the location in which sessions took place.Most studies received a medium weighting in terms of their relevance to the review question. This is because they all outlined the way in which either the intervention itself or the operationalised dependent variable was relevant to the participants by including in their description of the participants a description of his or her deficit in terms of the target behaviour. Documenting the social significance of goals and the ecological validity of study aims is considered an important aspect of SCD (Horner et al., 2005). Wilson (2013) received a high weighting in this regard because all intervention and data collection for the study took place in the participants’ classrooms using classroom materials. Additionally, the target social-communication behaviour for each child was defined through a process of semi-structured assessment and a corresponding social-communication skill hierarchy. Once a target had been identified by research staff, each child’s teacher and parent was consulted to confirm whether they endorsed the behaviour as an appropriate goal. 12 Doctorate in Educational and Child Psychology Kim O’Connor Another way in which some studies demonstrated additional relevance in terms of working with participants with an ASD diagnosis was in involving familiar caregivers in either the design or delivery of the intervention. Given the wide range of ways in which ASD difficulties can present, it is not surprising that the involvement of parents and professionals who know the child well is recommended for interventions (Simpson, 2005). For example, in Kleeberger and Mirenda (2010) all experimental sessions took place in the participant’s home and his mother was always present. Familiar teachers and teaching assistants participated in Wilson’s (2013) study as models in the videos as well as delivering the intervention itself. Outcomes All of the studies collected observational data on incidence rates of target behaviours. The types of social and communication skills targeted by each study are shown in Table 4. Outcomes can be considered in terms of actions or verbalisations, or a combination of the two, as most studies focused on these behaviours as measurable indicators of social and communication skills. Effect sizes for each outcome, calculated for each case, are also presented in the table. Percentage of non-overlapping data (PND) was used as the evaluative effect size measure for this review because of its validity and demonstrated applicability in a wide range of contexts (Scruggs, Mastropieri & Casto, 1987; Scruggs & Mastropieri, 1994). Scruggs and Mastropieri (1998) suggest descriptive labels that interpret the relative strength of a PND effect size, and these interpretations are also included in the table. 13 Doctorate in Educational and Child Psychology Kim O’Connor Table 4 Summary Table of Effect Sizes by Study Type of Outcome Primary Outcome* Study** Effect Size Effect Size Type Effect Size Interpretation 77% PND*** Effective 69% PND Questionable 14% PND Ineffective 96% PND Very effective Gross motor actions Finger play actions 1 Toy play actions Scripted actions P1 2 Actions 97% PND Very effective 100% PND Very effective Toy clean-up behaviour P2 95% PND Very effective Toy clean-up behaviour P3 81% PND Effective 40% 63% PND NAP**** Ineffective Weak Verbalisat ions Combined Actions & Verbalisat ions Reaching to request an object P1 Pointing & vocalising to share attention P2 Using gesture to request more P3 Using gesture to request more P4 Scripted verbalisations P1 Scripted verbalisations P2 3 4 N/A - PND NAP PND NAP Questionable Medium Questionable Medium 96% PND Very effective 97% PND Very effective 100% PND Very effective Performing role in a play scenario P2 100% PND Very effective Performing role in a play scenario P3 100% PND Very effective 2 5 Medium Medium - 53% 73% 54% 80% Performing role in a play scenario P1 Medium Medium Scripted actions P2 Toy clean-up behaviour P1 Study Quality Medium Medium 14 Doctorate in Educational and Child Psychology Scripted vocalisations & play actions P1 Scripted vocalisations & play actions P2 Scripted vocalisations & play actions P3 6 Kim O’Connor 100% PND Very effective 100% PND Very effective 100% PND Very effective Medium *P1 = Participant 1, P2 = Participant 2, etc. **Study 1 = Kleeberger & Mirenda (2010); Study 2 = MacDonald et al. (2009); Study 3 = Nikopoulos et al. (2009); Study 4 = Wilson (2013); Study 5 = Ozen et al. (2012); Study 6 = Palechka & MacDonald (2010). ***PND = percentage of non-overlapping data (Scruggs, Mastropieri & Casto, 1987). See text for explanation of technique. ****NAP = non-overlap of all pairs (Parker & Vannest, 2009). These effect sizes are taken from the original research paper by Wilson (2013). Verbalisations It appears that VM is a highly effective intervention for verbalisations. The PND for MacDonald et al.’s (2009) study was 96% P1 and 97% P2, suggesting that VM was extremely effective in teaching the two participants to make the appropriate verbalisation to follow a play set script. Though both participants had a zero baseline for the airport play set and one had a zero baseline for the zoo play set, with the implication that PND ratings would automatically be high even if verbalisations only slightly increased, it could be argued that if all intervention data points exceeded zero, even if only marginally, this still demonstrates convincing treatment effect. Follow-up data collected for the airport play set was still at relatively high levels, suggesting maintenance of treatment effects over time. However, only one study focused specifically on verbalisations and thus caution must be advised when drawing conclusions on the effects of VM on verbal social and communication skills. 15 Doctorate in Educational and Child Psychology Kim O’Connor Actions The research evidence on the effects of VM on actions is much more variable. PND effect sizes ranged from 40% (Wilson, 2013) to 100% (Nikopoulos et al., 2009) which spans interpretations of intervention effects from ‘ineffective’ to ‘very effective’. There are several considerations to bear in mind when evaluating the research evidence. Despite demonstrating VM to be very effective on the whole, two participants in the Nikopoulos et al. (2009) study presented a zero baseline phase. However, both this study and MacDonald et al. (2009), with 96-97% PND, reported follow-up data that suggested, on the whole, convincing maintenance of treatment effects. Additionally, Nikopoulos et al. (2009) reported high levels of generalisation of behaviours across toys and subjects for two participants. It should be noted, though, that the data for the third participant was much more variable in terms of generalisation and maintenance. Data for the participants in Wilson (2013) were extremely variable and may partially explain why overall the VM intervention was found to be questionable or ineffective. For all three participants, data did not stabilise sufficiently so it would have been advisable to run the intervention for longer or more frequently to allow a stable pattern of data to emerge. It seems likely this may have happened given that data for visual attention and intervention fidelity were high. Additionally, without robust maintenance or generalisation data it is difficult to place much confidence in the 16 Doctorate in Educational and Child Psychology Kim O’Connor study’s results. Addressing these limitations may have led to more convincing reports of intervention effects. PND ranged from 14% to 77% for Kleeberger and Mirenda (2010), representing questionable intervention effects. In two conditions the effect of the VM intervention was very clear: gross motor actions represented 77% PND and finger play actions 69% PND. For toy play actions, baseline behaviour was already relatively high and very little change was demonstrated in the intervention phase, thus leading to a very low PND of 14%. Additionally, relatively high generalisation of behaviours was shown, particularly in the gross motor actions condition. There is, therefore, a rather mixed picture of intervention effects in this study. Combined actions and verbalisations Two studies reported the effects of a VM intervention on a combined actions and verbalisations variable. Both Ozen et al. (2012) and Palechka and MacDonald (2010) collected data that demonstrated 100% PND for all participants, suggesting that VM was very effective. While maintenance data for all three participants in Ozen et al. (2012) were very high, results are perhaps somewhat compromised by the fact that one participant’s mastery criterion level was set at 80% instead of the 100% level used for the other two participants. The results for Palechka and MacDonald (2010) are more convincing and the high proportion of attending to video that the three participants demonstrated adds further weight to the results obtained. However, 17 Doctorate in Educational and Child Psychology Kim O’Connor without investigation of generalisation or maintenance of target behaviours it is difficult to be entirely convinced of treatment effects. Conclusion and Recommendations This review examined six single-case studies of the effects of VM interventions on the social and communication skills of children with autism. Overall, VM was found to be a very effective intervention in the majority of studies. It was used to teach children a range of skills, from imitation and gesturing through to performing a role in a socio-dramatic play scenario. VM was found to be very effective in promoting both actions and verbalisations, although the research evidence on actions was not as conclusively in support of VM. There was some variation in the extent to which the results of each study could be considered meaningful and reliable. The one study given a high weighting for methodological quality reported data that indicated VM was an extremely effective intervention for both actions and verbalisations (MacDonald et al., 2009). Nikopoulos et al. (2009), the study that was rated highly for methodological relevance, also demonstrated that VM was a very effective intervention for promoting cooperative behaviours. Studies that did not report results as conclusively in favour of VM had methodological limitations that may have influenced the reliability of the results obtained (Kleeberger & Mirenda, 2010; Wilson, 2013). 18 Doctorate in Educational and Child Psychology Kim O’Connor Given that a markedly restricted repertoire of activities and interests is characteristic of autism (Corbett, 2003), it seems that VM is a valuable intervention to target developing a wider range of social and communication skills. This may be particularly pertinent in the case of play skills, which many of the reviewed studies target, because of the documented difficulties children with autism face with pretend play and imagination (Jarrold, 2003). In addition to its demonstrated impact, VM is a cost-effective treatment that can be conducted in an educational setting with limited input from external professionals. Compared to more resource-intensive treatments such as applied behaviour analysis (Lovaas, 1987), VM may be an appealing alternative, particularly given the increasing prevalence of tablet devices. The possibility of personalising the content of the video for each child makes VM particularly appropriate for the variable presentation of autism spectrum disorders (Howlin, 2006). One significant finding that emerged from the review was the high level of generalisation and maintenance of behaviours targeted in the interventions. Results from four studies suggested that the benefits of VM extended further than the specific conditions of the intervention itself and provide further support for the value of VM in increasing the repertoire of social and communication skills available to children with autism. There are several limitations to the quality of the evidence provided in this review. The first is that none of the studies triangulated the observational method of data collection with another measure, such as a parent or teacher questionnaire. A 19 Doctorate in Educational and Child Psychology Kim O’Connor second limitation is that four of the six studies reviewed made use of a mastery criterion in their design. The level at which ‘mastery’ is defined can vary, and perhaps give a distorted view of the actual skill level of participants and therefore potentially over-inflate the impact of VM. One example of this is that one of the participants in Ozen et al. (2012) worked to a different level of mastery than the other two, yet all three participants obtained 100% PND. A further limitation is that some studies made use of verbal prompts and praise during the intervention, making it difficult to isolate the effects of VM from those provided by social reinforcement. For example, Kleeberger and Mirenda (2010) provided prompts to the participant to pay attention to the video, and praised efforts when he attempted to imitate. The present review aimed to contribute to a growing body of evidence on the specific conditions in which VM interventions may be most effective. By reviewing studies which included a way to assess visual attention for minimum standards, conclusions can be drawn about particular children for whom VM may be a recommended intervention. VM does indeed seem to be an effective intervention for children who are able to attend. Recommendations for further research Single-case designs provide useful information about the process of skill acquisition in individuals and findings can then be further developed in controlled effectiveness trials (Kratochwill et al., 2010). One recommendation from this review is that VM should be explored in group design studies with controls so that scaled-up effects of 20 Doctorate in Educational and Child Psychology Kim O’Connor the intervention can be investigated. A further recommendation is that the effects of VM need to be separated from potential mediator variables such as use of verbal praise and prompts to engage participants. More studies exploring the effects of VM alone would allow for critical reviews on the specific impact of this intervention. It may be that use of praise or reinforcement and VM together form the most effective treatment package, but further research is needed to establish the basis for recommendations such as this. This study has focussed on the effects of VM on social and communication skills for children with ASD. A further avenue for research would be to explore the effects of VM on other skills that may benefit children with autism, such as developing academic or independent living skills. Finally, it would be interesting to explore the effects of this intervention on developing the social and communication skills of children with social, emotional and behavioural difficulties. VM may be a particularly useful intervention in mainstream settings, where the limited resource implications would make it an appealing strategy for teachers and other professionals. 21 Doctorate in Educational and Child Psychology Kim O’Connor References Bandura, A. (1977). Social Learning Theory. Upper Saddle River, NJ: Prentice Hall. Buggey, T., Hoomes, G., Sherberger, M. E., & Williams, S. (2011). Facilitating social initiations of preschoolers with autism spectrum disorders using video selfmodeling. Focus on Autism and Other Developmental Disabilities, 26(1), 2536. Cameron, R. J. (2006). Educational psychology: The distinctive contribution. Educational Psychology in Practice, 22(4), 289-304. Charlop-Christy, M. H., Le, L., & Freeman, K. A. (2000). A comparison of video modeling with in vivo modeling for teaching children with autism. Journal of autism and developmental disorders, 30(6), 537-552. Corbett, B. A. (2003). Video Modeling: A Window into the World of Autism. Behavior Analyst Today, 4(3). De Bruin, C. L., Deppeler, J. M., Moore, D. W., & Diamond, N. T. (2013). Public School–Based Interventions for Adolescents and Young Adults With an Autism Spectrum Disorder A Meta-Analysis. Review of Educational Research, 83(4), 521-550. Department for Education (DfE). (2013). SFR 30/2013 – Special Educational Needs in England: January 2013. Retrieved 18 February, 2014, from https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/ 225699/SFR30-2013_Text.pdf 22 Doctorate in Educational and Child Psychology Kim O’Connor Department for Education and Skills (DfES). (2002). Autistic Spectrum Disorders: Good Practice Guidance. Retrieved 18 February, 2014, from http://webarchive.nationalarchives.gov.uk/20130401151715/https://www.educ ation.gov.uk/publications/eOrderingDownload/0597-2002-PDF1.pdf Durlak, J. (2003). General guidelines for conducting a literature review. Appendix B of Task force on evidence-based practice interventions in school psychology. Fallon, K., Woods, K., & Rooney, S. (2010). A discussion of the developing role of educational psychologists within Children’s Services. Educational Psychology in Practice, 26(1), 1-23. Gough, D. (2007). Weight of evidence: a framework for the appraisal of the quality and relevance of evidence. Research Papers in Education, 22(2), 213-228. Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single subject research to identify evidence-based practice in special education. Exceptional Children, 71, 165-179 Howlin, P. (2006). Autism spectrum disorders. Psychiatry, 5(9), 320-324. Jarrold, C. (2003). A review of research into pretend play in autism. Autism, 7(4), 379-390. Jowett, E. L., Moore, D. W., & Anderson, A. (2012). Using an iPad-based video modelling package to teach numeracy skills to a child with an autism spectrum disorder. Developmental neurorehabilitation, 15(4), 304-312. Kleeberger, V., & Mirenda, P. (2010). Teaching generalized imitation skills to a preschooler with autism using video modeling. Journal of Positive Behavior Interventions, 12(2), 116-127. 23 Doctorate in Educational and Child Psychology Kim O’Connor Kratochwill, T. R. (2003). Task force on evidence-based interventions in school psychology. Retrieved April 16, 2014, from http://madison.k12.in.us/MCSWeb/CSSU/EBI%20Manual.pdf Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L. & Rindskopf, D. M. et al. (2010). Single-case designs technical documentation. Retrieved from What Works Clearinghouse website: http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf Lovaas, O. I. (1987). Behavioral treatment and normal educational and intellectual functioning in young autistic children. Journal of consulting and clinical psychology, 55(1), 3. MacDonald, R., Sacramone, S., Mansfield, R., Wiltz, K., & Ahearn, W. H. (2009). Using video modeling to teach reciprocal pretend play to children with autism. Journal of Applied Behavior Analysis, 42(1), 43-55. Mason, R. A., Ganz, J. B., Parker, R. I., Burke, M. D., & Camargo, S. P. (2012). Moderating factors of video-modeling with other as model: A meta-analysis of single-case studies. Research in developmental disabilities, 33(4), 1076-1086. Mason, R. A., Davis, H. S., Boles, M. B., & Goodwyn, F. (2013a). Efficacy of Pointof-View Video Modeling A Meta-Analysis. Remedial and Special Education, 34(6), 333-345. Mason, R. A., Ganz, J. B., Parker, R. I., Boles, M. B., Davis, H. S., & Rispoli, M. J. (2013b). Video-based modeling: Differential effects due to treatment protocol. Research in Autism Spectrum Disorders, 7(1), 120-131. Mineo, B. A., Ziegler, W., Gill, S., & Salkin, D. (2009). Engagement with electronic screen media among students with autism spectrum disorders. Journal of autism and developmental disorders, 39(1), 172-187. 24 Doctorate in Educational and Child Psychology Kim O’Connor Nikopoulos, C. K., Canavan, C., & Nikopoulou-Smyrni, P. (2009). Generalized Effects of Video Modeling on Establishing Instructional Stimulus Control in Children With Autism Results of a Preliminary Study. Journal of Positive Behavior Interventions, 11(4), 198-207. Ozen, A., Batu, S., & Birkan, B. (2012). Teaching Play Skills to Children with Autism through Video Modeling: Small Group Arrangement and Observational Learning. Education and Training in Autism and Developmental Disabilities, 47(1), 84. Palechka, G., & MacDonald, R. (2010). A comparison of the acquisition of play skills using instructor-created video models and commercially available videos. Education and Treatment of Children, 33(3), 457-474. Scruggs, T. E., Mastropieri, M. A., & Casto, G. (1987). The quantitative synthesis of single-subject research methodology and validation. Remedial and Special Education, 8(2), 24-33. Scruggs, T. E., & Mastropieri, M. A. (1994). The utility of the PND statistic: A reply to Allison and Gorman. Behaviour Research and Therapy, 32(8), 879-883. Scruggs, T. E., & Mastropieri, M. A. (1998). Summarizing single-subject research issues and applications. Behavior Modification, 22(3), 221-242. Shipley-Benamou, R., Lutzker, J. R., & Taubman, M. (2002). Teaching daily living skills to children with autism through instructional video modeling. Journal of Positive Behavior Interventions, 4(3), 166-177. Shukla-Mehta, S., Miller, T., & Callahan, K. J. (2010). Evaluating the effectiveness of video instruction on social and communication skills training for children with autism spectrum disorders: A review of the literature. Focus on Autism and Other Developmental Disabilities, 25(1), 23-36. 25 Doctorate in Educational and Child Psychology Kim O’Connor Simpson, R. L. (2005). Evidence-based practices and students with autism spectrum disorders. Focus on Autism and Other Developmental Disabilities, 20(3), 140149. Tetreault, A. S., & Lerman, D. C. (2010). Teaching social skills to children with autism using point-of-view video modeling. Education and Treatment of Children, 33(3), 395-419. Wilson, K. P. (2013). Teaching Social-Communication Skills to Preschoolers with Autism: Efficacy of Video Versus In Vivo Modeling in the Classroom. Journal of autism and developmental disorders, 43(8), 1819-1831. 26 Doctorate in Educational and Child Psychology Kim O’Connor Appendix 1 Inclusion and Exclusion Criteria Inclusion Criteria The study must be published in a peerreviewed journal Exclusion criteria The study is not published in a peer reviewed journal (eg dissertation or grey literature) 2. Language The study must be written in English The study is not written in English 3. Type of study The study must contain primary empirical data The study does not contain primary empirical data (eg a ‘how to’ guide or review) 1. Type of publication 4. Intervention 5. Participants a) The intervention must be video modelling with other as model The intervention is a different form of video modelling (eg video selfmodelling or point-of-view video modelling) b) The intervention must not be run in combination with other interventions The intervention is run in combination with other interventions or is part of a combined intervention package (eg PECS or Social Stories) c) The video-based instruction must form the intervention (i.e. an independent variable) The video-based instruction does not function as the independent variable (eg video used as a stimulus or method of recording) a) All participants must have an ASD diagnosis Not all participants have an ASD diagnosis b) Participants are screened for their ability to attend to video or study adequately accounts for participants’ ability to attend to video There is no explicit mention of pre-screening participants, participants are unable to attend to video for a sufficient length of time or description of attending does not allow for a conclusion to be drawn 27 Doctorate in Educational and Child Psychology for an appropriate length of time (eg through a variable measuring visual attention) Kim O’Connor about whether participants attended or not c) Must be pre-school or primary school age children Are secondary age adolescents or older, or are below pre-school age 6. Date Studies have been published from 2009 onwards Studies are published earlier than 2009 7. Outcome Measures Primary outcome measures are related to social and communication skills Primary outcome measures are not related to social and communication skills (eg life skills or academics) Rationale for Inclusion & Exclusion Criteria: 1. Excluding research that has not been peer-reviewed is a way to ensure reviewed papers have met minimum quality standards. 2. Resources are not available for translation. 3. There must be primary data available for the review to synthesise. 4. (a) Previous meta-analyses have suggested looking at types of video modelling separately (Shukla-Mehta et al., 2010; Mason et al., 2013b). A recent meta-analysis has looked at point-of-view video modelling (Mason et al., 2013a). (b) The review aims to explore the effects of VM interventions alone. (c) The review aims to explore the effects of VM and thus it should be operationalized as the independent variable. 5. (a) The review focuses specifically on effects for children with ASD. (b) This review aims to explore the particular circumstances in which VM is effective by focusing on participant characteristics, specifically the ability to attend (De Bruin et 28 Doctorate in Educational and Child Psychology Kim O’Connor al., 2013; Mason et al., 2012; Mason et al., 2013a). (c) A recent meta-analysis looked at studies conducted with 12-22 year olds (De Bruin et al., 2013). To ensure findings are applicable to an educational setting, participants must be pre-school age (3 years old) at a minimum. 6. A comprehensive meta-analysis exploring the effects of video instruction on the social and communication skills of children with ASD searched until 2009 (ShuklaMehta et al., 2010). 7. The review aims to explore the effects on social and communication skills in particular. 29 Doctorate in Educational and Child Psychology Kim O’Connor Appendix 2 Studies excluded at full-text Name of Study Reason for exclusion Axe, J. B., & Evans, C. J. (2012). Using video modeling to teach children with PDD-NOS to respond to facial expressions. Research in Autism Spectrum Disorders, 6(3), 1176-1185. 5b. There is no information given about participants’ ability to attend. Boudreau, E., & D’Entremont, B. (2010). Improving the pretend play skills of preschoolers with autism spectrum disorders: The effects of video modeling. Journal of Developmental and Physical Disabilities, 22(4), 415-431. 5b. Study does not adequately demonstrate that participants attended. Brim, D., Townsend, D. B., DeQuinzio, J. A., & Poulson, C. L. (2009). Analysis of social referencing skills among children with autism. Research in Autism Spectrum Disorders, 3(4), 942-958. 4b. Video modelling is part of a combined package intervention (including visual and manual prompting). Cardon, T. A., & Wilcox, M. J. (2011). Promoting imitation in young children with autism: A comparison of reciprocal imitation training and video modeling. Journal of autism and developmental disorders, 41(5), 654-666. 5c. Participants are as young as 20 months. Charlop, M. H., Gilmore, L., & Chang, G. T. (2008). Using video modeling to increase variation in the conversation of children with autism. Journal of Special Education Technology, 23(3), 47. 5b. There is no information given about participants’ ability to attend. Charlop, M. H., Dennis, B., Carpenter, M. H., & Greenberg, A. L. (2010). Teaching socially expressive behaviors to children with autism through video modeling. Education and treatment of children, 33(3), 371-393. 5b. Study does not adequately demonstrate that participants attended. Dupere, S., MacDonald, R. P., & Ahearn, W. H. (2013). Using video modeling with substitutable loops to teach varied play to children with autism. Journal of applied behavior analysis, 46(3), 662-668. 4a. The intervention is point-of-view video modelling. Lydon, H., Healy, O., & Leader, G. (2011). A comparison of video modeling and pivotal response training to teach pretend play skills to children with autism spectrum disorder. Research in Autism Spectrum Disorders, 5(2), 872-884. 5b. There is no information given about participants’ ability to attend. 30 Doctorate in Educational and Child Psychology Kim O’Connor MarzulloâKerth, D., Reeve, S. A., Reeve, K. F., & Townsend, D. B. (2011). Using multiple-exemplar training to teach a generalised repertoire of sharing to children with autism. Journal of applied behavior analysis, 44(2), 279294. 4b. Video modelling is part of a combined package intervention (including hand-overhand guidance). McHugh, L., Bobarnac, A., & Reed, P. (2011). Brief Report: Teaching Situation-Based Emotions to Children with Autistic Spectrum Disorder. Journal of autism and developmental disorders, 41(10), 1423-1428. 5b. There is no information given about participants’ ability to attend. Plavnick, J. B., & Ferreri, S. J. (2011). Establishing verbal repertoires in children with autism using function-based video modelling. Journal of applied behavior analysis, 44(4), 747-766. 5b. Two participants were unable to attend to video screens. Sancho, K., Sidener, T. M., Reeve, S. A., & Sidener, D. W. (2010). Two variations of video modeling interventions for teaching play skills to children with autism. Education and Treatment of Children, 33(3), 421-442. 4a. The intervention is point-of-view video modelling. Scheflen, S. C., Freeman, S. F., & Paparella, T. (2012). Using Video Modeling to Teach Young Children with Autism Developmentally Appropriate Play and Connected Speech. Education and Training in Autism and Developmental Disabilities, 47(3), 302-318. 5b. Study does not adequately demonstrate that participants attended. Tereshko, L., MacDonald, R., & Ahearn, W. H. (2010). Strategies for teaching children with autism to imitate response chains using video modeling. Research in Autism Spectrum Disorders, 4(3), 479-489. 5b. Participants were unable to attend to video modelling in its typical form. 31 Doctorate in Educational and Child Psychology Kim O’Connor Appendix 3 Reviewed studies Kleeberger, V., & Mirenda, P. (2010). Teaching generalized imitation skills to a preschooler with autism using video modeling. Journal of Positive Behavior Interventions, 12(2), 116-127. MacDonald, R., Sacramone, S., Mansfield, R., Wiltz, K., & Ahearn, W. H. (2009). Using video modeling to teach reciprocal pretend play to children with autism. Journal of Applied Behavior Analysis, 42(1), 43-55. Nikopoulos, C. K., Canavan, C., & Nikopoulou-Smyrni, P. (2009). Generalized Effects of Video Modeling on Establishing Instructional Stimulus Control in Children With Autism Results of a Preliminary Study. Journal of Positive Behavior Interventions, 11(4), 198-207. Ozen, A., Batu, S., & Birkan, B. (2012). Teaching Play Skills to Children with Autism through Video Modeling: Small Group Arrangement and Observational Learning. Education and Training in Autism and Developmental Disabilities, 47(1), 84. Palechka, G., & MacDonald, R. (2010). A comparison of the acquisition of play skills using instructor-created video models and commercially available videos. Education and Treatment of Children, 33(3), 457-474. Wilson, K. P. (2013). Teaching Social-Communication Skills to Preschoolers with Autism: Efficacy of Video Versus In Vivo Modeling in the Classroom. Journal of autism and developmental disorders, 43(8), 1819-1831. Appendix 4 Summary of Reviewed Studies 32 Doctorate in Educational and Child Psychology Study and Aims Kleeberger & Mirenda (2010) Sample1 Design N = 1 child (1M) Multiple-baseline design across three Age: 4 years old imitation activities: gross motor, finger Identification: Aimed to play and toy play. examine the Participant had a Three songs or effectivenes diagnosis of autism; activities were s of video he rarely imitated selected for each. modelling to without specific teach a pre- prompts to do so. All baseline and schooler probe sessions with autism Participant Info: occurred 1-3 times a imitation Participant week. Order of skills. attended a preactivities was school and counterbalanced to received a homecontrol for order based treatment effects. Intervention programme. for each activity was introduced in a timeLocation: USA. lagged structure. Generalisation probes for actions not modelled in the videos took place at various times throughout the experimental process. 1 N = number, M = male, F = female, P = participant. Kim O’Connor Intervention Measures Outcomes Video modelling: nine videos were made depicting an adult model directing the activity and two adults who played the roles of children. The children imitated the adult activity. Videos ranged in length from 1-4 minutes. Sessions were held once daily. The researcher and a research assistant scored for occurrence of target behaviours. Inter-observer agreement data was collected. During baseline, participant’s mean gross motor and finger play imitation actions were approximately zero. Toy play imitation actions were around 40%. Target behaviour: Imitation of the gross motor, finger play or toy play behaviours shown in the video models. Follow up measures: no follow-up data was collected. Gross motor and finger play imitations increased significantly during the intervention phase. Toy play imitations increased slightly from baseline levels. Generalisation probes demonstrated some increase compared to baseline levels, which were a similar pattern to the baseline levels described above for the three activities. During the intervention phase, there was some increase in generalisation for novel toy play and finger play actions, and a more marked increase for novel gross motor actions. 33 Doctorate in Educational and Child Psychology Study and Aims MacDonald et al. (2009) Aimed to use video modelling to teach children with autism to engage in reciprocal pretend play with typically developing peers. Kim O’Connor Sample1 Design Intervention Measures Outcomes N = 2 children (2M) Multiple-probe design across three play sets. Video modelling: one session per participant was conducted daily. Two adults were videotaped acting out a sequence of pretend play. Participants watched the video twice and then were directed to the relevant play materials and told, “It’s time to play”. They were given 4 minutes to play. Video viewing sessions continued until mastery was reached on that play set. All sessions were videotaped and scored afterwards for occurrence of the target behaviours. Interobserver agreement data was collected. P1 – Achieved mastery level of scripted actions and scripted verbalisations on all three play sets and this was maintained at follow-up. He also showed a mean increase in unscripted verbalisations and a significant increase in cooperative play and reciprocal verbal interaction chains. Age: 5 & 7 year olds Identification: Diagnosis of autism; both engaged in solitary play. Each was matched with a typically developing peer to assess reciprocal interaction. Participant Info: Children attended a pre-school that combined individualised teaching with some integrated mainstream classroom time. Baseline, training and probe phases comprised 4 minute play sessions. The play sets were introduced one after the other, with children in each pair required to perform at or above mastery level on scripted verbalisations and scripted play actions before training began on the next play set. The sets were taught in the same order for both children. Target behaviours: (a) Scripted verbalisations, (b) scripted play actions. Follow up measures: one month following mastery of the airport and zoo, three follow-up probes were conducted on the airport set. Further follow-up probes on other play sets were conducted after a new play set was mastered. P2 – Achieved mastery level of scripted actions and scripted verbalisations on most of the three play sets and this was to some extent maintained at follow-up. He did not reach mastery for scripted verbalisations for the grill play set. He also showed a mean increase in unscripted verbalisations and a significant increase in cooperative play and reciprocal verbal interaction chains. Location: USA. 34 Doctorate in Educational and Child Psychology Study and Aims Nikopoulos, Canavan & NikopoulouSmyrni (2009) Sample1 Design N = 3 children (1F, 2M) Multiple-baselineacross-subjects design. Kim O’Connor Intervention Video modelling: an unfamiliar typically developing peer was Age: 7-9 year olds used as a model in a 30 Two to three baseline second video in which the Identification: or intervention experimenter was shown Aimed to Independent sessions were switching off a television, demonstrat diagnoses of conducted on any and leading the model to e the effects autism; teacher given day for each a toy. After the model had of video reports identified all child. After mastery played with the toy for 10 modelling were often was achieved, seconds, the on noncompliant in children were experimenter gave the establishing response to transferred to a instruction, “Play is stimulus instructions and generalisation across finished” and the model control and task-related toys condition and put the toy away in a box. responding requests. then, upon successful Participants watched the to an completion of three video once, then Participant Info: instruction. consecutive sessions, encountered the same Children attended a a generalisation scenario as the one in the special school for across subjects video. children with severe condition. Target behaviour: Toy learning difficulties. clean-up behaviour. Location: UK. Measures Outcomes A latency recording system was used to measure the child’s initiation of the appropriate motor response to the experimenter’s instruction. Interobserver agreement data was collected. During baseline, none of the participants responded to the instruction “Play is finished”. After the video modelling intervention was introduced, all children met mastery criterion within 5 to 7 sessions. Follow up measures: one month after the final measurement had been taken a follow-up assessment was conducted for four sessions across four different toys. Generalisation across toys was variable between participants. Latency to respond remained low for two participants in the generalisation across subjects condition and at follow-up. The third participant’s performance was extremely variable in these two phases. 35 Doctorate in Educational and Child Psychology Study and Aims Ozen, Batu & Birkan (2012) Sample1 Design N = 3 children (3M) Multiple probe design across behaviours. Aimed to examine if video modelling was an effective way of teaching sociodramat ic play skills to individuals with autism in a small group arrangemen t. Identification: Children with autism; study reports participants had problems attending to play activities with peers as well as initiating and continuing communication with others. Age: 9 year olds Participant Info: Children attended a special early intervention programme and had individual support whilst attending a mainstream school. Location: Turkey. Kim O’Connor Intervention Video modelling: three different scenarios were scripted (canteen, doctor, Three different play teacher) with three roles scenarios were used in each. Three students with settings that played the roles of the corresponded (eg the participants for each teacher scenario scenario and carried out phase took place in a each of the steps classroom). Each role necessary for the script. in a scenario was Participants were given a broken into steps. role and watched the Training, probe and video, then were told the maintenance criteria needed for a good sessions were performance (eg make conducted weekly. eye contact). Probe sessions were Target behaviour: conducted for each scenario in turn as Performing the steps of a participants met role in a play scenario. mastery criterion for that scenario. Observational learning data was also collected. Measures Outcomes Sessions were recorded and the percentage of correctly performed steps in each scenario was calculated. Interobserver agreement data was collected. During baseline, all three of the participants performed moderately well in the canteen scenario, with an average of 40% correct responses, but did not score in the other two scenarios. Follow up measures: two weeks after the training sessions were completed, maintenance sessions were conducted. P1 – Achieved mastery level on all three scenarios and maintained this level of performance during maintenance sessions. He took comparatively longer to reach mastery level than the other participants, and had a different percentage criterion to indicate mastery (80% instead of 100%). He also showed a high level of observational learning. P2 & P3 – Achieved mastery levels on all three scenarios and maintained this level of performance during maintenance sessions. They also showed high levels of observational learning, although this was slightly lower for P3 than the other two participants. 36 Doctorate in Educational and Child Psychology Study and Aims Palechka & MacDonald (2010) Sample1 Design N = 3 children (1F, 2M) Multi-element design within participant and across model types. Additionally, multiple probe design across participants. Kim O’Connor Intervention Video modelling: an identical version of each CAV was created with an Age: 4-5 year olds adult using the same Compared figurines to model the Identification: the effects behaviour chain of of a Children with a completing the script commerciall diagnosis of autism; To compare ICV to using the figurines and y available all were selected CAV models, two play set. Participants children’s based on reports of scripts were taught were told, “It’s time to video (CAV) their lack of using one video of watch the movie” and relative to appropriate socioeach format for each watched the video two an dramatic play skills participant. Each consecutive times. Next, instructorand all had participant completed the participant was created increasing play mastery probes for instructed to sit in front of video model skills targeted on both scripts before the play set and was told, (ICV) on the their IEPs. training of another “It’s time to play”. At the acquisition participant began. end of the 5-minute of play skills Participant Info: Scripts were equated session the participant for children All were enrolled in for difficulty. Sessions was told, “Playing is all with autism. a centre-based were conducted daily. done”. programme that Mastery criterion Target behaviour: provided early levels were set. intensive Scripted vocalisations behavioural and scripted play actions. intervention. Measures Outcomes All sessions were recorded and scored for the occurrence of the target behaviours, as well as in some sessions the total duration of attending to video and attending to toys during video viewing. Percentages were calculated. Interobserver agreement data was collected. During baseline, all three participants demonstrated very few of the scripted behaviours and statements for the ICV across both scripts. Follow up measures: no follow-up data was collected. All three also reached mastery level with the ICV, and comparatively quicker than the number of sessions it took them to reach mastery with the CAV. P1 took 12 sessions to reach the mastery phase, P2 took 4 sessions and P3 took 16 sessions. All participants also consistently attended to the video during the training phase, although P3 attended less on average than P1 and P2. Location: USA. 37 Doctorate in Educational and Child Psychology Kim O’Connor Study and Aims Wilson (2013) Sample1 Design Intervention Measures Outcomes N = 4 children (2F, 2M) Aimed to examine the relative efficacy of video modelling compared to in-vivo modelling in teaching socialcommunicat ion skills to pre-school children. Age: 3-5 year olds Alternating treatments design with baseline and replication across participants. Video modelling: each child’s teacher served as the adult model and a teaching assistant as facilitator in a threeminute video in which the child’s target behaviour was modelled. Research assistants blind to the study’s hypotheses collected data using observational methods to record occurrences of behaviour. An automated interval indicator allowed for data on visual attention to be collected which was then analysed with a pairedsamples t test. Inter-observer agreement data was collected. During baseline, most participants showed limited initiation of their target behaviour. However, the baseline for one participant (P2) did not stabilise and so results were not analysed for her in terms of intervention effects. Identification: All participants had a diagnosis of autism which was supported by experimenteradministered measures; teacher and parent reports identified strengths and limitations with regard to socialcommunication skills. Participant Info: Participants were recruited from two pre-schools which served students with a range of developmental disabilities. Location: USA. Baseline measures were taken three times per week during five-minute observations for a minimum of five data points. Treatment sessions took place on average three times per week for a minimum of five sessions and a maximum of fifteen sessions. Both video and in-vivo treatments were provided on each day of data collection, with at least 1 hour between treatments, and with the order of treatments randomised daily. Target behaviour: A target socialcommunication behaviour was determined and operationally defined for each child using semistructured assessment procedures and a corresponding socialcommunication skill hierarchy. P1: reaching to request an object; P2: pointing and vocalising to share attention; P3: using gesture to request more; P4: using gesture to request more. Follow up measures: two weeks after the treatment phase, maintenance sessions were conducted for two days. Introduction of the treatment for P1 resulted in an upward trend in the data and a slightly increased level, although effects were not immediate. For P3, there was also a delayed response to video modelling which was then followed by an upward trend and increased level. Results were maintained for both children. For P4, video modelling resulted in a more immediate and pronounced upward trend and increased level, although maintenance was more questionable. On the whole, participants showed a significant preference for the video model in terms of visual attention data. 38 Doctorate in Educational and Child Psychology Kim O’Connor Appendix 5 Coding Protocols 39 Doctorate in Educational and Child Psychology Kim O’Connor 40 Doctorate in Educational and Child Psychology Kim O’Connor 41 Doctorate in Educational and Child Psychology Kim O’Connor 42 Doctorate in Educational and Child Psychology Kim O’Connor 43 Doctorate in Educational and Child Psychology Kim O’Connor 44 Doctorate in Educational and Child Psychology Kim O’Connor 45 Doctorate in Educational and Child Psychology Kim O’Connor 46 Doctorate in Educational and Child Psychology Kim O’Connor 47 Doctorate in Educational and Child Psychology Kim O’Connor 48 Doctorate in Educational and Child Psychology Kim O’Connor 49 Doctorate in Educational and Child Psychology Kim O’Connor 50 Doctorate in Educational and Child Psychology Kim O’Connor 51 Doctorate in Educational and Child Psychology Kim O’Connor 52 Doctorate in Educational and Child Psychology Kim O’Connor 53 Doctorate in Educational and Child Psychology Kim O’Connor 54 Doctorate in Educational and Child Psychology Kim O’Connor 55 Doctorate in Educational and Child Psychology Kim O’Connor 56 Doctorate in Educational and Child Psychology Kim O’Connor 57 Doctorate in Educational and Child Psychology Kim O’Connor 58 Doctorate in Educational and Child Psychology Kim O’Connor 59 Doctorate in Educational and Child Psychology Kim O’Connor 60 Doctorate in Educational and Child Psychology Kim O’Connor 61 Doctorate in Educational and Child Psychology Kim O’Connor 62 Doctorate in Educational and Child Psychology Kim O’Connor 63 Doctorate in Educational and Child Psychology Kim O’Connor 64 Doctorate in Educational and Child Psychology Kim O’Connor 65 Doctorate in Educational and Child Psychology Kim O’Connor 66 Doctorate in Educational and Child Psychology Kim O’Connor 67 Doctorate in Educational and Child Psychology Kim O’Connor 68 Doctorate in Educational and Child Psychology Kim O’Connor 69 Doctorate in Educational and Child Psychology Kim O’Connor 70 Doctorate in Educational and Child Psychology Kim O’Connor 71 Doctorate in Educational and Child Psychology Kim O’Connor 72 Doctorate in Educational and Child Psychology Kim O’Connor 73 Doctorate in Educational and Child Psychology Kim O’Connor 74 Doctorate in Educational and Child Psychology Kim O’Connor 75 Doctorate in Educational and Child Psychology Kim O’Connor 76 Doctorate in Educational and Child Psychology Kim O’Connor 77 Doctorate in Educational and Child Psychology Kim O’Connor 78 Doctorate in Educational and Child Psychology Kim O’Connor 79 Doctorate in Educational and Child Psychology Kim O’Connor 80 Doctorate in Educational and Child Psychology Kim O’Connor 81 Doctorate in Educational and Child Psychology Kim O’Connor 82 Doctorate in Educational and Child Psychology Kim O’Connor 83 Doctorate in Educational and Child Psychology Kim O’Connor 84 Doctorate in Educational and Child Psychology Kim O’Connor 85 Doctorate in Educational and Child Psychology Kim O’Connor 86 Doctorate in Educational and Child Psychology Kim O’Connor 87 Doctorate in Educational and Child Psychology Kim O’Connor 88 Doctorate in Educational and Child Psychology Kim O’Connor 89 Doctorate in Educational and Child Psychology Kim O’Connor 90 Doctorate in Educational and Child Psychology Kim O’Connor 91 Doctorate in Educational and Child Psychology Kim O’Connor 92 Doctorate in Educational and Child Psychology Kim O’Connor 93 Doctorate in Educational and Child Psychology Kim O’Connor 94 Doctorate in Educational and Child Psychology Kim O’Connor 95 Doctorate in Educational and Child Psychology Kim O’Connor 96 Doctorate in Educational and Child Psychology Kim O’Connor 97 Doctorate in Educational and Child Psychology Kim O’Connor 98 Doctorate in Educational and Child Psychology Kim O’Connor 99 Doctorate in Educational and Child Psychology Kim O’Connor 100 Doctorate in Educational and Child Psychology Kim O’Connor 101 Doctorate in Educational and Child Psychology Kim O’Connor 102 Doctorate in Educational and Child Psychology Kim O’Connor 103 Doctorate in Educational and Child Psychology Kim O’Connor 104 Doctorate in Educational and Child Psychology Kim O’Connor 105 Doctorate in Educational and Child Psychology Kim O’Connor Appendix 6 Weighting of Studies A: Methodological Quality This rating is based on the rating given to each of the studies according to an adapted coding protocol for single-participant design (Kratochwill, 2003). Section II of the coding protocol allows for a scrutiny of key features of the methodological quality of a study. A rating system defines features that mark a study as strong evidence, promising evidence, weak evidence or no evidence. The elements of Section II under consideration for Weight of Evidence A are: reliability and validity of measurement, quality of baseline and quality of evidence of primary outcomes assessed through visual analysis of data. Each subsection was rated from 0-3 with a score of ‘0’ indicating no evidence, ‘1’ indicating ‘weak evidence’, ‘2’ indicating ‘promising evidence’ and ‘3’ indicating ‘strong evidence’. These 3 weightings were averaged to give an overall measure of methodological quality. To receive a ‘High’ weighting for ‘methodological quality’ a study must receive an average rating of 2.5 or above. To receive a ‘Medium’ weighting for ‘methodological quality’ a study must receive an average rating between 1.5 and 2.4. To receive a ‘Low’ weighting for methodological quality a study must receive an average rating of 1.4 or below. 106 Doctorate in Educational and Child Psychology Kim O’Connor B: Methodological Relevance This weighting considers whether the methodological design was suitable for evaluating the effect of video modelling interventions on the social and communication skills of children with ASD. In order to receive a ‘High’ weighting for methodological relevance the study must have made use of a multiple baseline design or included at least three attempts to demonstrate intervention effect (Horner et al., 2005). The study must have included generalisation and maintenance or follow up sessions with at least three data points for each phase. In order to receive a ‘Medium’ weighting for methodological relevance the study must detail three attempts to demonstrate intervention effect, as well as either generalisation or maintenance or follow up sessions with at least three data points for the phase. In order to receive a ‘Low’ weighting for methodological relevance the study may not have demonstrated intervention effect three times. Generalisation or maintenance data may not be included, or may be less than three data points. C: Study Focus Relevance This weighting considers whether the focus and character of the study contribute towards answering the review question. 107 Doctorate in Educational and Child Psychology Kim O’Connor In order to receive a ‘High’ weighting for relevance the study sample must be comprised of children with a diagnosis of autism. The significance of the intervention for the child must have been established. The social or communication skill operationalized as the dependent variable must have been identified as relevant by a child’s teacher, parent or other caregiver. A teacher, parent or relevant figure in the child’s education should have contributed to the design or delivery of the intervention. In order to receive a ‘Medium’ weighting for relevance the study sample must be comprised of children with a diagnosis of autism. Either the significance of the intervention or the relevance of the dependent variable for the child must have been established. A teacher, parent or relevant figure in the child’s education may have contributed to the design or delivery of the intervention. In order to receive a ‘Low’ weighting for relevance, the study sample must be comprised of children with a diagnosis of autism. The significance of the intervention or the relevance of the dependent variable for the child may have been established. A teacher, parent or relevant figure in the child’s education may have contributed to the design or delivery of the intervention. D. Overall Weight of Evidence To calculate an overall weight of evidence studies were given scores of ‘1’ for ‘Low’ weightings, ‘2’ for ‘Medium’ weightings and ‘3’ for ‘High’ weightings. These scores were then averaged to give an overall weight of evidence score. 108 Doctorate in Educational and Child Psychology Kim O’Connor To receive a ‘High’ overall weighting a study must receive an average score of at least 2.5. To receive a ‘Medium’ overall weighting a study must receive an average score of between 1.5 and 2.4. To receive a ‘Low’ overall weighting a study must receive an average score of less than 1.4. 109