Single Subject Action Inquiry IMPROVING READING PERFORMANCE Significance of Single Subject Research (SSR) for Teachers/SPED Practitioners “(SSR) is experimental rather than correlational or descriptive, and its purpose is to document causal, or functional, relationships between independent and dependent variables” (Horner, et al., 2005, p. 165). Focuses on individual learner or single group (e.g. a class) “whose performance generates a single score per measurement period” (ibid., p. 166). As such, benefits practitioners developing Individualized Education Programs (IEPs) and Behavior Intervention Plans (BIPs) . Used to establish “evidence-based practices” because of rigorous documentation of experimental control. Significance, cont. Multidisciplinary use of SSR (more than 45 professional journals report single subject research) (APA, 2002; Anderson 2001, cited in ibid., p.166) “Interventions derived from social learning theory, medicine, social psychology, social work, and communication disorders are but a sample of procedures that have been analyzed by single subject designs and methods” (ibid., p. 166) Problem Statement Video: http://www.youtube.com/watch?v=w7nCfRDCcT4 1 in 7 American adults are unable to read (National Center for Education Statistics (NCES) (http://nces.ed.gov/naal/estimates/overview.aspx, cited in G. Toppo, USA Today,2009). 42 million adult Americans can't read. 50 million can recognize so few printed words they are limited to a 4th or 5th grade reading level (National Adult Literacy Survey, cited by Robert Sweet Jr. of the National Right to Read Foundation[http://www.nrrf.org/]). One out of every four teenagers (approx. 1 million per year) drops out of high school, and of those, over 75% say that difficulty reading was a major factor in their decision. (http://nces.ed.gov/nationsreportcard/pdf/dst2011/2012455.pdf) Social, economic, and medical consequences of illiteracy are well documented (e.g., see Weiss et al., 2001; Marcus, 2006; Martinez & Fernandez, 2010, among others). Research Question What can I do within 4 to 8 weeks of student teaching to improve the fluency (rate, accuracy and prosody) and/or comprehension of 4-6 struggling readers? Specifically, If I administer x, y, and z interventions , x number of times a week for x length of time per session for x number of weeks, will participating students show gains in reading fluency and/or comprehension as measured by pre-post assessments? Methodology Individual Participant (or Group ) as Unit of Analysis Precise Participant and Setting Description Operational description of participants, setting, and the process by which participants were selected For example, specific disability & determination instrument/process (e.g., ASD & Autism Diagnostic Interview – Revised, respectively) Description, cont. Standardized Tests KTEA 2 (Reading Fluency subscale) WJ-III (Reading Fluency subtest) Gray Oral Reading Test IV (Rate + Accuracy) Test of Silent Word Reading Fluency Criterion-Referenced Measures Qualitative Reading Inventory (QRI) DIBELS Dependent Variables Operationally Defined, allowing 1. valid & consistent assessment of variable, 2. replication of assessment process 3. (i.e., direct observation and empirical summary; e.g., silent/oral words per minute, instances of correct phrasing, expressing and intonation, number of uncorrected miscues, etc.) Dependent Variables Measured Repeatedly, allowing 1. identification of performance patterns prior to intervention as baseline for comparison M TTT M TTT M 2. comparison of performance patterns across conditions, phases, levels, environments, etc. Dependent Variables “Dependent variable recording is assessed for consistency throughout the experiment by frequent monitoring of inter-observer agreement (e.g., the percentage of observational units in which independent observers agree) or an equivalent, (allowing) assessment for each variable across each participant in each condition of the study” (ibid., p.167). Dependent Variables Selected for their social significance A dependent variable is chosen …. “because it is perceived as important for the individual participant, those who come into contact with that individual, or for society” (ibid., p.167). Independent Variables Operationally defined, allowing “valid interpretation of results and accurate replication of procedures” (ibid., 167). Specific descriptions of procedures typically include A) B) documentation of materials (e.g., 7.5 cm x 12.5 cm card) documentation of actions (e.g., peer tutors implemented the reading curriculum 1:1, 30 min/day, 3 days/wk for 6 weeks) Avoid general descriptions of procedures. Independent Variables “To document experimental control, …the independent variable is actively, rather than passively, manipulated” (ibid., p.167). Fidelity of implementation – important b/c independent variable is applied over time. Looks like…”continuous direct measurement of independent variable…” (Gresham, Gansel, & Kurtz, 1993, cited in ibid., p.168). Time Series Research Design C _____________________________________________________________________ T O X X X O XXX O XXX O XXX O Baseline/Comparison Condition “Treatment as usual” condition Precise description 16 14 12 10 8 6 4 2 0 Student 1 Student 2 Student 3 Student 4 Experimental Controls Internal validity requires three things: Repeated and reliable measurement - valid and reliable measuring instruments or techniques) Baseline stability Single variable rule - manipulate only one variable at a time Threats to Reliability Interobserver reliability (sometimes referred to as interrater reliability or interobserver agreement) is important to establish confidence in the measurement of the dependent variable. Interobserver Reliability Identify and define the target behavior in such a way that at least two people can observe the individual and agree whether or not the behavior has occurred, or to what extent, or for how long, and so on. Identifies at least two people to serve as observers (one can be the researcher :). Then the observers are trained and practice observing the individual and scoring the dependent variable. Following practice sessions, the observers should compare results for each and every occurrence or measurement of the target behavior (dependent variable). Control Designs Reversal Design https://encryptedtbn3.google.com/images?q=tbn:ANd9GcSm5 ffbcV3OzaKB4gWP_hxVHnHP3RErClNox7Kr 9EbhXmDZsAb7 Control Designs Multiple Baseline Design https://encryptedtbn1.google.com/images?q=tbn:ANd9GcRHi RqDFRpxxNzyaGTBu5vp3WMRDjimt1b3cP7jIhwaKIAg5Ub Control Designs Changing Criterion https://encryptedtbn0.google.com/images?q=tbn:ANd9GcSD mqKxbhgo3hOeSezKa3tC2BvrWuxWbwt_DP 3XhglZSNPLx_FqTQ Control Designs Alternating Treatments http://winginstitute.org/uploadedImages/Gra phs/Mindmap/SSD3e.png Threats to Internal Validity Do the research conditions warrant the conclusions? Un-controlled extraneous variables that might account for the results of a study, e.g.: History – events that occur b/t 1st & 2nd measurement Testing – potential increases as time between pre & post is shortened. Instrumentation - changes in the way a test or other measuring instrument is calibrated that could account for results of a research study (unreliability of measuring instrument) Selection – different interventions for different individuals Maturation Statistical regression - individuals are selected for an intervention or treatment on the basis of extreme scores on a pretest. Research mortality - volunteers drop out of study Threats to Internal Validity Multiple treatment interference – May occur when more than one independent variable is used. EX: Because I’m planning to use a variety of interventions, it may be difficult if not impossible for me to accurately determine which of the components of the independent variable or variables actually accounted for changes in the dependent variable. Threats to External Validity Can the results be generalized beyond the study itself? Population validity (when the sample does not adequately represent the population). Personological validity (when personal/ psychological characteristics interact with the treatment). Ecological validity (when the situational characteristics of the study are not representative of the population). Results Graph it! Citations Horner, et al. (2005) The use of single subject research to identify evidence-based practice in special education. Council for Exceptional Children, 71:2. pp. 165-179. Marcus, E. N. (2006). The silent epidemic: the health effects of illiteracy. New England Journal of Medicine, July, 2006. 355:339-341. Martinez, R., Fernandez, A. (2010). The social and economic impact of illiteracy: analytical model and pilot study. United Nations Educational, Scientific, and Cultural Organization (UNESCO), Dec. 2010. Downloaded 10/20/11 from http://unesdoc.unesco.org/images/0019/001905/190571e.pdf. Weiss, B. D., Hart, G., Pust, R. E. (1991). The relationship between literacy and health. Journal of Healthcare for the Poor and Underserved. 1 (4), 351-363.