SINGLE-CASE, QUASI-EXPERIMENT, AND DEVELOPMENT RESEARCH © 2012 The McGraw-Hill Companies, Inc. Describe single case experimental designs and discuss reasons to use this design Describe the five types of evaluations involved in program evaluation research Needs assessment Program assessment Process evaluation Outcome evaluation Efficiency assessment © 2012 The McGraw-Hill Companies, Inc. Describe the one-group posttest-only design Describe the one-group pretest-posttest design and the associated threats to internal validity that may occur History Maturation Testing Instrument decay Regression toward the mean © 2012 The McGraw-Hill Companies, Inc. Describe the nonequivalent control group design and nonequivalent control group pretest-posttest design, and discuss the advantages of having a control group Distinguish between the interrupted time series design and control series design © 2012 The McGraw-Hill Companies, Inc. Describe cross-sectional, longitudinal, and sequential research designs, including the advantages and disadvantages of each design Define cohort effect © 2012 The McGraw-Hill Companies, Inc. Single Case Experimental Designs (formerly called single-subject designs) Measured from baseline period to treatment periods Reversal or withdrawal design Called an ABA design Baseline (A) Treatment (B) Baseline (A) The use of praise as a treatment to measure the improvement of a child’s school performance Measure test scores give regimen of praise for correct homework problems measure test scores © 2012 The McGraw-Hill Companies, Inc. © 2012 The McGraw-Hill Companies, Inc. Multiple Baseline Designs Change is observer under multiple circumstances The manipulation is introduced at different times Determines that the manipulation caused change Replications in Single Case Designs © 2012 The McGraw-Hill Companies, Inc. © 2012 The McGraw-Hill Companies, Inc. NEEDS ASSESSMENT PROGRAM THEORY ASSESSMENT PROCESS EVALUATION OUTCOME EVALUATION EFFICIENCY ASSESSMENT © 2012 The McGraw-Hill Companies, Inc. Used when control features of experimental designs cannot be achieved For example, the independent variable cannot be manipulated Internal validity may be affected © 2012 The McGraw-Hill Companies, Inc. Threats to internal validity in quasiexperimental designs include: History Maturation Testing Instrument Decay Regression Toward the Mean © 2012 The McGraw-Hill Companies, Inc. One-Group Posttest-Only Design © 2012 The McGraw-Hill Companies, Inc. Nonequivalent Control Group Design © 2012 The McGraw-Hill Companies, Inc. One-Group Pretest-Posttest Design © 2012 The McGraw-Hill Companies, Inc. Nonequivalent Control Group Pretest-Posttest Design © 2012 The McGraw-Hill Companies, Inc. Interrupted Time Series Design Examines the dependent variable over an extended period of time, both before and after the IV is implemented Interpretation problems (possible regression to the mean) Control Series Design Improves interrupted time series design by finding an appropriate “control group” Involves finding a similar population that did not receive a particular manipulation Limited because this is not a true “control group” © 2012 The McGraw-Hill Companies, Inc. Cross-Sectional Method – persons of different ages measured at the same point in time Longitudinal Method – same group is observed at different times (as they age) Sequential Method – combination of 1 and 2 © 2012 The McGraw-Hill Companies, Inc. Cross Sectional Method Year of Birth (cohort) Time 1: 2005 Group 1 1950 55 years old Group 2 1945 60 years old Group 3 1940 65 years old © 2012 The McGraw-Hill Companies, Inc. Longitudinal Method Year of Birth (cohort) Group 1: 1950 Time 1: 2005 Time 2: 2010 Time 3: 2015 55 yr 60 yr 65 yr © 2012 The McGraw-Hill Companies, Inc. Sequential Method Year of Birth (cohort) Group 1: 1950 Group 2: 1940 Time 1: 2005 Time 2: 2010 Time 3: 2015 55 yr 65 yr 60 yr 70 yr 65 yr 75 yr © 2012 The McGraw-Hill Companies, Inc. Comparison of Longitudinal and CrossSectional Methods Strengths: - Can attribute changes to development Can examine variables at a later time Weaknesses: - Expensive Difficult Morality As a hybrid, the sequential method shares virtues of both methods © 2012 The McGraw-Hill Companies, Inc.