Dissertation Template for Use With Program Evaluations

advertisement
[Insert Title Here]
FOR USE WITH PROGRAM EVALUATIONS
This is a template and general outline. Other appropriate headings and subheadings
should be used. For dissertations that use the CIPP model, see Daniel Stufflebeam’s
general overview on the page 10 of this template (these components are integrated into
this template).
by
[Insert Name Here]
An Applied Dissertation Submitted to the
Abraham S. Fischler College of Education
in Partial Fulfillment of the Requirements
for the Degree of Doctor of Education
Nova Southeastern University
[Enter Year Here]
Approval Page
This applied dissertation was submitted by [Insert Name] under the direction of the
persons listed below. It was submitted to the Abraham S. Fischler College of Education
and approved in partial fulfillment of the requirements for the degree of Doctor of
Education at Nova Southeastern University.
[Insert Name and Degree, e.g., Al Smith, EdD]
Committee Chair
Date
[Insert Name and Degree]
Committee Member
Date
Lynne R. Schrum, PhD
Dean
Date
ii
Statement of Original Work
I declare the following:
I have read the Code of Student Conduct and Academic Responsibility as described in the
Student Handbook of Nova Southeastern University. This applied dissertation represents
my original work, except where I have acknowledged the ideas, words, or material of
other authors.
Where another author’s ideas have been presented in this applied dissertation, I have
acknowledged the author’s ideas by citing them in the required style.
Where another author’s words have been presented in this applied dissertation, I have
acknowledged the author’s words by using appropriate quotation devices and citations in
the required style.
I have obtained permission from the author or publisher—in accordance with the required
guidelines—to include any copyrighted material (e.g., tables, figures, survey instruments,
large portions of text) in this applied dissertation manuscript.
___________________________
Signature
___________________________
Name >above the line, type your name<
___________________________
Date >above the line, type the date signed, e.g., March 31, 2015<
iii
Abstract
[Insert Title of Dissertation]. [Insert Name and Year, e.g., Richard Dadier, 2015]:
Applied Dissertation, Nova Southeastern University, Abraham S. Fischler College of
Education. [Insert 4 or 5 ERIC Descriptors, e.g., ERIC Descriptors: Databases, Internet,
Media Selection, Middle Schools, Teacher Education]
[Insert description of dissertation—example follows] This applied dissertation was
designed to provide better access to current information for the students and staff in a
middle school. The printed materials located in the school’s media center were outdated,
scarce, or inadequate. Electronic databases were available in the media center for online
searching and information retrieval. However, the students did not know how to use
databases as a source for completing class assignments or how to browse within these
online services to find additional information. Teachers also did not know to use
electronic information to enrich their lessons.
The writer developed lesson plans and strategies to train students and teach on how two
online services available in the media center. Daily sessions on these databases provided
students and teachers with training in (a) e-mail usage, (b) searching and locating current
events information, (c) printing from the screen, (d) saving messages, and (e) dialing into
the online services. Teachers were encouraged to continue to use these services for
curriculum enrichment and as an additional source for future lesson plans.
An analysis of the data revealed that students were more likely than teachers to use the
online databases. The most successful activities were those that involved students in
research information about current events. Although teachers planned assignments that
required the use of online services, they did not want to provide additional time for
students to be in the media center.
iv
Table of Contents
Page
Chapter 1: Introduction ........................................................................................................1
Xxxxxxxxxxx xx Xxxxxxxxx ..................................................................................1
Xxxxxxxx Xxxx Xxxxxx .........................................................................................2
Xxxxxxxx Xxxxx .....................................................................................................4
Chapter 2: Literature Review ...............................................................................................6
Xxxxxxx Xxxxxxxxx ...............................................................................................7
Xxxxxx Xxxxxxxxxxx ...........................................................................................15
Xxxxxx xx xxx Xxxx .............................................................................................24
Xxxxxxxxxxxx xx xxx Xxxxxxx xx xxx Xxxxxxxx .............................................31
Chapter 3: Methodology ....................................................................................................38
Xxxxxx...................................................................................................................38
Xxxxxxxx Xxxxxxxx .............................................................................................41
Xxxxxxxxxxx xx Xxxxxxxx ..................................................................................43
Chapter 4: Results ..............................................................................................................46
Xxxxxxxxxx xxx Xxxxxxxxx xx Xxxxxxxxx .......................................................46
Xxxxxxxxxxx xx Xxxxxxx Xxxxxxxxx ................................................................50
Xxxxxx xx Xxxxxx Xxxxxx ................................................................................. 53
Chapter 5: Discussion ........................................................................................................57
Xxxxxxxx ...............................................................................................................58
Xxxxxxxxxx ...........................................................................................................64
Xxxxxxxxxxxxxxx .................................................................................................69
Xxxxxxxx xx Xxxx ................................................................................................71
References ..........................................................................................................................74
Appendices
A Title in Initial Caps and Lower Case—Begin a Second Line Directly Below
the First Line ...................................................................................................81
B Title in Initial Caps and Lower Case .............................................................83
Tables
1
2
Title in Initial Caps and Lower Case ..............................................................47
Title in Initial Caps and Lower Case ..............................................................51
Figure
Title in Initial Caps and Lower Case .....................................................................49
v
1
Chapter 1: Introduction
Statement of the Problem
This should include (a) a clear statement that the problem exists, (b) evidence that
supports the existence of the problem, (c) evidence of an existing trend that has led to the
problem, (d) a short description of the necessity for an evaluation approach, (e) a clear
description of the setting, (f) probable causes related to the problem, and (g) a specific
and feasible statement. Specific subtopics may include the following.
The topic. This is a brief description of the proposed area of study.
The research problem. This is an area of conflict, concern, or controversy (a gap
between what is wanted and what is observed).
Audience/stakeholders. Detail the stakeholders and relevant individuals
associated with the evaluation.
Program
Provide a brief description of the program that is the subject of the evaluation.
Professional evaluation standards. Include a brief discussion that details the
evaluation standards that are followed as defined by The Joint Committee on Standards
for Educational Evaluation (JCSEE.org).
Purpose of the Evaluation
Locke, Spirduso, and Silverman (1987) stated, “The purpose statement should
provide a specific and accurate synopsis of the overall purpose of the study” (p. 5). Key
points to keep in mind when preparing a purpose statement are as follows:
1. Create a sentence that begins with “The purpose of this evaluation is . . .”
2. Clearly identify and define the central concepts or ideas of the study.
2
3. Provide a brief description of the evaluation model to be used.
Definition of Terms
Provide complete scientific definitions and, if necessary, appropriate references..
Include as many terms or variables as needed.
3
Chapter 2: Literature Review
The literature review should be built from the relevant evaluation research and
should include: (a) a discussion of the theoretical or conceptual framework within which
the study will be grounded; (b) a synthesis of the findings in a “state-of-knowledge”
summary in regard to the problem area, including additional evidence as to the nature and
the importance of the problem; (c) a clear discussion of how further research should
extend, differ from, or replicate past studies, including the identification of critical
variables in the problem area and important questions to be tested; (d) an indication of
shortcomings that should be avoided in the design of prior evaluations, as well as
strengths to be repeated in conducting another evaluation; and (e) a critique of the
various evaluation models available for application.
Evaluation Framework
After a critique of the various evaluation models is introduced in the previous
section, a discussion regarding the framework to be used in the current study should be
placed here. This includes a complete description of the model, historical perspectives,
trends, analysis, and past research that utilized the model of choice.
Research Questions or Objectives
The research questions (same for objectives) are based on the problem or area of
need, the research reviewed, and on the desires of the stakeholders. The research
questions should adhere to the following guidelines: (a) formation of question or
questions based on theory, previous research (i.e., the literature review), experience, and
stakeholders’ interests; (b) stated in the form of a question; and (c) focused and clear (i.e.,
specific, feasible, and measurable).
4
Chapter 3: Methodology
Program
Include an in-depth discussion of the program to be evaluated. This includes an
organizational history and description of services.
Participants. This section should include the following elements: (a) the target
population or sample (to which it is hoped the findings will be applicable) should be
defined, consistent with the Statement of the Problem and the Research Questions
sections; (b) the population from which the sample will actually be drawn should be
specified (this should also include demographic information such as age, gender, and
ethnicity); and (c) procedures for selecting the sample should be outlined, including
justification for the sampling method (i.e., sampling procedure).
Evaluation Model
Characterize the evaluation model to be used (noted in the literature review under
Evaluation Framework) and how it specifically will be applied to the current study. This
should include an in-depth discussion of the framework, the application specifically
related to the program to be evaluated, and any modifications required to fit the current
evaluation.
Instruments
This section will detail each data-collection instrument. The relevant information
pertaining to each instrument should include (a) the source or developers of the
instrument, (b) validity and reliability information, and (c) other salient information (e.g.,
number of items in each scale, subscales).
5
Procedures [Relevant subheadings pertaining to the evaluation model should be included
in this section.]
Design. The appropriate design should be embedded within the evaluation model
and is the actual structure or framework that provides the “when,” or time in which data
will be collected (e.g., correlational approach with a predictive design). Include the
relevant design or designs and data-collecting procedures for the primary and secondary
phases of the evaluation. Specifically, the type of design should be written in the first
sentences of this section, then followed up by the details of how the data will be collected
(i.e., the methodological steps). Write this section in future tense. Convert to past tense
where appropriate once data have been collected. The Procedures section is based directly
on the research questions and the design of choice (i.e., this is the “how to” section of the
examination) and should be written step by step in a linear fashion with a timeline.
Data collection procedures. This section should include a discussion about the
participants and the program, including the setting, the events (when the data will be
collected), the process, and the type or types of data to be collected through each phase of
the evaluation (e.g., surveys, observations, interviews, documents, audio and visual
material). Subheadings may be included to detail each subcomponent of the evaluation.
Data analysis. Indicate the appropriate data analyses that will be used in the
investigation. These data analyses should be based on the research questions and the
research design selected for the study. Specify the procedures for reducing and coding the
data. For quantitative studies, subsequent data analyses should include summary
descriptive statistics and inferential statistical tests (e.g., independent or dependent t test,
6
ANOVA, and chi-square). For qualitative studies, the procedures to be followed for the
analyses must also be addressed.
Limitations
Include any limitations, restrictions, or constraints that may affect the validity of
the dissertation’s outcome.
7
Chapter 4: Results
[Refer to “Executive Summary” on page 10; also, bullet symbols are used in this template
for instructional purposes, but they should not be used in the dissertation manuscript.]

results presented in sequence and relative to each research question or objective

only the results are presented without a rationale or discussion

includes relevant tables and figures

appropriate use of statistical or qualitative language to present data
8
Chapter 5: Discussion
[Refer to “Executive Summary” on page 10.]

introductory paragraphs provide overview of the study

results are elaborated and interpreted in sequence and relative to each research
question

conclusions and summaries regarding the findings are offered

findings are linked to relevant research

implications of findings are discussed

limitations are indicated

recommendations for future research are offered
9
References
10
With permission from the author, this information was derived from Stufflebeam’s
(2010) CIPP Evaluation Model Checklist.
The Checklist and Doctoral Dissertations
Many doctoral students have employed the CIPP Model as the framework for their
doctoral dissertations. This CIPP Evaluation Model Checklist is potentially useful in
completing such dissertations. In such uses a two step process is recommended. First,
employ the checklist to plan, conduct, and report a sound evaluation aimed basically at
assessing the evaluand’s value, answering the client group’s evaluative questions, serving
the client group’s intended uses of findings, and meeting the utility, feasibility, propriety,
and accuracy standards of the evaluation profession. Second, characterize and assess the
completed evaluation within the general structure of a doctoral dissertation. While
dissertations appropriately may be structured according to different outlines, the
following is offered as a generic outline for dissertations based on applications of the
CIPP Model and this checklist.
Executive Summary
Introduction (the evaluation’s purpose, client group, key questions, intended uses, and
negotiated agreement; professional standards that were followed; and safeguards
for the rights of evaluation participants)
Review of Relevant Literature (citing and assessing similar studies, pertinent
publications, and relevant rules and laws)
Evaluation Framework (a characterization of the CIPP Evaluation Model and how it was
adapted for use in the dissertation)
Evaluation Methodology (use of the CIPP Checklist plus explanations of data sources,
sampling procedures, measurement tools, analysis procedures, synthesis
procedures, and reporting methods)
Evaluation Findings (findings—as applicable—for the evaluand’s context, inputs,
process, impacts, effectiveness, sustainability, and transportability)
Conclusions (assessments—as applicable--of the evaluand’s merit, worth, probity,
feasibility, equity, safety, and significance plus responses to the client group’s
key evaluation questions)
Impacts of the Evaluation (documentation of how the evaluation findings were used and
with what effect)
Meta-Evaluation (the evaluator’s attestation of the evaluation’s adherence (or not) to the
evaluation profession’s standards; summary of an external assessment of the
evaluation if the client obtained one; and—if provided--the client’s response to
the evaluation)
References
Appendix (such items as the contract or memorandum of agreement for the evaluation,
11
human subject review board approval, key evaluation instruments, data tables,
information on the validity and reliability of the employed evaluation tools, list
of interim reports, costs of the evaluation, the evaluator’s resume, summary of
the standards or meta-evaluation criteria that guided the evaluation, and a copy
of this completed CIPP Evaluation Model Checklist)
Download