Spring 2016
ENED 3400 – Program Development and Evaluation (3 cr)
Instructor:
Dr. Ken Gilbertson
123 SpHC
726-6258
email: kgilbert@d.umn.edu
url: www.d.umn.edu/~kgilbert
Office Hours: By appointment (sign up on the schedule posted on my office door)
Course Syllabus
Course Description
This course provides an introduction to the techniques of program development and
evaluation in the context of outdoor and environmental education. It is designed for
those who will be working in these fields to gain skills in developing a program and
conducting evaluations of program outcomes, as well as in accessing, understanding,
and using existing evaluations to guide practice. The focus of this course is at a
program-level, as opposed to assessing learning/outcomes at a lesson-level.
Course Goals:
1. Program Theory/Theory of Change: You will explore theories that drive
program development and implementation, helping answer how programs
can be designed to promote learning, skill development, personal growth,
and responsible environmental behavior.
2. Program Development: Beyond the lesson level and the delivery of a
scope and sequence, you will learn the essentials for developing and
evaluating a program in environmental and outdoor education.
3. Program Evaluation: You will learn the importance of program evaluation
for the purposes of aligning program intent with actual program outcomes;
and for the purposes of program improvements. You will learn and
practice the steps of assessing and evaluating a program.
Student Outcomes:
1. Students will analyze the basic elements of environmental and outdoor
education program development
2. Students will use relevant theories (e.g. theory of change) and research in
outdoor, environmental, and adventure education to guide program
development
3. Students will explain types of evaluation and the purposes for each type of
program evaluation
4. Students will describe the steps in the process of evaluating program
outcomes and select appropriate evaluation tools to use when answering
specific evaluation questions.
Assessment:
1. Students will write a summary and respond to in-class discussion
questions that draw on their knowledge of program development
processes in environmental and outdoor education.
2. Students will develop a written justification for a planned or proposed
program that describes the program theory (or theory of change)
underlying the program that links program activities/format to program
outcomes through the use of one or more theories.
3. Students will explain the process of aligning a program mission statement
and philosophy with practical steps of program assessment and evaluation.
4. Students will practice evaluating an environmental and/or outdoor
education program using at least two evaluation tools.
Course Requirements:
1. Complete all assigned readings.
2. Actively participate in classroom discussions.
3. Actively participate in group projects and assignments.
4. Describe the Program Design of the UMD Recreational Sports Outdoor
Program Climbing Program. This will occur through a written paper.
5. Write a Logic Model of the RSOP Climbing Program.
6. Write a Strengths, Weaknesses, Opportunities, & Threats (SWOT)
analysis of the RSOP Climbing Program.
7. Evaluate the RSOP Climbing Program presenting its strengths and what is
can improve on. This will include:
a. Learning Outcomes
b. Logistical program delivery
c. Program Cost-effectiveness
d. Risk management
8. Present the evaluation to the RSOP Climbing staff in a written paper and
powerpoint presentation.
Texts:
Rossman & Elwood Schlatter (2008). Recreation programming: Designing leisure
experiences (5th ed.).
Urbana, IL: Sagamore Publishing.
Ernst, Monroe, & Simmons (2009). Evaluating your environmental education
program: A workbook for practitioners. Washington, D.C.: North American
Association for Environmental Education.
Schedule:
Week
Date
Topic
Assignment:
What is DUE TODAY
1
Jan. 14
2
19
2
21
3
26
3
28
4
Feb. 2
4
4
5
5
9
11
6
16
6
7
18
23
7
8
25
March 1
8
3
UNIT I: Program Design
Introduction: Course
description; Syllabus;
Expectations
A. Components of
1. Participate in an
Program Design
RSOP Climbing
B. Group member
Program
interaction/responsibilities 2. Observe Climbing
Program (participants
and instructor
interactions)
3. Read: Chapters 1-3
(Rec Programming)
A. Program Terminology 1. Discussion of
Readings,
Participation, and
Observation
2. Quiz 1: 15 points
Program Outcomes
1. Read: Ch. 4 (Rec
Programming)
Program Outcomes
1. Read: Ch. 10 (Rec
Programming)
2. Quiz 2: 15 points
1. Determine Climbing
Program Outcomes
Program Strategies
1. Read: Ch’s 5 & 6 (Rec
Programming)
Program Strategies
Program/Agency
1. Discussion of
Interface
Readings and
Observation
2. Readings: Ch 7
Program Development
1. Readings: Part III
Chapters (Rec
Programming)
Program Development
1. Quiz 3: 15 points
Operational Strategies
1. Readings: Part IV
Chapters (Rec
Programming)
Operational Strategies
Operational Strategies
1. Readings: pp 18-19
Logic Model
(NAAEE)
Operational Strategies
1. Design a Logic Model
of the Climbing
Program
2. Quiz 4: 15 points
8
10
9
15
Spring Break
Spring Break
UNIT II: Program
Evaluation
Evaluation Components
9
10
10
17
22
24
Evaluation Components
Evaluation Types
Evaluation Steps
11
11
12
29
31
April 5
Evaluation Plan
Evaluation Plan
Data Collection
12
13
13
7
12
14
14
19
14
15
21
26
Data Collection
Data Collection
Analyze & Interpret
Results
Analyze & Interpret
Results
Communicating Results
Communicating Results
15
28
Final Presentation
Finals
Week
May 3 (24 pm)
Course Reflection
1.
Readings: Part V:
Intro & Ch 20 (Rec
Programming)
2.
Readings: Ch’s 1
& 2 (NAAEE)
1. Quiz 5: 15 points
1. Design a SWOT
Analysis of Climbing
Program
1.
Readings: Ch’s 3
& 4 (NAAEE)
2.
Design an
evaluation plan
Collecting Data
1. Readings: Ch 5
(NAAEE)
Analyze Data
Write-up Results
Present Findings –
Classroom Draft
Present Final Paper &
Powerpoint presentation
Course Reflection
Grading:
Scale: 90% = A
87% = A83% = B+
80% = B
77% = B-
73%= C+
70% = C
67% = C60% - D
1. Quizzes
5 x 15 pts. Each (taken
via Moodle)
Outcomes
Logic Model
2. Logic Model
3. Logic Model
75 pts
40 pts.
50 pts.
4. SWOT Analysis
5. SWOT Analysis
6. SWOT Analysis
7. Results
8. Results
9. Discussion
Cost Effectiveness
Risk Management
Evaluation Plan
Data Analysis
Presentation (Paper &
Ppt)
Active Class Participation
Total :
30 pts.
30 pts.
40 pts.
40 pts.
80 pts.
50 pts (5 pts/week)
435
You will be graded on both an individual and group basis. Your active
involvement is required. Presentations will be scored in the following criteria:
All work must be formally presented both orally and in writing. All written and oral
work must be presented typed and in the following order:
I.
II.
III.
IV.
V.
VI.
VII.
VIII.
IX.
X.
Title: Subject to be discussed for this presentation (depending on the
scope and sequence of the plan in addition to who the audience is)
Team Members:
Date:
Introduction: Present a short narrative on the purpose of the subject
and how your team will present the subject investigation to that stage
in the project.
Background Information: A brief description of the agency type and
how this subject fits into the management plan of the agency. Describe
briefly what subjects your team has accomplished to date and how this
subject ties in with what's been done.
The Plan: This is the content of this week's presentation. It should be
presented concisely and completely. Follow the format presented in
class lectures. That is, use narratives, charts and graphs where
appropriate. Always keep in mind that you are presenting this material
as if the class were a board of directors. Casual approach is not
acceptable.
Methods & Analysis: What method(s) did your group use to collect
data? How were the data analyzed?
Conclusion: Conclude your presentation with a synopsis of what was
just covered followed by your recommendations for approval.
References: Include a list of professionally based references. Present
them in APA format (follow the format used for "texts" below).
Peer grade of each individual team member. (Presented at Final
Reflection)
Assignments:
The class will work in a cooperative effort to design an annual operational plan
plus a long-range management plan and to present it to the agency involved.
This final presentation will include agency representatives and interested public.
It will include your recommendations for the design and layout of the grounds and
buildings comprising the agency recreation facilities. Your final product will be a
comprehensive paper that includes all of the topics covered in Unit II plus your
formal presentation (including handouts, maps, and Powerpoint presentation).
All work, including peer evaluations are to be typed using double-spacing.
When presenting, you are expected to dress professionally. That is, dress as if
you were going to give one of the most important interviews for a very valued job.
A different team member must take a lead role in presenting each
assignment. The other team members are welcome to assist in any way they
can to make the overall presentation effective. That is, assisting with visual aids
(slides, overheads, videos, etc.).
In addition, a management team leader will be selected by each team for
each assignment phase that will be presented to the class.
*You are responsible to be prepared before class begins each day.
At the end of the semester, your team will present a final formal evaluation to the
RSOP Rock Climbing Director and staff.
*FINAL PRESENTATION:
For the Final presentation: Present in 45-50 minutes with up to 15 minutes for
questions.
Copies you are required to provide (minimum number):
1. Bound Color copies of your written long-range plan (2): 2 for Director of
Agency
2. Stapled Handouts of powerpoint presentation (6 slides/page): 1 for
everybody attending.
3. CD with powerpoint and long-range plan (in .doc or, .docx format): (3) – 2:
Director of Agency plus 1 to Ken