Assessment Programs Processes for Learning Excellence - APPLE Manual

advertisement
APPLE Manual
P
Intended for Instructional Department Chair and Faculty Use
APPLE
Instructional Departments Purpose
Instructional Departments provide tools to BETTER THE LIVES of CTC
students through educational instruction. Educational instruction at CTC
prepares our students to be 1) capable, knowledgeable, and reliable with their
career options, 2) to receive the foundations to be better prepared for
transfer to a university, and 3) to become better members of our society and
economy.
Institutional Effectiveness Purpose
The purpose of Institutional Effectiveness is to ensure that the college is
continuously improving in all areas for the goal of creating the best
institutional that we could possibly be.
Learning Outcomes Assessment Purpose
Learning Outcomes Assessment’s Purpose is to create the most efficient and
effective platform for discussion to ensure learning excellence and continuous
improvements to the students’ learning experience.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
2
APPLE
TABLE OF CONTENTS
PROGRAM ENHANCEMENT PLAN
PROGRAM ENHANCEMENT PLAN MANUAL
PROGRAM OVERVIEW
PROGRAM ASSESSMENT
PROGRAM ENHANCEMENT STEPS FOR DEPARTMENT CHAIRS & FACULTY
CONDENSED PROGRAM ENHANCEMENT PLAN
4
5
9
12
15
RESOURCES
SHORT LIST/LONG LIST – SYSTEMATIC ASSESSMENT PRACTICE
18
PROGRAM STUDENT LEARNING OUTCOMES ALIGNMENT FORM
20
PROGRAM ENHANCEMENT CHECKLIST
21
ASSESSMENT GUIDELINES FORM
23
TASKSTREAM TRAINING GUIDES
27
TASKSTREAM INTRODUCTION/REFRESHER
27
TASKSTREAM GUIDE FOR PROGRAM OVERVIEW– ALIGN PROGRAM & CORE OUTCOMES 28
TASKSTREAM GUIDE FOR PROGRAM ASSESSMENT– ASSESSMENT PLAN
35
PROGRAM REVIEW 3 YEAR CYCLE
45
LOA DEFINITIONS
46
VERBIAGE EQUIVALENCIES
49
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
3
APPLE
Program Enhancement Plan
Manual
Program Overview & Assessment
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
4
APPLE
Program Overview
1. Program Description (Static)
The Program Description is a statement which includes:
1. Your program description
2. Visual image (Optional)
3. Program vision (Optional)

Examples of information for your program description can be found on your
brochures, your previous Taskstream Program Review workspace, and your
CTC webpage.

Visual images should be representative of your program.
o Example: Aviation has included an image of a plane near a hanger with
other smaller clips attached.

Your program vision describes where you would like to see your program in
the future; your hopes and aspirations for your program.
2. Program Details & Program Enhancement Resources (Semi-Static)
Program Details & Program Enhancement Resources includes any details concerning
resources, equipment, faculty, faculty training, marketing materials, advisory
committees, etc. that are instrumental to your program and Program Enhancement
Plan. The Program Details provide valuable information to those assisting with
assessing and program enhancement strategies. Program Enhancement Resources
will assist your program with measuring your Program Learning Outcomes and Core
Outcomes. Below are some items that would be placed in this area.
A. Curriculum/Outcomes Maps
i. Program Outcomes Map (aka Curriculum Map)
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
5
APPLE
ii. Program Course & Degree/Certificate Map (Optional)
B. Rubrics
i. Department/Faculty created rubrics
ii. Modified versions of the VALUE rubrics
iii. AAC&U VALUE Rubrics
C. Student Learning Outcome Alignment (SLOA) Forms
i. Define target/ideal criteria. What is the current satisfactory
level for the outcome/objective? Ex: 85% proficiency
ii. Which courses, instructors, and staff will be involved in this
process?
iii. General Learning Activities - Assignment Type
a) Capstone assignments
b) Comprehensive projects
c) Try to use current assignments and make necessary
modifications
d) Interactive assignments/game-like
e) Pre-assessment and Post-assessment
f) Student Program Learning Portfolio
g) Subject Area Exams
D. Completed Core Curriculum Course Management Spreadsheet to ensure a
sufficient amount of Core Curriculum Assessments are being completed in
your program for the semester. This should be completed ahead of time.
i. Core Curriculum courses have to assess at least 2 core objectives,
which are Critical Thinking Skills & Communication Skills. On top
of that requirement, there is at least 1 other core objective
required. The core objectives are:
1. Critical Thinking Skills
2. Communication Skills
3. Empirical & Quantitative Skills
4. Teamwork
5. Social Responsibility
6. Personal Responsibility
E. Indirect Evidence/Data
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
6
APPLE
i. Completion rates for programs (IR will assist with this)
1. Graduation & Retention
ii. Advisory Board minutes and agendas
iii. Alumni employment data
iv. Student surveys
1. Satisfaction/Opinion regarding assessments surveys
v. Job placement rates
vi. Exam pass rate or average score
vii. Employer satisfaction surveys and comments
viii. Community and professional feedback
F. Log of program/course improvements
G. What tools and software programs are you using to measure and evaluate
students, assist with teaching, and manage students?
H. Department/Program Faculty, Staff and Adjunct List
I. Advisory Committee details
J. Demographics of students in your program
K. Current resources (such as departmental equipment software, staffing,
etc.) & those resources that you are hopeful to have in the future
L. Facilities descriptions/location(s)
M. CTC campuses that offer your programs
i. Indicate if you have a relationship and communicate your program
standards and improvements with these campuses
Recommendation: Please utilize your faculty. The resource and knowledge base
among faculty is outstanding. It is not recommended that the entire Program
Enhancement Plan be completed by one individual. The Program Enhancement Plan
should be completed as a collaboration of faculty and stakeholders (Advisory
Committees as an example).
Recommendation: Even if core assessments are not currently being done in your
Department, you must still assess core outcomes, at minimum use Critical Thinking
Skills and Communication Skills. It is ideal that Non-Core Programs assess at
least 3 core objectives. This ensures that our students are receiving a stronger
foundation in their learning process.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
7
APPLE
Tips concerning outcomes:

You can refer to your AIP’s (Assessment of Instructional Programs), if
available

Use at least 1 learning outcome from the ACGM or WECM

Ideas of program learning outcomes can be taken from course learning
outcomes in course syllabi

Ensure bundling a number of outcomes within 1 outcome is not occurring.
This is most often the case when commas, semi-colons, and conjunctions are
used.

Focus on capstone assessments, if available
3. Align Program & Core Outcomes (Semi-Static)
This section allows for program and core outcomes to be aligned/mapped. What
are the learning outcomes for your program? Choose between 3 program learning
outcomes to measure for this cycle. Align/map these program learning outcomes to
core objectives. Refer to your Student Learning Outcome Alignment (SLOA)
Forms.
Taskstream Instructions: Refer to Taskstream Directions for Program Overview Align Program & Core Outcomes (Included in this Manual)
4. Curriculum Map (Static)
This area is primarily for set-up in Taskstream. You can use this space to create
your Curriculum Map or transfer a current Curriculum Map file to this area for
interface capabilities.
Taskstream Instructions: Taskstream Directions for Program Overview Curriculum Maps (Not Included in this Manual)
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
8
APPLE
Program Assessment
5. Assessment Plan (Semi-Static)
This area is primarily for set-up in Taskstream. This space is used to set up
program outcomes in Taskstream to allow for data and artifact submissions in the
Assessment Data & Conclusions requirement.
Taskstream Instructions: Taskstream Directions for Program Assessment –
Assessment Plan (Included in this Manual)
6. Assessment Data & Conclusions (Changes)
Provide the measurements and data summary outlined in the Program Enhancement
Process. What assumptions, conclusions, and ideas for improvement can be drawn
from the assessment data? Discuss, analyze, and document the results of the
Enhancement Strategies that have been implemented.
Assessment Data
Include all relevant resources:
1. Direct Evidence/Data
o Each Assessed Package should include:
1. The student artifacts for all the students in the course
for this particular assessment
2. An assessment for each student in the course, using
rubrics
3. Total assessment for the entire course using the
Assessment Guidelines Form
Conclusions
1. Assumptions of initial Assessment Data
2. Ideas for Enhancement Strategies
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
9
APPLE
Recommendation: Allow for discussions among your department’s/program’s faculty
physically and/or electronically.
7. Enhancement Strategies (Use of Results) (Changes)
Which ideas for improvement from Assumptions & Conclusions will be implemented?
Outline the approach that will be used to implement the ideas for improvement to
your Program/Course.
1. Improvements to implement
2. Improvement approach
a. List the courses this improvement will be applied to
b. Outline the details for the improvement approach
8. Reexamined Improvements & Impacts (Changes)
What are the noticeable improvements in your program/program outcomes/core
outcomes?
1. Consider improvements that are related to implemented Enhancement
Strategies
2. Consider improvements that were not planned, but naturally occurred
because of other actions. What is your assumption for the cause of the
improvements?
9. Assessment Committees’ Reviews (Changes)
The Program Enhancement Committee will review your Program Enhancement Plan.
Committee assessment information and results will be placed in this area by the
LOA Coordinator for Departments to examine.
1. Assessment data results
2. How many assessments need to be reviewed?
3. How many assessments have been reviewed?
4. Total assessments
5. Completed Assessment Committee reviews will be placed here
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
10
APPLE
8. Previous Semester Assignments (Changes)
This area allows for submissions of previous semester assignments, or student
artifacts. Please include assignments that include application of program outcomes
going back as far as your program cycle began. Please include assignments that
include application of core outcomes for courses that were in the core after the
start of Fall 2014; which is when the New Core Curriculum was implemented.
These assignments do not have to be assessed at the moment. The Assessment
Committees will assist with random assessment of these student artifacts.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
11
APPLE
Program Enhancement Start-Up Steps
For Department Chairs & Faculty
Utilize Taskstream to locate your resources for updates.
Complete the Program Enhancement Checklist while going through these steps.
Step 1 – Choose your Program Outcomes
1. Ensure that a Long Program Outcomes List or a Curriculum Map is created and up to
date. If one is not available, one must be created. Your Long Program Outcomes
List is the list of all of the Program’s essential Student Learning Outcomes.
2. Choose 3 program outcomes from the Long Program Outcomes List/Curriculum Map
and add those to the Short List. You will use a Program Student Learning Outcomes
Alignment Form as your Short List. For clarification of the Long List/Short List
tool, refer to the resource for the Short List/Long List – Systematic Assessment
Practice
3. Save any updated Curriculum Maps and Student Learning Outcomes Alignment
(SLOA) Forms in Taskstream under Program Enhancement Plan/Program
Overview/Program Details & Resources.
Step 2 – Organize Outcomes Maps
1. Decide in which courses the program outcomes will be assessed. Also decide which
faculty members in these courses will assess outcomes. If your department has
courses in the core and in the General Studies degree program, choose as many of
those as possible. Refer to the Core Curriculum Course Management Spreadsheet
for a list of those courses.
a.
(If an outcomes map is not created, one must be created first)
2. Refer to your department’s Outcomes Maps, or Curriculum Maps, and make
revisions. Examples of other Departmental Outcomes Maps can be found in
Taskstream Resources.
Step 3 – Complete the Core Curriculum Course Management
Spreadsheet
1. This step is only for departments that have courses in the Core Curriculum. If your
department does not have a course in the Core Curriculum, you can skip this step.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
12
APPLE
Indicate which courses will be assessed for the semester, by completing the Core
Curriculum Course Management Spreadsheet.
2. Find and open the General Core Curriculum Course Management Spreadsheet in
Taskstream. Also refer to your Outcomes Maps.
3. Find the worksheet for your department. Ensuring that you enter the semester
and term.
4. For each course that will be assessed this semester, highlight in blue.
5. Save the Core Curriculum Course Management Spreadsheet in Taskstream
Resources. Be sure to change the title of the spreadsheet by adding the semester
at the end of the file name.
a. Ex: Core Curriculum Course Management Spreadsheet Spr16
Step 4 – Complete the Program Student Learning Outcomes
Alignment Forms.
1. Assign core outcomes to the program outcomes. If you have Core Curriculum
courses, your Core Student Learning Outcomes Alignment (SLOA) Forms are
located in Taskstream. The Core Student Learning Outcomes Alignment (SLOA)
Form will assist with your Program Student Learning Outcomes Alignment (SLOA)
Form.
2. Complete all other areas of the Program Student Learning Outcomes Alignment
Forms.
3. If a different plan will be used for the same program outcome, include subsequent
versions of the same plan using letters. Ex: Communication A, Communication B,
Communication C, etc.
4. Save the Program Student Learning Outcomes Alignment (PSLOA) Form in
Taskstream Resources.
Step 5 – During and at the end of each semester start compiling
the Assessment Package for LOA submission.
1. Instruct and measure outcomes.
2. Use the Student Learning Outcome Alignment (SLOA) Forms, the Assessment
Guidelines Form, and rubrics when assessing students.
A. Each Assessment Package should include:
1. The student artifacts for all the students in the course for this
particular assessment
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
13
APPLE
2. An assessment for each student in the course, using rubrics
3. Total assessment for the entire course using the Assessment
Guidelines Form
3. Save the Assessment Package in Taskstream - Assessment Data & Conclusions or
Previous Semester Assignments, when applicable.
Note: Include Student ID #’s as an identifier.
Step 6 – Gather Past Assignments for Submission
1. Gather student assignments and submit assignments in Taskstream. Refer to the
Program Review 3 Year Cycle for the start year that you will need to gather
assignments/student artifacts from. If you have assignments/student artifacts
for a year prior to your start year, please advise the LOA Coordinator. This
information may be of great benefit to the institution.
Step 7 – Go through the Program Enhancement Checklist
1. Go through the Program Enhancement Checklist to ensure all essential assessment
steps and forms have been completed. Save your updated Program Enhancement
Checklist in Taskstream Resources.
Step 8 – Attend Trainings
1. Attend trainings to expand on LOA knowledge.
a. Trainings can be requested and initiated by your department for certain
topics of interest.
Step 9 – Discuss Findings
1. We will get together, discuss findings, and will generate Enhancement
Strategies/Improvement Ideas. LOA will provide organized data and assessment
information.
Step 10 – Continuously Assess & Submit Data
1. Instruct and measure outcomes each semester.
2. Send Assessed Package to LOA through Taskstream at the end of the semester.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
14
APPLE
Condensed Program Enhancement Plan
Program Overview
1. Program Description (Static)
The Program Description is a statement which includes:
1. Your program description
2. Visual image (Optional)
3. Program vision (Optional)
2. Program Details & Program Enhancement Resources (Static)
Program Details & Program Enhancement Resources includes any details concerning
resources, equipment, faculty, faculty training, marketing materials, advisory
committees, etc. that are instrumental to your program and Program Enhancement
Plan. The Program Details provide valuable information to those assisting with
assessing and program enhancement strategies. Program Enhancement Resources
will assist your program with measuring your Program Learning Outcomes and Core
Outcomes.
3. Align Program & Core Outcomes (Semi-Static)
This section allows for program and core outcomes to be aligned/mapped. What
are the learning outcomes for your program? Choose between 3 program learning
outcomes to measure for this cycle. Align/map these program learning outcomes to
core objectives. Refer to your Student Learning Outcome Alignment (SLOA)
Forms.
Taskstream Instructions: Refer to Taskstream Directions for Program Overview Align Program & Core Outcomes (Included in this Manual)
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
15
APPLE
4. Curriculum Map
This area is primarily for set-up in Taskstream. You can use this space to create
your Curriculum Map or transfer a current Curriculum Map file to this area for
interface capabilities.
Taskstream Instructions: Taskstream Directions for Program Overview Curriculum Maps (Not Included in this Manual)
Program Assessment
5. Assessment Plan (Semi-Static)
This area is primarily for set-up in Taskstream. This space is used to set up
program outcomes in Taskstream to allow for data and artifact submissions in the
Assessment Data & Conclusions requirement.
Taskstream Instructions: Taskstream Directions for Program Assessment –
Assessment Plan (Included in this Manual)
6. Assessment Data & Conclusions (Changes)
Provide the measurements and data summary outlined in the Program Enhancement
Process. What assumptions, conclusions, and ideas for improvement can be drawn
from the assessment data? Discuss, analyze, and document the results of the
Enhancement Strategies that have been implemented.
7. Enhancement Strategies (Use of Results) (Changes)
Which ideas for improvement from Assumptions & Conclusions will be implemented?
Outline the approach that will be used to implement the ideas for improvement to
your Program/Course.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
16
APPLE
8. Reexamined Improvements & Impacts (Changes)
What are the noticeable improvements in your program/program outcomes/core
outcomes?
9. Assessment Committees’ Reviews (Changes)
The Program Enhancement Committee will review your Program Enhancement Plan.
Committee assessment information and results will be placed in this area by the
LOA Coordinator for Departments to examine.
8. Previous Semester Assignments (Changes)
This area allows for submissions of previous semester assignments, or student
artifacts. Please include assignments that include application of program outcomes
going back as far as your program cycle began. Please include assignments that
include application of core outcomes for courses that were in the core after the
start of Fall 2014; which is when the New Core Curriculum was implemented.
These assignments do not have to be assessed at the moment. The Assessment
Committees will assist with random assessment of these student artifacts.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
17
APPLE
Short List / Long List
Systematic Assessment Process
Concept & Instructions
Short List
(Student Learning Outcomes
Alignment Form)
3 Program Outcomes
Long List
(Curriculum Map)
All Program Statements of
Intended Outcomes
1.
2.
3.
4.
5.
____
____
____
____
____
6.
7.
8.
9.
10.
____
____
____
____
____ …
1. _____________
2. _____________
3. _____________
The continued alternation between the 2 lists demonstrates the dynamic nature of the
systematic process for ultimately assessing all educational program outcomes for a
program1
Process
1. Long List Creation
a. Refer to your Curriculum Map, if available.
b. For revision/creation of Long List: Invite all faculty (all adjuncts and
online instructors as well) to provide up to 3 intended education
(student learning) outcomes which graduates of the program should
achieve.
2. Short List Creation
a. The Dept. Chair will chose and identify the 3 Program Outcomes that
will be on the Short List for assessment for the next 3 years.
Nichols, J., & Nichols, K. (2005). A road map for improvement of student learning and
support services through assessment (pp. 76-79). New York: Agathon Press.
11
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
18
APPLE
3. When there is clear evidence that those completing the program are able to
achieve an outcome, the outcome can be returned to the long list. This can
be done before the 3 year review time period.
Tips
1. Open discussion and revision of Short List outcomes are encouraged. Ensure
clear understanding among all program faculty members.
2. 1 Program Outcome = 1 Program Expectation. Assessments should be
singular in nature & not bundled (limit comma, semi-colon, & conjunctions).
3. Consider outcomes from other institutions or those available from test
makers through standardized tests, but remember to maintain control over
your own program curriculum.2 Outcomes that come from outside of CTC
may provide for readily available means of assessment, however this may not
measure the outcomes that the CTC faculty find important and useful.
Nichols, J., & Nichols, K. (2005). A road map for improvement of student learning and support
services through assessment. (pp. 82) New York: Agathon Press.
2
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
19
APPLE
PROGRAM - STUDENT LEARNING OUTCOMES ALIGNMENT (SLOA) FORM
Program:_____________________ Semester Term: ____________________
Program Outcomes
Short List
Faculty & Courses
Involved with this outcome
Core Outcomes
If the Course is in the Core
Curriculum, include all core
objectives required
General Learning
Activities
Assignment Type
Assessment
Must include assessment
method of analysis &
ideal/target criteria
Critical Thinking Skills
Communication Skills
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
20
APPLE
Program Enhancement Checklist
Steps
(#’s correspond to Program
Enhancement Start-Up Steps)
1.1 Complete a Long Program
Outcomes List using a
Curriculum Map.
1.2 Choose 3 program outcomes to
add to the Short List.
2.1 Decide in which courses the
program outcomes will be
assessed.
3. Complete the Core Curriculum
Course Management
Spreadsheet if you have
courses in the Core
Curriculum.
4.1 Assign core outcomes to the
program outcomes.
4.2 Complete the Program
Student Learning Outcomes
Alignment Forms.
Guide for Program Enhancement Steps
Option
Choice
Completed
Not Completed
N/A
Option 1 – Course-Outcomes Map (Ex: HVAC)
Option 2 – Program-Course-Outcomes Map (Ex:
Computer Science)
Option 3 – Program-Outcomes-Course Map (Ex: Radio
& TV Broadcasting)
Place outcomes on the Program - Student Learning
Outcomes Alignment (SLOA) Form under “Program
Outcomes” (Refer to the Long List / Short List Systematic Assessment Process)
Place the chosen courses and faculty on the Program Student Learning Outcomes Alignment (SLOA) Form
under “Faculty & Courses.” (Refer to the Core
Curriculum Course Management Spreadsheet if you
have Core Curriculum courses)
The Core Curriculum Course Management Spreadsheet
can be found in Taskstream’s Resources area.
Place the chosen core outcomes on the Program Student Learning Outcomes Alignment (SLOA) Form
under “Core Outcomes.” (Refer to the Core Curriculum
Course Management Spreadsheet and Core SLOA Form
if you have Core Curriculum courses)
Complete the remaining areas of the Program Student
Learning Outcomes Alignment Forms.
-
-
-
-
-
-
-
-
-
-
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
21
APPLE
5.1 Start compiling an
Assessment Package for LOA
submission
Use rubrics, Assessment Guideline Form, &
Student Learning Outcome Alignment Forms
6.1 Gather student
assignments and submit
assignments in Taskstream
7. Save updated Program
Save in the Program Enhancement Plan – Previous
Semester Assignments.
Enhancement Checklist in
Taskstream Resources.
Save in Taskstream in the Program Enhancement Plan Program Details & Program Enhancement Resource
area.
All items
are
required
Continuous –
Every
Semester
Continuous –
Every
Semester
-
-
-
-
-
Additional Steps
Steps
I. If you have courses in the Core Curriculum, ensure
that you have a completed Core Student Learning
Outcomes Alignment Form for each course
II. If you have courses in the Core Curriculum, ensure
that you have received the stamp of approval for
all Core Student Learning Outcomes Alignment
Forms.
III. Complete the Program Details & Program
Enhancement Resources section of the Program
Enhancement Plan – Program Overview by including
all relevant details regarding program resources
IV. Indicate if you have an Advisory Board
V. Submit your Department Faculty Profile
VI. Create Program/Course Specific Rubrics
VII. Create or adopt Core Rubrics
VIII. Create a capstone course or project
IX. Receive an LOA approval stamp on all submissions
X. Decide if Dept. programs will be separated & when
Guide
Option
Choice
Completed
Not Completed
N/A
-
-
-
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
22
Assessment Guidelines Form
All items that should be included in program Assessed Packages:
Student Learning Outcome Alignment Form
Student Artifacts
Individual Assessments with rubrics
Assessment Guideline Form
1. Department or Program: __________________________________
2. Course Prefix/Number/Title: ______________________________
3. Point of Contact/Author(s) of the Assessment:
_____________________________________________________
_____________________________________________________
4. Dept. Chair: ___________________________________________
5. Coordinating Student Learning Outcomes Alignment Form(s):
_____________________________________________________
_____________________________________________________
_____________________________________________________
6.
Which degree(s)/program(s) is this course in?
____________________________________________________
____________________________________________________
____________________________________________________
____________________________________________________
APPLE
7. Measure Method (Ex: Student Artifacts or Exams):
_____________________________________________________
8. Are rubrics included?
Yes ☐
No ☐
Some, but not all ☐
9. How many rubrics were used? ______________________________
10. Are assignment details/instructions included? Yes ☐
11.
Is this course in the Core Curriculum?
Yes ☐
No ☐
No ☐
12. If this course is in the Core Curriculum, according to the Core
Student Learning Outcome Alignment Form what Core Objectives are
required by the THECB for this course?
☐Critical Thinking Skills ☐Communication Skills
☐Teamwork
☐Personal Responsibility
N/A ☐
☐Empirical & Quantitative Skills
☐Social Responsibility
13. According to the Program Student Learning Outcome Alignment Form,
what Core Objectives are required?
☐Critical Thinking Skills ☐Communication Skills
☐Teamwork
☐Personal Responsibility
☐Empirical & Quantitative Skills
☐Social Responsibility
14. Which Core Objectives are actually included in the Assessment
Package?
☐Critical Thinking Skills ☐Communication Skills
☐Teamwork
☐Personal Responsibility
☐Empirical & Quantitative Skills
☐Social Responsibility
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
24
APPLE
15. Were required Core Objectives included in the Assessment Package
(According to both Core & Program Student Learning Outcome
Alignment Forms)?
Yes ☐
No ☐
____________________________________________________
16. Were required Program Objectives included (Refer to the Program
Student Learning Outcome Alignment Form)?
Yes ☐
No ☐
____________________________________________________
17. Provide Sample Size & Population Size:
Sampled/Assessed Students: ______________________________
All Students in the Course this semester: _____________________
All Students in the Program/Department: _____________________
18. What is the idea/target criteria?
_____________________________________________________
_____________________________________________________
_____________________________________________________
19. Did the average student assessments meet the ideal/target criteria?
_____________________________________________________
_____________________________________________________
20. How many students or percentage of students did not meet the
ideal/target criteria?
_____________________________________________________
_____________________________________________________
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
25
APPLE
21. Reflections, Notes, and Conclusions based on data:
_____________________________________________________
_____________________________________________________
_____________________________________________________
22. What are the Enhancement Strategies (Ideas for Improvement)?
_____________________________________________________
_____________________________________________________
_____________________________________________________
23. Sufficient Enhancement Strategies?
_____________________________________________________
_____________________________________________________
_____________________________________________________
24. Comments on the Enhancement Strategies:
_____________________________________________________
_____________________________________________________
_____________________________________________________
25. Recommendations:
_____________________________________________________
_____________________________________________________
_____________________________________________________
26. General Notes:
_____________________________________________________
_____________________________________________________
_____________________________________________________
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
26
APPLE
Taskstream Guides
For The Program Enhancement Plan
Taskstream Introduction/Refresher




The AMS (Accountability Management System) used at CTC is Taskstream.com.
Username: Ctcd email (fully spelled out email)
Password: first initial last name 1 (please do not change)
To work in a workspace or input data and files you must “Check Out” the workspace as
if you were checking out a library book. After you have made your changes, you can
“Check In” the workspace. You are still able to continue accessing that workspace and
information unless there is a lock on the workspace.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
27
APPLE
Taskstream Guide For
Program Overview - Align Program & Core Outcomes
This is the area where you set up (map) your program outcomes to the core
outcomes/objectives in Taskstream
Taskstream Terms = CTC Terms
1. Outcome Set = Department Program Outcomes
(Ex: Mathematics Program Outcomes)
1.1
Objective = Program Outcome
1.1.1
Mapping = Core Outcomes
1. Click on “Check Out” in the top right hand corner of the screen.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
28
APPLE
2. Click on “Create New Outcome Set”
3. The “Set Name” will be your department or program name. Provide your
program name and the words Program Outcomes.
a. Example: Science Program Outcomes
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
29
APPLE
4. Click the “Designate Alignment/Mapping Preference” dial. Click “Continue.”
5. Click “Create New Objective”
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
30
APPLE
6. Enter one of your program outcomes into the “Objective” area. Click
“Continue.”
7. Click on “Add mapping”
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
31
APPLE
8. For the “Select category of set to map to” select the drop down option
that states “Goal sets distributed to (Your Department’s Name).” Click
“Go.”
9. Click on the “TX-Texas Core Curriculum” dial. Press “Continue.”
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
32
APPLE
10.
Click the dials next to each Core Objective that is applicable to this
program outcome.
a. Refer to your Student Learning Outcome Alignment Form for the
objectives that match up (map) with the program outcome.
11.
Click “Continue.”
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
33
APPLE
12.
You should now see your program outcome mapped to core outcomes.
Continue by redoing steps 5-11 for each program outcome on your Program
Student Learning Outcomes Alignment Forms for this semester.
Congratulations on successfully completing the Taskstream Align Program &
Core Outcomes workspace! If you have any questions, contact the
LOA Coordinator at Ex: 1182.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
34
APPLE
Taskstream Guide For
Program Assessment – Assessment Plan
This workspace is used to enter data information and data files.
This can only be completed after entering information in “Align Program & Core
Outcomes.”
13.
Go to your Program Enhancement Workspace. Click on “Assessment Plan”
on the left hand side of the screen.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
35
APPLE
14.
Click “Check Out” near the top right hand corner of the screen.
15.
Expand “Outcomes and Measures” if it is not already expanded. To do
this, click on the small arrow that’s pointing to “Outcomes and Measures.”
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
36
APPLE
16.
Click on “Select Outcomes.”
17.
Click “Select Existing Set.”
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
37
APPLE
18.
Choose your Department, or Program, Program Outcomes. Click the dial
next to your Program Outcomes. Press “Continue.”
a. In this example, we will be working with the Science Program
Outcomes. You will choose your own departments, which should
already have been created in the “Align Program and Core Outcomes”
section. If you have not completed the “Align Program and Core
Outcomes” section, you will need to complete that task first. A
training guide is also available for that section.
19.
Click the dial next to the objective/program outcome that you want to
set up.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
38
APPLE
20.
Click “Accept and Return to Plan.”
21.
Copy the Program Outcome by selecting all of the text, right click, and
click copy.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
39
APPLE
22.
Click on “Add New Measure” towards the bottom left hand of the
screen.
23.
Click in the “Measure Title” text area and paste the Objective/Program
Outcome by right clicking and then clicking paste.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
40
APPLE
24.
Select the “Measure Type/Method,” which is usually going to be Direct –
Student Artifact or Direct – Exam.
25.
Indicate the Ideal/Target Criteria for this program outcome. Refer to
the Student Learning Outcome Form.
a. Ex:
i. 80% proficiency – Program Outcome
ii. 80% proficiency – Critical Thinking Skills
iii. 70% proficiency – Communication Skills
iv. 85% proficiency – Quantitative and Empirical Skills
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
41
APPLE
26.
Make sure you include the course(s) that will be included in this
assessment.
27.
Click on “Apply Changes.”
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
42
APPLE
28.
You should now see your program outcome and some details concerning
this program outcome. Repeat the previous steps for each program
outcome.
29.
After entering all program outcomes, click “Check In” in the top right
hand corner.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
43
APPLE
30.
You do not need to submit a comment. You can now click on “Return to
Work Area” in the top of the screen if your screen says “Check In
Successful.”
31.
Assessment results will not be uploaded into the Assessment Plan area.
When you have assessment data and assessment packets, upload these
items into Assessment Data & Conclusions.
Congratulations on successfully completing the Taskstream Assessment Plan
workspace! If you have any questions, contact the
LOA Coordinator at Ex: 1182.
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
44
APPLE
Program Review 3 Year Cycle
The cycle indicates when closing conclusions will be made and Enhancement Strategies
will be implemented
AY: 2011-2012 & 2014-2015 (2015-2016) & 2017-2018

Business Administration

Computer Science

English as a Second Language (ESL)

Mental Health Services

Nursing

Office Technology

Paralegal & Homeland Security programs

Radio & TV Broadcasting
AY: 2012-2013 & 2015-2016 (2015-2016) & 2018-2019

Agriculture programs

Aviation

Computer Aided Drafting & Design

Child Development & Teacher Education

Electronics

Emergency Medical programs

Mathematics

Protective Services
AY: 2013-2014 & 2016-2017 (2015-2016) & 2019-2020

Communications

Developmental Studies

Fine Arts

Hospitality Management programs

Industrial Technologies

Medical Lab program

Science

Social & Behavioral Science

Kinesiology
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
45
APPLE
LOA Definitions
APPLE – Assessment Programs & Processes for Learning
Excellence is a compilation of programs and processes that
contributes to bettering the student learning process
Assessment Cycle - The systematic collection, review and use
of evidence for the purpose of improving student learning3
Assessed Package - This package is turned into LOA. The
package information should reflect information from the
Program Student Learning Outcomes Alignment Form and the
Assessment Guidelines Form.
a) Each Assessed Package should include:
1. The student artifacts for all the students in the course
2. An assessment for each student in the course, using
rubrics
3. Total assessment for the entire course using the
Assessment Guidelines Form
IE / Institutional Effectiveness – IE is a CTC Department,
which the Learning Outcomes Coordinator is a part of, and IE
is also refers to IE plans, which are departmental goals that
align with SACS COC and CTC Strategic Plan goals.
Direct measure - Students' demonstration of learning4
3
THECB - Texas Core Curriculum Assessment Guidelines. (n.d.). Retrieved July 13, 2015, from
http://www.thecb.state.tx.us/index.cfm?objectid=42E67B6B-002A-90EE-C17A4779C473E964
4
THECB - Texas Core Curriculum Assessment Guidelines. (n.d.). Retrieved July 13, 2015, from
http://www.thecb.state.tx.us/index.cfm?objectid=42E67B6B-002A-90EE-C17A4779C473E964
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
46
APPLE
Externally informed benchmarks - Targets for student
attainment set by and/or in collaboration with constituencies
outside the institution. Examples include advisory boards, peer
institutions and national norms5
Indirect measure - Students' perceptions of their learning or
other measures not derived directly from student work6
Long Program Outcomes List - The list of all of the Program
Student Learning Outcomes
Program Overview – Details and descriptions of an
instructional program
Student Artifacts - Student pieces of work that demonstrate
the student’s educational abilities and skills such as; exams,
quizzes, projects, internships, and assignments
Student Learning Outcomes Assessment – Statements that
describe significant and essential learning that learners have
achieved, and can reliably demonstrate at the end of a course
or program. In other words, learning outcomes identify what
the learner will know and be able to do by the end of a course
or program.
5
THECB - Texas Core Curriculum Assessment Guidelines. (n.d.). Retrieved July 13, 2015, from
http://www.thecb.state.tx.us/index.cfm?objectid=42E67B6B-002A-90EE-C17A4779C473E964
6
THECB - Texas Core Curriculum Assessment Guidelines. (n.d.). Retrieved July 13, 2015, from
http://www.thecb.state.tx.us/index.cfm?objectid=42E67B6B-002A-90EE-C17A4779C473E964
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
47
APPLE
Verbiage Synonyms
APPLE (Assessment Programs & Processes of Learning
Excellence) – Combination of the prior Program Review and
Assessment Plan; Will also include future initiatives involving
Student Learning Outcomes
Enhancement Strategies - Use of Results; Improvement Ideas
General Education – Core Curriculum or the Associates Degree
titled General Education
Outcomes – Competencies; Objectives
Program Enhancement Plan – Program Review; Program
Overview + Program Assessment
Curriculum Map – Program Outcomes Maps
Taskstream Terms = CTC Terms
1. Outcome Set = Department Program Outcomes
 (Ex: Mathematics Program Outcomes)
1.1.
Objective = Program Outcome
1.1.1.
Mapping = Linking Core Outcomes to Program
Outcomes
APPLE Plan 2016
CTC’s Students are Excellent because CTC’s Faculty are Excellent.
48
Download