Teaching
Effectiveness:
IDEA PROCESS
Workshop on the process and
procedures required for
Student Evaluations
Fall 2014
Agenda
•
•
•
•
•
•
Overview
Faculty Information Form (FIF)
Student Ratings Form
Packets, Stacks, and Packaging
Results, Stacks, and Packets
Fall dates and Spring planning
Agenda
•
•
•
•
•
•
Overview
Faculty Information Form (FIF)
Student Ratings Form
Packets, Stacks, and Packaging
Results, Stacks, and Packets
Fall dates and Spring planning
IDEA: What is that?
•Operates out of Kansas
State University
D evelopment • Over 35 years experience
and
• Nationally normed and
E ducational research-driven assessment
services
A ssessment
• www.theideacenter.org
I ndividual
IDEA: What is it?
• IDEA student ratings forms are used
by all departments – both digital and
paper forms.
• Student forms are mailed in bulk by
the Senate to IDEA once each
semester.
• Reports provided to the campus and
faculty will be consistent for the
campus.
IDEA: What does it
mean for faculty?
• Each Department has a Policy of
Assessment of Teaching Effectiveness
• Faculty complete the Faculty
Information Form (FIF) for each
section scheduled for Student Ratings
• The FIF requires the faculty member to
“rate” relevance of course objectives.
• The results report format is consistent
Student Ratings
Process and Procedures
Overview of the process:
9 Pickup blank Student and Faculty forms from
Senate Office
9 Faculty Select Courses based on policy and
complete FIF and designate Short or
Diagnostic form.
9 Prepare student ratings packets
9 Students complete rating forms
9 Department takes rating forms with FIF to
Senate for mailing
9 Receive results reports for distribution
Agenda
•
•
•
•
•
•
Overview
Faculty Information Form (FIF)
Student Ratings Form
Packets, Stacks, and Packaging
Results, Stacks, and Packets
Fall dates and Spring planning
Faculty Information Form
Faculty Information Forms (FIF)
• Completed by faculty for each course self selected
for evaluation – refer to Departmental Policy for
requirements and course selection.
• Objectives – Faculty should consult the Dept
Chair or instruction sheet for guidance
• Course information - information is on
MyFresnoState (roster) or the DAA may need to
assist faculty.
• FIF is the same whether the faculty is using the
Short Form or Diagnostic Form.
Faculty
Information
Form (FIF)
Front Page
Sample completed FIF
Typing form information is
not required or expected.
The sample marks are not
in compliance – the
square marks are for
demonstration only.
Faculty
Information
Form (FIF)
Back Page
Sample completed FIF
Note: The sample marks
are not in compliance –
the square marks are for
demonstration only.
FIF:
Completing
the Form
Instructor Information
FIF:
Completing
the Form
Instructor Information
Course Information
FIF:
Completing
the Form
Instructor Information
Course Information
• Meeting Days
FIF:
Completing
the Form
Instructor Information
Course Information
• Meeting Days
• Discipline See back page
for a summary list of discipline
codes. See the IDEA Center
for a complete list:
www.theideacenter.org
FIF:
Completing
the Form
Instructor Information
Course Information
• Meeting Days
• Discipline (see second page)
• Meeting time
FIF:
Completing
the Form
Instructor Information
Course Information
• Meeting Days
• Discipline (see second page)
• Meeting time
• Course No. = Class Nbr
FIF:
Completing
the Form
Instructor Information
Course Information
• Meeting Days
• Discipline (see second page)
• Meeting time
• Course No. = Class Nbr
• Number of Students Enrolled
FIF:
Completing
the Form
Instructor Information
Course Information
• Meeting Days
• Discipline (see second page)
• Meeting time
• Course No. = Class Nbr
• Number of Students Enrolled
• Local Codes
• The code to enter here
will be determined later.
FIF:
Completing
the Form
Instructor Information
Course Information
Objectives – Faculty will
complete this section; it aides
in the reporting results. Best
Practice: 3-5 objectives
marked as important or
essential. All that is required is
for one objective to be marked
as important or essential.
FIF:
Completing
the Form
Instructor Information
Course Information
Objectives – Faculty will
complete this section; it aides in
the reporting results. (Select 3-5)
Contextual Question
• Course Approach: primary
• Course Approach: secondary
• Not required
• Course Requirements
• Required for Group Reports
FIF:
Completing
the Form
Instructor Information
Course Information
Objectives
Contextual Question
FIF:
Completing
the
back page
Contextual Questions
continued from front page
FIF:
Completing
the
back page
Contextual Questions
continued from front page
Discipline Codes
• Short List provided here
• Complete list:
www.theideacenter.org
Faculty Information Form
DAA Responsibility:
• Review forms for stray marks and writing
• It is “OK” when ALL Objectives left blank;
however, let Chair know.
• It is a problem when ALL Objectives are
marked “M” Minor, let Chair know. One
objective must be marked as “E” Essential.
• Missing data – fill in if known or ask instructor
for the information.
• Track courses and faculty for compliance with
departmental policy frequency etc. Use Faculty
Evaluation Report in MyFresnoState.
Agenda
•
•
•
•
•
•
Overview
Faculty Information Form (FIF)
Student Ratings Form
Packets, Stacks, and Packaging
Results, Stacks, and Packets
Fall dates and Spring planning
Student Reaction Forms
Course Packets
• Prepare a packet for each course
selected by faculty (refer to the FIF’s)
• Schedule date/time for the course
evaluations to be completed
• Conduct the course evaluations
• Review scantrons for errors, extra
writing, etc.
Student Reaction Forms
Course Packets
Contents of Course Packets - Suggested
• Instruction sheet
• Course information to write on classroom
white board – Instructor Name, Class #
• Student Ratings Sheets- one for each
student enrolled in the course
• Pencils
• Drop off instructions
• Do not include the FIF in the packet
Student Reaction Forms
Course Packets
General Notes
• Pickup Student Ratings Sheets from the
Academic Senate –Thomas Room 130
• The instructor is not in the room during
the student rating process.
• Reverse side of form for comments. No
extra paper for comments.
• Do not copy forms – pickup additional
forms from Senate if needed
• Students
completed
the forms
Sample
Student
Reactions to
Courses
Course Information
Best Practice: Provide this
information on the white board
Course No. = PS: Class Nbr
Sample
Student
Reactions to
Courses
12 Reaction Questions
Sample
Student
Reactions to
Courses Form
6 Student reflection Questions
Sample
Student
Reactions to
Courses
Form
Extra Questions – May be used
beginning Fall 2012
Sample
Student
Reactions to
Courses
Form
Comments on back of form.
Agenda
•
•
•
•
•
•
Overview
Faculty Information Form (FIF)
Student Ratings Form
Packets, Stacks, and Packaging
Results, Stacks, and Packets
Fall dates and Spring planning
Stacks and Packets
Prepare for mailing
Terminology
1. Packets
FIF and student forms for each course rated (or to be
rated) by students.
2. Stacks
A group of completed Packets for each course rated
by students in the department. Stacks are organized
alphabetically by instructor.
3. Cover Sheet
This sheet will be provided by the Academic Senate
when stacks are delivered.
Stacks and Packets
Prepare for mailing
After students complete reaction forms
1. Review forms for stray marks & writing.
2. Create your department “stacks”
A. Faculty member
i.
FIF – Faculty Information Form
ii. Student Reaction Forms
iii. Repeat for each section rated
3. Repeat “A” for each faculty member
• Corresponding
FIF form
placed on top
of Student
forms for each
course
evaluated.
Stacks and Packets
Prepare for mailing
At the Senate Office (Thomas 132)……
1. How the Department “stacks” packets–
determines how reports are delivered.
2. Deliver your stack to the Academic
Senate during the scheduled time.
3. Place cover sheet (provided) on top.
4. Departments will be grouped by college.
5. Mailing is mid December
6. Don’t be late!
At the Senate ….
A sheet will be
provided with your
department name
to place on top of
your stack.
And your college will
be stacked into one
or more piles with a
cover page.
Agenda
•
•
•
•
•
•
Overview
Faculty Information Form (FIF)
Student Ratings Form
Packets, Stacks, and Packaging
Results, Stacks and Packets
Fall dates and Spring planning
Results
At the Academic Senate Office ….
1. IDEA will mail results in bulk to the
Academic Senate. The Group
Summary Report is the “cover sheet.”
2. Academic Senate will notify
Department offices that results are
ready to pickup.
Results:
Sample
from IDEA
Results come as one page
on a 17 X 11 piece of paper
folded like a booklet.
Faculty training on
September 7th provided
information on this form and
how to use the information.
Sample Page 1
Results:
Sample
from IDEA
Results come as one page
on a 17 X 11 piece of paper
folded like a booklet.
Sample Page 2
Results:
Sample
from IDEA
Results come as one page
on a 17 X 11 piece of paper
folded like a booklet.
Sample Page 3
Results
1. One set of reports will be delivered to
the Dean’s office for inclusion in the
Personnel Action File.
2. Give the copy of the Student Rating
Forms to the Department Chair.
Per APM 322 VII.B.2. page 5
– “A copy of the student comments shall be
given to the[chair] and the [instructor]
member.
– The [chair] shall review the student
comments in a timely fashion for evidence
of gross violations of university policy.
Results
3. After Chair reviews comments, distribute
result summaries and student rating forms to
instructors.
4. Do not make copies.
5. Chairs can review summary reports for
faculty in the personnel file (PAF) in the
Dean’s office after signing into the log sheet.
Agenda
•
•
•
•
•
•
Overview
Faculty Information Form (FIF)
Student Ratings Form
Packets, Stacks, and Packaging
Results, Stacks, and Packets
Fall dates and Spring planning
Online Evaluations
You will receive an email from TILT
regarding the coordination of using the
IDEA process for online courses.
Diagnostic Form
The use of the Diagnostic Form and Additional Questions
is OPTIONAL.
Diagnostic Form:
Please remember that Questions 1-20 on the Diagnostic
Form and any additional questions added by the
instructor are not used in computing the scores for
progress on relevant objectives and the Summary
Evaluation scores. Departments will be responsible for
collecting information from faculty with regard to choice of
either the Short Form or Diagnostic Form and/or the use
of additional questions.
Diagnostic Form cont.
The use of the Diagnostic Form and Additional Questions
is OPTIONAL.
Additional Questions:
Additional questions must be provided to the Department at
the same time as the FIF on a single sheet of white lettersize paper. Questions need to numbered consecutively
(starting with 19 for the Short Form and 48 for the
Diagnostic Form) and response items must be provided
as per the IDEA instructions. Additional questions are not
used in computing the scores for progress on relevant
objectives and the Summary Evaluation scores. The list
of additional questions will only be placed in the faculty
Personnel Action File at the request of the faculty being
evaluated.
Resources
Faculty Affairs Web site:
http://www.fresnostate.edu/academics/aps/teaching-effectiveness/
The IDEA Center:
http://www.theideacenter.org/
Faculty Directions:
http://www.theideacenter.org/sites/default/files/DirectionsToFaculty.pdf
Video: Completing the Faculty Information Form:
http://www.theideacenter.org/FIFVideo
Some thoughts to Selecting Objectives:
http://www.theideacenter.org/sites/default/files/SOME%20THOUGHTS
%20ON%20SELECTING%20IDEA%20OBJECTIVES.pdf
Complete list of Discipline Codes:
http://www.theideacenter.org/sites/default/files/DisciplineCodes.pdf