Assessments for Initial and Advanced Programs in Educational

advertisement
Page 1 of 4
Procedures for ensuring that key assessments of candidate performance
are fair, accurate, consistent, and free of bias for programs in the Educational Studies Department:
Elementary and Secondary: Initial and Advanced Programs
There are four assessment used to evaluate the effectiveness of the Initial Programs in Elementary and Secondary
Education. Three of those assessments have been developed internally: the Exit Portfolio, analysis of Impact on P-12 Student
Learning, and Student Teaching Final Evaluation. The fourth assessment is an assessment that has been developed externally,
PRAXIS II. The PRAXIS II has established fairness, accuracy, consistency and free from bias measures.
Initial Programs:
Elementary and
Secondary
Fair
The three internally
developed assessments
have been curriculum
mapped and evaluated for
communication of
assessment expectations
and criteria. The
expectations for these
assessments are on-line
and given in EDUC F 200, a
required introductory
course for all candidates in
the initial programs.
The assessment
expectations are reviewed
in each of the cohort
methods blocks for
Elementary Education, by
course instructors in the
Secondary Programs, and
for all candidates in the
first Student Teaching
seminar by the Associate
Accurate
The rubric used to evaluate
the portfolio and the rubric
used by Cooperating
Teachers to make a final
evaluation of Student
Teachers are aligned with
the INTASC Standards. The
rubric used to assess the
Impact on P-12 Student
Learning has a separate
rubric. See, for example,
Exit Portfolio evaluation
sheet & Impact on P-12
Student Learning rubric
(http://new.ipfw.edu/dotA
sset/170708.pdf ), &
Student Teaching final
evaluation form
(http://new.ipfw.edu/dotA
sset/200385.pdf).
The accuracy of the
Cooperating Teacher’s
evaluation is compared to
Consistent
1) Cooperating Teachers
receive detailed
instructions about the
assessments they need to
carry out. Most Cooperating
Teachers have worked with
us before and have
experience assessing the
progress of Student
Teachers.
2) The assessors of the Exit
Portfolio, which includes
the Impact on P-12 Student
Learning, are Education
faculty. They receive a
review of the evaluation
procedures every semester.
Each portfolio has one
reading; if the score falls
below the Needs Major
Improvement cutoff (below
48/70) there is a second
reading. If the combined
Free from Bias
1) The Student Teacher
evaluation forms are
clear and precise, based
on the INTASC
Standards, which inform
all assessments in the
Initial Programs. They
are known to the
candidates, Cooperating
Teachers, and
University Supervisors.
If questions of bias in
the evaluations are
raised by candidates,
the Chair of Educational
Studies and the Director
of Field Experiences and
Student Teaching
intervene.
2) Expectations for the
portfolio are clearly and
often reviewed by
instructors with
Page 2 of 4
Fair
Dean. At the portfolio
checkpoints in both the
Elementary and Secondary
programs, candidates
upload a required number
of artifacts & reflections, in
preparation for their Exit
Portfolio. Thus, candidates
are continually working
with their portfolios
making the expectations
clear and, thus, fair to all.
See Portfolio Guidelines for
Elementary and Secondary
Education:
http://new.ipfw.edu/dotA
sset/146090.pdf. Also
available in Exhibit 2.1:
http://new.ipfw.edu/depa
rtments/education/standa
rds/2011accreditation/sta
ndard2/.
Accurate
that of the University
Supervisor’s. If they are in
stark contrast to each
other, the chair of the
Educational Studies
Department and the
Director of Field
Experiences and Student
Teaching work with both
parties and the candidate
to determine a path
forward.
The data from the portfolio
assessments are reviewed
and analyzed by the
Education faculty at the
Assessment Retreat in
August of each year. See
Exhibit 1.1 for 2011
Report:
http://new.ipfw.edu/depa
rtments/education/standa
rds/2011accreditation/sta
ndard1/.
Consistent
score still falls below 48, the
candidate has the
opportunity to revise and
resubmit the portfolio until
it reaches mastery. If there
is more than a 10 point
spread between the 1st
reading and the 2nd, a third
reading is required, and the
two highest are averaged
for the final score. The
Associate Dean reviews the
assessments of all portfolios
for accuracy in scoring
before releasing the
evaluation to the candidate.
We have been remarkably
consistent over the years
with the scoring of the
portfolios. See page 31 in
Exhibit 1.1, 2011 Report:
http://new.ipfw.edu/depart
ments/education/standard
s/2011accreditation/stand
ard1/.
Free from Bias
candidates.
3) All candidates have
equal access to all
equipment helpful in
submitting files to their
portfolios; computers,
software, scanners, and
technology support are
readily accessible on
campus for all
candidates to upload
and submit their
assessments.
4) Candidates also can
receive immediate help
from Mentoring Services
from our portfolio
vendor, TaskStream,
through email
(help@Taskstream.com)
or by calling 1-800-3115656 for any questions
.about the portfolio. The
Associate Dean, the
Assessment Assistant,
and the Data Manager
are also accessible
online and by phone to
the Student Teachers
each semester to
answer any questions
about portfolios.
Page 3 of 4
In the Advanced Program in Elementary and Secondary Education three assessments, the 18-Hour Portfolio
Checkpoint, the 33-Hour Portfolio Checkpoint, and the Capstone Assessment are used to evaluate the effectiveness of the program.
These assessments have been developed internally and meet the requirements for fair, accurate, consistent and free from bias, as
described below.
Advanced
Programs:
Elementary and
Secondary
Fair
The assessment system for
the Advanced Programs in
Elementary and Secondary
Education is made
available to candidates
online at
http://new.ipfw.edu/dotA
sset/149032.pdf. It is
introduced to candidates
in the first course in the
program, EDUA F500.
An assessment based on
the Conceptual
Framework,
http://new.ipfw.edu/dotA
sset/149122.pdf, and one
based on the NBPTS
Standards,
http://new.ipfw.edu/dotA
sset/149124.pdf, are
required in every course,
except the first, F500, and
the final Capstone course.
At the 18-hour and 33hour checkpoints, a series
of assessments are
completed, in addition to
the candidates assembling
all of the CF assessments
Accurate
The rubrics associated
with these assessments are
aligned with the IPFW SOE
Conceptual Framework
standards and the 5 Core
Propositions of the NBPTS
and the assessment. The
level of complexity of the
assessment is aligned with
the complexity of the
various standards. The
faculty gathers at the
Assessment Retreat in
August to review and
analyze the data generated
by these assessments, and
it is compared to data
generated from prior
years. The Exit Portfolio
data are reviewed at the
end of each semester.
From these ongoing
reviews of the data the
faculty determines
whether the assessments
are accurate.
Consistent
Since the CF and NBPTS
assessments are completed
in all but two courses in the
programs, there are
multiple raters for these
assessments. There are
informal training sessions
for scoring these
assessments on an as
needed basis. Candidates
submit their portfolios at
each of the two checkpoints
to the Coordinator of the
Elementary and Secondary
Advanced Programs. The
Coordinator asks faculty
members to assess a
candidate’s portfolio. The
evaluations of the portfolio
are given to the candidates
at portfolio checkpoint
meetings organized each
semester. In addition to the
Coordinator of the
programs, the Associate
Dean and other faculty
attend these meetings.
Through the discussions the
candidates share their
Free from Bias
The instructions for all
assessments and rubrics
are readable, clear, and
precise. They are made
public in several
different venues to all
candidates. Equipment
such as computers,
software, scanners, and
technology support are
readily accessible on
campus by all
candidates throughout
their programs. The unit
has a liaison librarian
who establishes
websites for each course
with links to research
tools especially tailored
to each course. The
librarian offers group
sessions to graduate
courses or individual
email or phone support.
Capstone presentations
and the two portfolio
checkpoints are
arranged in the
evenings when it is
Page 4 of 4
and NBPTS assessments
that have completed up to
that point in a portfolio.
Because the candidates
are, in effect, working on
their portfolios through
their entire program, they
are always aware of the
assessment requirements
for the program. We
believe this makes the
process fair. When they
turn in their portfolios at
the two checkpoints, they
have the option to revise
and resubmit if their
portfolio is judged
unacceptable.
experiences in the program.
They also have the
opportunity to give
feedback on the programs
themselves, their strengths
and weaknesses. Through
these checks and balances
in the assessment process,
we have multiple
opportunities to assess the
consistency of our
programs.
Also, candidates in the
Capstone course publically
present their research
projects to other
candidates, as well as to
invited faculty members,
who are then able to judge
the projects and participate
in the class discussion that
follows the presentation.
The assessments completed
during the Capstone course
are included in the Retreat
Reports, so consistency in
evaluations from year to
year can be compared.
convenient for working
educators to attend.
The use of the
University’s computer
tools, Blackboard, also
guarantee all
communication in the
course is publically
stated to ensure that it
is free from bias.
Download