Program Assessment Plan and Results
Analysis of SP07 Data
Division:
CDTE
Elementary Education
Program:
Person(s) responsible for implementation of assessment plan:
Period of assessment:
Academic Year 2006-2007
Thomas P. Benally, Coordinator of AA Elem Ed Pgm
Relevant statements(s) from Din4 College’s mission:
The Diné College Mission and Center for Diné Teacher Education Elementary Education Associate of Arts Program are interwoven. All of the major
concepts are addressed directly.
Diné College is a public institution of higher education chartered by the Navajo Nation. The mission of Diné College is to apply the Sa'ah Naagháí
Bik'eh Hózhóón principles to advance quality student learning:
•
•
•
through Nitsáhákees (Thinking), Nahatá (Planning), Iiná (Living) and Sihasin (Assurance)
in study of the Diné language, history and culture
in preparation for further studies and employment in a multi-cultural and technological world in fostering social responsibility, community
service and scholarly research that contribute to the social, economic and cultural well being of the Navajo Nation
Program mission
The mission of the Associate of Arts in Elementary Education program is to advise and prepare students for careers as educators utilizing Sa'ah
Naaghai Bik'eh Hozhoon. Our Program Goals further show how the program supports both missions.
Program goals addressed by this plan:
1. Students will articulate what it means to be a teacher.
1.1 Students will be able to express her/his own philosophy of education.
1.2 Students know what schools and education systems are.
1.3 Students have beginning skills and knowledge that are used in a learning environment.
1.4 Students can participate in rich professional critical talk.
2. Students will become educators of Navajo students.
2.1 Students know Navajo Nation schools and communities.
2.2 Students know Navajo children and their families.
2.3 Students advocate for quality education.
EE07ResultsReformat092407.doc
The Program Outcomes reflect content knowledge and skills we hope to see students grow as a result of instruction in our Elementary Education program. Program Outcomes further define each Program
Goal. The Assessment Measures & Criteria used evaluate students’ articulation of this content. We have identified a range and depth of demonstrable skills to be measured. Each of the five EDU courses
collects a minimum of 10 student artifacts for program review. Artifacts are collected from campuses and centers where the course is taught each semester. They are collected throughout various times of
the semester. For Program Assessment Results/Data, we are currently setting a milestone at 50% of reviewer findings. Anything below 50% will be further addressed in Program Assessment
Recommendations.
Program
Outcomes
Program Assessment
Measures & Criteria
Program Assessment
Results/Data
Program Assessment Recommendations
(Closing the Loop)
Program Matrix attached indicates types of student artifacts collected.
Goal 1. Students will articulate what it means to be a teacher.
With reviewers aware of the content knowledge expected based an artifact’s prompts stimulating student responses, the following
criteria were used to assess student learning:
1.1 Students
express a
philosophy of
Education
1.2 Students know
what schools and
education systems
are.
EF: Do students show
effective engagement when
expressing feelings related
to the four outcomes for
Goal 1?
EF: Program data shows
CT: Do students show
CT: Program data shows
1.3 Students show
beginning skills and
knowledge that are
used in a learning
environment.
1.4 Students have
skills to participate in
rich, professional,
critical talk
EE07ResultsReformat092407.doc
effective engagement in
different levels of critical
thinking skills related to
the four outcomes for
Goal 1?
that 90% of reviewer findings
indicate students are
successfully expressing
their feelings as they
address the four program
outcomes for Goal 1.
that 69% of reviewer findings
indicate students are
successfully demonstrating
critical thinking skills as
they address the four
program outcomes for Goal
1. A deeper analysis of the
data indicate:
•
•
•
•
•
90% Knowledge
82% Compreh/Unders
70% Application
54% Analy and/or Synth
47% Evaluative
EF: Program aggregated data at 90% indicates we are appropriately
using assessment prompts to elicit student responses and that their
responses indicate they have the skills to successfully express
their feelings regarding what it means to be a teacher. We really
made an improvement in this area, but we still considering additional
efforts after concerns regarding critical thinking are addressed.
CT: Program aggregated critical thinking data at 69% indicates that
while students are providing information regarding knowledge and
understanding of the concepts in Goal 1, through inadequate
assessment prompts or emphasis in instruction, students are not
indicating an adequate degree of skills in applying their learning,
synthesis or analysis of their learning or evaluation skills. Even though
we made an improvement in this area, further study of this issue will
be a part of the program assessment in the academic year FA07SP08.
Based on analysis of SP07 data, we will make the following
modifications for Fall 2007:
Thomas - Compare the Spring 2007 and Fall 2007 results. Review
and change some of the questions in the artifacts collected in EDU
290.
Janel – EDU 238. Will continue as is. Ben – EDU 292. Consider
dropping 2.3. Revisit this in December 2007. Review some of the
interview questions. Amelia – EDU 111. Focus more on higher level
critical thinking at evaluation. EDU 240 –Just added. Continue as is.
Program
Outcomes
Program Assessment
Measures & Criteria
Program Assessment
Results/Data
Program Assessment
Results/Data
Program Matrix attached indicates types of student artifacts collected.
Goal 2. Students will become educators of Navajo students.
With reviewers aware of the content knowledge expected based an artifact’s prompts stimulating student responses, the following
criteria were used to assess student learning:
2.1 Students know
Navajo Nation
Schools and
communities.
2.2 Students know
Navajo students and
their families.
2.3 Students commit
herself/himself to be
an advocate for
quality education.
EF: Do students show
effective engagement when
expressing feelings related
to the three outcomes for
Goal 2?
EF Program data shows
EF: Program aggregated data for students’ expression of feelings
that 91% of reviewer findings
indicate students are
successfully expressing
their feelings in regards to
Goal 2.
as they articulate knowledge of Navajo schools, communities and
children and see themselves as advocates, indicates we are
appropriately using assessment prompts to elicit student responses and
that their responses indicate they have the skills to successfully
express their feelings regarding what it means to be a teacher. We
need to continue to study this area but our first priority is to better
understand the critical thinking element of our assessment of student
learning.
CT: Do students show
effective engagement in
different levels of critical
thinking skills related to the
three outcomes for Goal 2?
CT: Program data shows
CT: Program aggregated data for critical thinking indicates that
that 64% of reviewer findings
indicate students are
successfully demonstrating
critical thinking skills in
regards to Goal 2. A deeper
analysis of the data indicate:
•
•
•
•
•
EE07ResultsReformat092407.doc
90% Knowledge
83% Compreh/Underst
64% Application
50% Analy and/or Synth
33% Evaluative
while students are providing information regarding knowledge and
understanding of the concepts in Goal 2, through inadequate
assessment prompts or emphasis in instruction, students are not
indicating an adequate degree of skills in applying their learning,
synthesis or analysis of their learning or evaluation skills when the
subject matter addresses Goal 2 outcomes. Even though we made an
improvement in this area, further study of this issue will be a part of the
program assessment in the academic year FA07SP08.
Program
Outcomes
Program Assessment
Measures & Criteria
Program Assessment
Results/Data
Program Assessment Recommendations
(Closing the Loop)
Program Matrix attached indicates types of student artifacts collected.
1.1 Students express
a philosophy of
Education
1.2 Students know
what schools and
education systems
are.
Overall Assessment of Students’ Communication Skills when
addressing Program Outcomes for Program Goals 1 & 2
CS: Do students show
CS: Program aggregated communication skills data indicates that
CS: Program data shows
effective everyday
communication skills and
college-level
communication skills as
they articulate information
related to Goals 1 & 2?
1.3 Students show
beginning skills and
knowledge that are
used in a learning
environment.
1.4 Students have
skills to participate in
rich, professional,
critical talk
2.1 Students know
Navajo Nation Schools
and communities.
2.2 Students know
Navajo students and
their families.
2.3 Students commit
herself/himself to be
an advocate for quality
education.
EE07ResultsReformat092407.doc
that 82% of reviewer findings
indicate students are
successfully demonstrating
communication skills in
both Goal 1&2. A deeper
analysis of the data indicate:
• 86% Everyday Comm
• 78% College-level Comm
Style
• 83% College-level
grammar
we are exceeding our initial milestone of 50% by 32% (82%). We
need to continue efforts reflecting effective student output but
concentrate our efforts first on understanding how students are
showing learning through critical thinking
Overall program assessment decisions:
o Modify assessment instrument and process for rating artifacts so calculations are made easier
o Merge synthesis and analysis as normally only one or the other is reflected in an artifact.
o Communication skills criteria for both goal 1&2 are combined.
o Consider other ways to tap into program evaluation such as surveys.
EDU
111
EDU
238
EDU
290
EDU
292
EDU
240
Philosophy
Stmt
Final
N
N
Final
N
Final
Materials
Critique
Interview
N
1.3 Student has beginning skills and knowledge that are used in a learning
environment.
Philosophy
Stmt
Final
Materials
Critique
Interview
N
1.4 Student can participate in rich professional, critical talk.
Philosophy
Stmt
Final
N
N
N
Philosophy
Stmt
Final
N
Interview
Final
N
N
N
Interview
Final
Philosophy
Stmt
Final
Materials
Critique
Interview
Final
Elementary Education Associate of Arts Program Matrix
Goal 1. Students will articulate what it means to be a teacher.
1.1 Student will able to express her/his own philosophy of education.
1.2 Student knows what schools and education systems are.
Goal 2. Students will become educators of Navajo students.
2.1 Student knows Navajo Nation schools and communities.
2.2 Student knows Navajo students and their families.
2.3 Commits herself/himself to be an advocate for quality education.
EE07ResultsReformat092407.doc