Program Assessment Plan American University CAS: Anthropology - PhD

advertisement
Program Assessment Plan
American University
CAS: Anthropology - PhD
CAS: Anthropology - PhD
Contact Person for Dolores Koenig
Assessment:
Primary Department: Anthropology
Learning Outcome: Theory
Students graduating with a PhD in Anthropology will be able to demonstrate familiarity with the major arguments shaping the classic and contemporary debates in anthropological theory, and in the
particular area of anthropology of interest to each student's dissertation project.
Outcome Year: 2012 or prior
2012-2013
2013-2014
2014-2015
Start Date: 04/01/2009
Outcome Status: Active Learning Outcome
Assessment Plan
Assessment Method
12/01/2014 2:45 PM
Target
Generated by TracDat a product of Nuventive.
Schedule/Cycle
Page 1 of 8
Active
Assessment Plan
Assessment Method
Target
Schedule/Cycle
Active
Evaluation of the third written doctoral program comprehensive examination. Students No target set:
write this comp during their last year of doctoral coursework and often during their last Since we have not yet implemented this
semester of course work. For most of our doctoral students, this is a watershed moment measure, we need to see the overall profile
in their doctoral study: They have completed all (or almost all) of their course work and of the student scores for each learning
are beginning to write their dissertation proposal. The third comprehensive exam, usually outcome, before making further statements
a literature review on a topic related to the dissertation project, bridges the gap between about implications of outcome.
classroom's supervised study and the independent work which the dissertation requires.
This position makes the third comprehensive exam an especially appropriate resource for
purposes of program assessment.
We expect that a review of aggregate scores will allow faculty to set criteria defining
effective levels of performance on each learning outcome, e.g. How many students
satisfied the expectations of each learning outcome with an aggregate score of 3.0 or
better? Was the mean aggregate score for the student cohort higher or lower than the
idealized (3.0) mean?
An individual student's performance can then be tabulated, in comparison to the other
students, and the student cohort as a whole, in terms of such measures.
Additionally, constructing these aggregate values allows us to propose improvements in
the academic component of the PhD program. If, for example, the aggregate scores for
one of the learning outcomes is far lower than the aggregate score for the other learning
outcome is far lower than the aggregate score for the other learning outcomes, we may
infer that students are not as familiar with the academic content associated with the
learning outcome. (There many be other reasons for the lower scores, of course, and
those reasons need to be explored.) We need to review the courses in the PhD curriculum
where the outcome-related academic content is addressed and, as appropriate, propose
changes in the syllabus/ lesson plans in those courses to ensure that students are receiving
appropriate instruction.
The third comp is evaluated by two readers with each reader assigning the portfolio a 1-5
score (1-minimal evidence that outcome has been met; 5--ample evidence that outcome
has been met) for each learning outcome. Reader scores will be averaged to obtain an
aggregate scoring for each outcome.
Measure Type:
Quiz/ Exam
Third Comp is offered each semester. The Yes
readers will be the student's advisor and one
other member of the faculty familiar with
the student's indicated subject area.
Meeting between PhD students and members of the department's Graduate Studies
Committee to discuss the extent to which learning outcomes have been met.
Student concerns provide focus for course selection and other curricular modification,
and suggest areas of unmet instructional need to be addressed through adjunct
appointments or new faculty hiring.
Measure Type:
Focus Group
Each semester.
No target identified.
This year, the anthropology department had a bumper crop of doctoral graduates, 10
n/a
students who received their degrees in August, December, and May 2013. Thus, the
Graduate Studies Committee created a questionnaire about the doctoral program based
on our learning objectives.
The Intellectual Development part of the questionnaire responded especially to the
Learning Objectives of Theory, Inquiry, Praxis-3, and Communication. The Public
Anthropology Section of the questionnaire looked at Communication, and Praxis-1,-2,
and -3. The Other section of the questionnaire allowed students to comment on any of the
learning objectives.
Measure Type:
Survey
12/01/2014 2:45 PM
Generated by TracDat a product of Nuventive.
Yes
Yes
Page 2 of 8
Learning Outcome: Communication
Students graduating with a PhD in Anthropology will be able to construct effective presentations of findings from research projects in written, oral, and visual media formats.
Outcome Year: 2012 or prior
2012-2013
2013-2014
2014-2015
Start Date: 04/01/2009
Outcome Status: Active Learning Outcome
Assessment Plan
Assessment Method
Target
Schedule/Cycle
Active
Evaluation of the third written doctoral program comprehensive examination. Students No target set:
write this comp during their last year of doctoral coursework and often during their last Since we have not yet implemented this
semester of course work. For most of our doctoral students, this is a watershed moment measure, we need to see the overall profile
in their doctoral study: They have completed all (or almost all) of their course work and of the student scores for each learning
are beginning to write their dissertation proposal. The third comprehensive exam, usually outcome, before making further statements
a literature review on a topic related to the dissertation project, bridges the gap between about implications of outcome.
classroom's supervised study and the independent work which the dissertation requires.
This position makes the third comprehensive exam an especially appropriate resource for
purposes of program assessment.
We expect that a review of aggregate scores will allow faculty to set criteria defining
effective levels of performance on each learning outcome, e.g. How many students
satisfied the expectations of each learning outcome with an aggregate score of 3.0 or
better? Was the mean aggregate score for the student cohort higher or lower than the
idealized (3.0) mean?
An individual student's performance can then be tabulated, in comparison to the other
students, and the student cohort as a whole, in terms of such measures.
Additionally, constructing these aggregate values allows us to propose improvements in
the academic component of the PhD program. If, for example, the aggregate scores for
one of the learning outcomes is far lower than the aggregate score for the other learning
outcome is far lower than the aggregate score for the other learning outcomes, we may
infer that students are not as familiar with the academic content associated with the
learning outcome. (There many be other reasons for the lower scores, of course, and
those reasons need to be explored.) We need to review the courses in the PhD curriculum
where the outcome-related academic content is addressed and, as appropriate, propose
changes in the syllabus/ lesson plans in those courses to ensure that students are receiving
appropriate instruction.
The third comp is evaluated by two readers with each reader assigning the portfolio a 1-5
score (1-minimal evidence that outcome has been met; 5--ample evidence that outcome
has been met) for each learning outcome. Reader scores will be averaged to obtain an
aggregate scoring for each outcome.
Measure Type:
Quiz/ Exam
Third Comp is offered each semester. The Yes
readers will be the student's advisor and one
other member of the faculty familiar with
the student's indicated subject area.
Meeting between PhD students and members of the department's Graduate Studies
Committee to discuss the extent to which learning outcomes have been met.
Student concerns provide focus for course selection and other curricular modification,
and suggest areas of unmet instructional need to be addressed through adjunct
appointments or new faculty hiring.
Measure Type:
Focus Group
Each semester.
12/01/2014 2:45 PM
No target identified.
Generated by TracDat a product of Nuventive.
Page 3 of 8
Yes
Assessment Plan
Assessment Method
Target
Schedule/Cycle
This year, the anthropology department had a bumper crop of doctoral graduates, 10
n/a
students who received their degrees in August, December, and May 2013. Thus, the
Graduate Studies Committee created a questionnaire about the doctoral program based
on our learning objectives.
The Intellectual Development part of the questionnaire responded especially to the
Learning Objectives of Theory, Inquiry, Praxis-3, and Communication. The Public
Anthropology Section of the questionnaire looked at Communication, and Praxis-1,-2,
and -3. The Other section of the questionnaire allowed students to comment on any of the
learning objectives.
Measure Type:
Survey
Active
Yes
Learning Outcome: Praxis
Students graduating with a PhD in Anthropology will be able to apply research findings to critical issues in contemporary society.
Outcome Year: 2012 or prior
2012-2013
2013-2014
2014-2015
Start Date: 04/01/2009
Outcome Status: Active Learning Outcome
Assessment Plan
Assessment Method
12/01/2014 2:45 PM
Target
Generated by TracDat a product of Nuventive.
Schedule/Cycle
Page 4 of 8
Active
Assessment Plan
Assessment Method
Target
Schedule/Cycle
Active
Evaluation of the third written doctoral program comprehensive examination. Students No target set:
write this comp during their last year of doctoral coursework and often during their last Since we have not yet implemented this
semester of course work. For most of our doctoral students, this is a watershed moment measure, we need to see the overall profile
in their doctoral study: They have completed all (or almost all) of their course work and of the student scores for each learning
are beginning to write their dissertation proposal. The third comprehensive exam, usually outcome, before making further statements
a literature review on a topic related to the dissertation project, bridges the gap between about implications of outcome.
classroom's supervised study and the independent work which the dissertation requires.
This position makes the third comprehensive exam an especially appropriate resource for
purposes of program assessment.
We expect that a review of aggregate scores will allow faculty to set criteria defining
effective levels of performance on each learning outcome, e.g. How many students
satisfied the expectations of each learning outcome with an aggregate score of 3.0 or
better? Was the mean aggregate score for the student cohort higher or lower than the
idealized (3.0) mean?
An individual student's performance can then be tabulated, in comparison to the other
students, and the student cohort as a whole, in terms of such measures.
Additionally, constructing these aggregate values allows us to propose improvements in
the academic component of the PhD program. If, for example, the aggregate scores for
one of the learning outcomes is far lower than the aggregate score for the other learning
outcome is far lower than the aggregate score for the other learning outcomes, we may
infer that students are not as familiar with the academic content associated with the
learning outcome. (There many be other reasons for the lower scores, of course, and
those reasons need to be explored.) We need to review the courses in the PhD curriculum
where the outcome-related academic content is addressed and, as appropriate, propose
changes in the syllabus/ lesson plans in those courses to ensure that students are receiving
appropriate instruction.
The third comp is evaluated by two readers with each reader assigning the portfolio a 1-5
score (1-minimal evidence that outcome has been met; 5--ample evidence that outcome
has been met) for each learning outcome. Reader scores will be averaged to obtain an
aggregate scoring for each outcome.
Measure Type:
Quiz/ Exam
Third Comp is offered each semester. The Yes
readers will be the student's advisor and one
other member of the faculty familiar with
the student's indicated subject area.
Meeting between PhD students and members of the department's Graduate Studies
Committee to discuss the extent to which learning outcomes have been met.
Student concerns provide focus for course selection and other curricular modification,
and suggest areas of unmet instructional need to be addressed through adjunct
appointments or new faculty hiring.
Measure Type:
Focus Group
Each semester.
No target identified.
This year, the anthropology department had a bumper crop of doctoral graduates, 10
n/a
students who received their degrees in August, December, and May 2013. Thus, the
Graduate Studies Committee created a questionnaire about the doctoral program based
on our learning objectives.
The Intellectual Development part of the questionnaire responded especially to the
Learning Objectives of Theory, Inquiry, Praxis-3, and Communication. The Public
Anthropology Section of the questionnaire looked at Communication, and Praxis-1,-2,
and -3. The Other section of the questionnaire allowed students to comment on any of the
learning objectives.
Measure Type:
Survey
12/01/2014 2:45 PM
Generated by TracDat a product of Nuventive.
Yes
Yes
Page 5 of 8
Learning Outcome: Inquiry
Students graduating with a PhD in Anthropology will be able to use key ideas from those debates to develop problem statements, plans for data-gathering and data-analysis, and statements of conclusion/
implications relevant to the student's research interest in archaeology or social-cultural anthropology.
Outcome Year: 2012 or prior
2012-2013
2013-2014
2014-2015
Start Date: 04/01/2009
Outcome Status: Active Learning Outcome
Assessment Plan
Assessment Method
Target
Schedule/Cycle
Active
Evaluation of the third written doctoral program comprehensive examination. Students No target set:
write this comp during their last year of doctoral coursework and often during their last Since we have not yet implemented this
semester of course work. For most of our doctoral students, this is a watershed moment measure, we need to see the overall profile
in their doctoral study: They have completed all (or almost all) of their course work and of the student scores for each learning
are beginning to write their dissertation proposal. The third comprehensive exam, usually outcome, before making further statements
a literature review on a topic related to the dissertation project, bridges the gap between about implications of outcome.
classroom's supervised study and the independent work which the dissertation requires.
This position makes the third comprehensive exam an especially appropriate resource for
purposes of program assessment.
We expect that a review of aggregate scores will allow faculty to set criteria defining
effective levels of performance on each learning outcome, e.g. How many students
satisfied the expectations of each learning outcome with an aggregate score of 3.0 or
better? Was the mean aggregate score for the student cohort higher or lower than the
idealized (3.0) mean?
An individual student's performance can then be tabulated, in comparison to the other
students, and the student cohort as a whole, in terms of such measures.
Additionally, constructing these aggregate values allows us to propose improvements in
the academic component of the PhD program. If, for example, the aggregate scores for
one of the learning outcomes is far lower than the aggregate score for the other learning
outcome is far lower than the aggregate score for the other learning outcomes, we may
infer that students are not as familiar with the academic content associated with the
learning outcome. (There many be other reasons for the lower scores, of course, and
those reasons need to be explored.) We need to review the courses in the PhD curriculum
where the outcome-related academic content is addressed and, as appropriate, propose
changes in the syllabus/ lesson plans in those courses to ensure that students are receiving
appropriate instruction.
The third comp is evaluated by two readers with each reader assigning the portfolio a 1-5
score (1-minimal evidence that outcome has been met; 5--ample evidence that outcome
has been met) for each learning outcome. Reader scores will be averaged to obtain an
aggregate scoring for each outcome.
Measure Type:
Quiz/ Exam
Third Comp is offered each semester. The Yes
readers will be the student's advisor and one
other member of the faculty familiar with
the student's indicated subject area.
Meeting between PhD students and members of the department's Graduate Studies
Committee to discuss the extent to which learning outcomes have been met.
Student concerns provide focus for course selection and other curricular modification,
and suggest areas of unmet instructional need to be addressed through adjunct
appointments or new faculty hiring.
Measure Type:
Focus Group
Each semester.
12/01/2014 2:45 PM
No target identified.
Generated by TracDat a product of Nuventive.
Page 6 of 8
Yes
Assessment Plan
Assessment Method
Target
Schedule/Cycle
This year, the anthropology department had a bumper crop of doctoral graduates, 10
n/a
students who received their degrees in August, December, and May 2013. Thus, the
Graduate Studies Committee created a questionnaire about the doctoral program based
on our learning objectives.
No part of the survey was designed specifically to assess Inquiry. However, a section of
the survey labeled "Other" allowed students to comment on any of the learning
objectives.
Measure Type:
Survey
Active
Yes
Learning Outcome: Praxis-2
Improvement in intellectual skills, to create the groundwork for a successful career in anthropology.
Outcome Year: 2012-2013
2013-2014
2014-2015
Outcome Status: Active Learning Outcome
Assessment Plan
Assessment Method
Target
Schedule/Cycle
This year, the anthropology department had a bumper crop of doctoral graduates, 10
n/a
students who received their degrees in August, December, and May 2013. Thus, the
Graduate Studies Committee created a questionnaire about the doctoral program based
on our learning objectives.
The Intellectual Development part of the questionnaire responded especially to the
Learning Objectives of Theory, Inquiry, Praxis-3, and Communication. The Public
Anthropology Section of the questionnaire looked at Communication, and Praxis-1,-2,
and -3. The Other section of the questionnaire allowed students to comment on any of the
learning objectives.
Measure Type:
Survey
Active
Yes
Learning Outcome: Praxis-3
Improvement in practical skills, to create the groundwork for a successful career in anthropology.
Outcome Year: 2012 or prior
2012-2013
2013-2014
2014-2015
Outcome Status: Active Learning Outcome
Assessment Plan
Assessment Method
12/01/2014 2:45 PM
Target
Generated by TracDat a product of Nuventive.
Schedule/Cycle
Page 7 of 8
Active
Assessment Plan
Assessment Method
Target
Schedule/Cycle
This year, the anthropology department had a bumper crop of doctoral graduates, 10
n/a
students who received their degrees in August, December, and May 2013. Thus, the
Graduate Studies Committee created a questionnaire about the doctoral program based
on our learning objectives.
The Intellectual Development part of the questionnaire responded especially to the
Learning Objectives of Theory, Inquiry, Praxis-3, and Communication. The Public
Anthropology Section of the questionnaire looked at Communication, and Praxis-1,-2,
and -3. The Other section of the questionnaire allowed students to comment on any of the
learning objectives.
Measure Type:
Survey
12/01/2014 2:45 PM
Generated by TracDat a product of Nuventive.
Active
Yes
Page 8 of 8
Download