Central Washington University

advertisement
Central Washington University
Assessment of Student Learning
Department and Program Report
Academic Year of Report: 2012-2013
College: CEPS
Department: NEHS
Program: Food Science and Nutrition: BS Food Science and Nutrition
What student learning outcomes were assessed this year, and why?
Our program assessed one student learning outcome this year.
1. Program graduates will be able to conduct a research study complete with a proposal,
data collection, statistical analysis, manuscript preparation, and poster presentation.
This learning outcome goal is related to University Goals I. It is also related to CEPS
Goal 1: Provide for an outstanding and professional growth experience for students.
This learning outcome goal was chosen because of the importance of graduates to
properly interpret published research when they become practitioners in their field. The
demonstrated ability by program graduates to conduct a basic research project and
effectively communicate their findings significantly contributes to this ability to interpret
published research.
How were these student learning outcomes assessed?
1. The program goal “Program graduates will be able to conduct a research study complete
with a proposal, data collection, statistical analysis, manuscript preparation, and poster
presentation” was evaluated by their participation in a food research project started in
NUTR 440: Experimental Foods and completed in NUTR 445: Experimental Foods
Research. The major outcome products of this food research project was a manuscript
prepared to meet the author guidelines for publication in the Journal of the Academy of
Nutrition and Dietetics and a poster suitable for presentation at the annual meeting of the
Academy of Nutrition and Dietetics (Food and Nutrition Conference and Expo). This
learning outcome was assessed using the following tools:
a. Scores from the evaluation of their research manuscripts were assessed. The
evaluation was done independently by the instructor and in blind evaluation by
three students in the class. Students from NUTR 445 from winter 2013 were
included in this assessment.
b. Scores from the evaluation of the poster presentations were assessed by NUTR
faculty other than the course instructor. This allowed an unbiased evaluation of
the quality of the poster presentation as well as an assessment of the quality of
the research conducted. Students from NUTR 445 from winter 2013 were
included in this assessment.
c. Selected items that were related to the research project from SEOI’s from the
winter 2013 were assessed.
d. Laboratory report scores were assessed (NUTR 440: Experimental Foods). The
purpose of including this assessment was to determine if scientific report writing
improved over time. The instructor provided substantial feedback on both writing
quality and the critical thinking that was involved in writing the results and
discussion sections.
e. Surveying Dietetic Internship Directors who work with our graduates in a 1000+
hour ACEND accredited supervised practice. The survey was administered in
the fall of 2012 and was completed by 19 DI Directors. These directors were
asked about how well our graduates were able to demonstrate an ability to
critically evaluate nutrition research and literature.
What was learned?
1. Program graduates will be able to conduct a research study complete with a proposal,
data collection, statistical analysis, manuscript preparation, and poster presentation.
a. Manuscript scores: Students in NUTR 445 did well on their research projects as
evidenced by the 100% passing grade (>70%) on the manuscript and poster
presentation (Table 1). The evaluation rubric for the manuscript evaluated each
paper for accuracy in following Guidelines for Authors of Research Briefs for the
Journal of the Academy of Nutrition and Dietetics, the clarity of the abstract, the
quality of the construction of the tables/figures, the clarity and accuracy of
describing of the methods used, the clarity and insightfulness of the results,
discussion, and conclusion sections, the overall quality of the writing, and the
design of the research. The manuscripts were evaluated by the course instructor
as well as by three peers (in a blind review process). Student evaluations were
typically higher than those given by the instructor.
b. Poster presentation scores: The evaluation rubric for the poster presentation
included an evaluation of the overall appearance of the poster, the quality and
clarity of the tables/figures, the clarity and organization of the written content, and
the clarity of the students’ oral presentation of their research. The evaluation of
the posters was done by fellow faculty members who were not familiar with the
specific research projects prior to viewing the posters. Table 1 below gives the
number of students in each level of competency for the manuscript and poster
presentations. Evaluation by the NUTR faculty indicated a high degree of quality.
Table 1
Below Expectations (<70%)
Met Expectations (70-79%)
Exceeded Expectations (80-89%)
Greatly Exceeded Expectations (90-100%)
Total
Research
Manuscript
Instructor
Peer
0
0
13
6
24
23
15
23
52
52
Poster
Presentation
0
3
19
30
52
c. Student Evaluation of Instruction: SEOI scores indicated that the students were
intellectually challenged, the course required a high amount of effort for one to
succeed, and a high degree of involvement in the course (Table 2). These
scores were substantially higher than the mean scores for the department,
college or university. The high degree of challenge, effort and involvement may
have contributed to the relatively lower overall rating of the course, particularly to
the mean of the department.
Table 2
SEOI
Course
Dept.
Course activities challenged students to think critically
4.52
4.50
Amount of work outside of class
4.48
3.29
Intellectual challenge presented to you
4.04
3.52
Course as a whole
4.09
4.44
d. Laboratory report grades. One of the goals of the laboratory reports was to
improve student writing quality using language and style appropriate for the
discipline. The instructor provided significant amounts of feedback for the first
two lab reports. The feedback was not only on grammar, style, and clarity, but
included comments regarding whether the students critically discussed their
research findings. The mean scores for lab reports 1, 2, and 3 were 82%, 92%,
and 90%, respectively. This continual improvement confirmed the success of the
instructor’s comments and better prepared the students to write their research
manuscripts.
e. Dietetic Internship Directors Survey. The survey was administered to 19 DI
Directors and we had a 52% response rate. On a 5 point scale (1=poorly
prepared, 3=average, 5=very well prepared), 83% of the directors scored our
graduates with a score of either 4 or 5 and 100% scored our graduates with at
least an average score.
What will the program do as a result of this information?
1. Program graduates will be able to conduct a research study complete with a proposal,
data collection, statistical analysis, manuscript preparation, and poster presentation.
The program is pleased with the feedback received related to the project. Students
found the research project intellectually challenging and required significant effort on
their part to produce a successful manuscript and poster. The instructor was pleased
with the improvement in the quality of the laboratory reports during the course.
Evaluation by Dietetic Internship Directors of recent graduates supports the continuing
use of this assignment as part of the program’s requirements. As this food research
project requires a significant commitment by students and faculty, it was important to find
that the project is meeting the student learning goal associated with it.
What did the program do in response to the feedback from last year’s assessment
report?
Based on previous SLO assessments, the original one quarter 5 credit Experimental Foods
class was divided into two separate courses offered in the fall (3 cr, NUTR 440) and winter (2 cr,
NUTR 445) beginning in the 2012 academic year. By spreading the research process over a
20-week period, we hoped to improve the quality of the food research as well as the research
experience for the students. We are still assessing whether this has occurred or not and have
implemented some changes to move towards our goals.
Download