2015 - SOA - Assessment Results

advertisement
Darr School of Agriculture Assessment Results for 2014-2015
1) College/School: School of Agriculture
2) Review your student learning outcomes (SLOs). Please update as needed. The outcomes can be found
at http://ag.missouristate.edu/
3) Indicate where your SLOs are published:
X College/School/Major Division website. Provide URL: http://ag.missouristate.edu/ by major
☐ Student handbook. Provide URL, if available online:
☐ Information sheet, flyer, or brochure. Provide URL, if available online:
☐ MSU undergraduate course catalog. Provide page number(s):
☐ MSU graduate course catalog. Provide page number(s):
X Course syllabi. Provide URL, if available online:
☐ Office of Assessment website http://www.missouristate.edu/assessment/plans.htm
☐ Other:
4) For your college/school, the approximate percent of departments that have SLOs explicitly stated on a
website or other publicly available document is as follows:
100%
5) Did your college/school engage in any college assessment activities between July 1, 2014 and June 30,
2015? (e.g., establishing/revising outcomes, aligning the curriculum to outcomes, collecting evidence,
interpreting evidence, using results, revising and assessment plan, setting assessment goals, sharing
assessment results, creating surveys or tests, etc.)?
Yes
No
6) Approximately what percent of departments/programs in your college/school/major division engaged
in assessment activities between July 1, 2014 and June 30, 2015?
100%
Please select a department or program from your college/school/major division to answer the
following questions:
7) For the period of June 1, 2009-June 30, 2015, describe 3-5 examples from a department or program in
which evidence of student learning was used to make changes and/or improve.
The goal of this section is to highlight assessment of student learning. The highlighted program or
department should be different than the one you focused on last year. The story will be highlighted on
the Assessment in Action stories on the Office of Assessment web page.
• Describe one department’s use of student evidence and how they used the evidence to make
changes to a course, program, or experience. “Using the results” can range from A) changes to the
presentation of the material in a course to a faculty meeting or, B) discussion about changes to
minor and major curriculum changes.
• Explain the process of assessment of student learning, evidence that was collected and used, and the
changes made.
The cultural awareness score of the public affairs scale was the lowest score in 2012 and 2013.
Because of this concern, we are highlighting the development of opportunities to increase cultural
competence across the School of Agriculture rather than selecting a specific department within the
school.
The full public affairs scale (40 questions) was given to entering freshman students in GEP 101,
transfer student in the transfer orientation class and the graduating seniors in senior seminar. Mean scores
from Fall 2012 through Fall 2015 are shown below.
During the Fall 2014 faculty from the School of Agriculture discussed in depth the public affairs scale
results and the indications that our incoming students, both freshmen and transfer, appeared to have a
better understanding of both ethical leadership and community engagement than cultural awareness (see
figure 1, 2, and 3 below). A variety of explanations for this were discussed including 1) many of our
students are from rural areas with limited opportunities for cultural experience, and 2) the structure of the
scale, including two questions directly related to travel which are considered by many of the students as
too expensive to pursue. Despite the fact that the lower score was relatively easy to explain, the faculty
and director decided to increase the emphasis on providing students opportunities to experience diverse
populations and cultures.
4.50
4.00
4.12
4.27
4.25
4.04
3.43
3.15
3.50
4.09
3.48
4.41
4.25 4.13
3.25
3.00
2.50
2.00
1.50
1.00
0.50
0.00
FA12-FR
FA13-FR
Community Engagement
FA 14-FR
Cultural Competence
FA 15-FR
Ethical Leadership
Figure 1. Entering Freshman Student Responses to the Public Affairs Scale
5.00
3.80
3.97
4.35
4.13
3.38
4.00
4.15
3.63
3.09 3.25
3.00
2.00
1.00
0.00
Community
Engagement
Cultural Competence
FA 13-TR
FA 14-TR
Ethical Leadership
FA 15-TR
Figure 2. Mean Transfer Student Responses to the Public Affairs Scale 2013-2014
5.00
4.00
3.00
4.35
4.10
3.26
4.25
3.84
3.15
4.30
3.86
3.18
2.00
1.00
0.00
Freshmen (362)
Community Engagement
Transfer (147)
Cultural Competence
Seniors (171)
Ethical Leadership
Figure 3. Mean Freshmen, Transfer and Senior Student Responses to the Public
Affairs Scale
Response: Provide Increased Emphasis on Cultural Awareness Opportunities

The School introduced a Study Abroad panel of agriculture students that had participated in
study away opportunities to the Agriculture GEP course. The second year we also included a
presentation by students visiting from Taiwan as well as including an international student
from Tunisia on the panel. Comments in reflection papers in response to the panels indicated
an increased interest in pursuing study away activities.

The School increased emphasis on travel abroad opportunities as well as development of
educational exchange opportunities for students. Opportunities and participation in study
away activities from 2012-2015 are shown in the table below. Some opportunities were part of
an exchange with another country (*) and others were primarily educational opportunities.
The Haiti opportunity was also a service program. Students and faculty provided instruction to
the communities they visited in Haiti on various agricultural topics.
2010-2013
Location
Faculty Students
Brazil
China
2
3
Ghana
1
Haiti
Italy
Nicaraugua
1
6
Sri Lanka
1
4
Taiwan
1
3*
*indicates exchange program
**indicates a service program
2013-2014
Faculty Students
2
12*
1
6
2
1
2014-2015
Faculty
Students
2
8*
1
7
2
4**
1 Internship
3

Comments expressed in the senior exit survey expressed that cost was a major deterrent to
participation is study away activities. The department committed $7,500 in last year and has
committed an additional $5,000 this year to provide more students this opportunity.

In addition to our students traveling to other countries, students from Taiwan, Brazil, and China
have visited and participated in a variety of educational opportunities.
Dr. Gary Webb and William Boyer
discuss nutritional management
of the performance horse with
both Brazilian and Missouri State
Students at Pinegar Arena.
Instructors Samantha
Warner and Mike Klem
enjoy the sights of Brazil as
well as working with
Brazilian students to better
understand the agriculture
industry in Brazil.

Closer to home, four students participated as counselors for the George Washington Carver
Agriculture Institute each of the last two years. They worked hand-in-hand with inner city
and other high school students to help them understand agriculture and its impact on all of us.

The Ag Ambassadors class has helped prepare and present materials about the Darr School of
Agriculture to students in both rural and metropolitan high schools in Missouri. Working
directly with students from diverse backgrounds helps our students refine their leadership and
service skills as well as increase their exposure to individuals from a variety of backgrounds
and cultures.

In the Agriculture Industry Study course, participating students were asked to rate each of the
statements below on a five point Likert scale from strongly disagree to strongly agree to determine
their perceptions of how the components of the public affairs mission are applied in
agribusinesses.
Pre
Post
Mean
Std.
difference
Deviation
Mean
Std.
Deviation
Mean
Missouri agribusiness
companies engage in
community services
3.66
.653
4.63
.660
0.969
Community engagement by
agricultural business is
necessary for profitability
4.19
.535
4.41
.756
0.219
Agricultural businesses in
Missouri promote cultural
diversity
3.91
.734
4.16
.767
0.250
Missouri agricultural business
invest in training workforce on
cultural sensitivities
3.69
.693
4.44
.759
0.750
Pre
Missouri agricultural business
put societal interests over their
interest while making business
decisions
Missouri agricultural
businesses are likely to hold
themselves accountable in
case of adverse business
situations
Post
Mean
Std.
Deviation
3.41
.756
3.84
.677
Mean
Std.
Deviation
Mean
difference
0.750
4.72
.523
0.875
The means for each of the six questions increased from the pre-test to the post-test. Responses indicate
that students have a better understanding of the importance of cultural awareness, community
engagement, and ethical leadership in the agriculture business workplace following their participation in
the industry study course.
8) State evidence used to indicate how well students achieved those goals: a. Direct measure(s): (could
include a sample of student work analyzed by faculty to find strengths and weaknesses, faculty
observations based on student work, or certificate or licensure exam, test results, etc.)
Student Work-The university exit exam includes student work that was and will continue to be
evaluated. An assessment grant application will be completed to request stipends for faculty
from each unit to review last year’s and next year’s work and report to faculty in the fall.
Public Affairs Scale will continue to be completed in GEP 101 and transfer orientation.
Because the scale is now included in the University exit exam, results will be requested and
comparisons made to previous years will be used to assess the effectiveness of program changes
implemented.
b. Indirect measure(s): (student surveys, focus groups, exit interviews, alumni surveys and
feedback, employer surveys, course evaluations, NSSE, University Exit Exam, etc.)
The Senior Exit Survey will continue to be administered in Senior Seminar. Results will be
compiled. Results will continue to be discussed annually to identify strengths, weaknesses,
opportunities and threats.
Feedback from students, alumni and employers will provide additional information to assist in
program revisions and development.
9) Who interpreted or analyzed the evidence that was collected? (Check all that apply.)
☐ Course instructor(s)
☒ Faculty committee
☐ Ad hoc faculty group
☐ Department chairperson
X Persons or organization outside the university – a program review was completed Fall 2015.
☐ Faculty advisor
☐ Staff advisor (e.g., from student support services)
☐ Students (graduate or undergraduate)
☒ Dean/Director
☐ Other:
10) How did they evaluate, analyze, or interpret the evidence? (Check all that apply.)
X Used a rubric or scoring guide—rubric developed for QIP in Public Affairs
X Scored exams/tests/quizzes
☒ Used professional judgment (no rubric or scoring guide used)—faculty discussions
☒ Compiled survey results
☒ Used qualitative methods on interview, focus group, open-ended response data
☐ External organization/person analyzed data (e.g., external organization administered and scored
the nursing licensing exam)
☐ Other:
11) Beyond the results, state additional conclusions or discoveries. This can include insights about
assessment procedures, teaching and learning, program aspects, etc.

During discussions in faculty and unit meetings a concern for the inability of students to
perform basic agriculture calculations was voiced. As a response a new instructor has worked
with faculty members in each unit to identify problem areas. Faculty members provided
example questions and an evaluation instrument was developed. Students in the Agriculture
GEP sections, transfer orientation class, several lower and upper level animal and plant
science courses. Results will be evaluated and a plan for supplemental instruction and/or
additional support for students scoring poorly (60 percent or below) will be developed. Partial
results are show in figures below.
Percent Correct
>80%
70%-80%
60%-70%
50%-60%
50% <
Animal Science Labs
31
22
11
12
0
GEP
24
14
14
16
7
AGN 335
31
8
6
3
4
Total
86
44
31
31
11

Exit Survey Results indicate a continued interest in for more hands-on learning opportunities.
In response an additional instructor has been hired to facilitate animal science labs and
increase the emphasis on hands on activities. The two additional animal science, two
additional plant science, a new instructor in the agriculture communications, a faculty member
in forestry and an additional faculty member in agriculture business will provide the school
the manpower and flexibility to develop critical course offerings and hands-on activities.
Graduate Students have been increasingly utilized in the laboratory setting to enhance handson learning activities. The most current are listed below. Students working in many of these
lab settings are also being provided an opportunity to develop their cultural awareness.
Supervisor
Chin-Feng Wang
Wenping Qui
Melissa Remley
Gary Webb
Mike Klem

Courses
AGN 495/730
Graduate Students
Surya Sapkota
Xu Chen
Pragya Adhikara
Mia Mann
Brigette Williams
Logan Duncan
AGP 496
Ru Dai
Michael Kovens
Sylvia Peterson
AGN 104
Cheyenne Arthur
Dakota Arthur
AGN 215 & 216
Cheyenne Arthur
Dakota Arthur
AGN 405
Cheyenne Arthur
AGS 162, 161, 191 Daniel Potter
Will Boyer
AGS 162, 161, 191, Cassie O’Hara
163, 263, 164, 264
AGS 452
Cheyenne Arthur
Dakota Arthur
Semester
Fall 2012, 2013
Fall 2013
Fall 2013
Fall 2014, Fall 2015
Fall 2015
Fall 2015
Fall 2014 and F2015
Fall 2014
Fall 2015
F & SP 2014, SP 2015
F & SP 2014, SP 2015
SP 14, FA 14, FA 15,
SP 15
SP 15
FA13, SP 14, FA 14,
SP 15
FA 14, SP 15, SU 15
SP 14, SP 15
SP 14, SP 15
Exit Survey Results indicated a need for a Career Fair opportunity exclusively for agriculture
students.
Fall 2014 the Darr School of Agriculture Career Fair was initiated. Six businesses
participated in a two day event which provided the opportunity for the business
representatives to meet with students in the classroom setting, with faculty and club presidents
at an informal dinner setting and in the actual career fair setting. This year the fair has grown
to 18 businesses and an interview day will be added the day after the fair for businesses
interested in hiring for positions or internships at that time.
The exit survey will continue to be one measure of student interest in curricular and service
enhancements.

Pre-post testing is being reconsidered at the measurement for student learning. The point of
consideration is whether this type of testing is the most effective measure of student learning
because it measures retention of information immediately after it was presented. The pre-post
testing results available are shown in the table below.
Class
AGS 399
AGS 461
AGP 103
Pre-test
Score
4.6
Pre-test
Percent
13
41
41
Pre-test
Range
4-32%
28-74
Post-test
score
22.6
Post-test
Percent
65
74
66
Post-test
Range
39-77%
55-82%
Faculty members in both plant and animal sciences are developing questions for an exit test
that students will be asked to complete on-line prior to graduation. The objective is to better
determine the overall retention of information at the time of program completion addressed in
the student learning outcomes of the programs and Darr School of Agriculture.
Download