DEGREE OF SATISFACTION - University of Central Missouri

advertisement
University of Central Missouri
NOEL-LEVITZ STUDENT SATISFACTION INVENTORY (SSI)
SPRING 2009 STUDENT SATISFACTION SURVEY
RESULTS
Prepared by:
The Office of Institutional Research
University of Central Missouri
Warrensburg, MO 64093
May 2009
Spring 2009 Student Satisfaction Survey
Introduction
The Noel-Levitz Student Satisfaction Survey was administered to a sample of UCM undergraduate
students during the spring semester of 2009. The survey measures students’ satisfaction with a broad
spectrum of college experiences. The major tenet of the survey is that satisfaction with college
occurs when an expectation is met or exceeded by an institution. With this caveat in mind, students
rate each item in the inventory by the importance of the specific expectation as well as their
satisfaction with how well that expectation is being met. A performance gap is then determined by
the difference in the importance rating and the satisfaction rating.
The Student Satisfaction Inventory (SSI) is a very reliable instrument. According to Noel-Levitz,
both the two-year and four-year versions of the SSI show exceptionally high internal reliability.
Cronbach’s coefficient alpha is .97 for the set of importance scores and .98 for the set of satisfaction
scores. This report presents the results of the spring 2009 Noel-Levitz Student Satisfaction Inventory
survey at UCM.
Survey Methodology
During the spring 2009 semester, a sample of UCM students completed the Noel-Levitz
Student Satisfaction Inventory Survey. The survey was administered to students in randomly
selected on-campus credit course sections. Class instructors assisted by distributing and
collecting the questionnaires. Extended-campus students were not included in the survey
because the survey mostly evaluates on-campus services. A total of 1,700 surveys were
returned.
The results of the survey were tabulated by Noel-Levitz and benchmarked against responses
from a national sample of four-year public university students. Cross-tabulation analyses
were carried out by the Office of Institutional Research.
Characteristics of Respondents
More than half (57%) of the respondents were female. An overwhelming majority were fulltime students (93%). Eighty-two percent of the sample reported that they were Caucasian,
7% were African American and the remaining 11% belonged to other ethnic groups. The
vast majority of respondents (84%) were less than 25 years of age. Just about all sample
students were enrolled primarily in day courses (94%). Sixty-six percent of respondents were
employed at the time of the survey.
1
Respondents varied by class level: Freshman (23%), sophomore (20%), junior (26%), senior
(27%), and others (4%). About 38% of respondents resided in residence hall, 4% resided in
fraternity/sorority houses, 8% resided with their parents,14% resided in own home, 34%
rented a room or apartment off campus and other form of accommodation (2%).
About 66% of the respondents reported a cumulative GPA of 3.0 or higher at the time of the
study. With respect to respondents’ educational goal, about seven out of 10 respondents
(72%) intended to obtain a bachelor’s degree. Sixty-seven percent of the sample members
reported that UCM was their “first” choice of institution. Another 25% reported that UCM
was their “second” choice, and 8% indicated it was their “third” choice or lower. Overall, the
demographic characteristics of the survey samples were representative of the student body.
Measurement
The Noel-Levitz instrument provides a dual rating system for measuring student expectations.
Students rate each item in the inventory on a 1-7 scale by its importance of the specific
expectation as well as their satisfaction with how well that expectation is being met.
Important score ratings depict how strongly students feel about the expectation (the higher
the score, the more important it is to a student, hence the stronger the expectation).
Satisfaction ratings show how satisfied students are that UCM has met the expectation (the
higher the mean score, the more satisfied the students).
Importance Scale
Satisfaction Scale
7 = very important
6 = important
5 = somewhat important
4 = neutral
3 = somewhat unimportant
2 = not very important
1 = not important at all
7 = very satisfied
6 = satisfied
5 = somewhat satisfied
4 = neutral
3 = somewhat dissatisfied
2 = not very satisfied
1 = not satisfied at all
A mean score is obtained by dividing the total of all the scores on each item by the number
of individual cases involved. Means for importance and satisfaction are calculated by
summing respondents’ rating and dividing by the number of respondents.
Standard deviations are computed to show variability in the responses. The larger the
standard deviation, the greater the variability (with some students being very satisfied and
some students being very dissatisfied). The smaller the standard deviation the less variability
in the responses. Cross-tabulation analyses across target groups (e.g., class level, gender, race,
employment status, residence status, etc.) are performed on items with high variability.
2
A performance gap is determined by measuring the difference between importance ratings
and satisfaction ratings. Items with a large performance gap score (e.g., 1.50 or higher)
indicate that UCM is not meeting students’ expectations in those areas, whereas a small or
zero gap score (e.g., .50) indicates that UCM is meeting students’ expectations.
In addition to the three areas of measurement for each scale and item – importance,
satisfaction and performance gap – Noel-Levitz compared UCM data with the responses of
students from other four-year public institutions who took the SSI between fall 2008 and
spring 2009. Standard deviations are presented for the satisfaction means for both UCM and
the national group.
Matrix for Prioritizing Action
The matrix showed on page 5 helps us to identify areas where resources can be redirected from
areas of low expectation to areas of high expectation. The matrix can be used to align
university and student priorities and guide university strategic planning initiatives. For example,
items on the SSI that fall into quadrant 1 need immediate attention in terms of human and
financial resources, whereas items that fall into quadrant 2 pinpoint areas of strength that
should be used to market the university to prospective students and parents, alumni and donors.
Quadrant 3 signifies areas where it could be beneficial to direct human or financial resources
to quadrant 1. Lastly, quadrant 4 identifies areas that are least important to students.

Quadrant 1 – High Importance/low satisfaction pinpoints areas in need of
immediate attention.

Quadrant 2 – High Importance/high satisfaction showcases areas of strength that
should be highlighted.

Quadrant 3 – Low importance/high satisfaction suggests areas where it could be
beneficial to redirect resources to areas of higher importance.

Quadrant 4 – Low importance/low satisfaction presents an opportunity to examine
those areas that have low status with students.
3
The illustration below attempts to display this conceptual framework geographically.
Very
Important
1
2
Very
Dissatisfied
Very
Satisfied
4
3
Very
Unimportant
Inventory Composite Scales
The Noel-Levitz Student Satisfaction Inventory (SSI) measured student satisfaction with a
wide range of college experiences. All items on the SSI are grouped into 12 composite
“scales” or general topics that offered a global perspective of strengths and areas in need of
improvement. Some items on the inventory contribute to more than one scale. The following
is a list of these scales and a description:
1. Academic Advising assesses the comprehensiveness of the academic advising
program. Academic advisors are evaluated on the basis of their knowledge,
competence and personal concern for student success, as well as on their
approachability.
2. Campus Climate assesses the extent to which we provide experiences that promote a
sense of campus pride and feelings of belonging. This scale also assesses the
effectiveness of our channels of communication for students.
3. Campus Life assesses the effectiveness of student life programs offered, covering
issues ranging from athletics to residence life. This scale also assesses campus
4
policies and procedures to determine students’ perceptions of their rights and
responsibilities.
4. Campus Support Services assesses the quality of support programs and services that
students utilize in order to make their educational experiences more meaningful and
productive. This scale covers areas such as tutoring, the adequacy of the library and
computer labs, and the availability of academic and career services.
5. Concern for the Individual assesses commitment to treating each student as an
individual. Those groups who frequently deal with students on a personal level (e.g.
faculty, advisors, counselors, and residence hall staff) are included in this assessment.
6. Instructional Effectiveness assesses students’ academic experience, curriculum, and
overriding commitment to academic excellence. This comprehensive scale covers
areas such as the variety of courses offered, the effectiveness of the faculty in and out
of the classroom, and the effectiveness of adjunct faculty and graduate teaching
assistants.
7. Recruitment and Financial Aid Effectiveness assesses the ability to enroll students
in an effective manner. This scale scores issues such as competence and knowledge
of admissions counselors, as well as the effectiveness and availability of financial aid
programs.
8. Registration Effectiveness assesses issues associated with registration and billing.
This scale also measures commitment to making the registration process as smooth
and effective as possible.
9. Responsiveness to Diverse Populations assesses our commitment to specific groups
of students enrolled at the University of Central Missouri, e.g., under-represented
populations, students with disabilities, commuters, part-time students, and older,
returning learners.
10. Safety and Security assesses responsiveness to students’ personal safety and security
on campus. This scale measures the effectiveness of both security personnel and
campus facilities.
11. Service Excellence assesses the perceived attitude of the staff towards students,
especially front-line staff. This scale pinpoints the areas where quality service and
personal concern for students are rated most favorably and least favorably.
12. Student Centeredness assesses efforts to convey to students that they are important
to us. This scale measures the extent to which students feel welcome and valued.
5
Summary of Key Findings
 According to the survey results, the top five most important composite scales to UCM
students (in order) are: instructional effectiveness (6.27), academic advising (6.24), safety
and security (6.23), registration effectiveness (6.13), and recruitment and financial aid (6.08).
Albeit not in the same order, the five most important composite scales to UCM students are
generally identical to those identified as important by students in the national comparison
group.
 Which of the 12 composite scales are most satisfying to UCM undergraduates? According to
the survey results, the top five most satisfying composite scales are: campus support services
(5.48), instructional effectiveness (5.39), student centeredness (5.30), campus climate (5.24),
and responsiveness to diverse populations (5.18).
 It is interesting to note that UCM students’ satisfaction ratings are higher than those of
students in the national comparison group in eleven out of the 12 composite scales. UCM
students were less satisfied with academic advising than students in the national comparison
group (5.17 vs. 5.25). The difference is statistically significant at the .05 level.
 Respondents are least satisfied with the following five composite scales: safety and security
(4.88), recruitment and financial aid (5.01), campus life (5.02), concern for the individual,
and service excellence (5.10).
 Of the 12 composite scales, safety and security received the highest performance gap
(1.35). It is important to point out that one particular item on the safety and security
composite scale-“the amount of student parking space on campus is adequate” had a
performance gap of (2.98). Hence, the overall mean rating for safety and security
scale was significantly skewed by this particular item. Parking space is not a safety
and security issue per se, but the item is embedded in the safety and security
composite scale.
 Cross-tabulation analyses reveal that the availability of student parking is more
important to commuters than residence hall students. Not surprisingly, commuters are
also less satisfied with the amount of parking space on campus than residence hall
students (2.90 vs. 3.52).
6
 Which of the 73 expectations on the survey are most important to UCM undergraduate
students? Results of the survey indicate that the top five expectations that are most important
to UCM students relate to instructional effectiveness: the content of the courses within my
major is valuable, (6.54), the instruction in major field is excellent (6.53), nearly all of the
faculty members are knowledgeable in their field (6.43), the campus is safe and secure for all
students (6.43), and I am able to register for classes I need with few conflicts (6.42).
 Most notably, UCM students’ rating of campus safety and security was higher than ratings of
students in the national comparison group (5.66 vs. 5.29; statistically significant at the .001
level). Since campus safety and security is becoming one of the top five issues of importance
to UCM students and to college students across the United States and abroad, this positive
assessment by UCM students should be communicated to those who are unfamiliar with the
campus-prospective students and their parents, international and out-of-state students.
 Which expectations received the highest satisfaction rating from UCM undergraduates?
The top five expectations that received the highest satisfaction among UCM students are:
library resources and services are adequate, nearly all of the faculty are knowledgeable in
their field, computer labs are adequate and accessible, on the whole, the campus is well –
maintained, there is a good variety of courses provided on this campus and faculty are
usually available after class and during office hours.
 It is noteworthy that four of the expectations rated as greatest importance by UCM students
are also rated as highest satisfaction. These items fall in quadrant 2 of the matrix for
prioritizing action (see page 4) and are considered to be the university’s areas of strength
that should be included in promotional materials: Nearly all of the faculty are
knowledgeable in their field, the campus is safe and secure for all students, the instruction
in my major field is excellent, the content of the courses within my major is valuable.
 Sample respondents are least satisfied in the following areas: student parking (3.61), living
conditions in the residence halls (4.26), weekend activities for students (4.34), my
academic advisor helps me set goals to work toward (4.76), and financial aid counselors
are helpful (4.77).
 Five items of high importance and low satisfaction ratings are: I am able to register for
classes I need with few conflicts, adequate financial aid is available for most students,
faculty provide timely feedback about student progress in a course, billing policies are
reasonable, my academic advisor helps me set goals to work toward. Performance gap
score (importance rating minus satisfaction rating) for each expectation is 1.00 or higher.
These are areas in need of immediate attention, i.e., retention agenda/priorities.
7
 Nine items on the survey asked respondents to rate their enrollment decision factors. The
“cost” of attending UCM was the most important factor in students’ decision to enroll at the
university. UCM students rated cost as factor in decision to enroll higher than students at the
national comparison group (6.27 vs. 6.18).
 While cost remains the major attractive force in students’ decision to enroll at UCM, the
importance of personalized attention, campus appearances and opportunity to play sports
increased between 2007 and 2009. The size of the university was more of a factor for out-ofstate students and international students than for resident students in their decision to enroll at
UCM.
 Availability of financial aid was the second most important factor in students’
decision to enroll at UCM (5.87), followed by academic reputation of the university
(5.83). African-American students rated opportunity to play sports, availability of
financial aid and academic reputation as factors in decision to enroll at UCM than
any other group.
 Overall, how satisfied are UCM students with their educational experience at UCM?
Three items on the inventory assessed students’ overall satisfaction with UCM by
revealing the extent to which they perceive their expectations have been met. When
asked, “So far, has your college experience met your expectations?” 83% indicated
that the university has met their expectations.
 Respondents who indicated that UCM was their “first” choice of college reported
greater satisfaction with the university than those who indicated that UCM was their
“second” or “third” choice. It is also noteworthy that respondents with higher
cumulative GPAs were more likely to be satisfied with UCM than students with
lower GPAs.
 Students were further asked to rate their overall satisfaction with their experience here
thus far. A sizable majority (76%) were satisfied, compared with 73% of students at
the national comparison group.
 Finally, respondents were asked, “All in all, if you had to do it over, would you enroll
here again?” About 7 in 10 respondents (72%) answered in the affirmative. This
response compares very favorably to students at the national comparison group.
8
Table 1.
Institutional Summary
Rating of Twelve Composite Scales
Four-Year Public
Institutions
UCM
Composite Scale
1. Student Centeredness
2. Campus Life
3. Instructional Effectiveness
4. Recruitment and Financial Aid
5. Campus Support Services
6. Academic Advising
7. Registration Effectiveness
8. Safety and Security
9. Concern for the Individual
10. Service Excellence
11. Responsiveness to Diverse
Populations
12. Campus Climate
Import
6.06
5.68
6.27
6.08
6.00
6.24
6.13
6.23
6.01
5.93
6.04
Satis/SD Gap
5.30/1.04 0.76
5.02/1.02 0.66
5.39/0.96 0.88
5.01/1.11 1.07
5.48/0.93 0.52
5.17/1.30 1.07
5.17/1.05 0.96
4.88/1.12 1.35
5.06/1.05 0.95
5.10/0.98 0.83
5.18/1.25
5.24/0.98
0.80
Import
6.08
5.70
6.32
6.13
6.04
6.33
6.20
6.30
6.11
6.01
6.10
Satis/SD Gap
5.12/1.16 0.96
4.89/1.07 0.81
5.26/1.04 1.06
4.83/1.23 1.30
5.30/1.01 0.74
5.25/1.35 1.08
4.98/1.16 1.22
4.53/1.26 1.77
4.99/1.15 1.12
4.95/1.08 1.06
5.10/1.34
5.08/1.08
1.02
Mean
Difference
0.18***
0.13***
0.13***
0.18***
0.18***
-0.08*
0.19***
0.35***
0.07*
0.15***
0.08*
0.16***
Note: The last column (mean difference) shows the difference between our satisfaction means and the
national group satisfaction means. If the mean difference in theses scores is a positive number, then
UCM students are more satisfied than the students in the national comparison group. If the mean
difference is a negative number, UCM students are less satisfied than the students in the national
comparison group.
The greater the number of asterisks, the greater the confidence in the significance of this difference,
and the greater the likelihood that this difference did not occur by chance.
*Difference statistically significant at the .05 level
**Difference statistically significant at the .01 level
*** Difference statistically significant at the .01 level
9
Table 2.
Ten Expectations That Are Most Important
to UCM Respondents
2009
UCM
Mean
Item
1. The content of the courses within my major is valuable.
2. The instruction in my major field is excellent.
3. Nearly all of the faculty are knowledgeable in their field.
4. The campus is safe and secure for all students.
5. I am able to register for classes I need with few
conflicts.
6. My academic advisor is knowledgeable about
requirements in my major.
7. The quality of instruction I receive in most of my classes
is excellent.
8. Tuition paid is a worthwhile investment.
9. Major requirements are clear and reasonable.
10. My academic advisor is approachable.
Score
6.54
6.53
6.43
6.43
National
Mean
Score
6.54
6.52
6.48
6.44
6.42
6.42
6.52
6.50
6.38
6.46
6.34
6.34
6.34
6.42
6.40
6.42
Table 3.
Rating of Ten Expectations That Are Most Satisfying
to UCM Students
UCM
Mean
Expectation
1. Library resources and services are adequate.
2. Nearly all of the faculty are knowledgeable in their field.
3. Computer labs are adequate and accessible.
4. On the whole, the campus is well-maintained.
5. There is a good variety of courses provided on this campus.
6. Faculty are usually available after class and during
office hours.
7. The campus is safe and secure for all students.
8. Library staff are helpful and approachable.
9. The content of the courses within my major is valuable.
10. The instruction in my major field is excellent.
10
Score
5.74
5.73
5.71
5.69
5.67
5.66
National
Mean
Score
5.46
5.62
5.40
5.53
5.33
5.52
5.66
5.64
5.61
5.57
5.29
5.46
5.43
5.41
Table 4.
Rating of Eleven Expectations of Greatest Importance and Highest Satisfaction
Expectation
1. The campus is safe and secure
for all students.
2. The instruction in my major field
is excellent.
3. Library resources and services
are adequate.
4. Computer labs are adequate and
accessible.
5. I am able to experience intellectual
growth here.
6. There is a commitment to academic
excellence on this campus.
7. Students are made to feel welcome
on this campus.
8. Class change (drop/add) policies
are reasonable.
9. There is a good variety of courses
provided on this campus.
10. Nearly all of the faculty are
knowledgeable in their field.
11. Faculty are usually available after
class and during office hours.
Mean
Mean
Importance Satisfaction Performance
Rating
Rating
Gap
6.43
5.66
0.77
6.53
5.57
0.96
6.10
5.74
0.36
6.24
5.71
0.53
6.26
5.53
0.73
6.18
5.38
0.8
6.16
5.48
0.68
6.15
5.51
0.64
6.32
5.67
0.65
6.43
5.73
0.7
6.29
5.66
0.63
11
Table 5.
Items of High Importance and Low Satisfaction Rating
Item
1. I am able to register for classes I need
with few conflicts.
2. Adequate financial aid is available for
most students.
3. Faculty provide timely feedback about
student progress in a course.
4. Billing policies are reasonable.
5. My academic advisor helps me set
goals to work toward.
Mean
Mean
Importance Satisfaction Performance
Rating
Rating
Gap
6.42
5.08
1.34
6.29
4.88
1.41
6.25
5.08
1.17
6.13
4.79
1.34
5.94
4.76
1.18
Table 6.
Rating of Factors in Decision to Enroll at UCM
2009
Enrollment Factor
1. Cost as factor in decision to enroll.
2. Financial Aid as factor in decision to enroll.
3. Academic reputation as factor in decision
to enroll.
4. Size of institution as a factor in decision
to enroll.
5. Opportunity to play sports as a factor
in decision to enroll.
6. Recommendations from family/friends as
factor in decision to enroll.
7. Geographic setting as factor in decision
to enroll.
8. Campus appearance as factor in decision.
to enroll.
9. Personalized attention prior to enrollment
as factor in decision to enroll.
12
UCM
Important
6.27
5.87
5.83
National
Group
Important
6.18
5.92
5.91
5.41
5.28
3.58
3.51
4.75
4.8
5.33
5.49
5.29
5.25
5.23
5.23
Table 7.
Respondents' Rating of UCM's Commitment to Students' Needs
Item
1. Institution's commitment to
part-time students.
2. Institution's commitment to
evening students.
3. Institution's commitment to
older/returning learners.
4. Institution's commitment to
underrepresented populations.
5. Institution's commitment to
commuters.
6. Institution's commitment to
students with disabilities.
UCM
Means
5.19
National
Group Means
5.10
Mean Difference
(Satisfaction)
0.09*
5.13
5.08
0.05
5.28
5.18
0.10*
5.16
5.10
0.06
5.01
4.92
0.09*
5.33
5.25
0.08
Table 8.
Respondents’ Overall Measure of Satisfaction
UCM
%
National
%
Difference
National - UCM
83
81
0.09**
Rate your overall satisfaction with
your experience here thus far
93
91
0.09**
All in all, if you had it to do over again,
would you enroll here?
71
71
0.05**
Measure
So far, how has your college experience
met your expectations?
13
Download