academic graduate survey

advertisement
Okanagan University College
ACADEMIC GRADUATE SURVEY
Spring 1999
Institutional Research and Planning
and Dr. J. M. Small
1999 Academic Graduate Survey
Fall, 1999
September, 1999
Executive Summary
In June 1999, the Office of Institutional Research and Planning conducted a survey of all
graduating degree students in order to gather information related to their OUC experiences.
Of the 342 mailed questionnaires, 120 were returned, giving a 35% rate of response. The
survey and this report were designed to provide client feedback to University College
constituent groups with improvement in programs and service as the ultimate goal. The
questionnaire was similar to that used in 1998, thereby allowing some comparisons to be
made.
As was the case last year, the graduate population is typical of a community-based postsecondary institution, except that females outnumbered males by about two-to-one. This
is due to the nature of the OUC degree programs. About half could be considered nontraditional students in that they are over 24 years old, are married and have family
commitments. Their motivations for choosing OUC over other institutions were primarily
pragmatic in nature.
Respondents were satisfied with most aspects of their programs and courses. The four
highest rated items all deal directly with the attitude of instructors towards their students
and teaching responsibilities. The lower rated items focus on course and program
organization and requirements.
Administrative and support services were also generally satisfactory but rated a bit lower
than programs and courses. Respondents were reasonably satisfied with 13 of the 16
services. A common theme which appears to connect the satisfaction levels of students
with regard to both administrative and support services and programs and courses is a
high level of professionalism among OUC staff, faculty members in particular.
Despite the fact that the 1999 survey was somewhat changed, some comparisons
between the two years were possible:
i.
The ratio of male to female graduates increased from 1 to 3 in 1998 to 2 to 3 in
1999. (see Table 1, page 5 and Table 1, page 5 of 1998 Academic Survey)
The 1999 graduates claimed to have been less motivated by location in choosing
OUC.
The 1999 graduates had been more inclined to interrupt their studies for
employment reasons.
More 1999 graduates had secured jobs by the end of their programs. This is likely
related to ‘iii’ above.
ii.
iii.
iv.
Generally the results paint a very positive picture of OUC programs and services. This
impression is underscored in a series of closing questions that attempted to elicit a
concluding judgement from respondents.
•
•
In terms of degree program expectations, 81% felt that their experience had met or
exceeded their expectations.
In terms of value of education as an investment, 91% felt that their degree program
had been a good, very good, or exceptional investment.
Institutional Research and Planning
Page 2
1999 Academic Graduate Survey
•
Fall, 1999
93% would be inclined to recommend their degree program to a close friend.
Conclusions and recommendations arising from the survey are provided at the end of the
report.
TABLE OF CONTENTS
1.
INTRODUCTION ....................................................................................................... 5
2.
THE STUDENT BODY.............................................................................................. 5
3.
MOTIVATIONS........................................................................................................... 7
4.
STUDENT SATISFACTIONS.................................................................................... 8
5.
CONTINUITY OF STUDY....................................................................................... 10
6.
PROGRAM OUTCOMES........................................................................................ 11
7.
GENERAL SATISFACTION .................................................................................... 12
8.
CONCLUSIONS....................................................................................................... 13
9.
RECOMMENDATIONS ........................................................................................... 14
Institutional Research and Planning
Page 3
1999 Academic Graduate Survey
Fall, 1999
LIST OF TABLES AND FIGURES
T ABLE 1: REPRESENTATIVENESS OF THE RESPONDENT GROUP ....................... 5
T ABLE 2: DEMOGRAPHIC AND ECONOMIC CHARACTERISTICS OF
RESPONDENTS........................................................................................................ 6
T ABLE 3: FACTORS INFLUENCING DECISION TO ATTEND OUC ............................ 7
T ABLE 4: SATISFACTION WITH ADMINISTRATION AND SUPPORT SERVICES...... 8
T ABLE 5: SATISFACTION WITH PROGRAMS AND COURSES ................................... 9
T ABLE 6: COMPARISON OF SELECTED SATISFACTION ITEMS IN 1998 AND 1999
SURVEYS ................................................................................................................... 9
FIGURE 1: REASONS FOR INTERRUPTING STUDIES............................................... 10
T ABLE 7: RATING OF PROGRAM OUTCOMES .......................................................... 11
FIGURE 2: EMPLOYMENT OUTCOMES ...................................................................... 12
Appendix A: Research Instrument
Appendix B: Survey Results – Actual Scale
Institutional Research and Planning
Page 4
1999 Academic Graduate Survey
Fall, 1999
1. INTRODUCTION
In June 1999, OUC conducted a survey of all graduating students in order to gather
information related to their university experiences, with the ultimate goal of improvement
of degree programs and services. Since the questionnaire was similar to that used in
1998, an additional objective was to compare the two sets of data for changes in
demographics and perceptions. Of the 342 mailed questionnaires, 120 were returned.
The 35% response was better than last year (27%) and is considered to be acceptable
for revealing general tendencies. The extent to which the respondents are representative
of OUC’s graduating population is indicated in the comparison provided in Table 1.
(Note: In all tables, reported percentages are based on the number of responses for each
particular question. In some cases, the base is not the total respondent group.)
Table 1: REPRESENTATIVENESS OF THE RESPONDENT GROUP
Variable
Graduate Population (%)
Respondent Group (%)
Program of Study
BA
BED
BFA
BSC
BSN
BSW
BBA
Total
N
110 (32%)
45 (13%)
26 ( 8%)
61 (18%)
48 (14%)
28 ( 8%)
27 ( 8%)
345 (100%)
N
42 (35%)
12 (10%)
11 ( 9%)
15 (13%)
19 (16%)
12 (10%)
9 ( 8%)
120 (100%)
Average Age
29.3 years
30.2 years
2.1:1
2.3:1
Female/Male Ratio
Bearing in mind that the average age of the respondent group is an approximation based
on age–range data, the average ages of the population and respondent group are about
the same, and the representativeness of the genders also is close. There are some
minor biases in program of study: BSc and BEd graduates are slightly under-represented
in the respondent group, and BA graduates are slightly over-represented. Generally,
however, the respondents are quite typical of the target population.
2. THE STUDENT BODY
Examination of Table 1 shows that female graduating students outnumbered males by
about two-to-one, down from three-to-one among last year’s graduates. While this
distribution may suggest a bias in admissions and/or in dropout rate, this is not the case.
A major factor influencing the male/female ratio leans towards the nature of the programs
OUC offers. The mix of programs OUC offers tends to be slightly more attractive to
female students. i.e. nursing, elementary education. The average age in all programs
was around 29 years, but a closer analysis of the data reveals that the average age
Institutional Research and Planning
Page 5
1999 Academic Graduate Survey
Fall, 1999
varied by program with the oldest being BSW (33.6) and BFA (32.7) and the youngest
BSC (25.8).
The majority (84%) of the respondents were from the Okanagan, most of the remainder
from other parts of British Columbia, and about 3% from Alberta. All are Canadian
citizens or landed immigrants (Table 2.) Aboriginal Canadians comprised only 2.8% of
the respondents, while 3.7% of respondents classified themselves as disabled. Because
these are self-declared results only, it is likely that the actual totals are somewhat higher.
There were twice as many female respondents compared to males, and 41% of
respondents were within the typical college age (18 to 24 years). The majority were
single, but 38% were living with a spouse or partner during their last year of studies.
Table 2: DEMOGRAPHIC AND ECONOMIC CHARACTERISTICS OF RESPONDENTS
Variable
Area
Okanagan
Kootenays
Lower Mainland
Alberta
Other
Gender
Male
Female
Age
21-24
25-29
30-39
40-54
55 or older
Marital Status
Never married
Married or partnered
Divorced/Separated/Widowed
Citizenship
Canadian
Landed immigrant
Financial Sources
Off-campus work
On-campus work
Student loan
Prior savings
Spouse/partner
Family/friends
Other
Institutional Research and Planning
Number of
Respondents
Percentage
101
6
5
3
3
84%
5%
4%
3%
3%
36
84
30%
70%
52
28
15
24
1
43%
23%
13%
20%
1%
63
46
11
53%
38%
9%
117
2
98%
2%
78
19
49
61
30
43
14
72%
19%
48%
56%
29%
42%
18%
Page 6
1999 Academic Graduate Survey
Fall, 1999
Respondents supported themselves from multiple sources: 91% through employment;
71% received financial help from relatives and friends, and almost half had student loans.
Regarding family tradition of higher education, in the case of two out of three
respondents, neither parent had completed a degree. 22% of respondents reported that
one parent had completed a degree and 10% stated that both parents had completed a
degree.
The information on students reveals a fairly typical student body for a small university.
The great majority are from the local community and there are very few foreign or
aboriginal students. A significant number could be considered nontraditional students in
that they are over 24 years old (57%) and are, or have been, married or partnered (47%)
and have family responsibilities. On the whole, the respondents are generally very similar
to last year’s group.
3. MOTIVATIONS
Respondents were asked to rate a variety of factors that might influence a decision to
attend OUC (see Table 3). The rank order of factors, in terms of importance, are shown
along with respective rankings from last year’s survey (in parentheses).
Table 3: FACTORS INFLUENCING DECISION TO ATTEND OUC
Influencing Factors
Important or V important
Rank
Availability of program
Quality of instruction
Cost of tuition
96.7%
95.8%
90.8%
1 (2)
2 (4)
3 (3)
Living expenses
Class size
80.7%
80.7%
4 (5)
4 (5)
Institutional reputation
Location
76.5%
67.5%
6 (8)
7 (1)
Size of institution
47.1%
8 (9)
Athletics program
16.0%
9 NR
The six most important factors influencing the decision to attend OUC were rated as
important or very important considerations by 76%, or more, of the respondents.
Availability of desired program, quality of instruction, and reasonable tuition costs were
the top ranked considerations. Those factors also rated highly in last year’s survey.
Reasonable living expenses, small classes, and the university college’s reputation also
carried a lot of weight for the present group. The major difference from last year is the
importance of location, a factor rated number one last year and seven out of nine this
Institutional Research and Planning
Page 7
1999 Academic Graduate Survey
Fall, 1999
year. This finding suggests that students are becoming less place-bound and might be
more inclined to relocate to find the programs they desire.
4. STUDENT SATISFACTIONS
Respondents were asked to rate their satisfaction level with Administration and Support
Services and with Programs and Courses. Their responses are summarized in Tables 4
and 5 which display means and standard deviations based on the following scale:
♦
♦
♦
♦
♦
♦
♦
very dissatisfied 1
moderately dissatisfied 2
slightly dissatisfied 3
neutral 4
slightly satisfied 5
moderately satisfied 6
very satisfied 7
The “not applicable” responses were not factored into the calculations.
Table 4: SATISFACTION WITH ADMINISTRATION AND SUPPORT SERVICES
Service
Friendliness/courtesy of program staff
Tuition/fee level
Quality of classrooms
Parking availability
Academic advising by faculty
Availability of required degree courses
Availability of required specialty courses
Leadership of academic dean
Food service
Responsiveness of administration to student concerns
Ease of registration
Quality of computing resources
Quality of library resources
Remote access to computer network
Training to utilize computing resources
Academic advising by non-faculty
Mean
SD
Rank
5.7
5.4
5.4
5.3
5.1
4.9
4.7
4.5
4.5
4.4
4.3
4.2
4.1
3.9
3.8
3.5
1.5
1.5
1.6
1.7
1.9
1.7
1.9
1.6
1.8
1.8
1.9
1.7
2.0
1.7
1.5
1.9
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
Assuming that a mean score above 4 (neutral) indicates a reasonable level of
satisfaction, respondents were satisfied with 13 of the 16 services. The five most
satisfactory services are friendliness/courtesy of program staff; quality of classrooms;
tuition/fee level; parking availability; and academic advising by faculty. All five had a
mean rating of better than slightly satisfied.
Institutional Research and Planning
Page 8
1999 Academic Graduate Survey
Fall, 1999
The three least satisfactory services are: academic advising by non-faculty; training to
utilize computing resources; and remote access to computing network. All were rated
between slightly dissatisfied and neutral.
Table 5: SATISFACTION WITH PROGRAMS AND COURSES
Program Feature
Accessibility of instructors outside class
Instructors treat students with respect
Theoretical focus of program
Expertise of faculty in my area
Instructors’ pride in teaching
Quality of courses
Program expectations
Practical focus of program
Communication of program expectations
Standard of evaluation
Program flexibility
Mean
SD
Rank
6.0
6.0
5.9
5.9
5.9
5.7
5.4
5.4
5.2
5.1
5.0
1.5
1.5
1.2
1.4
1.4
1.3
1.3
1.5
1.6
1.6
1.5
1=
1=
3
4=
4=
6
7=
7=
9
10
11
Generally, respondents were satisfied with all aspects of their programs and courses.
The four highest rated all deal directly with the attitude of instructors towards their
students and teaching responsibilities. The lower rated items focus on course and
program organization and requirements.
It is difficult to compare these ratings to those of last year’s survey since the number of
items, wording of items, and formatting have been changed. But the generally positive
perceptions of students is a trend which continues from 1998. Table 6 compares data
from the two surveys relating to items perceived as needing improvement in 1998.
Table 6: COMPARISON OF SELECTED SATISFACTION ITEMS IN 1998 AND 1999 SURVEYS
1998 SURVEY
Answer Scale
1998 Survey
Good or
Question
Very Good
Program advising by
your Faculty Office
Academic counselling
services
Career counselling
services
Library
holdings
Registration procedures
Institutional Research and Planning
47.4%
17.1%
1999 SURVEY
Answer Scale
1999 Survey
Slightly,
Question
Moderately, &
Very Satisfied
Academic advising by
69.8%
the faculty
Acadmic advising by
27.1%
non-faculty
10.5%
38.8%
20.8%
Quality of library
resources
Ease of class
50.4%
48.7%
Page 9
1999 Academic Graduate Survey
Fall, 1999
registration process
The program allowed for
flexibility
54.1%
Agree or
Strongly Agree
Program flexibility
61.7%
While acknowledging that comparisons between the two sets of data is tenuous, it
appears that some headway has been made in academic faculty advising and
registration procedures. Program flexibility and library holdings appear to have lost
ground over the last year.
5. CONTINUITY OF STUDY
Two out of three respondents completed their degree programs within a four to five-year
time frame, but as many as 21% had taken seven or more years. This is similar to last
year and is considered normal for a small university with a large part-time student
population.
Respondents were asked if they had ever interrupted their studies for a term or more, not
including inter-session, for any of a variety of given reasons (see Figure 1). As before, the
most common reason was employment. Discontinuing for all categories have increased
over last year.
Figure 1: REASONS FOR INTERRUPTING STUDIES
16%
14%
1999
1998
12%
10%
8%
6%
4%
2%
0%
Illness
Employment
Institutional Research and Planning
Have or raise
children
Other family
reasons
Travel
Required to
Other (unspecified
withdraw by OUC
reasons)
Page 10
1999 Academic Graduate Survey
Fall, 1999
6. PROGRAM OUTCOMES
Respondents were asked to rate 19 desirable learning outcomes on a 5 point scale as
follows:
Almost None (1); Very Little (2); Some (3); Quite a Bit (4); A Great Deal (5).
The lead question was: “How much did your education at OUC contribute to
improvement in each of the following areas?” Table 7 displays their responses in rank
order of impact, along with last year’s ranking.
Table 7: RATING OF PROGRAM OUTCOMES
Skill Item
Research skills
Critical judgement
Writing skills
Ability to learn on one’s own
Problem solving skills
Creative thinking
Speaking skills
Awareness of ethical issues
Ability to work with others
Ability to work across disciplines
Ability to work effectively in teams
Self-confidence
Leadership skills
Development of skills employers seek
Conflict resolution skills
Career prospects
New career possibilities
Basic computer skills
Advanced computer skills
Mean
SD
1999
Rank
1998
Rank
4.3
4.1
4.0
3.9
3.8
3.8
3.7
3.7
3.6
3.6
3.6
3.6
3.4
3.4
3.3
3.3
3.1
2.8
2.3
0.8
0.9
1.0
1.0
1.0
1.1
1.1
1.2
1.0
1.0
1.0
1.1
1.1
1.2
1.3
1.3
1.3
1.3
1.3
1
2
3
4
5
6
7
8
9=
9=
9=
10
13
14
15=
15=
17
18
19
1
2
5
4
3
6
7
8
9
10
N/A
11
12
14
13
16
17
15
N/A
An examination of Table 7 reveals that the impact of the programs is greatest in terms of
intellectual skills and weakest with respect to pragmatic skills. Research, thinking, and
communication skills were rated as quite a bit to a great deal enhanced by degree
programs. By contrast, career-related outcomes were only somewhat enhanced and
computing skills even less so. These findings are almost identical to last year’s and
affirm liberal education as the hallmark of degree programs. However, four of the seven
degree programs, accounting for about two-thirds of the respondents, have an implied
Institutional Research and Planning
Page 11
1999 Academic Graduate Survey
Fall, 1999
career focus and the question again is raised about the desirability and feasibility of
developing more explicit connections between degree programs and workplace skills.
Despite this criticism, it must be noted that respondents were not asked for a judgement
about how much emphasis should have been placed on the listed outcomes, and they
may be quite supportive of the intellectual focus. This supposition is supported by the
fact that 69% of respondents claimed to have secured a job and 62% believed that these
jobs were closely related to the expertise acquired in their university studies. Most of the
jobs were full-time, but temporary, positions. Employment outcomes are presented in
Figure 2 along with data from the 1998 survey.
Figure 2: EMPLOYMENT OUTCOMES
70%
60%
1999
50%
1998
40%
30%
Job secured at graduation
Clearly related to studies
Permanent position
Full-time position
Compared to last year, a higher percentage of respondents had secured jobs and more
of them saw a clear relationship between their studies and the nature of employment.
Fewer of the 1999 placements, however, were permanent.
7. GENERAL SATISFACTION
Three questions were related to general satisfaction with the university-college
experience. Respondents' answers indicated that:
•
In terms of degree program expectations, 32% felt that their experience had met
their expectations; whereas in the case of 49%, expectations had been
exceeded. Only 19% felt that their experience had not been equal to their
expectations.
Institutional Research and Planning
Page 12
1999 Academic Graduate Survey
Fall, 1999
•
In terms of value of education as an investment, 26% felt that their degree
program had been a good investment; whereas 65% felt that it was a very
good to exceptional investment. Only 8% felt that their degree expenditures
were a poor investment.
•
50% would be extremely inclined to recommend their degree program to a
close friend, and 43% would be moderately inclined to so recommend. Only
7% would not be inclined to recommend their program to a friend.
These responses reveal a very high level of general satisfaction with experiences at
OUC. Given that universities traditionally provide a screening of candidates for
professional careers and that not everyone can live up to their aspirations, the fact that
19% of respondents had been somewhat disappointed is understandable; yet this figure
represents a target to be monitored and addressed. Also, the fact that more than 90%
believed that their educational costs represented a good investment confirms the value
of a degree in today’s economy.
8. CONCLUSIONS
1. The questionnaire responses reveal a high level of general satisfaction of graduates
with most aspects of their programs.
2. The quality of teaching and professionalism of faculty, both in and outside of classes,
are generally very high.
3. The questionnaire reveals that a high percentage of graduates felt that their education
had been a very good to exceptional investment.
4. Comparisons with the 1998 survey reveal that:
i.
ii.
iii.
More respondents reported interruption of their studies for employment
reasons.
Respondents were less influenced to choose OUC by the convenience of
location than were last year’s graduates.
More graduates had secured jobs than in the previous year.
5. The survey has produced valuable information on which to base several program and
service improvements.
Institutional Research and Planning
Page 13
1999 Academic Graduate Survey
Fall, 1999
9. RECOMMENDATIONS
Specific recommendations for the improvement of degree programs and services
identified from this years survey are:
1. Improving library holdings.
2. Enhancing access to computers and on-line services.
3. Review the curricula of structured programs to see if there is sufficient flexibility and
explore ways to increase course options where appropriate.
4. Explore ways to make connections in programs with the workplace, such as by
discussing career possibilities in classes and stressing skills that employers are
seeking.
5. Explore the desirability of focusing more specifically on computers and computing.
Institutional Research and Planning
Page 14
Download