NSSE Benchmarks: 2006, 2008 and 2011

advertisement
NSSE Multi-year Benchmark Report (Combined U of S / College Report)
NSSE Benchmarks: 2006, 2008 and 2011
Prepared by the office of Institutional Planning and Assessment December 2011
Highlights of Results






U of S scores for first-year students were generally lower than the average of medical/doctoral universities
in Canada (our peers), especially on the Level of Academic Challenge and Enriching Educational Experience
benchmarks.
However, U of S final-year students generally scored higher than our peers on most benchmarks including
Active and Collaborative Learning, Student-Faculty Interaction, and Supportive Campus Environment.
U of S scores, for both first- and final-year students, have improved between 2006 and 2011.
Overall, scores for first-year students were significantly lower than final-year students (same as our peers).
Pharmacy & Nutrition had the best overall scores, followed by Edwards, Nursing, and Education.
At the final-year student level:
o Nursing, Engineering, and Edwards had the best scores in Level of Academic Challenge;
o Edwards, Pharmacy & Nutrition, and Education out-performed the rest in Active and
Collaborative Learning;
o The Division of Humanities & Fine Arts and Agriculture & Bioresources excelled in StudentFaculty Interaction;
o Education and Pharmacy & Nutrition students had the highest scores for Enriching Educational
Experience;
o Agriculture & Bioresources, Kinesiology, and Pharmacy & Nutrition topped the list on
Supportive Campus Environment.
About NSSE
The National Survey of Student Engagement (NSSE, pronounced "Nessie") is a survey that measures students'
levels of engagement with their institution. The NSSE obtains information from first-year and final-year
undergraduate students in Canada and the United States about their participation in programs and activities
that institutions provide for their learning and personal development.
Survey items on the NSSE represent empirically confirmed "good practices" in undergraduate education. That
is, they reflect behaviors by students and institutions that are associated with desired outcomes of a university
education/experience. More than 1,300 different colleges and universities in the United States and Canada
have participated in NSSE since its inception in 2000.
NSSE at the University of Saskatchewan
NSSE was first administered at the University of Saskatchewan (U of S) in 2006 with follow-ups in 2008 and
2011. It is now planned to be conducted every three years with the next survey scheduled for 2014. In 2006
and 2008, the survey was administered using a random sample of first-year and final-year U of S students,
while in 2011, a census was conducted. The response rates were 55%, 53% and 43% respectively.
Page | 1
NSSE Multi-year Benchmark Report (Combined U of S / College Report)
NSSE Benchmarks
The NSSE instrument is short, reliable, and easy to complete. It asks undergraduates how they spend their
time, what they feel they have gained from classes, and their assessment of the quality of their interactions
with faculty and students as well as the value of other important educational activities. NSSE results are
organized into five benchmarks of effective educational practice, as outlined below:





Active & Collaborative Learning (ACL)
Level of Academic Challenges (LAC)
Student-Faculty Interaction (SFI)
Enriching Educational Experiences (EEE)
Supportive Campus Environment (SCE)
NSSE benchmark scores are calculated based on respondents’ answers to a series of questions that associate
with each benchmark. There are 6-11 questions behind each benchmark. Theoretically, the values of the
benchmarks range from 0 to 100, as all items that contribute to a benchmark are converted to a 0 – 100 point
scale. For example, items with four response options (e.g., never, sometimes, often, very often) are recoded
with values of 0, 33.33, 66.67, or 100. In Canada, the average scores on NSSE benchmarks range from the midtwenties to the mid-fifties1. For more information about the construction of the NSSE Benchmarks, please go
to http://nsse.iub.edu/_/?cid=403.
1
Conway, C., Zhao, H., & Montgomery, S. (2011). The NSSE National Data Project Report. Toronto: Higher Education
Quality Council of Ontario.
Page | 2
NSSE Multi-year Benchmark Report (Combined U of S / College Report)
Interpreting the Benchmark Report
Name of the
benchmark
Means are reported for
first-year and final-year
students
The mean is the weighted
arithmetic average of
student level benchmark
scores calculated based
on student responses to
the benchmark questions
The U of S uses the
Canadian medical/
doctoral group for NSSE
benchmarking purposes.
This group (which
includes the U of S)
consists of universities
that offer a broad range
of Ph.D. programs and
research, as well as
medical schools. For a
complete list, please see
Appendix One.
A description of the
benchmark and the
individual items used in
its creation are
summarized
Level of Academic Challenge (LAC)
Benchmark Mean Comparisons
Ag & Bio
Arts & Science
A&S – Science Div.
A&S – Social Sciences Div.
A&S – Humanities & Fine Arts Div.
Education
Engineering
Edwards
Kinesiology
Nursing
Pharmacy & Nutrition
U of S
Medical/Doctoral
2006
44
45
52
55
48
46
47
50
First-year
2008
43
47
46
52
50
46
48
51
2011
48
48
46
50
47
46
48
52
2006
56
53
53
53
54
49
57
53
48
56
55
53
54
Final-year
2008
53
53
51
53
55
49
59
54
53
58
53
53
55
2011
50
53
51
52
55
49
58
57
49
58
55
54
55
Level of Academic Challenge (LAC) Items
Challenging intellectual and creative work is central to student learning and collegiate quality. Universities promote
high levels of student achievement by emphasizing the importance of academic effort and setting high expectations for
student performance.









Preparing for class (studying, reading, writing, doing homework or lab work, etc. related to academic
program)
Number of assigned textbooks, books, or book-length packs of course readings
Number of written papers or reports of 20 pages or more; number of written papers or reports of between
5 and 19 pages; and number of written papers or reports of fewer than 5 pages
Coursework emphasizes: Analysis of the basic elements of an idea, experience or theory
Coursework emphasizes: Synthesis and organizing of ideas, information, or experiences into new, more
complex interpretations and relationships
Coursework emphasizes: Making of judgments about the value of information, arguments, or methods
Coursework emphasizes: Applying theories or concepts to practical problems or in new situations
Working harder than you thought you could to meet an instructor's standards or expectations
Campus environment emphasizes: Spending significant amount of time studying and on academic work.
Page | 3
NSSE Multi-year Benchmark Report (Combined U of S / College Report)
Level of Academic Challenge (LAC)
Benchmark Mean Comparisons
Ag & Bio
Arts & Science
A&S – Science Div.
A&S – Social Sciences Div.
A&S – Humanities & Fine Arts Div.
Education
Engineering
Edwards
Kinesiology
Nursing
Pharmacy & Nutrition
U of S
Medical/Doctoral
2006
44
45
52
55
48
46
47
50
First-year
2008
43
47
46
52
50
46
48
51
2011
48
48
46
50
47
46
48
52
2006
56
53
53
53
54
49
57
53
48
56
55
53
54
Final-year
2008
53
53
51
53
55
49
59
54
53
58
53
53
55
2011
50
53
51
52
55
49
58
57
49
58
55
54
55
Level of Academic Challenge (LAC) Items
Challenging intellectual and creative work is central to student learning and collegiate quality. Universities
promote high levels of student achievement by emphasizing the importance of academic effort and setting
high expectations for student performance.









Preparing for class (studying, reading, writing, doing homework or lab work, etc. related to academic
program)
Number of assigned textbooks, books, or book-length packs of course readings
Number of written papers or reports of 20 pages or more; number of written papers or reports of
between 5 and 19 pages; and number of written papers or reports of fewer than 5 pages
Coursework emphasizes: Analysis of the basic elements of an idea, experience or theory
Coursework emphasizes: Synthesis and organizing of ideas, information, or experiences into new,
more complex interpretations and relationships
Coursework emphasizes: Making of judgments about the value of information, arguments, or methods
Coursework emphasizes: Applying theories or concepts to practical problems or in new situations
Working harder than you thought you could to meet an instructor's standards or expectations
Campus environment emphasizes: Spending significant amount of time studying and on academic
work.
Page | 4
NSSE Multi-year Benchmark Report (Combined U of S / College Report)
Active and Collaborative Learning (ACL)
Benchmark Mean Comparisons
Ag & Bio
Arts & Science
A&S – Science Div.
A&S – Social Sciences Div.
A&S – Humanities & Fine Arts Div.
Education
Engineering
Edwards
Kinesiology
Nursing
Pharmacy & Nutrition
U of S
Medical/Doctoral
2006
28
28
47
37
40
27
31
34
First-year
2008
27
30
46
39
44
31
33
34
2011
37
30
45
37
42
30
33
35
2006
47
39
37
38
42
50
45
48
44
42
51
43
41
Final-year
2008
50
38
37
38
42
47
47
49
50
40
54
43
42
2011
44
40
38
42
41
50
44
54
46
47
51
45
44
Active and Collaborative Learning (ACL) Items
Students learn more when they are intensely involved in their education and asked to think about what they
are learning in different settings. Collaborating with others in solving problems or mastering difficult material
prepares students for the messy, unscripted problems they will encounter daily during and after university.







Asked questions in class or contributed to class discussions
Made a class presentation
Worked with other students on projects during class
Worked with classmates outside of class to prepare class assignments
Tutored or taught other students (paid or voluntary)
Participated in a community-based project (e.g., service learning) as part of a regular course
Discussed ideas from your readings or classes with others outside of class (students, family members,
co-workers, etc.)
Page | 5
NSSE Multi-year Benchmark Report (Combined U of S / College Report)
Student-Faculty Interaction (SFI)
Benchmark Mean Comparisons
Ag & Bio
Arts & Science
A&S – Science Div.
A&S – Social Sciences Div.
A&S – Humanities & Fine Arts Div.
Education
Engineering
Edwards
Kinesiology
Nursing
Pharmacy & Nutrition
U of S
Medical/Doctoral
2006
20
20
40
19
19
22
20
20
First-year
2008
18
23
37
18
22
20
22
22
2011
22
22
29
15
19
20
21
21
2006
41
32
33
32
33
31
29
27
31
30
37
31
29
Final-year
2008
41
32
32
30
35
33
34
28
33
32
33
32
31
2011
35
33
34
29
37
31
32
32
32
33
31
33
31
Student-Faculty Interaction (SFI) Items
Students learn firsthand how experts think about and solve practical problems by interacting with faculty
members inside and outside the classroom. As a result, their teachers become role models, mentors, and
guides for continuous, life-long learning.






Discussed grades or assignments with an instructor
Talked about career plans with a faculty member or advisor
Discussed ideas from your readings or classes with faculty members outside of class
Worked with faculty members on activities other than coursework (committees, orientation, studentlife activities, etc.)
Received prompt written or oral feedback from faculty on your academic performance
Worked on a research project with a faculty member outside of course or program requirements
Page | 6
NSSE Multi-year Benchmark Report (Combined U of S / College Report)
Enriching Educational Experience (EEE)
Benchmark Mean Comparisons
Ag & Bio
Arts & Science
A&S – Science Div.
A&S – Social Sciences Div.
A&S – Humanities & Fine Arts Div.
Education
Engineering
Edwards
Kinesiology
Nursing
Pharmacy & Nutrition
U of S
Medical/Doctoral
2006
21
20
29
21
21
19
20
24
First-year
2008
19
21
22
20
21
20
21
25
2011
21
22
21
18
21
22
21
24
2006
36
29
30
28
28
35
32
25
26
29
38
30
34
Final-year
2008
34
29
31
29
29
37
35
27
35
35
39
32
35
2011
29
29
29
29
29
38
32
30
32
33
36
31
36
Enriching Educational Experiences (EEE) Items
Complementary learning opportunities enhance academic programs. Diversity experiences teach students
valuable things about themselves and others. Technology facilitates collaboration between peers and
instructors. Internships, community service, and senior capstone courses provide opportunities to integrate
and apply knowledge.











Participating in co-curricular activities (organizations, campus publications, student government, social
fraternity or sorority, etc.)
Practicum, internship, field experience, co-op experience, or clinical assignment
Community service or volunteer work
Foreign language coursework / Study abroad
Independent study or self-designed major
Culminating senior experience (capstone course, senior project or thesis, comprehensive exam, etc.)
Serious conversations with students of different religious beliefs, political opinions, or personal values
Serious conversations with students of a different race or ethnicity than your own
Using electronic medium (e.g., listserv, chat group, Internet, instant messaging, etc.) to discuss or
complete an assignment
Campus environment encouraging contact among students from different economic, social, and racial
or ethnic backgrounds
Participate in a learning community or some other formal program where groups of students take two
or more classes together
Page | 7
NSSE Multi-year Benchmark Report (Combined U of S / College Report)
Supportive Campus Environment (SCE)
Benchmark Mean Comparisons
Ag & Bio
Arts & Science
A&S – Science Div.
A&S – Social Sciences Div.
A&S – Humanities & Fine Arts Div.
Education
Engineering
Edwards
Kinesiology
Nursing
Pharmacy & Nutrition
U of S
Medical/Doctoral
2006
54
51
70
52
52
54
52
54
First-year
2008
56
54
68
54
52
61
54
54
2011
55
55
64
54
54
60
55
56
2006
59
51
53
47
53
51
49
49
55
50
65
51
48
Final-year
2008
64
51
55
48
53
50
55
50
57
51
55
52
49
2011
63
52
53
50
54
58
53
55
62
56
60
55
51
Supportive Campus Environment (SCE) Items
Students perform better and are more satisfied at colleges that are committed to their success and cultivate
positive working and social relations among different groups on campus.






Campus environment provides the support you need to help you succeed academically
Campus environment helps you cope with your non-academic responsibilities (work, family, etc.)
Campus environment provides the support you need to thrive socially
Quality of relationships with other students
Quality of relationships with faculty members
Quality of relationships with administrative personnel and offices
Page | 8
NSSE Multi-year Benchmark Report (Combined U of S / College Report)
Appendix One. Medical/Doctoral Universities in Our Comparator Group
Institution Name
City
Prov.
2011
Dalhousie University
McGill University
McMaster University
Queen's University
Université d'Ottawa / University of Ottawa
Université de Montréal
Université de Sherbrooke
Université Laval
University of Alberta
University of British Columbia
University of Calgary
University of Manitoba, The
University of Toronto
University of Western Ontario
Halifax
Montreal
Hamilton
Kingston
Ottawa
Montreal
Sherbrooke
Quebec city
Edmonton
Vancouver
Calgary
Winnipeg
Toronto
London
NS
QC
ON
ON
ON
QC
QC
QC
AB
BC
AB
MB
ON
ON
2008
Dalhousie University
McGill University
McMaster University
Queen's University
The University of Manitoba
Université d'Ottawa / University of Ottawa
Université de Montréal
Université Laval
University of Alberta
University of British Columbia
University of Calgary
University of Toronto
University of Western Ontario
Halifax
Montreal
Hamilton
Kingston
Winnipeg
Ottawa
Montreal
Quebec city
Edmonton
Vancouver
Calgary
Toronto
London
NS
QC
ON
ON
MB
ON
QC
QC
AB
BC
AB
ON
ON
Halifax
Montreal
Hamilton
Kingston
Quebec city
Edmonton
Vancouver
Ottawa
Toronto
London
NS
QC
ON
ON
QC
AB
BC
ON
ON
ON
2006
Dalhousie University
McGill University
McMaster University
Queen's University
Université Laval
University of Alberta
University of British Columbia
University of Ottawa
University of Toronto
University of Western Ontario
Page | 9
Download