NSSE 2014 Engagement Indicators
Academic Challenge
Hope College
Academic Challenge: First-year students
Challenging intellectual and creative work is central to student learning and collegiate quality. Colleges and universities promote
student learning by challenging and supporting them to engage in various forms of deep learning. Four Engagement Indicators are
part of this theme: Higher-Order Learning, Reflective & Integrative Learning, Learning Strategies, and Quantitative Reasoning.
Below and on the next page are three views of your results alongside those of your comparison groups.
Mean Comparisons
Engagement Indicator
Mean
Your first-year students compared with
Great Lakes Private
Carnegie Class
NSSE 2013 & 2014
Effect
Effect
Effect
Mean
size
Mean
size
Mean
size
Higher-Order Learning
39.5
40.3
-.06
41.2 *
-.13
39.0
.03
Reflective & Integrative Learning
35.9
36.7
-.07
37.8 **
-.16
35.6
.02
Learning Strategies
40.0
40.1
-.01
40.4
-.02
39.5
.04
Quantitative Reasoning
28.0
27.0
.07
28.0
.00
27.4
.04
Hope
Notes: Results weighted by institution-reported sex and enrollment status (and institution size for comparison groups); *p<.05, **p<.01, ***p<.001 (2-tailed); Effect size: Mean
difference divided by pooled standard deviation; Symbols on the Overview page are based on effect size and p before rounding.
Score Distributions
Higher-Order Learning
Reflective & Integrative Learning
60
60
45
45
30
30
15
15
0
0
Hope
Great Lakes Private
Carnegie Class
NSSE 2013 & 2014
Hope
Learning Strategies
Great Lakes Private
Carnegie Class
NSSE 2013 & 2014
Quantitative Reasoning
60
60
45
45
30
30
15
15
0
0
Hope
Great Lakes Private
Carnegie Class
NSSE 2013 & 2014
Hope
Great Lakes Private
Carnegie Class
NSSE 2013 & 2014
Notes: Each box-and-whiskers chart plots the 5th (bottom of lower bar), 25th (bottom of box), 50th (middle line), 75th (top of box), and 95th (top of upper bar) percentile scores.
The dot represents the mean score. Refer to Detailed Statistics for your institution’s sample sizes.
NSSE 2014 Engagement Indicators
Academic Challenge
Hope College
Academic Challenge: First-year students (continued)
Summary of Indicator Items
Great Lakes
Private
Carnegie
Class
%
%
%
%
4b. Applying facts, theories, or methods to practical problems or new situations
81
75
77
73
4c. Analyzing an idea, experience, or line of reasoning in depth by examining its parts
78
76
78
72
4d. Evaluating a point of view, decision, or information source
66
73
76
70
4e. Forming a new idea or understanding from various pieces of information
66
73
74
69
2a. Combined ideas from different courses when completing assignments
52
57
59
56
2b. Connected your learning to societal problems or issues
56
56
60
53
2c. Included diverse perspectives (political, religious, racial/ethnic, gender, etc.) in course
discussions or assignments
2d. Examined the strengths and weaknesses of your own views on a topic or issue
58
55
59
50
60
65
68
63
2e. Tried to better understand someone else's views by imagining how an issue looks from
his or her perspective
2f. Learned something that changed the way you understand an issue or concept
65
68
70
66
70
67
71
65
2g. Connected ideas from your courses to your prior experiences and knowledge
85
80
82
77
9a. Identified key information from reading assignments
83
83
87
80
9b. Reviewed your notes after class
65
65
64
65
9c. Summarized what you learned in class or from course materials
64
64
64
63
52
50
52
52
40
37
39
38
36
36
40
37
Higher-Order Learning
Percentage responding "Very much" or "Quite a bit" about how much coursework emphasized…
Hope
NSSE 2013 &
2014
Reflective & Integrative Learning
Percentage of students who responded that they "Very often" or "Often"…
Learning Strategies
Percentage of students who responded that they "Very often" or "Often"…
Quantitative Reasoning
Percentage of students who responded that they "Very often" or "Often"…
6a. Reached conclusions based on your own analysis of numerical information (numbers,
graphs, statistics, etc.)
6b. Used numerical information to examine a real-world problem or issue (unemployment,
climate change, public health, etc.)
6c. Evaluated what others have concluded from numerical information
Notes: Refer to your Frequencies and Statistical Comparisons report for full distributions and significance tests. Item numbering corresponds to the survey facsimile included in your
Institutional Report and available on the NSSE Web site.
2 • NSSE 2014 ENGAGEMENT INDICATORS
NSSE 2014 Engagement Indicators
Academic Challenge
Hope College
Academic Challenge: Seniors
Challenging intellectual and creative work is central to student learning and collegiate quality. Colleges and universities promote
student learning by challenging and supporting them to engage in various forms of deep learning. Four Engagement Indicators are
part of this theme: Higher-Order Learning, Reflective & Integrative Learning, Learning Strategies, and Quantitative Reasoning.
Below and on the next page are three views of your results alongside those of your comparison groups.
Mean Comparisons
Hope
Engagement Indicator
Mean
Great Lakes Private
Effect
Mean
size
Higher-Order Learning
40.6
42.2
-.12
Reflective & Integrative Learning
40.9
40.2
.06
Learning Strategies
36.6
40.0 ***
Quantitative Reasoning
27.6
29.6
Your seniors compared with
Carnegie Class
Effect
Mean
size
NSSE 2013 & 2014
Effect
Mean
size
43.0 **
-.18
41.2
-.04
41.4
-.04
38.9 **
.15
-.23
39.8 ***
-.22
40.3 ***
-.25
-.12
30.7 **
-.18
29.9 *
-.14
Notes: Results weighted by institution-reported sex and enrollment status (and institution size for comparison groups); *p<.05, **p<.01, ***p<.001 (2-tailed); Effect size: Mean
difference divided by pooled standard deviation; Symbols on the Overview page are based on effect size and p before rounding.
Score Distributions
Higher-Order Learning
Reflective & Integrative Learning
60
60
45
45
30
30
15
15
0
0
Hope
Great Lakes Private
Carnegie Class
NSSE 2013 & 2014
Hope
Learning Strategies
Great Lakes Private
Carnegie Class
NSSE 2013 & 2014
Quantitative Reasoning
60
60
45
45
30
30
15
15
0
0
Hope
Great Lakes Private
Carnegie Class
NSSE 2013 & 2014
Hope
Great Lakes Private
Carnegie Class
NSSE 2013 & 2014
Notes: Each box-and-whiskers chart plots the 5th (bottom of lower bar), 25th (bottom of box), 50th (middle line), 75th (top of box), and 95th (top of upper bar) percentile scores.
The dot represents the mean score. Refer to Detailed Statistics for your institution’s sample sizes.
NSSE 2014 ENGAGEMENT INDICATORS • 3
NSSE 2014 Engagement Indicators
Academic Challenge
Hope College
Academic Challenge: Seniors (continued)
Summary of Indicator Items
Great Lakes
Private
Carnegie
Class
%
%
%
%
4b. Applying facts, theories, or methods to practical problems or new situations
83
81
81
80
4c. Analyzing an idea, experience, or line of reasoning in depth by examining its parts
78
80
82
78
4d. Evaluating a point of view, decision, or information source
71
76
78
72
4e. Forming a new idea or understanding from various pieces of information
71
76
78
72
2a. Combined ideas from different courses when completing assignments
78
73
76
72
2b. Connected your learning to societal problems or issues
73
68
71
64
2c. Included diverse perspectives (political, religious, racial/ethnic, gender, etc.) in course
discussions or assignments
2d. Examined the strengths and weaknesses of your own views on a topic or issue
63
62
64
55
72
71
72
66
2e. Tried to better understand someone else's views by imagining how an issue looks from
his or her perspective
2f. Learned something that changed the way you understand an issue or concept
71
73
75
70
75
72
76
70
2g. Connected ideas from your courses to your prior experiences and knowledge
91
86
88
84
9a. Identified key information from reading assignments
87
84
88
83
9b. Reviewed your notes after class
48
61
56
63
9c. Summarized what you learned in class or from course materials
58
65
63
66
49
53
54
55
39
44
45
45
43
44
49
44
Higher-Order Learning
Percentage responding "Very much" or "Quite a bit" about how much coursework emphasized…
Hope
NSSE 2013 &
2014
Reflective & Integrative Learning
Percentage of students who responded that they "Very often" or "Often"…
Learning Strategies
Percentage of students who responded that they "Very often" or "Often"…
Quantitative Reasoning
Percentage of students who responded that they "Very often" or "Often"…
6a. Reached conclusions based on your own analysis of numerical information (numbers,
graphs, statistics, etc.)
6b. Used numerical information to examine a real-world problem or issue (unemployment,
climate change, public health, etc.)
6c. Evaluated what others have concluded from numerical information
Notes: Refer to your Frequencies and Statistical Comparisons report for full distributions and significance tests. Item numbering corresponds to the survey facsimile included in your
Institutional Report and available on the NSSE Web site.
4 • NSSE 2014 ENGAGEMENT INDICATORS
Hope College 2014 Engagement Indicators
Higher-Order Learning
60%
Hope Mean Percentile
of Group Mean Distribution
1.2%
40%
20%
0%
Higher-Order Learning
NSSE 2013 & 2014
Detailed Statistics: First-Year Students
SD
12.5
13.8
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
0.56
60%
Mean
39.5
39.0
Hope Mean Percentile
of Group Mean Distribution
71.2%
20%
0%
SD
12.5
13.6
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-1.38
60%
Hope Mean Percentile
of Group Mean Distribution
8.3%
0%
Higher-Order Learning
Top 10%
Detailed Statistics: First-Year Students
SD
12.5
13.6
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-4.05
60%
Mean
39.5
42.7
Hope Mean Percentile
of Group Mean Distribution
0.0%
0.0%
80% 100.0%
40%
20%
0%
Prepared by Hope College Office of Institutional Research
2/24/2015
0.0%
Hope
Group
40%
20%
0%
SD
12.6
14.1
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-0.66
60%
Mean
40.6
41.2
25.4%
80% 74.6%
40%
20%
0%
Higher-Order Learning
Top 50%
Detailed Statistics: Seniors
SD
12.6
13.7
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-3.00
60%
Hope
Group
40%
0.2%
80% 99.8%
Higher-Order Learning
NSSE 2013 & 2014
Detailed Statistics: Seniors
SNSUM
8
3
8.3%
80% 91.7%
20%
60%
Hope
Group
Mean
40.6
43.3
Hope Mean Percentile
of Group Mean Distribution
0.1%
8.3%
Mean
39.5
40.6
Group Mean Standard Deviations
of Hope Mean from Group Mean
-2.88
Hope Mean Percentile
of Group Mean Distribution
25.4%
Higher-Order Learning
Top 50%
Detailed Statistics: First-Year Students
Hope
Group
100%
SNSUM
8
2
71.2%
80% 28.8%
40%
Mean
40.6
43.0
Hope Mean Percentile
of Group Mean Distribution
0.2%
71.2%
Hope
Group
SD
12.6
12.9
Hope
Group
0.2%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-2.25
1.2%
80% 98.8%
25.4%
100%
1.2%
Mean
39.5
41.2
Higher-Order Learning
Carnegie Class
Detailed Statistics: Seniors
SNSUM
8
4
0.1%
80% 99.9%
40%
20%
0%
0.1%
SD
12.5
13.0
Hope
Group
SNSUM
8
1
Higher-Order Learning
Top 10%
Detailed Statistics: Seniors
SD
12.6
13.6
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-5.32
60%
Hope
Group
Mean
40.6
45.3
Hope Mean Percentile
of Group Mean Distribution
0.0%
0.0%
80% 100.0%
40%
20%
0%
0.0%
Higher-Order Learning
Carnegie Class
Detailed Statistics: First-Year Students
Hope College 2014 Engagement Indicators
Reflective & Integrative Learning
60%
Hope Mean Percentile
of Group Mean Distribution
0.3%
40%
20%
0%
Reflective & Integrative Learning
NSSE 2013 & 2014
Detailed Statistics: First-Year Students
SD
11.9
12.6
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
0.38
60%
Mean
35.9
35.6
Hope Mean Percentile
of Group Mean Distribution
64.7%
20%
0%
SD
11.9
12.5
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-2.01
60%
Hope Mean Percentile
of Group Mean Distribution
2.2%
20%
Reflective & Integrative Learning
Top 10%
Detailed Statistics: First-Year Students
SD
11.9
12.6
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-4.70
60%
Mean
35.9
39.3
Hope Mean Percentile
of Group Mean Distribution
0.0%
0.0%
80% 100.0%
40%
20%
0%
Prepared by Hope College Office of Institutional Research
2/24/2015
0.0%
Hope
Group
40%
20%
0%
SD
11.8
13.0
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
2.39
60%
Mean
40.9
38.9
80%
99.2%
0.8%
40%
20%
0%
Reflective & Integrative Learning
Top 50%
Detailed Statistics: Seniors
SD
11.8
12.6
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-0.22
60%
Hope
Group
40%
25.8%
80% 74.2%
Reflective & Integrative Learning
NSSE 2013 & 2014
Detailed Statistics: Seniors
SNSUM
#
3
2.2%
80% 97.8%
0%
60%
Hope
Group
Mean
40.9
41.1
Hope Mean Percentile
of Group Mean Distribution
41.3%
2.2%
Mean
35.9
37.3
Group Mean Standard Deviations
of Hope Mean from Group Mean
-0.65
Hope Mean Percentile
of Group Mean Distribution
99.2%
Reflective & Integrative Learning
Top 50%
Detailed Statistics: First-Year Students
Hope
Group
100%
SNSUM
#
2
64.7%
80% 35.3%
40%
Mean
40.9
41.4
Hope Mean Percentile
of Group Mean Distribution
25.8%
64.7%
Hope
Group
SD
11.8
12.4
Hope
Group
25.8%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-2.77
0.3%
80% 99.7%
99.2%
100%
0.3%
Mean
35.9
37.8
Reflective & Integrative Learning
Carnegie Class
Detailed Statistics: Seniors
SNSUM
#
4
41.3%
80% 58.7%
40%
20%
41.3%
SD
11.9
12.1
Hope
Group
SNSUM
#
1
0%
Reflective & Integrative Learning
Top 10%
Detailed Statistics: Seniors
SD
11.8
12.5
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-2.76
60%
Hope
Group
Mean
40.9
43.1
Hope Mean Percentile
of Group Mean Distribution
0.3%
0.3%
80% 99.7%
40%
20%
0%
0.3%
Reflective & Integrative Learning
Carnegie Class
Detailed Statistics: First-Year Students
Hope College 2014 Engagement Indicators
Learning Strategies
60%
Hope Mean Percentile
of Group Mean Distribution
34.4%
40%
20%
0%
Learning Strategies
NSSE 2013 & 2014
Detailed Statistics: First-Year Students
SD
13.6
14.2
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
0.69
60%
Mean
40.0
39.5
Hope Mean Percentile
of Group Mean Distribution
75.6%
20%
0%
SD
13.6
14.0
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-1.41
60%
Hope Mean Percentile
of Group Mean Distribution
8.0%
20%
Learning Strategies
Top 10%
Detailed Statistics: First-Year Students
SD
13.6
14.0
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-4.04
60%
Mean
40.0
43.4
Hope Mean Percentile
of Group Mean Distribution
0.0%
0.0%
80% 100.0%
40%
20%
0%
Prepared by Hope College Office of Institutional Research
2/24/2015
0.0%
Hope
Group
40%
20%
0%
SD
13.3
14.8
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-3.85
60%
Mean
36.6
40.3
0.0%
80% 100.0%
40%
20%
0%
Learning Strategies
Top 50%
Detailed Statistics: Seniors
SD
13.3
14.5
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-6.19
60%
Hope
Group
40%
0.0%
80% 100.0%
Learning Strategies
NSSE 2013 & 2014
Detailed Statistics: Seniors
SNSUM
#
3
8.0%
80% 92.0%
0%
60%
Hope
Group
Mean
36.6
42.5
Hope Mean Percentile
of Group Mean Distribution
0.0%
8.0%
Mean
40.0
41.2
Group Mean Standard Deviations
of Hope Mean from Group Mean
-3.42
Hope Mean Percentile
of Group Mean Distribution
0.0%
Learning Strategies
Top 50%
Detailed Statistics: First-Year Students
Hope
Group
100%
SNSUM
#
2
75.6%
80% 24.4%
40%
Mean
36.6
39.8
Hope Mean Percentile
of Group Mean Distribution
0.0%
75.6%
Hope
Group
SD
13.3
14.1
Hope
Group
0.0%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-0.40
34.4%
80% 65.6%
0.0%
100%
34.4%
Mean
40.0
40.4
Learning Strategies
Carnegie Class
Detailed Statistics: Seniors
SNSUM
#
4
0.0%
80% 100.0%
40%
20%
0%
0.0%
SD
13.6
13.6
Hope
Group
SNSUM
#
1
Learning Strategies
Top 10%
Detailed Statistics: Seniors
SD
13.3
14.1
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-8.96
60%
Hope
Group
Mean
36.6
44.9
Hope Mean Percentile
of Group Mean Distribution
0.0%
0.0%
80% 100.0%
40%
20%
0%
0.0%
Learning Strategies
Carnegie Class
Detailed Statistics: First-Year Students
Hope College 2014 Engagement Indicators
Quantitative Reasoning
60%
Hope Mean Percentile
of Group Mean Distribution
49.2%
40%
20%
SD
15.0
16.4
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
0.71
60%
Mean
28.0
27.4
Hope Mean Percentile
of Group Mean Distribution
76.1%
76.1%
80% 23.9%
40%
20%
0%
SD
15.0
16.3
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-0.80
60%
Hope Mean Percentile
of Group Mean Distribution
21.1%
0%
Quantitative Reasoning
Top 10%
Detailed Statistics: First-Year Students
SD
15.0
16.2
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-2.77
60%
Mean
28.0
30.6
Hope Mean Percentile
of Group Mean Distribution
0.3%
0.3%
80% 99.7%
40%
20%
0%
Prepared by Hope College Office of Institutional Research
2/24/2015
0.3%
Hope
Group
40%
20%
0%
SD
16.8
17.4
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-2.13
60%
Mean
27.6
29.9
1.7%
80% 98.3%
40%
20%
0%
Quantitative Reasoning
Top 50%
Detailed Statistics: Seniors
SD
16.8
17.2
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-3.43
60%
Hope
Group
40%
0.2%
80% 99.8%
Quantitative Reasoning
NSSE 2013 & 2014
Detailed Statistics: Seniors
SNSUM
#
3
21.1%
80% 78.9%
20%
60%
Hope
Group
21.1%
Mean
28.0
28.8
Group Mean Standard Deviations
of Hope Mean from Group Mean
-2.82
Hope Mean Percentile
of Group Mean Distribution
1.7%
Quantitative Reasoning
Top 50%
Detailed Statistics: First-Year Students
Hope
Group
100%
SNSUM
#
2
76.1%
Hope
Group
Mean
27.6
30.7
Hope Mean Percentile
of Group Mean Distribution
0.2%
0%
Quantitative Reasoning
NSSE 2013 & 2014
Detailed Statistics: First-Year Students
SD
16.8
17.8
Hope
Group
0.2%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-0.02
49.2%
80% 50.8%
1.7%
100%
49.2%
Mean
28.0
28.0
Quantitative Reasoning
Carnegie Class
Detailed Statistics: Seniors
Mean
27.6
31.3
Hope Mean Percentile
of Group Mean Distribution
0.0%
SNSUM
#
4
0.0%
80% 100.0%
40%
20%
0%
0.0%
SD
15.0
16.2
Hope
Group
SNSUM
#
1
Quantitative Reasoning
Top 10%
Detailed Statistics: Seniors
SD
16.8
16.9
100%
Group Mean Standard Deviations
of Hope Mean from Group Mean
-5.07
60%
Hope
Group
Mean
27.6
33.0
Hope Mean Percentile
of Group Mean Distribution
0.0%
0.0%
80% 100.0%
40%
20%
0%
0.0%
Quantitative Reasoning
Carnegie Class
Detailed Statistics: First-Year Students