Alabama A&M University
Multi-Year Benchmark Report
August 2010
NSSE 2010 Multi-Year Benchmark Report
Interpreting the Multi-Year Benchmark Report
For institutions that have participated in multiple NSSE administrations, this Multi-Year Benchmark Report presents
comparable benchmark scores by year so that patterns of change or stability may be discernible. It also provides
statistics such as number of respondents, standard deviation, and standard error so that shorthand mean comparison
tests can be calculated.
Questions that might be answered with this report include, “How stable was the level of student-faculty interaction
over the years?” or “Given the implementation of initiative X three years ago, did the level of active and
collaborative learning increase?”
This report has three main parts: (a) a table of data quality indicators (p. 3), which provides a quick reference to
important statistics for each year’s participation, (b) multi-year charts, and (c) detailed statistics. Key terms and
features of (b) and (c) are illustrated below.
For more information and recommendations for analyzing past and present NSSE data for trends or stability, consult
the Multi-Year Data Analysis Guide. nsse.iub.edu/pdf/NSSE Multi-Year Data Analysis Guide.pdf
Key Terms and Features in this Report
Multi-year charts
appear on pages 4 & 6
Y-Axis
Benchmarks are computed on
a 0 to 100 scale, however
nearly all institutional scores
are between the y-axis values
of 15 and 85.
Error Bars/Confidence Intervals
Error bars around each benchmark
score show the upper and lower
bounds of the 95% confidence
interval (mean +/- 1.96 * SEM), a
range of values 95% likely to
contain the true population score.
"Upper" and "Lower" limits are
also reported in the detailed
statistics tables. Where confidence
intervals do not overlap between
years, a statistically significant
difference (p < .05) is likely to be
present.
Benchmark Score
The benchmark score is the
weighted average of the
students' scores, using only
randomly sampled students
(including those from
census administrations)
from each year's data.
n
Unweighted number of
respondents represented
in the data.
Multi-year detailed statistics
appear on pages 5 & 7
SEM
Standard error of the mean
is how much a score based
on a sample may differ
from the true population
score. SEM is used to
compute confidence
intervals.
Year
All NSSE administration years
since 2004 are listed
regardless of participation.
SD
Standard deviation, the
average amount by
which students' scores
differ from the mean.
-2-
NSSE 2010 Multi-Year Benchmark Report
Data Quality Indicators
Alabama A&M University
An important early step in conducting a multi-year analysis is to review the quality of your data for both first-year
and senior respondents in each year. The precision of an institution's population estimates can vary from one year to
the next. The values in this table were drawn from the Respondent Characteristics reports from each NSSE
administration.
Data Quality Indicators for Each NSSE Participation Year
Year
a
Mode
b
Response
Ratec
Sampling
Errord
Number of
Respondentse
FY
SR
FY
SR
FY
SR
2004
2005
2006
2007
2008
Paper
13%
13%
15.1%
14.7%
41
42
2009
Web+
11%
18%
9.3%
8.2%
98
116
2010
Paper
12%
10%
17.1%
18.2%
32
28
a
All NSSE administration years since 2004 are listed regardless of participation.
b
Modes include Paper (students receive a paper survey and the option of completing a Web version), Web (students
receive all correspondence by e-mail and complete the Web version), and Web+ (students initially invited to participate
via e-mail; a subgroup of nonrespondents receive paper surveys).
c
Response rates (number of respondents divided by sample size) adjusted for ineligibility, nondeliverable mailing
addresses, and students who were unavailable during the survey administration.
d
Sampling error gauges the precision of results based on a sample survey. It is an estimate of how much survey item
percentages for your respondents could differ from those of the entire population of students at your institution. Data
with larger sampling errors (such as +/-10%) need not be dismissed out of hand, but any results using them should be
interpreted more conservatively.
e
This is the original count used to calculate response rates and sampling errors for each administration's Respondent
Characteristics report. This number includes all randomly sampled students (including those from census
administrations). In 2004 and 2005 it may also include targeted oversamples. For this reason, the counts for 2004
and 2005 may not match those given in the detailed statistics on pages 5 and 7.
-3-
NSSE 2010 Multi-Year Benchmark Report
Multi-Year Charts
Alabama A&M University
First-Year Students
Level of Academic Challenge (LAC)
Active and Collaborative Learning (ACL)
85
85
75
75
65
65
51.7
55
47.9
51.3
57.0
55
45
45
35
35
25
25
15
45.0
46.6
'09
'10
15
'04
'05
'06
'07
'08
'09
'10
Student-Faculty Interaction (SFI)
'04
'06
'07
'08
Enriching Educational Experiences (EEE)
85
85
75
75
65
65
55
55
43.7
45
'05
41.2
40.9
35
45
30.3
35
25
23.7
25
15
26.3
15
'04
'05
'06
'07
'08
'09
'10
'04
'05
'06
'07
'08
'09
'10
Supportive Campus Environment (SCE)
85
75
Notes:
59.7
65
58.6
56.0
55
• Benchmark scores are charted for all years of
participation. See page 5 for detailed statistics.
• For more information and recommendations for analyzing
multi-year NSSE data, consult the Multi-Year Data
Analysis Guide. nsse.iub.edu/pdf/NSSE
Multi-Year Data Analysis Guide.pdf
45
35
25
15
'04
'05
'06
'07
'08
'09
'10
-4-
NSSE 2010 Multi-Year Benchmark Report
Detailed Statisticsa
Alabama A&M University
First-Year Students
2004
Level of
Academic
Challenge
Active and
Collaborative
Learning
Student
Faculty
Interaction
Enriching
Educational
Experiences
Supportive
Campus
Environment
a
2005
2006
2007
2008
2009
2010
LAC
51.7
47.9
51.3
n
36
76
28
SD
13.9
13.0
13.8
SEM
2.31
1.49
2.60
Upper
56.3
50.8
56.3
Lower
47.2
44.9
46.2
ACL
57.0
45.0
46.6
n
39
98
32
SD
20.7
17.8
16.2
SEM
3.30
1.80
2.86
Upper
63.4
48.5
52.2
Lower
50.5
41.4
41.0
SFI
43.7
41.2
40.9
n
36
85
31
SD
24.5
19.5
23.2
SEM
4 07
4.07
2 12
2.12
4 16
4.16
Upper
51.7
45.3
49.1
Lower
35.7
37.0
32.8
EEE
30.3
23.7
26.3
n
36
71
30
SD
18.3
11.8
17.3
SEM
3.04
1.40
3.17
Upper
36.3
26.4
32.5
Lower
24.3
20.9
20.1
SCE
59.7
58.6
56.0
n
34
67
28
SD
20.6
21.2
23.9
SEM
3.50
2.59
4.55
Upper
66.5
63.7
64.9
Lower
52.8
53.6
47.0
n=number of respondents; SD =standard deviation; SEM =standard error of the mean; Upper/Lower=95% confidence interval limits
IPEDS:100654
-5-
NSSE 2010 Multi-Year Benchmark Report
Multi-Year Charts
Alabama A&M University
Seniors
Level of Academic Challenge (LAC)
Active and Collaborative Learning (ACL)
85
85
75
75
65
65
58.6
52.9
55
52.2
59.3
57.6
'08
'09
60.4
55
45
45
35
35
25
25
15
15
'04
'05
'06
'07
'08
'09
'10
Student-Faculty Interaction (SFI)
'04
'06
'07
'10
Enriching Educational Experiences (EEE)
85
85
75
75
65
65
50.1
55
'05
51.3
55
44.7
45
45
35
35
25
25
15
41.0
41.5
'08
'09
39.2
15
'04
'05
'06
'07
'08
'09
'10
'04
'05
'06
'07
'10
Supportive Campus Environment (SCE)
85
75
61.1
65
56.3
56.5
55
Notes:
• Benchmark scores are charted for all years of
participation. See page 7 for detailed statistics.
• For more information and recommendations for analyzing
multi-year NSSE data, consult the Multi-Year Data
Analysis Guide. nsse.iub.edu/pdf/NSSE
Multi-Year Data Analysis Guide.pdf
45
35
25
15
'04
'05
'06
'07
'08
'09
'10
-6-
NSSE 2010 Multi-Year Benchmark Report
Detailed Statisticsa
Alabama A&M University
Seniors
2004
Level of
Academic
Challenge
Active and
Collaborative
Learning
Student
Faculty
Interaction
Enriching
Educational
Experiences
Supportive
Campus
Environment
a
2005
2006
2007
2008
2009
2010
LAC
52.9
52.2
58.6
n
33
104
28
SD
16.7
14.6
12.4
SEM
2.91
1.43
2.34
Upper
58.6
55.0
63.2
Lower
47.2
49.4
54.0
ACL
59.3
57.6
60.4
n
42
115
28
SD
22.4
20.7
18.0
SEM
3.46
1.93
3.40
Upper
66.1
61.3
67.0
Lower
52.5
53.8
53.7
SFI
50.1
51.3
44.7
n
35
108
28
SD
23.4
22.5
21.6
SEM
3 94
3.94
2 17
2.17
4 08
4.08
Upper
57.8
55.5
52.7
Lower
42.4
47.0
36.7
EEE
41.0
41.5
39.2
n
31
101
27
SD
22.1
18.4
14.0
SEM
3.96
1.84
2.69
Upper
48.7
45.1
44.4
Lower
33.2
37.9
33.9
SCE
56.3
56.5
61.1
n
31
95
27
SD
22.2
20.9
24.7
SEM
3.99
2.14
4.73
Upper
64.1
60.7
70.3
Lower
48.5
52.3
51.8
n=number of respondents; SD =standard deviation; SEM =standard error of the mean; Upper/Lower=95% confidence interval limits
IPEDS:100654
-7-