Page |1
Core Competency Assessment
Results Report
Information Literacy
2012
Prepared by Chris Orem
For Dabney S. Lancaster Community College
Page |2
In spring of 2012, 25 graduating Transfer degree-seeking students (77 total) completed the
Information Literacy Test (ILT) that measures four objectives of the VCCS Core Competency,
information literacy. Information literacy recognizes when information is needed and has the
ability to locate, evaluate, and use it effectively. (adapted from the American Library Association
definition). The four objectives measured by the test are listed below along with results for
each.
According to the VCCS overview of the ILT, a proficiency pass rate was set by VCCS faculty in
2004. Because the test had not changed since then, it was determined that the same pass
rates would be used again. These were:
Proficient Pass: 39 of 60 questions (65%)
Advanced Pass: 54 of 60 questions (90%)
Pass rates for the DSLCC Transfer students indicate that 44% of test-takers (54.5% overall)
scored at least a 65% on the test and no student scored above 90%. The average score for
Transfer students was a 60% (71.86% Overall). For the individual objectives, Transfer students
averaged 78% on Objective One items (74% overall students). Objective Two was by far the
lowest; the average score for Transfer students was 49.3%. However, it may be that these
questions related to Objective Two were low across the system. Objective Three and Objective
Five had average scores of 65.1% and 60.8% for Transfer students. These averages were in
line with the average scores of all respondents.
VCCS results are provided for the overall pass rate as well as for each individual standard. Of
note are the significant differences between transfer students and all VCCS test takers on
standards three (evaluate information and its sources critically and incorporate selected
information into his or her knowledge base) and five (understand many of the economic, legal,
and social issues surrounding the use of information and access and use information ethically
and legally). Though the difference in sample sizes (25 to 1076) should lead to some caution
when interpreting these results, effect sizes for these standards, which are not as sensitive to
differences in sample sizes indicates that DSLCC students scored significantly lower on these
two standards with moderate effect sizes. This apparent weakness among DSLCC transfer
students might be explained by the fact that the curriculum map completed by Transfer faculty in
August 2013 indicates that students don’t receive moderate exposure to these skills much past
their second semester, which may indicate the need to increase attention to this skill in later
coursework.
December 18, 2012; Revised 10/25/13
Prepared by Chris Orem, Office of Institutional Effectiveness
Page |3
Overall Pass Rates
Group
Dabney S. Lancaster
Passed Test
Took Test
N
Passed Test at
Advanced
Level
N
%
%
Transfer
25
11
44
Total
77
42
54.5
.
VCCS
1,076
624
58.0
Note. Proficient Pass Rate was established at 39/60 (65%). Advanced Pass Rate is
54/60 (90%)
.
Degree graduates will demonstrate the ability to:
a. determine the nature and extent of the information needed;
Standard 1
Mean
Standard Deviation
Lower Confidence
Limit (95%)
All DSLCC Testtakers (77)
71.86%
16.72
Upper Confidence
Limit
68.07
75.66
Min
Only transfer
students (25)
78%
17
70.98
85.22
33
Median/2nd Quartile
3rd Quartile
Max
25
75
83.33
100
Note. Number of Items = 12
December 18, 2012; Revised 10/25/13
Prepared by Chris Orem, Office of Institutional Effectiveness
67
83
91.6
VCCS (1076)
72.4
15.6
71.5
73.4
Page |4
b. access needed information effectively and efficiently;
Standard 2
Mean
Standard Deviation
Lower Confidence
Limit
All DSLCC Testtakers (77)
49.83
12.36
Only transfer
students (25)
49.3
12
44.35
VCCS (1076)
54.25
53
52.1
15.2
51.2
47.02
Upper Confidence
Limit
52.63
Min
26.3
21.05
47.37
57.89
78.95
Median/2nd Quartile
3rd Quartile
Max
52.6
57.9
73.6
Note. Number of items = 19
c. evaluate information and its sources critically and incorporate selected information into
his or her knowledge base;
Standard 3
Mean
Standard
Deviation
Lower Confidence
Limit (90%)
All DSLCC Testtakers (77)
69.31
Upper Confidence
Limit
Only transfer
students (25)
65.1
16
VCCS (1076)
58.5
71
71.7
72.8
71.9
15.5
15.82
65.72
72.9
Min
36.8
21.05
Median/2nd
Quartile
3rd Quartile
Max
63.1
73.68
78.95
94.74
78.9
94.74
Note. Number of Items = 19
d. use information effectively, individually or as a member of a group, to accomplish a
specific purpose;
N/A
December 18, 2012; Revised 10/25/13
Prepared by Chris Orem, Office of Institutional Effectiveness
Page |5
e. understand many of the economic, legal, and social issues surrounding the use of
information and access and use information ethically and legally.
Standard 5
Mean
Standard Deviation
Lower Confidence
Limit (90%)
All DSLCC Testtakers (77)
68.05
15.9
Upper Confidence
Limit
Only transfer
students (25)
60.8
15
54.61
VCCS (1076)
66.99
69.6
64.44
71.66
Min
30
Median/2nd Quartile
3rd Quartile
Max
68.5
17.5
67.5
30
70
80
100
Note. Number of Items = 10
December 18, 2012; Revised 10/25/13
Prepared by Chris Orem, Office of Institutional Effectiveness
60
70
80