CAAP
SCIENCE TEST FALL 2013
Texas Tech University
Institution Code: 4220
Institution Type: 4-Year Public
Subgroup: Freshman & Senior
Normative group: All CAAP tested Freshman & Senior
Prepared by the Office of Planning & Assessment
CAAP
SCIENCE TEST
Collegiate Assessment of Academic Proficiency (CAAP) Science Test
EXECUTIVE SUMMARY
The present report contains results from CAAP Science Test form 14-A. Scores were obtained from a
representative sample of 378 students (freshmen = 182; senior = 196). Results of the analysis indicate
that on average, freshmen and seniors scored above their respective normative group. As such, the
established benchmark of performing at or above the normative group was attained.
DESCRIPTION
The CAAP Science Test assesses students’ knowledge and skills in science. The test encompasses
content from biology, chemistry, physics and the physical science. The CAAP Science Test is
administered during the fall semester to a representative sample of students. The assessment
measures student’s core curriculum competency in science.
BENCHMARK
Benchmark measures for the CAAP Science Test have been established as being at or above the
national average for all freshman CAAP Science Test takers and at or above the national average for
all Senior CAAP Science Test takers. See Table 1.
Table 1: Benchmark
Freshman
Senior
At or above CAAP national average for Freshman
At or above CAAP national average for Senior
Yes
Yes
ASSESSMENT STRATEGY
The test was administered to a random stratified sample of freshmen and seniors from each College at
Texas Tech University (TTU) and TTU Waco (see Figure 1). Courses were chosen based on
enrollment by student classification and size. Freshman courses were chosen from the core
curriculum. The sample included courses from the following colleges: College of Agricultural Sciences
and Natural Resources, College of Architecture, College of Architecture, College of Arts and Sciences,
Rawls College of Business Administration, College of Education, College of Engineering, Honors
College, College of Human Sciences, College of Media & Communications, College of Visual and
Performing Arts. The test was administered during regularly scheduled class time for the courses that
were selected. A total of 505 students participated in the CAAP Science Test from 27 undergraduate
classes, of which 378 were valid for scoring by American College Testing (ACT).
1
Figure 1: Population and Sample by Major
Social Sciences
Physical Sciences
Philosophy/Religion
Mathematics
English
Home Economics
Health Professions
Foreign Languages
Major
Fine & Applied Arts
Engineering
Sample %
Education
General Studies
Population %
Computer & Info. Sciences
Community Services
Communications
Business
Biological Sciences
Architecture
Agriculture
Undecided
0%
2%
4%
6%
8% 10% 12% 14% 16% 18%
Percent
RESULTS
Table 2 provides a summary of CAAP scores by student classification. On average TTU freshmen
(M=60.09, SD=4.2) scored above the national average, t (181) = 4.824, p = .000. Seniors (M=60.96,
SD=4.3) scored above the national average with respect to their normative group, t (195) = 2.151, p =
.033.
Table 2: Summary of CAAP Scores by Student Classification
n
Freshman
Senior
1
2
182
196
National Mean
1
58.6
60.32
SD
Sample Mean
SD
4.6
4.8
60.09
60.96
4.2
4.3
4.824
2.151
p
.000
.033
2
http://act.org/caap/norms/pdf/2013/CAAP-TestedCollegeFreshmen.pdf accessed 12/19/2013
http://act.org/caap/norms/pdf/2013/CAAP-TestedCollegeSeniors.pdf accessed 12/19/2013
t
PERFORMANCE BY QUARTILES
Student performance on the CAAP Science test was also classified by quartiles for freshman level
students and for senior level students. Of particular relevance are the students whose scores fall in the
lowest quartile (Q1) relative to the national percentile. The classification by quartiles indicated that 26%
of freshman level students and 26% of senior level students performed in the lowest quartile. The
following tables depict the percentage of students in each quartile by classification level:
Table 3: Freshmen
Table 4: Seniors
Q1
Q2
26%
42%
Q2
26%
28%
Q3
18%
Q3
27%
Q4
14%
Q4
19%
Q1
CONCLUSION
The findings from the analysis herein reported indicate that Texas Tech University freshman and senior
level students are performing above the national average in the core curricular subject of science. In
addition, nearly a quarter of the students in each classification performed in the lower quartile relative to
the national percentile. It is recommended that the core curriculum committee, in conjunction with
faculty, and pertinent administrators consider these results in order to enhance the educational
experience, and continue improving student learning at Texas Tech University.
.
3