RAMAPO COLLEGE OF NEW JERSEY
FALL 1998
COMPANION PILOT STUDY
ELEMENTARY ALGEBRA
Wanda Kosinski
Testing Coordinator
© 1998
OFFICE OF INSTITUTIONAL RESEARCH & PLANNING
Introduction
This report contains preliminary results of the Companion pilot testing conducted
at Ramapo College between May 16 and October 17, 1998. The study was undertaken in
response to one of the recommendations in the self-study report on basic skills testing and
placement -- to find a replacement for the New Jersey College Basic Skills Placement
Test (NJCBSPT).1 The purpose of this study was to compare NJCBSPT algebra test
results with results on the paper and pencil Companion test to ensure proper placement of
students.
The Companion algebra test was administered to a sample of admitted Ramapo
students during four test dates between May and October 1998. At the same time,
students were also tested with the NJCBSPT algebra test in order to make possible a
study equating results from both tests.
Sample Design
A total of 55 students were selected for the Companion pilot study.2 Students
were randomly selected from the appointment lists prepared for test dates in May, June,
and October. Due to a scheduling conflict, all of the students with appointments for math
testing in August were included in the study. Table 1 shows the number of students
selected for the study sample by test date.
TABLE 1: SAMPLE CASES BY TEST DATE
Date
No.
Pct.
16-May
6
11%
20-Jun
12
22%
15-Aug
33
60%
17-Oct
4
7%
Total
55
1
See A Report on Basic Skills Testing and Placement, 1998, Office of Institutional Research and Planning,
Ramapo College of New Jersey.
2
Fifty-four students took Companion and NJCBSPT. One student refused to take NJCBSPT after
completing Companion because “none of [his] friends had to take two math tests.”
2
Tests
Companion
The Companion algebra test consists of 35 multi-choice questions derived from
the Computerized Placement Tests (CPTs) in the ACCUPLACER system, © 1997 by
Educational Testing Service (ETS). A score of 26 or better (74% correct) is required to
demonstrate proficiency in algebra. Percentage correct is based on 35 test items and
testing time is 40 minutes.
NJCBSPT
The NJCBSPT algebra test is 35 multi-choice questions. There has been no new
test item development or support for the instrument since 1993. A passing score is 22 or
better (73% correct) which indicates proficiency in algebra. Percentage correct is based
on 30 test items and testing time is 40 minutes.
Pilot Study
Students in the pilot study were first administered the Companion (algebra and
arithmetic sections) followed by the NJCBSPT (algebra section only). Instructions for
the administration of each test, as outlined in the individual Test Administrator’s
Manuals, were strictly adhered to. However, since only two of the four sections of
Companion were given, the review time allowed for the test was reduced to 7 minutes
from the suggested review time of 15 minutes.
Results
Table 2 shows students’ performance on the algebra sections of Companion and
NJCBSPT. Overall, students achieved higher scores with Companion than with
3
NJCBSPT.3 Of the students tested with Companion, 38% (21) achieved a passing
algebra score, 25% (14) scored less than 50% correct, and 2% (1) scored less than 25%
correct. Of the students tested with NJCBSPT, 31% (17) tested algebra proficient, 39%
(21) scored less than 50% correct, and 17% (9) scored less than 25% correct.
Correlation
Figure 1 graphically depicts the relationship between Companion and NJCBSPT
algebra scores for the sample. A visual scan of the data shows a clear, positive
relationship between student performance on Companion algebra and NJCBSPT algebra.
This relationship is also supported by statistical tests. The correlation coefficient
(Pearson’s r) between Companion algebra scores and NJCBSPT algebra scores is .92 and
is significant at the 0.01 level (2-tailed) (see Correlation Table in Appendix).
Figure 1: NJCBSPT v. Companion
NJCBSPT Score
30
20
10
0
0
10
20
30
40
Companion Score
The algebra scores for both tests and SAT-Math scores (see Table 4 & Figures 2
and 3 in Appendix) are strongly correlated in a positive direction. The correlation
3
Six students (11%) scored lower on Companion than on the NJCBSPT (cases 7, 11, 16, 17, 20, & 26) and
2 students (4%) scored the same on both tests (cases 6 & 25) (Table 3 in Appendix).
4
coefficient between Companion algebra and SAT-Math is .69 (Pearson’s r), while the
coefficient between NJCBSPT algebra and SAT-Math is .71 (Pearson’s r) (see
Correlation Table in Appendix).
Conclusions and Recommendations
According to the findings of a recent survey of testing procedures at Colleges and
Universities in New Jersey, Accuplacer and Companion seem to be identified as the test
of choice to replace NJCBSPT.4 Additionally, the content of discussions that took place
among test administrators during the Special Interest Group Meeting for Testing at the
18th Annual Conference of the New Jersey Association for Developmental Education on
November 20, 1998, serves to further validate this survey finding.
These indicators, coupled with the clearly demonstrated relationship that exists
between the students’ performance on the two tests, suggest that Ramapo College move
quickly to replace the NJCBSPT with the Companion test - a valid and more appropriate
tool for entry-level math placement of students. Furthermore, it is recommended that a
similar equating study be implemented with Companion reading comprehension and
sentence skill tests beginning March 1999 for college entry-level English placement of
the Fall 1999 in-coming freshmen class.
4
See A Survey of Basic Skills Exemption, Testing, and Placement Policies and Procedures at New Jersey
Colleges and Universities, 1997, February 1998, Office of Institutional Research and Planning, Ramapo
College of New Jersey.
5