Setting the Right Course
for College Success
1
COMPASS INTERNET
STATUS
• Why problems occurred
– Item Pool update (April 825 new items)
• What are we doing to correct the problem
– New workstation registrations will no longer go to the
“update” done a at sametime
– Current users Validation process will hardly be
noticed ( now typically 30-40 seconds)
– If item pool doesn’t match , the screen will walk user
through the update process.
• It will/must get BETTER
2
Nationwide Usage
• Over 1,260 postsecondary sites
throughout the country as of September 1,
2011
• 85% in 2-year community and technical
colleges
• 95% internet delivery
• 11 statewide agreements
• Available for Windows® XP, Vista, and
Windows 7; Internet Explorer 6, 7, 8, or 9
3
Nationwide Usage
• Over 2.5 million students tested,
completing over 7.5 million tests (Sept 1,
2010 through Aug 31, 2011)
• 17% of students tested “still in high school”
• Growing International Use (via
International Sites and COMPASS Remote
Testing Network)
4
1. COMPASS Item Pool Updates
(expanding test contents to align more strongly
with Common Core and State Requirements)
a.
b.
c.
April, 2011 (825 pretest items, Reading,
Writing Skills, and Mathematics)
October 27, 2011 (additional pretest
items, adding new operational items)
February, 2012 (additional pretest items,
adding new operational items)
5
2. COMPASS Accommodations
Test Form (paper/pencil; large type, Braille,
audio, reader script)
a. Writing Skills, Reading, Prealgebra (late
fall, 2011)
b. Algebra, College Algebra, Trigonometry,
Geometry (late spring, 2011)
c. Secure materials, request test materials
and answer documents from ACT, return
to ACT for scoring
6
3. COMPASS Group Testing
Form (under discussion; paper/pencil)
a.
b.
High School Outreach/Early Preparation
Dual Enrollment
For situations where there are more students in a group
than computers available
-scanning at ACT (or at site?)
-results into COMPASS for Reporting
7
4. COMPASS and ESL ATB
Preparation Procedures
(to meet US DOE regulations effective 7/1/2011; ATB
Information at www.act.org/compass/advant/atb.html)
•
•
•
•
•
Certification of all ATB Test Administrators (proctors) by ACT;
Application on web )
ATB Test Administration Manual on web
ATB Test Administrator Knowledge Test on web; applicants
must “pass”
ACT Confirms ATB Test Administrator Certification (3-4
weeks after application is submitted; 2,000+ certified)
WORK with DOE for regs, Retesting, portability of scores, take all
three tests on same day, setup separate test package with ATB
listed, Internet only, No Remote testing
8
4. COMPASS ATB Procedures
for Testing (US DOE regulations effective
7/1/2011)
f.
g.
h.
i.
j.
Identification of ATB Testers (use ATB Test Package)
Administer ATB Test Package
Completion of ATB Student Identification Form Prior (ATB
student completes part of form; Certified ATB Test Administrator
adds Code and Signature to form)
College runs ATB Test Record listing (new function being
added to Sessions TAB to generate CSV file, for late October),
adds Certified ATB Test Administrator Code to data from CSV
file in EXCEL, and e-mails EXCEL file to ACT in November
Watch for More Details and Instructions (to be sent in October
via e-mail to COMPASS Campus Coordinators)
9
5. Additional e-Write Prompts
a.
3 New e-Write 2-12 Prompts (to be Added
December, 2011)
b.
3 New ESL e-Write 2-12 Prompts (need
additional ESL essay pretest sites, for students
enrolled in fall ESL classes, 2011 for final pretesting; prompts to be added in fall, 2012)
10
6. National Fall 2011 COMPASS Entering
Student Descriptive Report (ESDR)
a. National, State, Campus ESDR’s (end of October, 2011; will
replace 2010 ESDR reports)
www.act.org/compass/reports/research.html
b.
Two Year Colleges (estimate 1.7 million students; total group, 19
and under, 20 and above)
c.
Four Year Colleges/Universities (estimate 200,000 students;
total group, 19 and under, 20 and above)
d.
ESDR: No charge for college or high school ESDR reports
11
7. New COMPASS Training
Resources
For the Remote Test Site Locator Service
(US and International), the “Getting
Started” Series, and Various “How To”
Guides, go to:
www.act.org/compass/resources.html
12
REMOTE TESTING
• Why/Why not
• Can you give a COMPASS Remote test to Walkins?
• Can you give Remote test overseas?
• Other Global options
• Software list not always same as Locator list on
COMPASS website
• Is High School testing technically a Remote
test?
• Can you charge the student $100 to administer
a Remote test?
13
COMPASS Web Addresses
COMPASS WEBSITE
www.act.org/compass
COMPASS Reference Manual
http://act.org/compass/resources.html
USER NAME: COMESL-PLACEMENT
PASSWORD: DOCS
User Name and Password in caps
COMPASS Practice:
http://www.act.org/compass/tests/index.html
http://online.gtcc.edu/moodle/public
Guilford Technical CC Jamestown NC
14
COMPASS WEBSITES cont.
• http://www.hostos.cuny.edu/oaa/compass/
index.asp
CITY UNIVERSITY OF NEW YORK
http://gsc.edu/academics/acadenrich/ls/CPE
/pages/default.aspx
GAINESVILLE COLLEGE LEARNING
SUPPORT
15
COMPASS
RETESTING
16
COMPASS Retest Gain Scores
Average score gain, students tested less than 2 days apart
Test
N
Average Gain
25th Percentile
Median
75th Percentile
Pre-algebra
9595
3.1
-4
2
10
Algebra
9411
3.3
-3
2
9
College algebra
756
4.4
-4
3
13
Reading
11677
4.6
-3
5
13
Writing
13230
9.6
-6
9
27
Average score gain, students tested no more than one week apart
Test
N
Average Gain
25th Percentile
Median
75th Percentile
Pre-algebra
21132
5.3
-2
4
13
Algebra
21960
5.2
-2
3
11
College algebra
1657
6.7
-2
5
15
Reading
29107
6.1
-1
6
14
Writing
29816
13.5
-2
13
30 17
COMPASS Retest Gain Scores
Average score gain, students tested no more than two weeks apart
Test
N
Average Gain
25th Percentile
Median
75th Percentile
Pre-algebra
26705
5.7
-2
4
13
Algebra
27798
5.4
-1
3
11
College algebra
2053
6.9
-1
5
16
Reading
36462
6.3
-1
7
14
Writing
37069
14
-1
14
30
Average score gain, students tested no more than one month apart
Test
N
Average Gain
25th Percentile
Median
75th Percentile
Pre-algebra
29281
5.8
-2
4
13
Algebra
30217
5.5
-1
3
11
College algebra
2242
7.2
-1
6
16
Reading
39701
6.3
-1
7
14
Writing
40116
14.2
-1
14
30
18
19
20
DO WE HAVE A
RETESTING POLICY?
21
• Factors other than examinee’s ability are
believed to have influenced previous
testing
• Scores obtained from earlier testing are
not believed to reflect examinees current
ability
22
COMPASS and HIGH-STAKES
TESTING
• A look at one colleges position on
retention, admissions, developmental
education with COMPASS use
• Southwestern Michigan College
• Charlotte McGowan
23
New ACT Research
• Effectiveness of dual credit offerings
• Effect of college readiness on graduation
from 4-year colleges
• Effect of college readiness on degree
attainment at 2-year colleges
• Do teacher attributes (like experience, and
subject matter expertise) matter in terms
of student learning outcomes
• Student growth and accountability
24
Next Generation COMPASS
Give your ideas/requests to ACT staff member or e-mail to
john.roth@act.org):
a.
b.
c.
d.
e.
Please Improve:
Please Add:
Please Remove:
Other comments, suggestions:
Name, Institution, Contact Information (optional, so we
can follow up if necessary)
25
Upcoming COMPASS Conferences: Mark
Your Calendars
November 16-18, 2011: COMPASS/ASSET Southeast Region Hilton
Head Conference at Crowne Plaza, Hilton Head, SC (to submit
Program Proposal and for additional information, send e-mail to Frank
Potter at frank.potter@act.org)
April 18-20, 2012: 16th Annual Southwest Region Post Secondary
Conference for Student Success at Marriott River Center, San
Antonio , TX (to submit Program Proposal and for additional
information, send e-mail to Don Pitchford at don.pitchford@act.org)
April 26-27, 2012: 11th Annual Midwest Region COMPASS and
Assessment Conference: April 26-27, 2012, at the Hyatt Lodge, Oak
Brook, IL (to submit Program Proposal and for additional information,
send e-mail to Tim Osborn at tim.osborn@act.org)
26
COMPASS Update
News You Can Use
Questions/Discussion
Thank You
27
Setting the Right Course
for College Success
28