Business Process Analysis Current State Process Name: Placement Testing Staff Drafting BPA: Steve Wallace/Jennifer Kinslow Date: May 2004/updated October 2004 Customers affected by this process: The process stakeholders in placement testing are Admissions, Counseling and Advising staff, Financial Aid and faculty from the following academic departments: Mathematics, English, English for Speakers of Other Languages (ESOL), and Transitional Studies (TRS). The customers affected by this process are 7,000 – 8,000 students tested using the Accuplacer Placement Test and Combined English Language Skills Assessment (CELSA) each year across the Brighton and Damon Campuses. Internal customers are also major stakeholder, i.e. the academic departments. The results of the placement testing, e.g. course placements actually dictate somewhat how the mathematics and English departments organize sections and hire instructors to teach. This is magnified even more in Transitional Studies, as placement decisions affect every course section that is being offered. The only way that students are registered for a Transitional Studies course is through placement testing. Offices Involved in Managing or Working with the Process: Admissions, Counseling and Advising, Services for Students with Disabilities, and the following academic departments: Mathematics, English, Transitional Studies, ESOL. Why Do We Do This? (What is the Process Goal?) Placement testing is accomplished for all full and part-time students who wish to matriculate into MCC programs unless they meet specific waiver criteria based on SAT/ACT tests, taking former college English/Math courses, and/or excellent performance (B or better) on high school English/Math Regents tests. Also non-matriculated students who are trying to register for English/Math courses are encouraged to test. Students indicating “English is a second language” on admissions applications may be referred to the ESOL department for CELSA testing after a review of high school transcripts. Students indicating “Learning Disability” on admissions applications will be required to provide documentation, which will be forwarded to Services for Students with Disabilities. If placement testing is required, student may be referred to Barb Arnone or Jennifer Kinslow in Counseling and Advising or Elizabeth Baxter at DCC Student Services. Placement testing is accomplished to ensure academic success for students as they begin their academic tenure at MCC. As a result of testing, students are placed in English and Mathematics 1 courses that are commensurate with their achievement on the placement test. By taking this approach, MCC is ensuring that the students are starting in a course where they can reasonably achieve initial success. This will give them a good foundation for higher level courses and will give them confidence in their academic ability that will be foundational for retention. The test also serves as an admissions entrance test for approximately ten percent of MCC’s student population. Those trying to be admitted to MCC who do not have high school graduation credentials (diploma or GED), must be admitted under federal Ability To Benefit (ATB) criteria. In order to be admitted and to draw federal financial aid, the prospective student must achieve minimum federally set scores on the Reading Comprehension, Sentence Skills, and Arithmetic portions of the Accuplacer test or a federally set score on the CELSA test for ESOL students. Known Problems with the Current State: Enforcement of scores for placement is the most significant problem with the placement process. The enforcement is inconsistent between departments. The mathematics department religiously enforces Accuplacer placements, as does the Transitional Studies Department. The English Department has been more lax toward the idea of mandatory placements over time. Registration flags should be imposed on Banner registration screens that will not allow students to register for courses above the level of original placement unless the placement has been revised by legitimate authority, normally given to Admissions staff. This occurs many times when students drop/add courses via Web registration. Field definitions, especially with placement revisions on Screen 224 have been a problem. Nonstandard entries are frequently entered into revision fields that make it difficult to query the system for placement data used in research. Screen 224 on SIS is incapable of listing more than one ESOL score. In retest situations, the original test score must be overwritten with new score. 2 Business Process Analysis Placement Testing 1.) Process Name: Placement Testing 2.) Business Objective: All matriculating incoming freshman who do not meet specific waiver criteria will take the Accuplacer Placement Test or CELSA to diagnose appropriate placement levels for beginning English and Mathematics courses at MCC. Students who also need to have skill levels diagnosed to determine eligibility for placement into specific programs also may be required to take the Accuplacer test to determine admission. Non-matriculated students are also highly encouraged to take the placement test. 3.) Definition of Terms: a.) Accuplacer: Placement test produced by College Board used by MCC in placing students in initial mathematics and English courses. MCC uses four components of this test: Reading Comprehension and Sentence Skills for English course placement and Arithmetic and Elementary Algebra for mathematics placement. b.) Combined English Language Skills Assessment (CELSA): Placement test for non-native English speaking students. CELSA is produced by the Association of Classroom Teacher Testers (ACTT). It includes 75 multiple choice questions based on reading passages. Students must indicate which word best fits in each sentence. c.) Companion Special Format: Placement test for students with disabilities. Companion is produced by College Board and is the paper/pencil format of Accuplacer. The test consists of 35 multiple choice questions in each of the four areas: Reading Comprehension and Sentence Skills for English course placement and Arithmetic and Elementary Algebra fro mathematics placement. Companion is available in audio, Braille, and large print formats. d.) Placement test: a diagnostic instrument used to determine current skill levels in English and mathematics in order to place students in classes commensurate with their ability levels. e.) Waiver criteria: Students may be waived from the Accuplacer test if one or more of the following conditions are met: Scores of 500 on either the mathematics or verbal portion of the SAT may waive the respective portion of the Accuplacer. Scores of 21 on either the mathematics or English portion of the ACT may waive the respective portion of the Accuplacer. 3 Prior college English or mathematics courses with a grade of “C” or better. A grade of B or better on high school New York State Regents Exams (English, Course III Math or Math B). The Admissions Office is the waiver authority and requests for waivers will be granted on an individual basis in consideration of the student’s entire academic record. 4.) f.) Matriculated student: A student granted admission to one of MCC’s academic credit-bearing programs. g.) Non-matriculated student: A student who has not matriculated and who are not seeking a degree (taking courses for enrichment, course credit at other colleges, etc.). Establishment of Process Boundaries: Beginning: Inputs: End: Output: 5.) Student receives a referral for testing from MCC Admissions, high school counselor, MCC Counseling and Advising staff, or Damon Student Services. Testing check-in form, high school graduation status form, picture ID. Receipt of end-of-test advisement regarding scores and placements from a test advisor. Placement test score report/recommendation for course placements on SIS. Review of scores and high school transcripts by Admissions. Process Actors: a.) Admissions: Owners of process as it relates to the admissions cycle. Counselors review all transitional placements for revision by screening with academic transcripts and annotate SIS 224 screen accordingly. Admissions processors send out study guide and scheduling flyers to students who need to be tested prior to being admitted into their programs. b.) Counseling and Advising: Assistant Director for Testing manages the entire placement testing process and serves as liaison for testing coordination and actions between Admissions and Counseling and Advising. Testing advisors run the placement testing process. They set up check-in, proctor, supervise peer advisors who assist in the process, and advise students of their scores and placement results after testing. 4 Peer advisors perform administrative tasks associated with check-in, proctoring, organizing test score reports, and clean-up, under the supervision of the testing advisors. Academic advisors advise students to take classes based on results of placement testing. 6.) Process Owner: The Director of Counseling and Advising owns the placement testing process in terms of budgeting for testing assets and ensuring that the placement testing operation is resourced (time, personnel, equipment, and money) to optimally perform required functions. The Director of Admissions owns the process as at relates to the completion of testing for admissibility to the college and in terms of meeting appropriate Ability to Benefit standards for all students seeking admissions. 7.) Process Stakeholders: Director of Admissions, Director of Counseling and Advising, Vice President of Academic Affairs, Vice President of Student Affairs, Associate Vice President of Enrollment, Director of Financial Aid, Director of Equal Opportunity Program, Student Housing, ESOL and Foreign Language Department, Students and Families 8.) Tasks Associated with the Process See page 7 for all placement testing processes. See page 8 and 9 for ESOL placement testing processes. See page 10 and 11 for testing students with disabilities processes. 9.) Decisions Associated With the Process See page 7 for all placement testing processes. See page 8 and 9 for ESOL placement testing processes. See page 10 and 11 for testing students with disabilities processes. 10.) Cross Check See page 7 for all placement testing processes. See page 8 and 9 for ESOL placement testing processes. See page 10 and 11 for testing students with disabilities processes. 11.) Sequence Tasks See page 7 for all placement testing processes. See page 8 and 9 for ESOL placement testing processes. See page 10 and 11 for testing students with disabilities processes. 12.) Associated Metrics a.) Accuplacer i. Scores must be uploaded within one duty day of testing. 5 b.) c.) 13.) ii. A monthly roster is created of all tested in that month using SPSS. The monthly report data is converted to an SPSS tables format and distributed to stakeholders for their information. iii. Students tested are randomly queried for satisfaction with the process. A satisfaction and academic analysis is accomplished and presented to the stake holders. iv. MCC Institutional Research is routinely consulted for production of ad hoc queries and data reports. v. One area of improvement exists: There are “automated checkpoints” needed in the current SIS or Banner that will keep students from registering for English and mathematics courses that are above the skill level indicated by their placements. These checkpoints need to be available for viewing by all who are involved in the advising and registration process. CELSA i. Scores must be inputted on Screen 224 by ESOL Department. ii. Answer sheet and high school graduation verification form are scanned into ImageNow and linked to respective student report by Admissions. iii. Students currently enrolled in ESOL (Spring/Fall 2004) courses have been included in pilot studies for on-line transition. These students have taken the LOEP and/or Compass ESL. Satisfaction survey regarding pilot study is also given to participants to complete. Companion Special Format i. Scores must be inputted on Screen 224 by testing advisor responsible for special testing. ii. Admissions counselors are notified that test scores are available for review/action. Institutional Change Process: The change noted in step 11.a.v. could be accomplished by computer programming, as well as personal checks in the system by those who advise and register for classes. 6 Placement Testing Flowchart 5/27/2004 Letter requiring testing sent to student Admissions receives copy of test results TRS placement? No Student info checked on screens 224, 206 & 207 Prior test on 224? Yes Print 2 copies of prior test results Mark student’s program and admit status on check-in card Set up approp. test sections for student per SIS info Refer student to Adv. Ctr. or other approp. advisement location Process Ends Read test instructions to students Administer test to students Yes Review for plcmnt. revision Update 224 screen accordingly Process Ends Print 2 copies of test results: 1 for student, 1 for admissions Assemble approp. Advisement packet No Testing Advisor Peer Advisor Admissions Placement Testing Process Advise student on scores, plcmnt. and admit status Is student admitted? Yes Daily score roster produced and filed Student arrives to test-fills out HS form & check-in card Go to Adm. Office or wait for status to be mailed Process Ends Upload scores to mainframe ETS Student No Scores appended to SIS 224 screen Process Ends - 7 ESOL Testing Flowchart 1.) ESOL testing referral from: Admissions Counselor Testing Advisor (referral after Accuplacer has been taken and a low Reading Comprehension and Sentence Skills score has been received) ESOL community learning centers ESOL & Foreign Language Department Friends/family of MCC students 2.) Student contacts ESOL Department to make appointment for test. 15-20 students are tested in one sitting for a timed test. (If we transition to on-line version, test will be administered on a walk-in basis.) 3.) Student name, address, and Social Security number are added to a list on Outlook. 4.) List from Outlook is printed on day of test. 5.) Student arrives day of test and fills out check-in card, high school graduation verification form, and provides photo ID. 6.) Directions for Combined English Language Skills Assessment (CELSA) test are provided by testing advisor. (If we transition to on-line version, COMPASS ESL or LOEP will be used.) 7.) Student tests while testing advisor and/or peer advisor proctors. CELSA is a 45-minute, 75 item test. (If we transition to on-line version, test will be un-timed.) 8.) Upon completion of test, or at end of 45-minute period, test is collected and hand scored by testing advisor or peer advisor. (If we transition to on-line version, student score report will automatically be generated and printed.) 9.) Student fills out demographic information sheet for ESOL Department (includes questions pertaining to residency status, native language, address, how long have they been in the United States). The back of this sheet includes a column with CELSA scores ranging from 43-75 and the ESOL course level applicable to each score. Student returns this form to testing advisor. (If we transition to on-line version, demographic questions will be included at the beginning of on-line test and score report will automatically be generated once student is finished.) 10.) Raw test score is circled on back of sheet by testing advisor (referred to in #9). 11.) Faculty member from ESOL Department meets with students individually to review placements. (If we transition to on-line version, testing advisor will review placements.) a.) If a student scores between 43-72, they are placed into respective ESOL course based on cut scores. These students will also be given the opportunity to meet 8 b.) c.) d.) with Don Beech after testing to discuss financial aid, advisement and registration, and/or be referred to Admissions for final admissions decisions. Student may also be referred to take Math Accuplacer. If a student scores between 73-75, they are eligible to take ENG 101. These students are referred to Admissions for final admissions decisions and/or Counseling & Advising for advisement and registration. Student may also be referred to take Math Accuplacer. If a student scores below 43, ESOL faculty member refers the student to outside resource for more preparatory work (i.e. Family Learning Center, BOCES, Continuing Education programs). If a non-high school graduate tests, the testing advisor and/or peer advisor fill out an additional scantron (bubble) answer form (copied from the original scantron for MCC), which is sent to Association of Classroom Teacher Testers (ACTT) for official ATB scoring. MCC (Jennifer Kinslow, site administrator) is notified via email and mail of the student’s scaled score. The passing scaled score is 90. Jennifer notifies Admissions. Student is also mailed a copy of their scaled score by ACTT to their home address. (If we transition to on-line version, we will continue to administer CELSA exam to non-graduates. Compass ESL and LOEP are not ATB approved.) 12.) Demographic information form/score report are kept by ESOL Department and entered onto screen 224 within 24 hours. (If we transition to on-line version, a program will need to be developed to do this automatically. Testing advisors will verify that test scores are in the computer within 24 hours.) 13.) Check-in cards are filed alphabetically in the testing lab. 14.) CELSA answer sheets and high school graduation verification forms are sent to Admissions and scanned. (If we transition to on-line version, computerized score report and graduation verification form will be sent to Admissions.) 9 Special Placement Testing for Students with Disabilities Flowchart 1.) Special testing referral from: Admissions Counselor Testing Advisor o Student may indicate prior to Accuplacer testing that they have test modifications. o Student may indicate after taking Accuplacer test that they have test modifications. Services for Students with Disabilities Office Counseling and Advising Office staff 2.) Student must provide recent documentation to MCC. Documentation may be sent to any of the following departments/individuals: Barb Arnone, Counseling and Advising Jennifer Kinslow, Counseling and Advising Admissions Office Services for Students with Disabilities Office Student may also provide documentation at the time of check-in for Accuplacer. All documentation will be forwarded to Services for Students with Disabilities to be scanned into ImageNow and linked with respective student on SIS. 3.) If student documentation test modifications indicates: only calculators are permissible OR student chooses to use calculator accommodation only, student may take Accuplacer on a walk-in basis. Refer to BPA for Accuplacer placement testing. only separate location, student may set up appointment prior to testing (with Jennifer Kinslow) or make request at time of walk in. Student will take Accuplacer. Refer to BPA for Accuplacer placement testing. only extended time on tests, student may take Accuplacer on a walk-in basis. The Accuplacer test is untimed. Refer to BPA for Accuplacer placement testing. tests read, student must make appointment in advance with Jennifer Kinslow (Counseling and Advising). COMPANION Special Format, produced by Accuplacer, will be used. Calculators may or may not be used, depending on documentation. o If student is a high school graduate, GED recipient, or currently in high school on track for a local or Regents diploma, student has option to take any portions of COMPANION an audio. Many students will choose to take English with COMPANION and Math Accuplacer. o If a student is not a high school graduate, including IEP diplomas, student must take the entire COMPANION audio test. need for Braille edition, student must make appointment in advance with Jennifer Kinslow (Counseling and Advising). COMPANION Special Format Braille edition will be used. Voice activated calculator/computer may be used if documentation permits. 10 4.) Student arrives day of test and fills out check-in card, high school graduation verification form, and provides photo ID. 5.) Directions for COMPANION test are provided by testing advisor (Jennifer Kinslow). 6.) Student tests while testing advisors and/or peer advisors proctor. COMPANION is untimed. 7.) Upon completion, test is hand scored; placements are derived using placement guidelines; student is advised and/or referred to Admissions. 8.) Scores and placements are entered onto screen 224 of SIS. Admissions counselors (Sarah Hagreen and/or Donna Burke) are notified by email that scores are available for review. 11