Sacramento City College Unit Plans Completed Spring 2004 Department Name: Assessment Department Spokesperson: Ivor McVarish Division Dean: Gary Straus Place an X in the boxes of included elements: X Accomplishments X Three-Year Plan X Action Plan X Budget Request X Budget Narrative X Key Performance Indicators Assessment Department / Accomplishments 2003 – 2004 # 1a 1b 2a 2b 2c 3a 3b 3c 3d 4a Linkage to Year-end Status and Accomplishments Other Plans Goal 1: Improve testing conditions in the lab. Replace existing monitors with flat screen monitors to reduce flicker and provide desk DAG1, DOE7, New monitors have been purchased and will be installed space for paper and pencil testing and use of M3, PT7 shortly. scratch paper for math. DAG1, DOE7, Complete software and hardware installation and Lab is physically ADA compliant and adaptive software Title 5, M3, training to comply with ADA requirements is installed. PT7 Goal 2: Increase ratio of enrolled students tested to non-enrolled students. M2, M3, PT3, Less than 4% of tested students were unregistered during Continue to publicize new “enroll first” policy PT7, PT9 this period. Check all students testing in the lab for student M2, M3, PT7, All students are being checked at the door. ID numbers to verify enrollment. PT9 M2, M3, PT7, Track progress. We have developed a tracking system. PT9 Goal 3: Decrease ratio of retests to first-time tests. Confirm retest policy with faculty and M3, PT3, PT7 Retest policy is clear. counselors Publicize policy M3, PT7 Policy is publicized. Check students for prior test at the door to the ASAP Look is being used to check students for prior M3, PT7 lab. tests. Track progress M3, PT7 Goal 4: Increase number and ratio of students participating in online orientation in the Assessment lab. DSS2, DAG1, DAG8, AB3, Continue to improve and promote online Online Orientation has been modified according to the Title5, M3, orientation. recommendation of the Orientation Committee. PT3, PT4, PT7, PT9 Action Item Assessment Department / Accomplishments 2003 – 2004 Linkage to Year-End Status and Accomplishments Other Plans DSS2, DAG1, Automate presentation of orientation after DAG8, AB3, This goal has been accomplished. 4a assessment. Title5, M3, PT4, PT7, PT9 DSS2, DAG1, Track number of students participating in DAG8, AB3, Orientation in the lab is being tracked. 4b orientation in the lab. Title5, M3, PT4, PT7, PT9 Goal 5: Continue to identify and work with SAC schools that can be converted to onsite computerized application, testing and orientation. DSS8, DAG8, Identify at least one additional potential school Two new high schools (St Francis and Christian DAG9, M3, 5a and expand program. Brother’s were tested online this season. PT4, PT7, PT9 DSS8, DAG8, Work with identified high school staff to DAG9, M3, Contacts have been identified. 5b coordinate program. PT4, PT7, PT9 DSS8, DAG8, Conduct surveys to track satisfaction and DAG9, M3, We continue to monitor feedback and satisfaction. 5c improve program and process. PT4, PT7, PT9 # Action Plan Assessment Department / Accomplishments 2003 – 2004 Linkage to Year-End Status and Accomplishments Other Plans Goal 6: Work with faculty and counselors to establish recency recommendations for assessment scores. Meet with research department and discuss M3, PT3, In process. 6a research feasibility and/or design PT7, PT9 Goal 7: Prepare for Matriculation Site Visit Coordinate with Research Department to conduct AB3, Title5, In process. 7a disproportion impact studies M3, PT3 AB3, Title5, Locate and organize validation research data In process. 7b M3, PT3 Monitor publicized prerequisite information for AB3, Title5, Ongoing. 7c accuracy and compliance with Title 5. M3, PT3 AB3, Title5, Send staff member to CCCAA swat team training On hold. 7d M3 Invite CCCAA team to visit the Assessment AB3, Title5, On hold. 7e Center. M3, PT3 Goal 8: Establish KPIs Evaluate data to determine beneficial KPIs MA3, PT3 Ongoing, progress is being made. 8a Work with Capp and Associates to add KPIs to Improved understanding of ASAP capabilities has MA3, PT3 8a standard reporting menu options. decreased the priority of this item. Other Accomplishments: Set up Davis Outreach Center Lab for automatic online testing. Successfully incorporated the English Essay into the English Writing Placement scheme. Began mailing assessment results to all first time students. Submitted requisitions for new copier and scanner. All testing with the exception of essay tests are available on a walk-in basis. Set up procedure and website for out of area online testing. # Action Plan Three-Year Plan Assessment Department 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. Long Range Plan Provide valid, reliable and fair assessment information to student and staff related to competency, course and program eligibility, education goals and performance. Provide specialized assessments for aptitude, interests, study skills, and referral to additional services when needed. Provide valid Ability-to-Benefit testing on a walk-in basis. Publicize and clarify the process of assessment for students, staff and the general public. Assist with systematic research planning for assessment viability and impact issues. Increase ratio of enrolled students tested to non-enrolled students. Decrease ratio of retests to first-time tests. Increase number and ratio of students participating in online orientation in the Assessment lab. Continue to identify and work with SAC schools that can be converted to onsite computerized application, testing and orientation. Continue to upgrade assessment instruments and systems as improved technology becomes available. Investigate the feasibility of creating a comprehensive procedure for establishing, communicating and assessing desired Student Services Learning Outcomes. 2005-2006 2007-2008 2009-2010 X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X Assessment Department / Action Plan 2004 – 2005 # 1a 1b 2a 2b 3a Linkage to Year-end Status and Accomplishments Other Plans Goal 1: Prepare for Matriculation Site Visit Coordinate with Research Department to conduct AB3, Title5, disproportion impact studies M3, PT3 AB3, Title5, Locate and organize validation research data M3, PT3 Goal 2: Work with faculty and counselors to establish recency recommendations for assessment scores. Meet with research department and discuss research M3, PT3, feasibility and/or design PT7, PT9 Action Item Meet with faculty and counselors to discuss need. Goal 3: Continue to improve SAC process and attendance PT5, DAG8, Work with Early Start to improve sharing of DOE1,DOE2, information. M1, M3 Add Discovery and Davis High schools for computerized testing. PT4, DAG8, M1, M3 3c Speed up application processing of SAC students. PT4, PT5, DAG8, DOE6, M1, M3 3d Revise SAC schedule to start two weeks later and do small schools first. PT4, DAG8, M1, M3 3b Goal 4: Improve the process of incorporating English Essay scores into ASAP database 4a Consult with Capp Assc. Director - Robert Elmore on how to streamline and/or automate the process. PT5, DAG8, DOE6, M1, M3 Assessment Department / Action Plan 2004 – 2005 # Action Item Linkage to Other Plans Year-end Status and Accomplishments Investigate methods of eliminating or minimizing DOE6 data errors Develop better methods of correcting errors. DOE6 4c Make ASAP Look available in more locations (RN) PT4, DOE6 4d Goal 5: Create a comprehensive procedure for establishing, communicating and assessing desired Student Services Learning Outcomes. PT2,DSS5, Identify desired student learning outcomes for the DOE1, M3, 5a Assessment Center. M7 Work with other student services areas as they PT2,DSS5, establish their own desired student learning 5b M1, M3 outcomes. Investigate methods of assessing learning in terms PT2,DSS5, of identified desired outcomes and if and how the 5c M1, M3 assessment center might be participate. Goal 6: Add vocational skill assessment to available assessment instruments. Research available instruments. PT1, PT2, M3 6a Research possible means of finance. PT1, PT2 6b Goal 7: Set up an Accuplacer Site to make placements to be used at High Schools. PT3, PT4, Secure a research Accuplacer site. 7a M1, M3 Set up rules and test PT3, PT4 7b 4b Assessment Department Budget Request 2004 - 2005 Line # 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Totals Description Classified Temp help Computerized tests (CPT) and supplies Operating Budget Increase Instruction Supplies Computers Equipment Furniture New Program Start-up Marketing Materials Remodel Space Faculty Hires Staff Hires Student Hires Temp Hires 10,000 28,000 28,000 10,000 Budget Narrative 2004 – 2005 Assessment Department Line # Description Total Amount Priority Rank 1 1 Classified Temp help 10,000 2 Computerized tests (CPT) and testing supplies 28,000 3 4 5 6 7 8 9 10 11 12 13 14 15 Justification Replace lost PFE funds needed to maintain sufficient staff to support SAC program. Needed to maintain current testing volume Key Performance Indicators for Assessment Department 4/1/03 to 4/1/04 - Data from ASAP Tests Taken Score Description 2002/2003 Retests Placement and Graduate Competency Change From Last Percent Year Tests Taken Percent 2003/2004 Retests 20 ESL Essay 42 Eng Essay 21 CPT Reading 906 86 9.49% 47 6.34% -18.21% 12.20% 741 351 7992 8204 1001 683 8.55% -2.58% CPT Sent 22 Skills 7428 831 11.19% 7053 566 8.02% -5.05% CPT 23 Arithmetic 24 CPT Algebra 25 CPT CLM 6087 5605 2191 708 733 332 11.63% 508 430 246 8.71% -4.16% 8.76% -12.44% 15.15% 5834 4908 1965 12.52% -10.31% LOEP 26 Reading 1089 112 10.28% 762 48 6.30% -30.03% LOEP 28 Language 1090 113 10.37% 762 48 6.30% -30.09% Companion 31 Reading 1506 11 0.73% 1345 5 0.37% -10.69% Companion 32 Sent Skills 1496 10 0.67% 1324 5 0.38% -11.50% Companion 33 Arithmetic 239 1 0.42% 407 1 0.25% 70.29% Companion 34 Algebra 39/40 Celsa 11 & 12 DTMS Total Tests Given 1166 30 98 37,135 1 0 28 3,967 0.09% 1099 26 76 34,645 1 0 28 3,967 0.09% -5.75% 0.00% -13.33% 36.84% -22.45% 11.45% -6.71% 13.08% 0.00% 28.57% 10.68% Total Students Tested Career Interest Inventories Myers Briggs 10,730 0.00% 10,693 0.00% -0.34% 644 0 0.00% 829 0 0.00% 28.73% 435 1,079 0 0.00% 0 0.00% 91.03% 0.00% 831 1,660 0.00% 53.85% SBI 25 0 0.00% 108 0 0.00% 332.00% ATB Not 95 calculated Strong Interest Study Skills Other Not 215 calculated 126.32% Local Background Information Report For Sacramento City College. Local Background Information Report Of Site ID 4671. Local Background Information Report for Test Date Range From 04/01/2003 To 04/01/2004 AQ1 Count Percent First time for recommended placement 7016 58.68 % Retest for recommended placement 2806 23.47 % 627 5.24 % 1304 10.91 % 203 1.70 % Graduation competency Other reason ATB Total Respondents AQ2 Yes (please inform the Examiner before you continue with the tests) 11956 Count 100.00 % Percent 1213 10.15 % No 10743 89.85 % Total Respondents 11956 100.00 % AQ3 Count Percent Yes 9864 82.50 % No 2092 17.50 % 11956 100.00 % Total Respondents AQ4 Count Percent Yes 7459 62.39 % No 4497 37.61 % 11956 100.00 % Total Respondents AQ5 Count Percent Third year or lower 2731 22.84 % Fourth year 4015 33.58 % College Prep senior English 2324 19.44 % Honors, A.P. or I.B. English 790 6.61 % I did not study English 375 3.14 % 1721 14.39 % 11956 100.00 % I studied English as a second language Total Respondents AQ6 I do not read in English Count Percent 293 2.45 % Less than 1 hour per week 1791 14.98 % 1 to 2 hours 3766 31.50 % 3 to 5 hours 3175 26.56 % 6 hours or more 2931 24.51 % 11956 100.00 % Total Respondents AQ7 I did not complete a math course Count Percent 787 6.58 % Basic Arithmetic or Pre-algebra 2447 20.47 % Elementary Algebra (Algebra 1) 2292 19.17 % Geometry 1638 13.70 % Intermediate Algebra (Algebra 2) 2887 24.15 % Trigonometry or Pre-calculus or Calculus or higher 1905 15.93 % 11956 100.00 % Total Respondents AQ8 I never took a math course Count Percent 623 5.21 % Taking it now 1627 13.61 % Less than one year 2957 24.73 % 1 to 4 years 4068 34.02 % 5 years or more 2681 22.42 % 11956 100.00 % Total Respondents AQ9 Count Percent 6 units or fewer 3238 27.08 % 7 to 11 units 2697 22.56 % 12 units or more (full time) 6021 50.36 % 11956 100.00 % Total Respondents AQ10 Less than an hour or not any Count Percent 175 1.46 % 1 to 2 hours 2375 19.86 % 3 to 4 hours 5450 45.58 % 5 to 7 hours 2666 22.30 % 8 hours or more 1290 10.79 % 11956 100.00 % Total Respondents AQ11 No Count Percent 11448 95.76 % Yes, from a university in the United States 149 1.25 % Yes, from a university in my native country other than the U.S. 358 2.99 % 11955 100.00 % Total Respondents AQ12 American Indian/Alaskan Native Count Percent 153 1.28 % Asian 2520 21.08 % Black/African American 2074 17.35 % 407 3.40 % 1979 16.55 % 252 2.11 % 3328 27.84 % Other 778 6.51 % Omit 464 3.88 % 11955 100.00 % Filipino Mexican-American/Chicano/Latino or other Hispanic Pacific Islander White/Caucasian Total Respondents AQ13 Count Percent Female 7215 60.35 % Male 4637 38.79 % Omit 103 0.86 % Total Respondents 11955 100.00 % Senior Assessment for College Comparison Sacramento City College HIGH SCHOOL American Legion 1997 1998 1999 2000 2001 2002 2003 2004 8 canceled 3 canceled canceled 18 34 22 Burbank 120 101 90 38 Capital City 41 94 66 44 4 canceled canceled - Christian Brothers 24 35 31 40 42 23 36 39 Davis 20 31 22 52 62 74 80 66 Davis School for Ind. Stud. Delta 5 canceled canceled canceled canceled 8 6 26 20 Cancele d 31 32 20 24 23 22 29 29 17 28 Discovery Fremont 15 8 discont. - - - - - Hiram Johnson - Main 124 93 95 89 117 116 140 82 Hiram Johnson - West 73 38 80 71 49 71 49 88 Kennedy 174 173 153 128 166 69 159 153 8 canceled canceled canceled 10 5 12 127 145 Cancele d 154 140 220 190 241 140 12 47 17 27 10 Martin Luther King McClatchy Natomas Charter River City 85 64 47 33 117 117 116 149 Sacramento 96 126 138 110 92 118 147 85 Sarah Jones 5 10 6 canceled 14 discont. discont - St. Francis 46 34 53 34 19 39 34 17 Yolo 10 5 20 27 canceled 9 5 8 Juveniles at Risk TOTAL 76 966 883 923 806 1,039 1,018 1,187 1,047