Operations an CE Accountability Professional Development Educational accountability targets either the processes or results of education. ◦ Desired goals are identified ◦ Measures are identified for determining whether the goals are met ◦ Criteria are defined to determine when measures demonstrate that goals have or have not been met Types of Accountability ◦ System – educational system responsibilities for student results Example: Goal - increases in performance in state tests (i.e. BLET) for groups of students Measurement – administration of BLET test Criteria – benchmark of pass performance (i.e. 75%) Rewards/sanctions – ability to maintain program, attract students Types of Accountability ◦ Process – compliance with laws and regulations Example: Goal – applied CE fee waiver rules appropriately Measurement – completion of internal audit (checklist) that identifies the requirements Criteria – number of elements within internal audit checked Rewards/sanctions – audit exceptions, financial penalties Types of Accountability ◦ Individual – student, faculty and staff responsibility for student achievement Example Goal – student must pass a credential test to successfully exit course Measurement – credential test covering relevant topics Criteria – required passing score on test Rewards/sanctions – access to credential Where is Continuing Education today? 1D SBCC 300.96 (c) – Continuing Education Program Management Each college's local board of trustees must adopt a policy which requires the development and implementation of an internal audit plan. Each college is required to publish, maintain and utilize an internal audit plan. The college presidents shall periodically report to the board of trustees on the findings of the internal audit. The internal plan must be submitted to the Department for compliance review. Where is Continuing Education today? CC00 – 147 Revisions to Accountability and Credibility Plan for Continuing Education ◦ ◦ ◦ ◦ ◦ Class Visitations Student Membership Verification Instructor Verification College Approval for Conducting a CE Class College Responsibility for Accuracy in Reporting Practices in CE Programs Where is Continuing Education today? 1D SBCC 300.96 (c) AND CC00 – 147 are at best PROCESS measures. The current SBCCC Internal Audit Plan for CE is a Plan Compliance Review Checklist Why is this important? Rigor, Relevance and Results Industry Credentials State Credentials CE to CU credit options Education to Employment measures Data driven decisions IACET 2007 Standards for Continuing Education and Training Internal Controls 1. Continuing Education and Training Organization 6. Planning and Instructional Personnel 2. Responsibility and Control 7. Content and Instructional Methods 3. The Learning Environment and Support Systems 8. Assessment of Learning Outcomes 4. Learning Event Planning 9. System for Awarding CEUs and Maintaining Learner Records 5. Learning Outcomes 10. Program Evaluation Accountability/Credibility Funding Special Initiatives ◦ NC Back to Work Resource Utilization Analyze • Data • Research Design • Reports • Tools Development • Processes Implementation • Outcomes • Measurements So much data – where to start? ◦ Internal Colleague Data Warehouse ◦ External Commerce Department of Labor XCLS – Status (Cancel) XCES – Estimated FTE Membership Public Safety & Health – 54% Public Safety & Health – 48% BSP/Health/Public Safety – 78% BSP/Health/Public Safety – 67% COLLEAGUE Analysis of internal patterns: • Course Titles • Frequency • FTE • Membership • Hours DATA WAREHOUSE Analysis of trends across colleges based on pertinent variables: • • • • Size of institution Geography Industry concentrations Commuting patterns Human Resources Development Colleges Alamance CC Asheville-Buncombe TCC Beaufort County CC Bladen CC Blue Ridge CC Brunswick CC Caldwell CC and TI Cape Fear CC Carteret CC Catawba Valley CC Central Carolina CC Central Piedmont CC Cleveland CC Coastal Carolina CC College of the Albemarle Craven CC Davidson County CC Durham TCC Edgecombe CC Fayetteville TCC Forsyth TCC Gaston College Guilford TCC Halifax CC Haywood CC Isothermal CC James Sprunt CC Johnston CC Lenoir CC Martin CC Mayland CC McDowell TCC Mitchell CC Montgomery CC Nash CC Pamlico CC Piedmont CC Pitt CC Randolph CC Richmond CC Roanoke Chowan CC Robeson CC Rockingham CC Rowan-Cabarrus CC Sampson CC Sandhills CC Southeastern CC South Piedmont CC Southwestern CC Stanly CC Surry CC Tri-County CC Vance-Granville CC Wake TCC Wayne CC Western Piedmont CC Wilkes CC Wilson CC Statewide Totals: 2010 FTE 2011 FTE 2012 FTE 31 89 6 18 60 46 30 137 13 59 50 34 20 37 4 72 57 115 43 59 110 112 37 54 22 14 41 29 112 16 31 33 59 20 51 11 99 37 64 31 8 110 58 109 121 22 150 143 54 19 67 3 69 247 241 68 32 12 29 71 11 35 55 37 42 101 14 48 49 59 21 37 3 64 42 102 56 47 150 129 81 45 23 14 37 39 178 14 20 29 40 26 42 14 84 57 51 37 16 93 48 101 105 30 128 144 45 23 69 1 48 250 224 64 26 7 29 76 11 37 61 33 83 92 17 63 62 38 25 38 2 60 35 75 39 73 161 128 98 59 23 13 23 36 177 13 55 32 51 33 33 23 91 53 44 39 17 104 56 62 91 51 128 134 47 24 64 3 91 273 201 51 32 12 3,496 3,454 3,572 Change in FTE Spring 2012 Summer 2012 Fall 2012 0 5 0 2 6 -4 41 -9 2 15 13 -21 4 1 -1 -4 -7 -27 -17 26 11 0 17 13 0 -1 -13 -3 0 -1 35 3 11 7 -8 9 7 -4 -7 2 1 10 8 -39 -14 21 -1 -10 2 1 -5 2 42 22 -24 -13 6 5 9 29 4 16 25 8 16 22 6 18 21 17 7 19 1 24 10 31 13 23 58 48 30 19 8 6 9 15 63 5 19 10 16 16 10 9 38 19 17 12 7 43 17 24 15 16 51 54 17 10 31 2 33 100 88 22 7 4 7 17 4 9 13 6 27 30 5 14 16 10 9 7 0 13 9 19 9 14 43 33 29 15 6 3 7 8 37 5 15 9 11 6 6 5 16 19 8 13 3 24 15 13 34 9 30 32 8 5 14 0 21 65 51 13 12 3 13 30 2 13 23 19 40 40 6 31 25 11 9 12 1 22 16 25 17 36 59 47 39 24 9 3 7 12 77 4 20 13 24 10 17 9 37 15 18 14 7 36 24 24 42 26 47 48 23 9 19 1 37 108 62 16 13 6 118 1,288 889 1,395 (2011 to 2012) COLLEAGUE Analysis of cancellation trends: • • • Titles Hours Program Area 6,419 66,941 5,577 5,196 2207.26 2117.18 1991.46 63,141 FTE CLASSES 61,715 STUDENTS 2010 2011 2012 TIER 2 PREFIX – ELIGIBLE FOR T2 FUNDING Analysis of Tier 2 eligible courses: • Titles • Hours • Frequency • Estimated FTE TIER 2 PREFIX – NOT ELIGIBLE FOR T2 FUNDING Analysis of Tier 2 eligible courses that do not meet Tier 2 criteria: • Titles • Hours • Frequency • Estimated FTE Labor Market ◦ Unemployment ◦ Employers Existing industries Growing industries New industries Exiting industries ◦ Commuting patterns Labor Market ◦ Employers Who is where State level changes impacting employers and industry Opportunities for support/partnerships Peer Colleges ◦ ◦ ◦ ◦ New Programs Innovative Delivery Best Practices Partnerships Competitors ◦ ◦ ◦ ◦ Other Colleges Private Educational Organizations Training Vendors Industry/Agency Originated Training Competitive Innovation MOOC mOOC SPOC Badges Industry Standards & Expectations Partnerships ◦ ◦ ◦ ◦ ◦ ◦ Employers JobLink Career Centers Division of Workforce Solutions Chamber Workforce Boards Peer colleges Internal Collaborations ◦ Academic levels ◦ Student Support Implementation ◦ ◦ ◦ ◦ Training Program Outcome Assessments Quality review Program review Continuing Education Professional Development Opportunities ◦ ◦ ◦ ◦ Senior CE Administrator Mentorship Program Senior CE Administrator Monthly Update CE Accountability/Credibility Forum CE – CIS Roundtable Remaining questions?