CALIFORNIA
PERKINS IV
SECONDARY to POSTSECONDARY
CAREER TECHNICAL EDUCATION
LINKAGE
ACCOUNTABILITY HANDBOOK
for
Perkins Title II, Tech Prep
2010-2011
5/26/2010
Revised 9/15/2010
Contact:
Address:
Telephone:
Internet:
Email:
W. Charles Wiseley, Ed.D.
California Community Colleges
Career Technical Education Unit
1102 Q St.
Sacramento, CA 95811
(916) 327-5895
www.cccco.edu
cwiseley@cccco.edu
Table of Contents
Section 1 - Introduction .................................................................................................................. 1
Section 2 - Definitions .................................................................................................................... 1
Agreed-Upon Performance Level Targets .................................................................................. 1
CCCCO Project Monitor............................................................................................................. 2
Industry-Recognized Credential ................................................................................................. 2
Postsecondary Tech Prep Leavers .............................................................................................. 2
Postsecondary Tech Prep Participant .......................................................................................... 2
Program Years ............................................................................................................................ 2
Secondary Tech Prep Participant ................................................................................................ 2
Supplemental Improvement Plans .............................................................................................. 3
Tech Prep Actual Performance Level ......................................................................................... 3
Tech Prep Improvement Plan...................................................................................................... 3
Tech Prep Performance Indicator Data Report ........................................................................... 3
Tech Prep Performance Indicator Measurement Definitions...................................................... 3
Section 3 - Understanding Tech Prep Actual Performance Levels ................................................. 3
Section 4 - Reaching Agreement on Minimum Performance Level Targets .................................. 3
Steps in the Process for Reaching Agreement on Performance Targets ................................. 4
Revisions to Agreed-Upon Performance Levels..................................................................... 5
Section 5 - Tech Prep Supplemental Improvement Plans ............................................................... 5
Steps in the Process of Evaluating Performance and Supplemental Improvement Plans....... 6
Revisions to the Tech Prep Supplemental Improvement Plan ................................................ 7
APPENDIX A – TECH PREP ACCOUNTABILITY TIMELINES CHART ............................................. 8
APPENDIX B – TECH PREP PERFORMANCE INDICATOR MEASUREMENT DEFINITIONS
CHART ......................................................................................................................................................... 9
APPENDIX C – SAMPLE TECH PREP PERFORMANCE LEVEL TARGET AGREEMENT CHART
.................................................................................................................................................................... 11
APPENDIX D – TECH PREP SUPPLEMENTAL IMPROVEMENT PLAN TEMPLATE .................... 12
APPENDIX E – TECH PREP ACCOUNTABILITY DATA SHARING TIMELINES CHART ............. 13
APPENDIX F – TECH PREP DATA FILES FOR PERFORMANCE INDICATOR MEASURES......... 15
Data for Secondary measures........................................................................................ 15
Data for Postsecondary measures ................................................................................. 16
APPENDIX G – ASSIGNING TECH-PREP STUDENT FIELD OF STUDY AREAS ........................... 18
Acknowledgements: Many people have contributed to this publication. Although Dr. W. C. Wiseley
designed the accountability framework and authored this manual, Karen DeCoster at the Massachusetts
Dept of Education generated the Massachusetts Tech Prep Manual that was used as a template for this
edition. I found the straight forward presentation useful and appreciated Karen’s offer of assistance.
Next, the MIS group in the community college Chancellor's Office (including Myrna Huffman, Tom
Nobert, Vinod Verma and Debbie Gutierrez) and Russ Weikle and Goeff Belleau at California Dept of
Education provided help in determining what was possible given the limited resources of the state. And
finally, the National Association for Tech Prep Leadership draft matrix provided an insightful look at how
the measures could be constructed through a consensus of the states.
i
Revised 6/13/2010
California Perkins IV Tech Prep Accountability Handbook
Section 1 - Introduction
The California Perkins IV Tech Prep Secondary to Postsecondary Career and Technical
Education (CTE) Linkage Initiative implements Tech Prep performance indicators as required by
Title II “Tech Prep Education” of the Carl D. Perkins Career and Technical Education
Improvement Act of 2006 Public Law 109-270 (Perkins IV) in Sections 203(e) and 204(e).
The official text of Perkins IV is at http://www.ed.gov/policy/sectech/leg/perkins/index.html.
Perkins IV Tech Prep Consortia staff and members should review the official copy of Perkins IV
and not rely on excerpts contained in this Accountability Handbook. Staff and members should
also review the 2008-2012 California State Plan for CTE as well as the California Perkins IV
Postsecondary CTE Core Indicator documentation available in the career technical education
section of the chancellor's office website at http://www.cccco.edu.
Perkins IV sets forth Tech Prep performance indicators for the first time. Perkins IV provides
for the state and each individual Perkins IV Tech Prep Consortium to reach agreement on
Minimum Performance Levels for each Tech Prep performance indicator. Perkins IV also
requires that the state report on the effectiveness of the Tech Prep program. The USDE requires
that to the state submit statewide counts and percentages in the Consolidated Annual Report
(CAR).
The California Perkins IV Tech Prep Secondary to Postsecondary CTE Linkage Accountability
Handbook is for 2010-2011 and 2011-2012. The handbook is designed to facilitate target
negotiations for each Tech Prep performance indicator between the Perkins IV Tech Prep
Consortium and the California Community Colleges Chancellor’s Office – Career Technical
Education unit. The handbook also includes the steps for evaluating subsequent year
performance targets and the forms to complete when consortia do not meet negotiated minimum
performance levels. Each performance year includes a cycle of: negotiating targets, evaluating
performance, and submitting annual reports. Appendix A provides a short calendar along with
an indication of approximate and firm due dates and activities.
The Chancellor’s Office – Career Technical Education unit may terminate funding for individual
Perkins IV Tech Prep Consortia for any fiscal year based in part or completely on Tech Prep
performance indicator results or noncompliance with required supplemental improvement plan
reporting.
Section 2 - Definitions
The definitions below are directly related to this Accountability Handbook. Additional
definitions pertaining to Perkins IV are provided in the Act itself, and in the California State Plan
for CTE both of which are available through links posted at http://www.cccco.edu.
Agreed-Upon Performance Level Targets
This term is used to denote the performance level on a Tech Prep performance indicator that a
Perkins IV Consortium agreed to set as a goal.
CCCCO is the acronym for the California Community Colleges Chancellor’s Office
Revised 6/13/2010
1
California Perkins IV Tech Prep Accountability Handbook
CCCCO Project Monitor
Each consortium has a project monitor in the Chancellor's office. Project monitors are assigned
by district and region. A listing of Perkins Project Monitors by Region is available on the
"Perkins, Title I, Part C" section of the Chancellor's Office website.
CDE is the acronym for the California Department of Education.
Industry-Recognized Credential
Credentials issued to an individual by a public agency, educational institution, private
organization, or other that indicates a level of occupational competency are considered IndustryRecognized due to Title 5 advisory committee and program review requirements. The CDE is
implementing data collection for industry-recognized certificates in 2010-2011. The CCCCO
and collects credentials through the Chancellor's Office Management Information System (MIS).
Postsecondary Tech Prep Leavers
A Postsecondary Tech-Prep Leaver is a student who is identified as Tech-Prep in a prior
academic year but did not enroll in the subsequent academic year. For example, if a student was
identified as Tech-Prep in program year one and did not enroll in a college in program year two,
then the student would be considered eight Tech-Prep leaver. Students who enroll in colleges
outside the community college system in year two (transfers?) should not be included as leavers.
Postsecondary Tech Prep Participant
A Postsecondary Tech Prep participant is a student who was a secondary Tech Prep participant
while enrolled in high school and is now enrolled in a postsecondary career and technical
education program in a public two-year college. Students may or may not be currently enrolled
in a career technical education course.
Program Years
For purposes of this document, the following program year equivalents will be used.
Program Year 1 is 2007-2008
Program Year 2 is 2008-2009
Program Year 3 is 2009-2010
Program Year 4 is 2010-2011
Program Year 5 is 2011-2012
Program Year 6 is 2012-2013
and so on.
Secondary Tech Prep Participant
A Secondary Tech Prep participant is a secondary student enrolled in a career and technical
education program that has at least one articulated course with a credit transfer mechanism to the
postsecondary level. Secondary Tech Prep participants must also be enrolled in a school that is
included as a member of the tech prep consortia. The membership list is available as part of the
tech prep consortia application.
Revised 6/13/2010
2
California Perkins IV Tech Prep Accountability Handbook
Supplemental Improvement Plans
Perkins IV requires that each consortia enter into an agreement with the state to meet minimum
levels of performance for each of the performance indicators in the Perkins IV sections 113(b)
and 203(e). Consortia not meeting minimum levels of performance for each of the tech prep
indicators must complete a Supplemental Improvement Plan. Appendix C provides a template
for the Supplemental Improvement Plan.
Tech Prep Actual Performance Level
This term is used to denote the actual performance level attained by consortium on a Tech Prep
performance indicator.
Tech Prep Improvement Plan
Refer to Section 5 of this Accountability Handbook titled “Tech Prep Improvement Plans.”
Tech Prep Performance Indicators are given in Appendix B.
Important Note: Tech Prep Performance Indicator 1STP3 and 1PTP4 will not be implemented
until the data collection is implemented in 2010-2011 and the data becomes available (see
Section 4 for more info).
Tech Prep Performance Indicator Data Report
Refer to Section 3 of this Accountability Handbook titled “Understanding Tech Prep Actual
Performance Levels” for information pertaining to the Tech Prep Performance Indicator Data
Report.
Tech Prep Performance Indicator Measurement Definitions
Measurement definitions for Tech Prep performance indicators are given in Appendix B.
Section 3 - Understanding Tech Prep Actual Performance Levels
The Chancellor’s Office – Career Technical Education unit calculates the actual performance
levels for Tech Prep performance indicators using the measurement definitions given in the Tech
Prep Performance Indicator Measurement Definitions Chart in Appendix B, data maintained in
the CCCCO MIS, and the data from the CDE 101 E1 (enrollment) and E2 (placement) Reports.
The actual performance levels for each Tech Prep performance indicator are reported to each
Perkins IV Tech Prep Consortium in January in a Tech Prep Performance Indicator Data Report.
The Chancellor’s Office will publish the reports on the web with the Perkins core indicator
reports.
Section 4 - Reaching Agreement on Minimum Performance Level Targets
Perkins IV requires that the Chancellor’s Office – Career Technical Education unit and each
consortium reach agreement on Minimum Performance Levels for the Tech Prep performance
indicators. Prior to May 1, 2011 Tech Prep Performance Level Targets will be negotiated for
Revised 6/13/2010
3
California Perkins IV Tech Prep Accountability Handbook
Performance Year 5 (2011-2012). The minimum performance level will be considered to be
90% of the negotiated target as identified in section 5.
Important Note:
Two Tech Prep Performance Indicators have been delayed until data collected in 2010-2011
is available.
1. Indicator 1STP3 (Secondary Tech Prep Participants Who Received an IndustryRecognized Credential) will not be calculated until negotiations for Year 6 when the
CDE industry-recognized data collection is implemented and available.
2. Indicator 1PTP4 (TP students who earned a BA degree) and will not be calculated until
negotiations for Year 6 when the implementation of BA degree attainment is available
from the 2010-2011 NSC data match.
No Tech Prep Performance Level Targets were negotiated for Performance Year 2 (20082009) through 4 (2010-2011) due to data collection and reporting implementation problems
although state numbers and percents will be developed for the 2010 Consolidated Annual
Report due in December.
Steps in the Process for Reaching Agreement on Performance Targets
Beginning in the 2010-2011 program year, Tech Prep Performance Level Targets for subsequent
year performance will be negotiated on or before the Tech-Prep consortia application due date
(approximately May 25 - see the annual Tech-Prep master calendar for exact dates).
Step 1 - The consortium members and staff shall review each Tech Prep Performance Indicator
Data Report provided in January 2011 by the CCCCO. Consortia project directors will receive
notification when the reports become available on the web.
Step 2 - Using the Tech Prep Performance Level Agreement Chart (see Appendix C for a sample
of the report worksheet/tab), the consortium shall accept the performance targets proposed by the
Chancellor's office or propose their own minimum performance levels for each Tech Prep
performance indicator for Performance Year 5 (2011-2012).
Step 3 - The consortium project director shall email the completed Tech Prep Performance
Indicator Data Report workbook (with a completed Tech Prep Performance Level Agreement
Chart worksheet), to Robin Harrington at rharring@cccco.edu and the CCCCO project monitor
in the CCCCO Career Technical Education unit by May 1, 2011.
Step 4 - The Chancellor’s Office – Career Technical Education unit project monitor will review
the proposed performance levels taking into account the factors as described below. The
CCCCO may require that modifications be made to the proposed performance levels based on
the review.
When considering proposed performance levels during the agreement process, the CCCCO will
take into account the following:
Revised 6/13/2010
4
California Perkins IV Tech Prep Accountability Handbook
1. How the proposed performance levels compare with the performance levels proposed by
other consortia, taking into account factors that may be identified by the consortium
including the characteristics of students when the students became secondary Tech Prep
participants and postsecondary Tech Prep participants, as well as the services to be
provided.
2. The participation of high schools and regional occupational programs and centers in the
consortium, as a proportion of the K-12 district reporting Tech Prep participants, will be
considered.
3. Prior performance of the consortia considering changes in consortium membership will
also be considered.
4. Other environmental factors identified by the chancellor's office or the consortium may
also be considered.
5. In addition, the extent to which the proposed performance level will promote continuous
improvement on the performance indicator by the consortium will be considered.
Step 5 - The consortium and the Chancellor’s Office – Career Technical Education unit will
agree upon Performance Level Targets for Performance Year 5 (2011-2012) by May 1, 2011.
Step 6 - The Chancellor’s Office – Career Technical Education unit project monitor will email
the Local Adjusted Performance Level Negotiation Chart to the consortium project director after
the negotiations have concluded so that the consortium will have a record of the final agreedupon Tech Prep Performance Levels for Performance Year 5 (2011-2012) and agreement dates.
Revisions to Agreed-Upon Performance Levels
The consortium may request revisions to the agreed-upon performance level for any Tech Prep
performance indicator if extenuating circumstances exist. The request must be submitted in an
Email from the consortium project director addressed to Robin Harrington at
rharring@cccco.edu and the CCCCO project monitor (check the project monitor listing on the
CCCCO website for current list of project monitors). The request must include documentation
that extenuating circumstances exist. The Chancellor’s Office – Career Technical Education unit
monitor will respond to the request within 20 business days of receipt. Requests must be
submitted to the chancellor's office prior to December 31 of the program year in which they were
negotiated.
Section 5 - Tech Prep Supplemental Improvement Plans
Perkins IV requires that each consortia enter into an agreement with the state to meet minimum
levels of performance for each of the performance indicators in the Perkins IV core indicators
[section 113(b)] and tech prep indicators [section 203(e)]. Because all districts must negotiate
targets for the Perkins core indicators, only the tech prep indicators will be evaluated using the
steps in this section. Consortia not meeting minimum levels of performance for each of the tech
prep indicators must complete a Tech-Prep Supplemental Improvement Plan (TP-SIP).
Important! Tech Prep Improvement Plans are submitted annually through the online Tech Prep
application. However, consortia not meeting 90 percent (90%) of the negotiated target for each
of the indicators must submit a Supplemental Improvement Plan in addition to the annual
Revised 6/13/2010
5
California Perkins IV Tech Prep Accountability Handbook
improvement plan. Supplemental improvement plans must be submitted electronically by e-mail
to the Chancellor's office project monitor. An electronic copy should also be sent to Robin
Harrington at rharring@cccco.edu.
Steps in the Process of Evaluating Performance and Supplemental Improvement Plans
Beginning in the 2011-2012 program year, Tech Prep Actual Performance Levels will be
evaluated against Tech Prep Performance Level Targets for subsequent year (2012-13) TechPrep consortia applications. Consortia not meeting at least 90% of the targets for any of the tech
prep indicators will be required to submit a Supplemental Improvement Plan. The following
steps describe the process of the evaluation and submissions (when necessary).
Step 1 - The consortium shall review its Tech Prep Performance Indicator Data Reports for
Performance Year 4, which will be issued in January 2012. If a consortium has a Tech Prep
performance indicator that failed to meet at least 90 percent (90%) of the agreed upon
performance level for the Tech Prep performance indicator, the consortium will be required to
develop and implement a TP-SIP for the performance indicator. Note that in cases where the
denominator for the performance indicator contains less than 16 students, the consortium is not
required to develop and implement a TP-SIP for that performance indicator.
Step 2 - The consortium shall access the current Tech Prep Supplemental Improvement Plan
Template from the tech prep section of the Chancellor's Office website at:
http://www.cccco.edu/. A sample of the Supplemental Improvement Plan is also available in
Appendix D of this handbook.
Step 3 - The consortium shall use one Tech Prep Supplemental Improvement Plan Template for
each performance indicator that failed to meet at least 90 percent (90%) of the agreed-upon
performance level for the performance indicator, (except that for cases where the denominator
contains less than 16 students the consortium is not required to develop and implement a TP-SIP
for that performance indicator.)
Step 4 - The consortium shall list on the TP-SIP the individuals that were consulted in the
development of the TP-SIP.
Step 5 - The consortium shall describe in the TP-SIP how the TP-SIP was developed.
Step 6 - The consortium shall email the completed TP-SIP(s) to CCCCO project monitor with a
copy to Robin Harrington at rharring@cccco.edu in the Career Technical Education unit by May
1st of the appropriate year.
Step 7 - The Chancellor’s Office – Career Technical Education unit will review the TP-SIP(s)
submitted by the consortium.
Step 8 - The Chancellor’s Office – Career Technical Education unit will notify the consortium
project director if the TP-SIP(s) does not meet minimum requirements so that the consortium
will revise and resubmit them as necessary.
Revised 6/13/2010
6
California Perkins IV Tech Prep Accountability Handbook
Step 9 - The Chancellor’s Office – Career Technical Education unit will notify the consortium
project director by email when the Tech Prep Supplemental Improvement Plan has been deemed
to meet minimum requirements.
Step 10 - The consortium will implement the Tech Prep Supplemental Improvement Plan.
Revisions to the Tech Prep Supplemental Improvement Plan
The consortium may revise its Tech Prep Supplemental Improvement Plans. Revised Tech Prep
Supplemental Improvement Plans shall be submitted by email to the CCCCO project monitor
with a copy to Robin Harrington at rharring@cccco.edu in the Career Technical Education unit.
The Chancellor’s Office – Career Technical Education unit will follow the steps outlined above
to determine if revisions are deemed to meet minimum requirements. Upon approval of their
revisions, the consortium will implement the revised plan. If
The Chancellor’s Office – Career Technical Education unit may terminate funding for individual
Perkins IV Tech Prep Consortium for any fiscal year based in part or completely on either Tech
Prep performance indicator results or noncompliance with required supplemental improvement
plan reporting.
Revised 6/13/2010
7
California Perkins IV Tech Prep Accountability Handbook
APPENDIX A – TECH PREP ACCOUNTABILITY TIMELINES CHART
When, Who, What and Why
When
Who
What
Why - Reference
CCC Chancellor's
Office (CCCCO)
Submit the Year 3 report in the CAR.
Perkins, Title II, Section 205
January
CCCCO
Publish Year 4 Tech-Prep performance indicator reports.
Section 3 in this handbook
January to April
Consortia & CCCCO
Negotiate Year 5 Tech-Prep performance indicator targets.
Section 4 in this handbook
May 1, 2011
Consortia & CCCCO
Final Tech-Prep Year 5 performance target negotiations due
Section 4 in this handbook
May 25, 2011
Consortia
Tech-Prep Year 5 Applications due
Section 4 in this handbook
December
CCCCO
Submit the Year 4 report in the CAR.
Perkins, Title II, Section 205
January
CCCCO
Publish Year 5 Tech-Prep performance indicator reports.
Section 3 in this handbook
January to April
Consortia & CCCCO
Negotiate Year 6 Tech-Prep performance indicator targets.
Section 4 in this handbook
January to April
Consortia & CCCCO
Evaluate Year 5 Tech-Prep actual performance level attained by
consortium against Year 5 negotiated performance indicator
targets.
Section 5 in this handbook
January to April
Consortia
Develop Tech-Prep Supplemental Improvement Plan as necessary.
Section 5 in this handbook
May 1, 2012
Consortia & CCCCO
Final Tech-Prep Year 6 performance indicator target negotiations
due.
Section 4 in this handbook
May 1, 2012
Consortia
Final Tech-Prep Supplemental Improvement Plans (as necessary)
due to CO.
Section 5 in this handbook
May 25, 2012
Consortia
Tech-Prep Year 6 Applications due
Section 4 in this handbook
December
CCCCO
Submit the Year 5 report in the CAR.
Perkins, Title II, Section 205
2010
December
2011
2012
Revised 6/13/2010
8
California Perkins IV Tech Prep Accountability Handbook
APPENDIX B – TECH PREP PERFORMANCE INDICATOR MEASUREMENT DEFINITIONS CHART
This chart lists the performance indicators, defines what each performance indicator measures, and gives the measurement definitions that the Chancellor’s
Office – Career Technical Education unit uses to develop Tech Prep Performance Indicator Data Reports for each consortium. Note: Dates given in the
measurement definitions are the dates used to compute Program Year 3 results to be submitted in the December 2010 CAR. Data for 1STP3 will also be used in
the subsequent Negotiations with consortia even though other indicators will move to then next year for negotiation reports published in January.
Perkin IV Text
Secondary
‘‘(B) The number and percent of
secondary education
tech prep students enrolled in the tech
prep program who—
“(i) enroll in postsecondary education;
“(ii) enroll in postsecondary education
in the same field or major as the
secondary education tech prep students
were enrolled at the secondary level;
Core Indicator
Measurement Definition (based on 2009-10 PY)
1STP1 Secondary Tech Prep
Graduates enrolled in postsecondary
education.
Numerator: Count of students identified as TP and first-time in fall or spring in the consortia
colleges in the prior academic year (Year 2). Source: CCC MIS system.
Denominator: High School district TP graduates in the consortia in the academic year prior to the
last completed academic year (Year 1). Source: California Dept of Education (CDE).
1STP2 Secondary Tech Prep
Graduates enrolled in postsecondary
education in the pathway field.
Numerator: Count of students identified as TP and first-time in fall or spring in the consortia
colleges in Year 2 with aligned CBEDS - 2 digit TOP. Source: CCC MIS system. Use CBEDS - IC TOP code table.
Denominator: High School district TP graduates in the consortia HS district in the academic year
prior to the last completed academic year (Year 1). Source: California Dept of Education (CDE).
Implementation in CDE data collection scheduled for 2010-2011.
Numerator: High School district TP graduates in the consortia in year 2 who left with an IndustryRecognized License or Certificate. Source: California Dept of Education (CDE).
Denominator: High School district TP graduates in the consortia HS district in the academic year
prior to the last completed academic year (Year 2). Source: California Dept of Education (CDE).
Numerator: Count of students identified as TP and first-time in fall or spring with postsecondary
credits in the term of first enrollment in the consortia colleges in Year 2. Source: CCC MIS system.
Denominator: High School district TP graduates in the consortia HS district in the academic year
prior to the last completed academic year (Year 1). Source: California Dept of Education (CDE).
“(iii) complete a State or industryrecognized certification or licensure;
1STP3 Secondary Tech Prep
Participants who received an
Industry-Recognized Credential
“(iv) successfully complete, as a
secondary school student, courses that
award postsecondary credit at the
secondary level;
1STP4 Secondary Tech Prep
Participants who, prior to HS
Graduation completed courses that
awarded postsecondary credit from
the community colleges
1STP5 Secondary Tech Prep
Participants who graduated from
High School and then enrolled in the
college and took Remedial Courses.
“(v) enroll in remedial mathematics,
writing, or reading courses upon
entering postsecondary education.
Numerator: Count of students identified as TP and first-time in fall or spring with basic skills
course records in the consortia colleges in Year 2. Source: CCC MIS system.
Denominator: Count of students identified as TP and first-time in fall or spring in the consortia
colleges in Year 2. Source: CCC MIS system.
Continued on next page
Revised 6/13/2010
9
California Perkins IV Tech Prep Accountability Handbook
APPENDIX B continued
Perkin IV Text
Postsecondary
‘‘(C) The number and percent of
postsecondary education tech prep
students who --“(i) are placed in a related field of
employment not later than 12 months
after graduation from the tech prep
program;
“(ii) complete a State or industryrecognized certification or licensure;
“(iii) complete a 2-year degree or
certificate program within the normal
time for completion of such program;
“(iv) complete a baccalaureate degree
program within the normal time for
completion of such program.
1.
2.
Core Indicator
Measurement Definition (based on 2009-10 PY)
1PTP1 Postsecondary Tech Prep
Participants who completed a Career
and Technical Education Program
and were employed within 12 months
after completion.
Numerator: Count of students identified as TP with certificates or degrees in the consortia colleges
in the academic year prior to the outcome year who were employed in the most recent year (Year 2).
Source: CCC MIS system & UI wage records.
Denominator: Count of students identified as TP with certificates or degrees in the consortia
colleges in the academic year prior to the most recent completed academic year (outcome year) (Year
1). Source: CCC MIS system.
1PTP2 Postsecondary Tech-Prep
participants who left postsecondary
education who received an industryrecognized credential during their
enrollment in a postsecondary career
and technical education program.
1PTP3 Postsecondary Tech Prep
Participants who received an
Associate Degree or a Two-Year
Certificate within the normal time1
for completion.
Numerator: Count of students in the denominator who left with a credit certificate or degree awarded
any time during their Postsecondary experience. Source: CCC MIS system.
Denominator: Count of students identified as Tech Prep Leavers in the most recent completed academic
year (outcome year) for the consortia colleges. Source: CCC MIS system.
1PTP4 Postsecondary Tech Prep
Participants who received a
Bachelor’s Degree within six years2
of being a first time a student at the
community college.
Numerator: Count of students identified as first-time & TP in the consortia colleges in the academic year
designated as normal time in years prior to the most recent academic year (outcome year) who attained a
two-year Certificate or Degree within the calculated normal time for completion. Source: CCC MIS
system.
Denominator: Count of students identified as first-time & TP in the consortia colleges in the academic
year designated as normal time in years prior to the most recent academic year (outcome year). Source:
CCC MIS system.
Implementation in 2010-2011 NSC Data Match
Numerator: Count of students identified as first-time & TP in the consortia colleges in the academic year
five years prior to the most recent academic year (outcome year) who earned a BA degree. Source: CCC
MIS system & NSC.
Denominator: Count of students identified as first-time & TP in the consortia colleges in the academic
year five years prior to the most recent academic year (outcome year). Source: CCC MIS system.
Normal time for completion for 1PTP3 will be calculated based on the median time to completion for the community college during the cohort year.
Normal time for completion for 1PTP4 will be calculated based on the Integrated Postsecondary Education Data System definition of six years for a bachelor's
degree.
Revised 6/13/2010
10
California Perkins IV Tech Prep Accountability Handbook
APPENDIX C – SAMPLE TECH PREP PERFORMANCE LEVEL TARGET AGREEMENT CHART
The agreement process is outlined in Section 4 of this Accountability Handbook. Worksheets for negotiating minimum performance
targets will be made available on the CCCCO website. Workbooks will resemble the chart below.
Consortium Name:
Agreement Number:
Performance
Indicator
______________________
______________________
Actual
Performance
Level for
Program Year 1
(2007-2008)
Secondary
1STP1
1STP2
1STP3
1STP4
1STP5
Postsecondary
1PTP1
1PTP2
1PTP3
1PTP4
Actual
Performance
Level for
Program Year 2
(2008-2009)
Consortium Project Director: __________________
Actual
Performance
Level for
Program Year 3
(2009-2010)
CCCCO
Proposed
Performance
Level for
Program Year 5
(2011-2012)
Consortium
Proposed
Performance
Level for
Program Year 5
(2011-2012)
Final AgreedUpon
Performance
Level for
Program Year 5
(2011-2012)
Date
Agreement
Reached
5/1/2012
NA*
NA*
NA*
NA*
NA*
NA*
NA*
NA*
NA*
NA*
NA*
NA*
NA*
NA*
NA* Important Note: Tech Prep Performance Indicators 1STP3 (Secondary Tech Prep Participants Who Received an Industry-Recognized Credential) and
1PTP4 (TP students who earned a BA degree) will not be implemented until the data is available (see Section 4 for more information).
Revised 6/13/2010
11
California Perkins IV Tech Prep Accountability Handbook
APPENDIX D – TECH PREP SUPPLEMENTAL IMPROVEMENT PLAN TEMPLATE
Directions: Follow the instructions given in Section 5 of this Accountability Handbook to complete and submit this template.
Consortium Name: _____________________________
Project Director: _____________________________
Email: _______________________
Phone: _(____)_______________________
Date Submitted: _________________ Tech Prep Performance Indicator: ______
Population
Individuals Consulted to
Targeted in
Develop Improvement
Improvement
Revised 6/13/2010
Improvement Activity Description
12
California Perkins IV Tech Prep Accountability Handbook
APPENDIX E – TECH PREP ACCOUNTABILITY DATA SHARING TIMELINES CHART
When, Who, What and Why
When
Who
What
Why - Reference
September 1
CDE & CCCCO
CCCCO consensus on CDE data table specifications in Appendix F
October 1
CDE
Submit data to CCCCO that meets the CDE data table specifications
in Appendix F for Year 3 & Year 4
November 1
CCCCO
Generate Tech Prep Accountability Report for Year 3 CAR for
review and analysis.
Perkins, Title II, Section 205
December 1
CCCCO
Submit the Year 3 report in the CAR format to CDE.
Perkins, Title II, Section 205
December 1-30
CDE
Integrate Report into submission to USDE.
Perkins, Title II, Section 205
December 31
CDE
Deadline to submit the Year 3 data in the CAR USDE.
Perkins, Title II, Section 205
January
CCCCO
Publish Year 4 Tech-Prep performance indicator reports.
Section 3 in this handbook
January to April
Consortia & CCCCO
Negotiate Year 5 Tech-Prep performance indicator targets.
Section 4 in this handbook
May 1, 2011
Consortia & CCCCO
Final Tech-Prep Year 5 performance target negotiations due
Section 4 in this handbook
May 25, 2011
Consortia
Tech-Prep Year 5 Applications due
Section 4 in this handbook
October 1
CDE
Submit data to CCCCO that meets the CDE data table specifications
in Appendix F for Year 5
November 1
CCCCO
Generate Tech Prep Accountability Report for Year 4 CAR for
review and analysis.
Perkins, Title II, Section 205
December 1
CCCCO
Submit the Year 4 report in the CAR format to CDE.
Perkins, Title II, Section 205
December 1-30
CDE
Integrate Report into submission to USDE.
Perkins, Title II, Section 205
December
CCCCO
Submit the Year 4 report in the CAR.
Perkins, Title II, Section 205
2010
2011
Revised 6/13/2010
13
California Perkins IV Tech Prep Accountability Handbook
APPENDIX E – TECH PREP ACCOUNTABILITY DATA SHARING TIMELINES CHART (CONTINUED)
When, Who, What and Why
2012
January
CCCCO
Publish Year 5 Tech-Prep performance indicator reports.
Section 3 in this handbook
January to April
Consortia & CCCCO
Negotiate Year 6 Tech-Prep performance indicator targets.
Section 4 in this handbook
January to April
Consortia & CCCCO
Evaluate Year 5 Tech-Prep actual performance level attained by
consortium against Year 5 negotiated performance indicator targets.
Section 5 in this handbook
January to April
Consortia
Develop Tech-Prep Supplemental Improvement Plan as necessary.
Section 5 in this handbook
May 1, 2012
Consortia & CCCCO
Final Tech-Prep Year 6 performance indicator target negotiations
due.
Section 4 in this handbook
May 1, 2012
Consortia
Final Tech-Prep Supplemental Improvement Plans (as necessary) due
to CO.
Section 5 in this handbook
May 25, 2012
Consortia
Tech-Prep Year 6 Applications due
Section 4 in this handbook
October 1
CDE
Submit data to CCCCO that meets the CDE data table specifications
in Appendix F for Year 6
November 1
CCCCO
Generate Tech Prep Accountability Report for Year 5 CAR for
review and analysis.
Perkins, Title II, Section 205
December 1
CCCCO
Submit the Year 5 report in the CAR format to CDE.
Perkins, Title II, Section 205
December 1-30
CDE
Integrate Report into submission to USDE.
Perkins, Title II, Section 205
December
CCCCO
Submit the Year 5 report in the CAR.
Perkins, Title II, Section 205
Revised 6/13/2010
14
California Perkins IV Tech Prep Accountability Handbook
APPENDIX F – TECH PREP DATA FILES FOR PERFORMANCE INDICATOR MEASURES
Data for Secondary measures
This matrix lists the data elements provided by the California Department of Education for developing the Tech-Prep performance indicators, for use by the
Chancellor’s Office – Management Information Systems unit to develop Tech Prep Performance Indicator Data Reports for each consortium and the Federal
reports submitted in the CAR. Note: Dates given in the measurement definitions are the dates used to compute Program Year 3 results to be submitted in the
December 2010 CAR.
CDE File: This file is used for indicator 1STP1, 1STP2, 1STP3, 1STP4
Element Name
Program Year
HS Year
CDS code
CBEDS code
TP Graduates (TPG)
TPG with Award
Definition
Academic Year of Report for report generated in January
Example: for the 2010 CAR, the program year is 2009-2010
Academic Year measured
Example: 2007-2008
CDS code of reporting LEA
CBEDS code of TP graduates at reporting LEA
Number of TP graduates of the LEA in 2007-8
TP graduates in the consortia in 2007-8 who left with an
Industry-Recognized License or Certificate.
Format
Position
X(9)
01-09
X(9)
10-18
X(7)
X(4)
99999v
19-25
26-29
30-34
99999v
35-39
CCC File: This file is used for indicator 1STP1, 1STP2, 1STP4, 1STP5
Element Name
Program Year
CCC Year
College_Id
TOP code
FT-TP Students
FT-TP-PS Students
FT-TP-BS Students
Revised 6/13/2010
Definition
Academic Year of Report: Report generated in January
Example: for the 2010 CAR, the program year is 2009-2010
Academic Year measured
Example: 2008-2009
Consortia Fiscal Agent MIS College identifier
TOP code of FT-TP students reporting LEA
Number of first-time TP students (in the academic year) at
the consortia colleges in 2008-2009 (not special admits)
Number of first-time TP students (in the academic year) at
the consortia colleges in 2008-2009 entering with credits or
have or credit by exam on transcript at entry.
Number of first-time TP students (in the academic year) at
the consortia colleges in 2008-2009 entering with basic
skills coursework in the semester of entry.
15
Format
Position
X(9)
01-09
X(9)
10-18
X(3)
19-21
X(7)
10-16
99999v
17-21
99999v
22-26
99999v
27-31
Additional notes
Use SAM TOP hierarchy selection
described in Appendix G
FT-TP Students w/ PS credits
California Perkins IV Tech Prep Accountability Handbook
Calculating sums from the CDE file: The numbers of TP graduates submitted in the file from CDE is summed to the appropriate level of analysis.
1. For the statewide reporting in the Consolidated Annual Report, the count is summed to the state level for use in a single denominator.
2. For the consortia reports, the counts is summed to the consortium level using the CDS table and the TP application for the CCC Year to determine the
HS to HS district to consortium.
a.
Note:
All HS district TP graduates are used for any HS in a consortium (unduplicated by HS district). For example, if the consortium has San Diego
Unified HS district, San Diego HS, SD City High School (both High Schools in the San Diego Unified HS district), and Valley HS (in Valley
HS district), then the counts will be those reported by San Diego Unified HS district and Valley HS district. Over counting is expected due to
HS in the district not in the consortium.
HS districts may be in multiple consortia. Consortia counts do not sum to a statewide total.
Calculating sums for consortia using community colleges data: The numbers of FT-TP students at the consortia colleges found in that CCC database are
summed to the appropriate level of analysis.
1.
2.
For the statewide reporting in the Consolidated Annual Report, the count is summed to the state level for use in a single denominator.
For the consortia reports, the counts is summed to the consortium level for all colleges in the consortium
Data for Postsecondary measures
With the consortia tables constructed, the measures identified in the postsecondary section of APPENDIX B can be extracted directly from the
MIS database. Data used for the consolidated annual report (CAR) to the Federal government in December would be that data used for the reports
generated in the prior January of that same calendar year.
For example, for the measure indicated in the table below for 1PTP1, the most recent year that would have been available in January 2010 would
be the 2008-2009 academic year. Therefore, students identified as Tech-Prep with certificates or degrees in the 2007-2008 academic year
(denominator) would be followed up in the UI wage records file for employment in 2008-2009 (numerator). Those numerators and denominators
would be used for the December 2010 submission of the CAR.
Perkin IV Text
Core Indicator
Measurement Definition (based on 2009-10 PY)
‘‘(C) The number and percent of
postsecondary education tech prep
students who --“(i) are placed in a related field of
employment not later than 12 months
after graduation from the tech prep
program;
1PTP1 Postsecondary Tech Prep
Participants who completed a Career and
Technical Education Program and were
employed within 12 months after
completion.
Numerator: Count of students identified as TP with certificates or degrees in the consortia colleges in the
academic year prior to the outcome year who were employed in the most recent year (Year 2). Source: CCC
MIS system & UI wage records.
Denominator: Count of students identified as TP with certificates or degrees in the consortia colleges in the
academic year prior to the most recent completed academic year (outcome year) (Year 1). Source: CCC MIS
system.
Revised 6/13/2010
16
California Perkins IV Tech Prep Accountability Handbook
Similarly, the 1PTP2 measure will use, as the denominator, the students identified as Tech-Prep in 2007-2008 who did not re-enroll in 2008-2009
(see the definition for postsecondary Tech-Prep leaver). The numerator will be those students identified in the denominator who earned a
certificate or degree at any time prior to leaving.
Perkin IV Text
Core Indicator
Measurement Definition (based on 2009-10 PY)
“(ii) complete a State or industryrecognized certification or licensure;
1PTP2 Postsecondary Tech-Prep
participants who left postsecondary
education with an industry-recognized
credential earned during their enrollment
in a postsecondary CTE program.
Numerator: Count of students in the denominator who left with a credit certificate or degree awarded any time
during their Postsecondary experience. Source: CCC MIS system.
Denominator: Count of students identified as Tech Prep Leavers in the most recent completed academic year
(outcome year) for the consortia colleges. Source: CCC MIS system.
Continuing to the next measure, to determine the academic year for use in the denominator of 1PTP3, we need to first determine the median time to
degree for the most recent academic year (2008-2009). If the median time to degree, for example, was 3.5 years, and then students from the
academic year three years prior to 2008-2009, or 2005-2006, who were identified as first-time &Tech prep would be included in the denominator.
The numerator then becomes a number of those students in the denominator who attained a Two-Year certificate or degree between fall 2005 and
spring 2009.
Perkin IV Text
Core Indicator
Measurement Definition (based on 2009-10 PY)
“(iii) complete a 2-year degree or
certificate program within the normal
time for completion of such program;
1PTP3 Postsecondary Tech Prep
Participants who received an Associate
Degree or a Two-Year Certificate within
the normal time1 for completion.
Numerator: Count of students identified as first-time & TP in the consortia colleges in the academic year
designated as normal time in years prior to the most recent academic year (outcome year) who attained a twoyear Certificate or Degree within the calculated normal time for completion. Source: CCC MIS system.
Denominator: Count of students identified as first-time & TP in the consortia colleges in the academic year
designated as normal time in years prior to the most recent academic year (outcome year). Source: CCC MIS
system.
1.
Normal time for completion for 1PTP3 will be calculated based on the median time to completion for the community college during the cohort year.
For the 2010 CAR and the January 2011 tech prep negotiation reports, 1PTP4 will not be calculated. The Chancellor's office will implement BA
degree completion in the NSC Data match during the 2010-2011 academic year. That data will be available for the January 2012 tech prep
negotiation reports and the December 2012 Federal report.
Perkin IV Text
Core Indicator
Measurement Definition (based on 2009-10 PY)
“(iv) complete a baccalaureate degree
program within the normal time for
completion of such program.
1PTP4 Postsecondary Tech Prep
Participants who received a Bachelor’s
Degree within six years2 of being a first
time a student at the community college.
Implementation in 2010-2011 NSC Data Match
Numerator: Count of students identified as first-time & TP in the consortia colleges in the academic year five
years prior to the most recent academic year (outcome year) who earned a BA degree. Source: CCC MIS system
& NSC.
Denominator: Count of students identified as first-time & TP in the consortia colleges in the academic year five
years prior to the most recent academic year (outcome year). Source: CCC MIS system.
2.
Normal time for completion for 1PTP4 will be calculated based on the Integrated Postsecondary Education Data System definition of six years for a bachelor's
degree.
Revised 6/13/2010
17
California Perkins IV Tech Prep Accountability Handbook
APPENDIX G – ASSIGNING TECH-PREP STUDENT FIELD OF STUDY AREAS
Identification and Assignment of Tech-Prep Pathway Areas
Following the careful assignment of both SAM priority codes and TOP codes to all CTE courses and
TOP codes to program awards (i.e., certificates and degrees), CTE student pathway or field of study can
be identified in a more efficient means using awards and course taking behavior.
For purposes of Perkins Tech-Prep accountability, assignment of student pathways are divided into six
categories or classes of assignment dependent on the enrollments during the enrollment examination
window. When multiple TOP codes are found in the same SAM priority code, the TOP code where
most of the units occur is assigned. See TIE BREAKER section in the Perkins IV Core Indicator Cohort
Definitions, Selection Methodology, and Report Specifications for more information on breaking unit
load ties.
For example, if a student has 3 units in 0707.20 – Database Design and Administration and 9 units in
0514.00 – Office Technology/Office Computer Applications with each course at SAM priority level C
then 0514.00 is used (see tie-breaker for resolving multiple TOP codes within classes at the same unit
level).
Class 1 CTE Certificate or Degree Earned
Students earning a certificate or degree in a TOP code designated as vocational will be
assigned the TOP code of the certificate or degree. Students receiving non-vocational
awards (degrees or certificates) are considered for Class 2-4 and will be reported as
completers in the assigned program area but are not in Class 1 for assignment purposes.
Class 2 Apprenticeship
All students not in Class 1 but enrolled in a course labeled “A“ SAM priority are assigned
the TOP code of that Apprenticeship course.
Class 3 Occupational Major, Specific Major Determined
All students not in Class 1 or Class 2 (did not earn award or enroll in a course labeled
priority “A“), but enrolled in a “B“ level course are assigned the TOP code of the “B” level
course.
Class 4 Occupational Major, Broad Area Determined
All students not in Class 1, 2, or 3 (did not earn award or enroll in “A“ or “B“ level courses),
but enrolled in a “C“ level course are assigned the TOP code of the “C” level course.
Class 5 Possible Area Determined
All students not in Class 1-4 (did not earn award or enroll in “A,“B,“ or “C“ level courses),
but enrolled in a “D“ level course. These students are not considered concentrators but are
assigned the two digit TOP for pathway determination.
Class 6 Non-Occupational Major
All students not classified above. No assignment of major or pathway.
The student’s major will be identified as the TOP code assigned to the course which placed the student
into Classes 1-5 described above. (NOTE: no major assignment is made for Class 6 students although
students may be in prerequisite general education courses.)
Revised 6/13/2010
18