California Workforce Association
Spring Conference
Denise Dombek
ETA Region 6, San Francisco, CA
May 12, 2015

2

• Workforce Innovation and Opportunity Act;
Joint Rule for Unified and Combined State
Plans, Performance Accountability, and the
One-Stop System Joint Provisions; Notice of
Proposed Rulemaking
• Pages 20573 - 20687 (115 pages) [FR DOC #:
2015-05528]
• Published on April 16, 2015
• Written Comments must be received by no later than June 15, 2015
3

• Performance Accountability – System Alignment
• Ensuring that federal investments in employment and training programs are evidence-based, data-driven, and
accountable to participants and taxpayers by establishing a common performance accountability system for the core programs and requiring other authorized programs to report on the common performance indicators.
4

• For the most part, most of the performance data required by WIOA is already being collected. However, the primary indicators of performance specify outcomes with respect to quarters after exit that are different from
WIA. There are also some additional data elements that will be required such as credentials attainment, measurable skills gain, training-related costs and information regarding employer engagement.
5

• Data management and the resultant quality of reported data are derived from and influenced by the policies, procedures and protocols utilized at the state and/or local levels
• Grantees should develop guidance for staff and sub-grantees involved in the collection of data:


Definitions of data elements
Sources of information

Participant record and documentation requirements

Procedures for collecting, entering and reporting data and associated “business rules” that cover timeliness and completeness


Procedures for entering data into an automated database
Procedures for correcting data
6

• Data collection and data entry:
•
•
Routine training should be provided for data management guidance
All staff involved in the collection or entry of data should be trained in the procedures
•
The data entry process should include steps for verifying entered data against original sources on a sample basis or for entire population of records
7

• If Data is not collected and reported, it didn’t happen!!
8

• Core Programs
• WIA (Title I)
• Adult, Dislocated Worker, Youth
• Wagner-Peyser (Title III)
• Vocational Rehabilitation (Title IV)
• Adult Education (Title II)
• Additional Programs
• Job Corps
• Native American
• Migrant and Seasonal Farmworker
• YouthBuild
9

 Additional Measures – Employer, Skills
 Tracking of “Efficiency” Outputs
 Common Reporting/Tracking: Core Programs
 UI Wage Record Access for Core Programs
 Sanctions for “Failure” – Reporting, Outcomes
 ETPL Reporting Changes – incl. scope of trainees
 Regression Models - Negotiations, Measurement
 Pay-for-Performance Contracting Allowability
 Dissemination of Effective Practices
10
10

• Local Areas may use up to 10% of Adult and Dislocated Worker funds for pay-for-performance contract strategies.
• Based on the achievement of specified levels of performance on the core program’s performance measures (primary indicators of performance)
• Further provisions included in Notice of Proposed Rulemaking (NPRM) and additional guidance planned on the appropriate use of pay-forperformance contract strategies.
11

WIA (Workforce Investment Act) effective through PY15
 ‘Services’ based
Participation and Exit
 Data Validation required
 Reporting Cohort primarily
1 st to 3 rd Qtr after Exit
 Nine Common Measures
 Reporting Participant
Information
 Sequence of Services –
Core, Intensive, Training
WIOA (Workforce Investment and
Opportunity Act) effective PY16*
 ‘Services’ based
Participation and Exit
 Data Validation codified
 Reporting Cohort extended 2 nd to 4 th Qtr after Exit
 Twelve Primary Indicators of Performance
 Expanded Reporting
Participant Information
 ‘Career Services’ and
Training
*unless State ‘early implementer’
12

• An individual determined eligible to participate in the program who receives a service funded by the program in either a physical location (e.g., One-
Stop Center) or remotely through electronic technologies.
• Three Components
• Determined eligible to participate in the program
• Receives a funded service
• In either a physical location or through electronic technologies
13

• When does participation begin?
• What services commence participation and inclusion in performance accountability?
• What is impact of self service?
• Reported across Core Programs?
14

• A participant who hasn’t received a program or partner-funded service for 90 consecutive days and no future services are scheduled
• Three components
• Hasn’t received a service
• For 90 consecutive days
• No future services scheduled
15

• When is it appropriate to Exit?
• Same for all Programs?
• Youth participants?
• Common or Program Exit?
16

Any core, intensive or training activity made available to eligible participants that allows them to benefit from specific programs in the workforce system.
17

• No longer ‘sequence of services’
• Core and Intensive = Career Services
• What commences and continues participation?
18

Of those who are not employed at the date of participation:
Number of adult participants who are employed in the 1 st quarter after the exit quarter
Number of adult participants who exit during the quarter
19

Of those who are employed in the first quarter after the exit quarter:
Number of adult participants who are employed in both the second and third quarters after the exit quarter
Number of adult participants who exit during the quarter
20

Of those adult participants who are employed in the first, second and third quarters after the exit quarter:
Total earnings in the second quarter plus total earnings in the third quarter after the exit quarter
Number of adult participants who exit during the quarter
21

WIA PLACEMENT IN EMPLOYMENT OR
EDUCATION
• Of those not employed, in the military or in post-secondary education at participation:
Number of youth employed, in the military or enrolled in post-secondary education and/or advanced training or occupational skills training in the 1 st quarter after exit
Number of exiters
22

23
Of those enrolled in education at participation or any time during the program:
Number of Youth who attained a diploma, GED or certificate by the end of the 3 rd quarter after exit
Number of Exiters
23

Of those out-of-school youth who are basic skills deficient:
Number of Youth participants who increase one or more educational functioning levels
24
Number of youth who completed a year of participation (based on date of 1st youth service)
PLUS Number of youth who exit before completing a year of participation
24

1.
Employment
• 2 nd quarter after exit
2.
Employment
• 4th quarter after exit
3.
Earnings
• New; Median earnings 2 nd quarter after exit
4.
Credential Rate
• New; Up to one year after exit; Doesn’t apply to WP
5.
In-Program Skills Gain
• New; Achieving measurable skills gains, Doesn’t apply to WP
6.
Employer Effectiveness
• New; before PY16
25

WIOA Youth Performance Measures
• Education/Employment
• 2nd quarter after exit
• Education/Employment
• 4th quarter after exit
• Earnings
• Median earnings 2nd quarter after exit
• Credential Rate
• Up to one year after exit
• If HS Dip/GED, must include Employment/Postsecondary
• In-Program Skills Gain
• Achieving measurable skills gains
• Employer Effectiveness
• before PY16
26

For the Quarter ending Sept 2014
Jan-
Mar
Apr-
June
2013
July-
Sept
Exit Cohort
Oct-
Dec
Jan-
Mar
Apr-
June
Employment/Education Qtr
2 Qtr Wage Delay
2014
July-
Sept
2015
Oct-
Dec Jan-Mar
Nov
15th Feb 14th
27

WIOA – What’s Eliminated
• Literacy/Numeracy indicator for youth
• Although utilized in development of Skills
Gain measure
• Customer Satisfaction as statutory measure
• State Incentive Funds
• But Governor’s reserve may be used for local incentives 28

• Focus on Out of School Youth
• 75% of formula youth funds minimum
• Work Experience Expenditure
• 20% of local area funds minimum
• Eligible Out-of-School Youth Age
• 16-24 year olds
• In-School Youth Age
• 14-21 year olds
• New Program Elements
• 5 new elements
29

• Youth PY 2015 Funding
• April 1, 2015
• WIOA Implementation
• July 1, 2015
TEGL 23-14. While WIOA is effective July 1, 2015 and the Youth funds allotments are provided April 1, 2015, and it will take some time to transition, States and Local Areas must begin to incorporate strategies for recruiting and serving more OSY with the receipt of PY 2015 funds. Progress must be documented, including plans to achieve 75% expenditure rate with future funds.
30

Additional Provisions
• State Targets
• Must use statistical adjustment model—use now codified (Sec. 116(b)(3)(A)(viii))
• Targets for first two years included in State Plans
• Additional Information required in Annual
Reports
• Example: Amount of funds spent on each type of service
• Data Validation now codified (Sec. 116(d)(5))
31

Additional Provisions
• Sanctions
• State Level
• If a state fails performance a first year, TA will be provided (used to say will provide TA upon request)
• If a state fails performance a 2 nd consecutive year or fails to submit an Annual Report for any year, it can lead to a
5% reduction in statewide funds (stronger language)
• Local Level
• If failure continues for a 3 rd consecutive year, the
Governor must take corrective action which shall include development of a reorganization plan (and new local board)
32

State Performance Reports will include:
• Information specifying levels of performance for the primary indicators
• State adjusted levels of performance for each program
• Performance information aggregated by individuals with:
• Barriers to employment
• Subpopulation of these individuals according to race, ethnicity, sex and age
• Total participants served by each program
• The percentage of the State’s annual allotment spent on administrative costs
33

• Information on participants in career and training services during the program year and the 2 preceding programs years:
• The number of participants enrolled
• The number of participants who exited
• The total amount of funding expenditures
• The average cost/participant
• The number of participants enrolled in more than 1 program
• The number of participants with barriers to employment
• Administrative costs
34

• Pay-for-performance contracts for program strategies:
• The performance of the service providers measured against contract-specified performance measures
• An evaluation of the design of the programs and performance of the strategies
• Where possible, levels of satisfaction among employers and participants
• Other information that facilitates comparisons with programs in other states.
35

Local Performance Reports will include everything in the State reports in addition to the following:
• The percentage of the Local’s annual allotment spent on administrative costs; and
• Other information that facilitates comparisons of programs in other local areas
36

ETPs provide student performance outcome data in State reports, which must include:
▪ The Total number of individuals exiting a program (WIOA-funded and non-WIOA-funded)
▪ Elements relating to the number of WIOA participants receiving & exiting training
▪ Average cost
▪ Number of special populations served.
37

Date Action
• April 16, 2015
• June 15, 2015
• July 22, 2015
• March 3, 2016
• June 30, 2016
• July 1, 2016
• Proposed regulations published
• Comment Period Ends
• Templates for state, local, and
ETP performance reports
• PY2016 Performance Targets negotiated
• Employer Effectiveness measure developed
• Full implementation of WIOA performance measures
38

• Fact Sheets
• NPRM Webcast
• Notice of Proposed Rulemaking Updates
• Guidance
• WIOA Technical Assistance Tools and
Resources
39
39

• Final Questions or Comments
40