WIOA Performance accountability Region V Youth Roundtable 08312016 To provide stakeholders with a better understanding of the performance accountability provisions in section 116 of WIOA and the accompanying regulation ID: 772513
Download Presentation The PPT/PDF document "WIOA Performance accountability" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
WIOA Performance accountability Region V Youth Roundtable 08/31/2016
To provide stakeholders with a better understanding of the performance accountability provisions in section 116 of WIOA and the accompanying regulation. Definitions of participant and exitPrimary indicators of performance for WIOA core programs and other workforce programsPerformance reporting timing and requirements The PIRL Statistical Adjustment M odel and Negotiations
Themes of WIOA Career Pathways Employer engagement Work-based learning Sector strategies PartnershipsIntegrated Service DeliveryData SystemsPerformance measurement
WIOA Regulations Performance is under Section 677 of the Joint Final Rule and includes:Definition of termsIndicators of performance State performance reports Establishing state l evels of performance (negotiations) Sanctions for failure to achieve adjusted levels of performance and/or failure to reportLocal area performanceEligible Training Provider reporting
WIOA Information Collection Requests Joint Requirements (OMB 1205-0526)Participant Individual Record Layout (PIRL) for jointly used data elements (ETA 9170) Annual Report template for States and Local Areas (ETA 9169) Reporting Cohorts for each indicator Eligible Training Provider data element definitions (ETA 9171) Effectiveness in Serving Employers specifications
WIOA Information Collection Requests (cont.) DOL-Only Requirements (OMB 1205-0521) Participant Individual Record Layout (PIRL) for ALL data elements to be reported to DOL (ETA 9172) Quarterly Report template (ETA 9173) Pay-for-Performance Report template (ETA 9174) All found at www.doleta.gov/performance/reporting
Upcoming Guidance Currently working on comprehensive joint guidance – hope to be published in the FallWill include further information on: What counts as a credential Who is included in credential measure Who is included in measure skill gain Operational parameters on all the indicators Exclusions for the indicators
Transition from WIA to WIOA indicators July 1, 2016 is the transition date for using the WIOA indicatorsAnyone still enrolled in WIOA on July 1, 2016 (i.e., receives services on or after July 1, 2016) or newly enrolls in WIOA on or after July 1, 2016 is included in the WIOA indicators Anyone who exits prior to July 1, 2016 will not be included in the WIOA indicators and will be included in a WIA closeout report
Youth Participant Definition of a Participant: reportable individual who receives other than self-service or information-only services and has satisfied all applicable programmatic requirements including eligibility determination For Youth this means: Eligibility determination Objective assessment Individual service strategy Received 1 of 14 youth program elements
Exit Program exit occurs when the participant no longer receives services for 90 days and has no additional services scheduled The date of program exit is determined after 90 days of no services have elapsed and no future services are planned. At that point the date of program exit is applied retroactively to the last date of service. The following services do not delay an exit: Follow-up services Self-service Information-only servicesCommon exit is encouraged but not required across DOL programs (no common exit with ED programs)
Primary Indicators of Performance
Youth Primary Indicators of Performance Employment/Education/Training Rate 2 nd Quarter after Exit -Successful Outcomes include unsubsidized employment, secondary education, postsecondary education, and occupational skills training in 2 nd quarter after exit -Adult measures only recognize unsubsidized employment as outcome
Youth Primary Indicators of Performance Employment/Education/Training Rate 4th Quarter after Exit - Successful Outcomes include unsubsidized employment, secondary education, postsecondary education, and occupational skills training in 4th quarter after exit -Adult measures only recognize unsubsidized employment as outcome
Youth Primary Indicators of Performance Median Earnings in the 2nd Quarter after Exit -Only includes those in unsubsidized employment in 2nd quarter after exit -Median is the number that is in the middle of the series of numbers, so that there is the same quantity of numbers above the median as there are below the median
Primary Indicators of Performance (continued) Credential Attainment Rate Only includes those who received training or education (excluding OJT or Customized Training)Credential can be obtained during the program or within 4 quarters following exitIf participant obtains secondary school diploma or equivalent, they must also be employed or in an education/training program leading to a postsecondary credential within 1 year after exit
Primary Indicators of Performance (continued) Measurable Skill Gains -5 Types of Measure Skill Gain – participant a success if they achieve any of the following: Educational functioning level increase Secondary school diploma attainmentTranscript/report card showing 12 credits attainedSatisfactory progress report toward established milestoneSuccessful passage of a required exam -Includes those in education or training in a given program year (not exit-based)-Only 1 gain per program year (i.e., in numerator and denominator 1 time) unless a participant has multiple periods of participation in a given program year
Measurable Skill Gains For DOL Title I programs and VR, programs can use all 5 types of skill gains, while Adult Ed programs only use first 2 types of skill gainsIncluded in indicator (if in education or training) in a given program year if participant was enrolled for any period of time in the program year Don’t delay enrollment at end of program year to avoid inclusion in the indicator
Primary Indicators of Performance(continued) Effectiveness in Serving Employers System measure reported jointly across all core programs (i.e., youth program does not have a separate employer measure) (States choose 2) Retention with the same employer in the 2nd and 4th quarters after exit Employer Penetration Rate Repeat Business Customer Rate
Reporting Timeframes Counts and outcomes based on a “first available” approach – same as current methodology.All timing cohorts are available in the Joint ICR documentation. First WIOA report is due on 11/14/2016* for most programs Quarterly reports due 45 days after the end of the quarter. Annual Reports due October 1. All of the annual and quarterly Periods for Reporting can be found at doleta.gov/performance/reporting
Data Availability
Participant Individual Record Layout (PIRL) The Joint PIRL (ETA-9170) contains 76 data elements common to ED and DOL WIOA core programs . States will NOT submit individual records using the Joint PIRL (ETA-9170). States will collect and report data as required by the DOL specific PIRL ETA-9172 (DOL-only PIRL). The DOL-only PIRL contains within it all of the common elements found in the Joint PIRL. The data elements are coded with an “R” to indicate which funding streams require which elements. DOL will aggregate and calculate the indicators of performance using the data submitted using the DOL-only PIRL.
Key Items in DOL PIRL Includes demographic data including all youth eligibility-related characteristicsIncludes all 14 program elements (training, financial literacy, and type of work experience included in 1200 section, everything else in 1400) Includes all data elements related to core indicators of performance
Negotiations WIOA requires 4 elements to be considered during performance level negotiations.How the levels involved compare with the adjusted levels of performance established for other States An objective statistical adjustment model The extent to which the levels involved promote continuous improvement The extent to which the levels involved will assist the State in meeting goals established in accordance with the Government Performance and Results Act
Statistical Adjustment Model The Departments have developed a fixed effect model to estimate State level performance outcomes. A summary of the model is in Attachment II of TEGL 26-15; the full description is found on www.doleta.gov/performance The model considers participant characteristics and the economic conditions in which they were served The new WIOA outcomes were calculated using existing WIA and Wagner-Peyser individual records, dating back to PY2005 (PY2012 for WP). The results of the Statistical Adjustment Model can be found at www.doleta.gov/performance/reporting, in Attachment IIIB (Negotiations Tool) of TEGL 26-15.
ETA programs: ETAperforms@dol.gov www.doleta.gov/performance www.doleta.gov/wioa Office of Career, Technical, and Adult Education programs: AskAEFLA@ed.gov www.ed.gov/AEFLARehabilitation Services Administration programs: Contact State Liaison; listing at https://rsa.ed.gov/people.cfm