ATIM Outcomes and Successes


Background

WIF and ATIM LogoThe federal Workforce Innovation Fund (WIF) Round I project successfully ended in June 2017, culminating in a five-year effort to plan, implement,​ and evaluate innovative, multi-partner sector strategies. Illinois was awarded one of twenty-six Round I project grants in the nation. To generate quantifiable data beyond anecdotal evidence, these projects included an impact analysis and randomly assigned treatment and control groups if involving services to individuals.

The $12 million project was branded “Accelerated Training for Illinois Manufacturing” (ATIM) and focused on working with businesses and nascent or established sector partnerships to identify regional needs for specific manufacturing skills and competencies and then explored various methods to accelerate the time to earnings and full productivity for jobseekers. ATIM involved a cross-cutting team of private sectors and State Agencies working on the initial program design and roll-out, plus regional public-private partnerships handling business engagement, participant recruitment, random assignment, training,​ and preparation for employment. The Illinois Department of Commerce & Economic Opportunity (DCEO) was the grant recipient and principal author of the application. In addition, the planning and implementation team included staff from the Illinois Manufacturer’s Association (MA), the Illinois Department of Employment Security (IDES), the Illinois Community College Board (ICCB), Southern Illinois University at Carbondale Center for Workforce Development (SIU-C) and the project evaluator, Social Policy Research Associates (SPR).

Full Impact Report
  • ​​Evaluation of ATIM (PDF)​​



Impact Overview
​​

​​Program Goals & Activities
  1. Reduce the time needed to fill critical job openings with qualified workers.
  2. Improve access to employment and earnings opportunities as quickly as possible.
  3. Provide competency-based training for stackable, industry-recognized credentials.
  4. Reduce the time needed to earn credentials and start earning wages.




Program Model Key Features
  1. Embed lean principles into sector-based talent development.
  2. Ongoing engagement with manufacturing sector employers, associations, and other experts to determine regional demand skills.
  3. Clearly defined career pathways.
  4. Expanded paid work-based learning opportunities, including work experience, internship, and On-the-Job Training (OJT).
  5. Individualized training plans to leverage existing skills to quickly provide needed training to achieve the individual's training plan goals.
  6. Because passing a drug test is a prerequisite for manufacturing employment, applicants were tested before random assignment.

​​
Infographic
ATIM Infographic PDF


Flexible Program Model

Flexible Program Model Image for ATIMATIM promoted the innovation of leveraging existing skills and working with trainers and businesses to create training options tailored for each person’s skill gap for the occupation or group of occupations they had targeted. Everyone in the Treatment Group received:
  1. enhanced career exploration,
  2. a personal skill gap analysis,
  3. a personal training plan and
  4. enrollment into training for a stackable industry recognized credential, the Manufacturing Skills Standards Council Safety (MSSC) certificate training. (Anyone already possessing this credential was allowed to bypass the MSSC training.)

From that point, next steps were unique to each individual and were determined by their personal short-term and long-term goals and their regional opportunities to enter manufacturing employment. Services could include any mix of: training for MSSC Certified Production Technician, American Welding Society or National Institute of Metalworking Skills certificates; essential work skills training; paid work experience, paid internships, and/or OJT. Participants with an urgent need for income were allowed to change their short-term plan upon discovering immediate employment opportunities; while others who had the resources to remain in training were allowed to modify their plan to continue with more advanced training so as to enter the workforce in a higher skill, higher pay occupation.



Participant Outcomes


​Enrollment: Treatment Group
​Entered Training (90% of Enrolled)
​Completed Training (85% of Entered Training)
​Earn at Least 1 Industry Cert. (80% of Entered Training)
​Number of Industry Credentials Earned
​Enter Employment (85% of Completed Training)
​Target ​600 ​540 ​459 ​432 ​432 ​390
​Actual ​609 ​565 or 93%
​461 or 82%
​454 or 80%
​1,267 ​427 or 94%
​​The Actual number may exceed Target number but not percent because actual enrollment exceeded the target.

This outcomes table includes 104 veterans automatically assigned to the treatment group due to statutory veterans’ priority of service requirements instead of being randomly assigned. These veterans counted toward meeting enrollment and outcomes goals, but were excluded from the impact evaluation.



Impact Analysis

ATIM Impact Analysis ImageATIM participants in the treatment group experienced higher rates of training enrollment, training completion, credential attainment, number of credential earned and employment following random assignment than members of the control group. Positive statistically significant differences in employment rates were documented during the second year after random assignment.

ATIM participants experienced higher earnings following random assignment than members of the control group. Statistically significant differences in earnings were documented during the second year following random assignment, with ATIM participants earning an average of approximately $5,000 more during that year than control group members.
  • ATIM percent of participants entering training were 72 points above the control group
  • ATIM percent of participant successful completion rates were 52 points above the control group
  • ATIM percent of participant credential attainment rates were 55 points above the control group
  • On average, individual ATIM participants earned 2 industry credentials more than the control group
  • ATIM participants, on average, were employed for more than one-third of a quarter longer than the control group members during the second year following random assignment


Promising Practices

  1. Supported the development of online, cross-program participant tracking and outcomes reporting, allowing case managers in different programs to see the progress of co-enrolled participants.
  2. The new practice of local workforce case managers utilizing Wagner-Peyser resources to conduct targeted recruitment of Unemployment Insurance recipients, with different messages tailored for specific audiences. This best practice was highly effective and has been incorporated into local WIOA implementation strategies in Illinois.
  3. Highlighted the vital importance of long-term public/private partnerships necessary to support work-based learning.
  4. Highlighted the positive impact of strong, well-informed case management and the use of an individually designed action plan (vs. a one-size-fits-all approach) on participant outcomes.
  5. Demonstrated the feasibility of early-exit based on proof-of-mastery of subject matter.
  6. Demonstrated the feasibility of accelerated training by community colleges.
  7. Provided valuable experience in how to incorporate business partners into program implementation.
  8. Demonstrated having a private sector expert on the team improves business engagement. The projects also demonstrated the quality of this person interacting with partners and potential partners has a direct impact on results.
  9. Demonstrated the value of establishing direct, two-way communication between State partners and front-line staff to improve understanding of project goals and implementation issues.

ATIM implementation was not without challenges. However, the State and regional partners were committed to successful implementation and improved outcomes for manufacturers and workers. The efforts of these teams were recognized nationally; with partners from Commerce and SIU invited by USDOL to share best practices with other WIF grantees at multiple national technical assistance events, webinars and National Convenings.