key: cord-0945533-v4y9q8sm authors: Perkins, Daniel F.; Davenport, Katie E.; Morgan, Nicole R.; Aronson, Keith R.; Bleser, Julia A.; McCarthy, Kimberly J.; Vogt, Dawne; Finley, Erin P.; Copeland, Laurel A.; Gilman, Cynthia L. title: The influence of employment program components upon job attainment during a time of identity and career transition date: 2022-02-13 journal: Int J Educ Vocat Guid DOI: 10.1007/s10775-022-09527-1 sha: 2f5f1430ec687bc9563758c4dfb6aecfadc73479 doc_id: 945533 cord_uid: v4y9q8sm This study assessed the effectiveness of employment programs components, which resulted in the identification of content and process components that increase employability. Employment program use was studied among 1172 United States of America military veterans to determine which content (i.e., interviewing skills) and process (i.e., working with a mentor/coach) components influence job attainment during a time of career and identity transition. Components were distilled utilizing a common components analysis approach (Morgan et al., 2018). Associations with finding employment up to 15 months after the military-to-civilian transition were explored. Veterans who engaged with employment programs were primarily accessing the following components: career planning, resume writing, and interviewing skills. However, only a few content components were significantly related to obtaining employment: interviewing (with mentor/coach), resume writing (online tools), translating military to civilian work (with mentor/coach), entrepreneurship (with mentor/coach), and virtual career fairs. Furthermore, not all processes or modes of instruction for content components were associated with success in the job market. Having a mentor/coach was one of the most effective delivery strategies. For example, veterans using programs delivered by a mentor/coach that translated military skills to civilian work were more likely to find a job at 6–9-months (84%) and 12–15-months (91%) post military separation. In addition, risks that predicted lower use of employment program components by veterans were identified such as junior enlisted rank, combat exposure, combat arms occupation, and physical health problems. With these findings, program developers, implementers, and funders can channel efforts towards the utilization of employment programs with effective components. The purpose of this analysis was to determine if employment program component use was related to the outcome of job attainment. A distinct population known to be in the throes of career transition was studied: transitioning military veterans in the United States of America. Many employment programs and services are available and offer job-seeking supports to military veterans (i.e., career fairs, resume writing resources, career counseling, training and certification programs, and formal networking opportunities). For example, career fairs may assist veterans in obtaining employment by providing opportunities for direct personal interaction with potential employers; veterans can also compare companies or jobs and find the best possible match (Stonebraker et al., 2019) . Another option, career counseling services, can help veterans identify career goals and transferrable skills through a relationship with a mentor or experienced professional who provides one-on-one, tailored assistance (e.g., American Corporate Partners; Buzzetta et al., 2017; Rausch, 2014) . However, despite the intent and promise of career development, career education, and employment services, additional empirical support is needed to validate their usefulness and effectiveness in helping individuals in a state of career transition obtain employment. Moreover, little is known about specific components of employment supports and their roles. This exploratory study determined content components, or topics taught, and process components, or modes of instruction, that influence job attainment during a time of distinct identity transition, a time that propels individuals to redefine their education and career goals. Understanding military service members' employment experiences after they transition from active status to veteran status is a critical area of study. Approximately 2.8 million post-9/11 veterans in the United States of America (U.S.) have reintegrated into civilian communities; this population is projected to grow to more than 5.1 million in 2021 (National Center for Veterans Analysis & Statistics, 2016) . Veterans serving in either the active-duty military or the reserve components may leave active status due to retirement (enter retired reserve), separation (unfulfilled military service obligation to be carried out in the Individual Ready Reserve), discharge (no further military service obligation), or deactivation (unit no longer active). Veterans of color, whose representation among transitioning veterans is predicted to increase from 25 to 35% by 2040, have been found to have a harder time finding employment (National Center for Veterans Analysis & Statistics, 2020) . Physical and mental consequences of warfare can also impact employability, a concern given that post-9/11 veterans are more likely than veterans from other wars to have been deployed and to have served in a combat zone. Permanent, severe, post-service disorders, disabling injuries, and illnesses are now more common as medical advancements have increased survival rates for those experiencing catastrophic wounds on the modern battlefield (DiRamio & Spires, 2009; Pew Research Center, 2019) . For example, one in three post-9/11 veterans in the U.S. has a service-connected disability, and 73% of these veterans are in the labor force (U.S. Congress, Joint Economic Committee, 2016) . Obtaining employment is important to individual veteran well-being and productivity, and also to the prevention of negative consequences for veterans' families and society if civilian reintegration is unsuccessful . The majority of post-9/11, U.S. veterans do not experience ongoing adjustment or reintegration problems, and they do successfully transition into their chosen communities (Tsai et al., 2015; Vogt et al., 2020) . However, a significant minority report several commonly occurring challenges in four life domains: vocational (e.g., employment, education), finances (e.g., housing, legal), health (i.e., physical and mental), and social (i.e., interpersonal relationships). Employment is often the top concern cited by post-9/11, U.S. veterans (Perkins et al., 2017) ; job attainment and employment is fundamentally linked to the veterans' successful reintegration (Bullock et al., 2009; Cohen et al., 2013) . For many veterans, military service is more than just a job; it is an identity. Finding employment post-service not only helps with practical aspects of well-being such as finances; it can also provide a post-military sense of purpose (Kintzle & Castro, 2018) . Despite having capabilities that are typically valued by organizations (e.g., leadership, teamwork, a sense of duty and responsibility, discipline), some post-9/11 U.S. veterans face challenges in obtaining employment (Haynie, 2016) . Generally, prior to the COVID-19 pandemic, veteran unemployment patterns in the U.S. resembled the civilian unemployment rate. Therefore, in times of high civilian unemployment, there is also high veteran unemployment; however, post-9/11 veteran unemployment has remained the highest of all wars (U.S. Bureau of Labor Statistics, 2018). During this study's 2016 survey administration, the overall veteran unemployment rate in the U.S. was 4.3%, which was slightly lower than the civilian population rate of 4.7% (U.S. Bureau of Labor Statistics, 2017). The veteran unemployment rate further declined in 2019 to 3.2%. Yet, unemployment rates for veterans differ based on age, gender, and disability status; some veteran subgroups experience pronounced employment challenges (U.S. Bureau of Labor Statistics, 2018). As an example, in 2015, post-9/11, U.S. veterans aged 18 to 24 years had an unemployment rate (13%) that was more than double the rate for older post-9/11 veterans and higher than that of similarly aged nonveterans (10.9%; U.S. Congress, Joint Economic Committee, 2016) . A substantial proportion of U.S. veterans do not have a job when they leave the military (Burnett-Zeigler et al., 2011; U.S. Department of Veterans Affairs, 2015) . There may be sizeable, deep-seated barriers to veteran employment. Indeed, a growing divide between civilians and those who serve in the all-volunteer military exists (Carter et al., 2017) . Veterans comprise only 7% of the U.S. population, a number that will continue to decline as veterans of World War II, the Korean Conflict, and the Vietnam War die. Networking and fraternal connections are diminishing; the proportion of chief executive officers with military experience declined from 60% in 1980 to 6% in 2014 (Benmelech & Frydman, 2015) , resulting in the loss of potential employment allies. As a result of the lack of firsthand familiarity with veterans, employers often hold inaccurate views of the capabilities veterans offer to the workforce (Stone & Stone, 2015) . Moreover, veterans may not understand the skills or abilities post-military jobs require (Resnik et al., 2012) . Furthermore, transitioned veterans' civilian networks of influence are limited; this may mean less assistance and decreased likelihood of obtaining a good-fitting job. The inaccurate perception that many civilian employers have about veterans adds to employment challenges. Civilians often derive their understanding of veterans in a vacuum that exists between firsthand exposure to veterans and prevailing stereotypes. The media is a source for civilians' beliefs about veterans (Zogas, 2017) . Often, these accounts offer a slanted view of veterans, portraying veterans as heroes or as damaged victims (Kleykamp & Hipes, 2015) . For instance, the media perpetuates the belief that most veterans experience post-traumatic stress disorder (PTSD; Moore, 2018) , even though the actual proportion is closer to only 12%. This belief may directly impact veterans' employment prospects. In a study of employers' perspectives, employers raised concerns about hiring veterans, citing stereotypes of widespread mental health challenges as the result of combat. Many employers also have difficulty understanding how military job skills translate into the civilian workplace (Berglass & Harrell, 2012) . Of course, some veterans have physical and/or mental health challenges that make obtaining employment difficult. Generalized anxiety, PTSD, and depression are diagnosed among post-9/11 veterans, and the employment rates in the U.S. for these sub-populations vary widely. Rates of PTSD among post-9/11 veterans typically average between 5 and 15%, and rates for depression range from 2 to 10% (Tanielian & Jaycox, 2008) compared to 2.6% to 5.2% in the general U.S. population (Reynolds et al., 2016) . Traumatic brain injury has been diagnosed in approximately 8% of post-9/11 U.S. veterans (Tanielian & Jaycox, 2008) . Common physical injuries reported by veterans include chronic pain, back problems, and limb amputations (Geiling et al., 2012) , which place them at higher risk for unemployment (Humensky et al., 2013) . Given the many employment challenges U.S. veterans face when they transition from active military service to veteran status, there have been numerous federal, state, and community-based programs established to assist veterans during reintegration, and some have benefited veterans and their families (Office of the Chairman of the Joint Chiefs of Staff, 2014). Indeed, there are tens of thousands of public and private programs designed to support veterans, and many focus on assisting veterans with securing employment (e.g., Hiring Our Heroes, Veteran Jobs Mission, 100,000 Jobs Mission; Carter, 2013) . Approximately 50% of veterans report using at least one program designed to enhance their employment status within three months of separation , and employment-related programs are used substantially more than other life domain programs (i.e., health, finance; Perkins et al., 2019) . Some evidence exists that participating in employment-related programs can improve veterans' vocational outcomes, even if many of these programs lack rigorous evidence of effectiveness (Curry Hall et al., 2014 . One investigation found unemployed U.S. veterans using the Transition Assistance Program (TAP), a federal program designed to bolster veterans' capacity to obtain civilian work, secured employment 3 weeks sooner than those veterans who did not use TAP (Faurer et al., 2014) . In addition, there is anecdotal evidence that employers look to hire veterans through career fairs and the Veterans Employment Center's website (Curry Hall et al., 2014) . However, limitations of prior studies, including selection bias and small sample sizes, restrict their ability to speak to program effectiveness. The sheer number of programs available to U.S. veterans makes evaluating the effectiveness of all these programs cost-prohibitive, particularly those provided by nonprofit, community-based programs that may not have dedicated evaluation budgets. So, we designed a coding approach to summarize specific program components and efficiently examine the program components without evaluation data . This approach built upon a distillation and matching model (Chorpita et al., 2007) , a meta-analysis of common components of parenting programs (Wyatt Kaminski et al., 2008) , and the theoretical framework of common factors in effective HIV prevention (Rotheram-Borus et al., 2009 ). The coding approach utilized differed from the approach of Chorpita, Wyatt Kaminski, and Rotheram-Borus and colleagues in that it enabled common components to be identified across a broad range of program domains (e.g., programs designed to enhance employment outcomes and mental health) and from programs not empirically supported by a randomized control trial or in peer-reviewed, empirical journals. The first phase in the approach identified and gathered information about common components across programs within a particular domain (e.g., employment). Common components were then classified as content components, identifying the topics taught by the program/service, or as process components, classifying the method by which the program/service was delivered. The second phase of our approach involved examining the association between exposure to shared components and changes in targeted outcomes. Thus, the current study was designed to examine whether use of different components of employment programs and services by U.S. veterans, who were unemployed within the first 3 months of separating from active-duty service, was associated with finding employment 6 to 9 months or 12 to 15 months after transition. We hypothesized that veterans' use of employment program components would positively predict securing employment at a future timepoint. The United States' Department of Veterans Affairs and Department of Defense Identity Repository [VADIR] was used to identify a sample of transitioning veterans. The population consisted of 48,965 U.S. veterans who served in the active component or were National Guard and Reserve Service members and who were deactivated, discharged, retired, or separated from the military in the 90 days prior to the Wave 1 survey (May-September 2016). National Guard and Reserve service members were required to have served at least 180 days on active-duty status before being deactivated. All veterans had a mailing address within the continental United States. Complete data were provided by 9566 veterans (20% response rate). A subset of the sample was selected for the current analyses. This subset involved veterans who met the following inclusion criteria: looking for work at Wave 1, not a full-time student, and transitioned from active-duty status. Given the research question, Wave 2 veterans who were working for pay and still looking for work were also included in the sample. Thus, the total sample for the current analyses was 1172 U.S. veterans. Using contact information provided by VADIR, 9566 participants were recruited through mail to participate in a web-based, longitudinal, prospective study examining well-being and program use after their transition from the military . A $5 cash pre-incentive and a $20 gift code incentive at survey completion were offered to the participants to complete the Wave 1 survey. The incentive was increased by $5 every wave thereafter. Incentives were used to prevent attrition over time in the longitudinal research study, and although there were no specific validity questions in the survey, the population was not conveniently selected (e.g., invites were targeted to all eligible participants from a Department of Veterans Affairs' repository) and all open-ended responses were reviewed for legitimacy. Longitudinal data were collected at 6-month increments after the initial survey. Wave 2 data were collected 6 to 9 months after separation and Wave 3 data were collected 12 to 15 months after separation. Additional information about the study procedures, including participant characteristics and recruitment strategies, has been previously published . The purpose of this current analysis with the sub-sample of 1172 U.S. veterans was to determine if employment program component use was related to the outcome of job attainment. To improve this quasi-experimental design, propensity score matching was utilized to adjust for confounding variables potentially predictive of selection into treatment or control groups (Braitman & Rosenbaum, 2002) . We conceptualized employment program use as "treatment" to be contrasted with non-use as a "control" condition. Before coding for program components, this analyses involved four primary analytic steps: (1) estimation of propensity scores; (2) use of propensity scores through one of several techniques to adjust for confounding variables; (3) assessment of balance to determine if there were mean differences in the propensity scores between the treatment and control group; and (4) estimation of the treatment effect in the analytic model (Lanza et al., 2013) . Matched propensity scoring utilizes analytic techniques to match study subjects who participate in a treatment condition to study subjects with similar risk factors who do not participate in a treatment condition (i.e., control condition). Propensity scores were created to determine the likelihood of U.S. veterans participating in any employment programs. Before matching, 73% (n = 854) of the veterans looking for work utilized at least one employment content component (e.g., resume writing and interviewing). See Morgan et al. (2018) for more details on the program characteristics and components. The focus of this analysis was on aggregated program component utilization at the individual level. To calculate propensity scores, 18 potentially confounding variables that could predict the outcome of job attainment and/or employment program component use were entered into a logistic regression modeling of the outcome of any employment program utilization (see Table 1 ). The covariates included gender, paygrade (rank), race/ethnicity, marital status, discharge status, military occupation, types of combat exposure, deployments, resilience, anxiety, depression symptoms, suicidal thoughts, PTSD symptoms, alcohol misuse, problematic financial status, low social support, part-time student status, and completed education or training. These covariates have previously been found to be predictors of employment program use . The unstandardized, predicted probabilities were saved for each veteran and included as a covariate in the outcome analytic model. This type of covariate is considered a "double robust" method and protects against misspecification of either the propensity score or the model itself (D'Agostino, 1998; Kang & Schafer, 2007) . Before matching (see Table 1 ), U.S. veterans from enlisted (E5 to E6), senior enlisted (E7 to E9), and officer (O1 to O7) ranks were between 2.25 and 6.76 times more likely to use employment programs than veterans from the E1 to E4 junior enlisted ranks. Veterans who were part-time students at baseline were two times more likely to utilize employment programs. Veterans who received a general discharge (i.e., a discharge other than honorable) were less likely to utilize employment programs. Veterans who were rated for probable depression were 54% more likely to use employment programs. Finally, veterans exposed to combat patrols were 54% more likely to use employment programs at Wave 1 than veterans who were not exposed. To create the matched sample, Greedy Nearest Neighbor Matching was used. The goal of using matched propensity scoring was to identify study subjects' likelihood of utilizing employment programs. Study subjects using employment programs were matched to other study subjects who did not use employment programs but who were very similar for utilizing employment programs based on the robust number of covariates that related to the outcome and/or program use. Any individuals without a match were excluded from the analyses. Due to the large sample size, two-to-one matching with a 0.1 caliper was used, and matches were within 0.10 of a standard deviation of one another. Note, Rosenbaum and Rubin (1985) suggest a caliper of 0.10 removes 98% of the bias in covariates with a normal distribution. Propensity scores were evaluated for their quality before and after matching by examining the overlap of box plots and the mean differences of the predicted probability estimates between the two groups. Before matching, the initial difference of the probability estimates was 0.15, which is close to a full standard deviation (SD = 0.17). After matching, the difference between the mean propensity scores dropped to 0.02 (SD = 0.16). Moreover, the balance of each predictor was assessed by replicating the logistic regression model predicting employment program utilization. Testing the probability estimates after matching helped to ensure any selection bias that could have been related to program participation between groups (non-employment program users and employment program users) was removed. The final matched sample consisted of 739 U.S. veterans from the overall sample of 1172. After matching, 62% of veterans (n = 460) used at least one employment content component. The survey asked the U.S. veterans to nominate employment programs or services they used since discharge that were intended to help them transition from military to civilian life. Programs were defined as any activity designed to meet the veteran's specific needs and could be offered by any organization, including community, government, private, or faith-based providers. For example, programs could be selfpaced; presented online; or delivered synchronously in a group setting by a qualified program leader, such as a facilitator, counselor, or social worker. The program use questions were adapted from another study, The Philanthropy Roundtable (Meyer, 2013) , which developed a list of veteran-serving organizations and programs focused on positively influencing veteran functioning across well-being domains. Veterans were asked to name up to two programs for seven types of programs within the employment domain for a total of 14 possible program nominations per veteran. Specifically, veterans were asked to name programs used that offered an online job database, a career fair, resume writing or military skills translation, job placement assistance, career counseling, job training or help obtaining certification, and any other employment-related programs. At Wave 1, there were 914 programs nominated in the employment domain. The research team coded the program nominations that had a verified website URL and were nominated by three or more veterans. There were 184 programs that met these criteria. Each of the nominated programs was then coded for their content and process components . Common content components include career planning, entrepreneurship, interviewing skills, job accommodations, job training and certification, networking conference, resume writing, and translating military experience to civilian work. Process components (i.e., how the content is taught) for each of the program content areas included self-paced online reading, direct instruction, rehearsal/role playing, interactive tool, mentor/coach, social support and peer learning, and networking group. Definitions of the content and process components are included in Table 2 . Coding was conducted using the qualitative software NVivo 12 (QSR International, 2016) . Two independent raters coded programs by indicating whether each component was either present or absent for each program. Coders applied all relevant codes to a program; therefore, codes were not mutually exclusive. Reliability among coders was established by having a third expert coder check coding consistency, discussing discrepancies, and coming to agreement on the final codes and definitions of each component. Veterans were also given a series of questions related to employment outcomes, including their current work status. Response options included working for pay, not working for pay but looking for work, or not working and not looking for work. Veterans were also asked about the number of hours worked per week. Using these two pieces of information, a full-time work status variable was created to include in the analysis. To determine the common components of employment programs nominated by the U.S. veterans, program website pages were gathered using BeamUsUp SEO Webcrawler software (Gomes, n.d.) , and subsequent screen shots were captured to ensure comprehensive and consistent coding over time. Trained pairs of coders used NVivo 11 (QSR International, n.d.) to capture the common content components (i.e., skills or information taught) and common process components (i.e., mode of delivery and teaching methods) used by the programs. Details on the development of and theoretical justification of this coding technique has been previously published . Logistic regression was used to determine which groups of veterans were more or less likely to obtain a job. Job status was dichotomized as obtaining full-time employment in comparison to remaining part-time or being unemployed. Survey participants were first asked about their current work status in Wave 1. Then, veterans who were looking for work at Wave 1 and either still looking for work or working full-time in Waves 2 and 3 were included in the analyses. Those who indicated not working and not looking for paid work were excluded from the analyses. Follow-up questions were asked to identify veterans' reasons for not looking for employment and responses included retired, an illness, a homemaker, or in school/ training. Logistic regression was chosen as the analytical technique given its ability to include more than one predictor, which is advantageous for this sample of veterans representing different branches of the U.S. military service, genders, and paygrades. Moreover, logistic regression produces odds ratios, which provide the probability of a group experiencing the outcome of interest. An odds ratio of 1 indicates that there is equal probability (i.e., no significant differences) for experiencing the outcome with the veteran characteristic versus without the veteran characteristic. Each content component was analyzed separately with the same predicted probability of a program use covariate, that is, the propensity score was included in the model. All statistical models used SPSS 15 and Stata 15. First, common components (i.e., content and process) were identified among the employment programs veterans nominated (see Table 2 ). The most common content components used by the U.S. veterans looking for work included career planning and exploration (61%), resume writing (59%), interviewing skills (35%), and translating military experience to civilian work (34%). Other content components, not as commonly used, included job training and certification (22%), entrepreneurship (18%), career fairs (17%), and virtual career fairs (10%) or a networking conference (9%). Few veterans reported using job accommodations (2%). The most common process components included an interactive online tool, information read online, direct instruction, or one-on-one program delivery with a mentor or coach. Rehearsing, role playing, practicing interviewing or other employment-related skills, and being part of a networking group were not commonly used process components. The models of getting a job at 6 to 9 months post-separation and at 12 to 15 months post-separation contrasted those using specific employment content components with component non-users (presented in Table 3 ). At Wave 1,739 U.S. veterans were not working but were looking for a job. Of those, 42% (n = 313) found a job by Wave 2, and 55% (n = 326) found a job by Wave 3. Those who were looking for a job at Wave 1 and found a job in the next 6 to 9 months were 71% more likely to be male; 87% more likely to be in E5 to E6 paygrades (vs. E1 to E4); 4 times more likely to be officers (O1 to O3); 51% more likely to be married (1 st marriage vs. single, Veterans who used a program with the interviewing content component delivered through a mentor or coach were 2.20 times more likely to find a job at 6-to 9-months post-separation and 2.24 times more likely to find a job at 12-to 15-months postseparation than those not using that program component. Those who used rehearsal/ role playing to build interviewing skills, however, were 68% less likely to have a job at 6-to 9-months post-separation. Veterans who nominated programs with resume writing content read online were 2.20 times more likely to find a job at 6to 9-months post-separation. Veterans who used resume writing programs with a mentor or coach were 2.51 times more likely to find a job 12-to 15-months postseparation. Veterans who used programs that helped translate military experience/ skills to civilian work delivered by a mentor or coach were 84% more likely to find a job at 6-to 9-months post-separation, and these veterans were 91% more likely to find a job 12-to 15-months post-separation. Programs that offered the content component of entrepreneurship using a mentor or coach were 2.35 times more likely to find a job at 6-to 9-months post-separation, and 2.73 times more likely to find a job 12-to 15-months post-separation. Finally, veterans who utilized career fairs delivered virtually were nearly 2 times more likely to find a job 12-to 15-months post-separation. This study examined the use, predictors of use, and impact of employment programs designed to improve employment prospects. In particular, this study advanced prior research on populations facing career transitions by applying an innovative approach to identify the common components of employment programs that predict U.S. veteran employment over the first 15 months of their separation from active military service. Several themes emerged and were confirmed through the results of this study. First, many U.S. veterans indicate use of employment programs . Certainly, more than 60% of job-seeking veterans in the matched sample (70% before matching) used at least one employment content component. However, there were several factors that predicted lower use of employment programs, including junior enlisted rank, combat exposure, combat arms occupation, and physical health problems. Unfortunately, these same predictors are also indicative of unemployment risk (Cohen et al., 2013; MacLean et al., 2019; Zivin et al., 2016; Zogas, 2017) . Thus, potential program participants of a young age or with mental and physical conditions (i.e., post-traumatic stress disorder, moral injury, adverse childhood experiences, and disabilities) beg the attention of career counselors and educators to increase reach and appropriately modify program content and delivery. Second, compared to veterans from the lowest enlisted ranks, veterans from higher ranks were significantly more likely to use a variety of employment programs. This was particularly true for the use of career fairs, resume writing, and job-training and certification programs-a list that includes some of the most successful tools for obtaining a job. Furthermore, veterans with physical health issues were substantially more likely than those without issues to use each type of employment program content component (e.g., online job database, career fairs, resume writing assistance). Race, ethnicity, and mental health conditions (with the exception of depressive symptoms) were not significant factors related to program use and use of specific employment components. The U.S. veterans who engaged with employment programs were primarily accessing the following components: career planning, resume writing, and interviewing skills. However, only a few content components were significantly related to obtaining employment: interviewing (with mentor/coach), resume writing (online tools), translating military to civilian work (with mentor/coach), entrepreneurship (with mentor/coach), and virtual career fairs. Not all modes of instruction of these components were associated with success in the job market; the importance of having a mentor/coach cannot be overlooked. In most cases, the U.S. veterans were exposed to program content components by information read online (i.e., career planning, resume writing, learning about job accommodations), direct instruction for resume writing, and interactive online tools for career planning and resume writing. Veterans rarely utilized (i.e., used by less than 25% of all veterans) job training or certification, networking conferences, entrepreneurship, and career fairs whether in-person or virtual. Mentors/coaches and rehearsal and role playing, which are often highly effective in assisting people obtain jobs and progress in careers (Smith et al., 2015; Solari et al., 2016) , were also rarely used, except in the case of career planning. However, our findings indicate that mentors/coaches were a significant process component across many of the employment content components (i.e., interviewing, resume writing, translating military to civilian work, and entrepreneurship). Yet, why veterans are not using program components delivered by mentors and coaches is unclear. Mentors and coaches may not be available in many veteran-serving, employment programs, or, perhaps, veterans and other populations are uncomfortable with this process modality. There are a few limitations to note in the current study. First, while the overall sample was fairly representative of the larger population of transitioning U.S. veterans, how well the sub-sample of those looking for work represents the larger veteran population is not clear. Note, this sample was drawn from the census of veterans transitioning form U.S. military service in summer/fall 2016. However, unlike previous investigations, this study employed a robust, analytical design, which increases confidence in the results. Second, the quality of content and process components experienced by the veterans was not analyzed; thus, for components that were not significant, insufficient quality may negate any potential impact. The study results suggest that some employment program components may work better than others, and that what works is contingent upon the employment outcome (i.e., in this case obtaining employment), and, potentially, time since transition (i.e., some components may be significant at later waves of the survey) and mode of learning. Thus, these findings may be of value for program developers and stakeholders, including departments of defense or veterans affairs, as they make decisions about designing, funding, and operating employment programming for transitioning veterans. Organizations that provide employment programming for transitioning populations should focus on the components that are predictive of employment. These results may also be useful to veterans and other populations in transition as they determine the type of employment program components likely to be most successful in helping them obtain a job. Although a wealth of data were collected on the programs nominated by the studied veterans, this reported analysis assessed program component use as an aggregate. Future analyses and research can explore the influence of program factors (e.g., staffing, funding) on the content and processes of program components and employment outcomes. Future research should also examine the quality of employment program components. Perhaps, some components were not delivered with sufficient quality to impact U.S. veterans' odds of getting a job. For example, the category of career planning and exploration programs is broad, and the quality of content may be highly variable. High-and low-quality content within components may lead to null findings and deserves further exploration. In addition, it may take time for the impact of components to be realized; some may be more beneficial at later points during a career transition or after military separation. For example, there may be a delayed effect if a person chooses to attend school or participate in additional training before joining the workforce. Findings for career planning with direct instruction and job training and certification may also be significant at future waves because more time may need to pass to complete these components before they can impact an outcome. As noted in previous research on predictors of who is using employment programs , more effort should be expended to understand why individuals are not using programs or to identify specific components that are likely to lead to successful outcomes, especially for those with the highest risk for unemployment. In this study, many of the studied U.S. veterans did not use components delivered by mentors and coaches, although mentors and coaches figured in several of the significant associations. The explanation for why veterans are not using program components delivered by mentors and coaches is unclear. Future research should examine the availability of mentor/coach delivery in employment programs and assess comfort and receptibility toward this process modality. More broadly, this study represents a significant step forward in illustrating how specific program components can be linked to more or less successful outcomes among individuals embracing career and identity transitions. The data collected from U.S. veterans represents some of the first findings on the effectiveness of employment program components for job attainment in this population, which is known to be encountering the stressors of many transitions simultaneously (e.g., identity, career, geographic location, financial stability). Strategic evaluations like those reported here pave the way for greater reliance on evidence-based programming, and ultimately, delivery of more effective services for military veterans and others facing employment transitions. Post-9/11 veteran transitions to civilian life: Predictors of the use of employment programs Military CEOs Well after service: Veteran reintegration and American communities Rare outcomes, common treatments: Analytic strategies using propensity scores Career concerns of unemployed U.S. war veterans: Suggestions from a cognitive information processing approach Civilian employment among recently returning Afghanistan and Iraq National Guard veterans Creating hope: Assisting veterans with job search strategies using cognitive information processing theory Expanding the net: Building mental health care capacity for veterans Lost in translation: The civil-military divide and veteran employment Understanding the common elements of evidence-based practice Clinical and demographic factors associated with employment status in U.S. military veterans returning from Iraq and Afghanistan Veteran employment: Lessons from the 100,000 jobs mission. RAND Corporation Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group Partnering to assist disabled veterans in transition Managing the re-employment of military veterans through the Transition Assistance Program (TAP) Medical costs of war in 2035: Long-term care challenges for veterans of Iraq and Afghanistan Revisiting the business case for hiring a veteran: A strategy for cultivating a competitive advantage. Institute for Veterans and Military Families How are Iraq/Afghanistan-era veterans faring in the labor market? Demystifying double robustness: A comparison of alternative strategies for estimating a population mean from incomplete data Examining veteran transition to the workplace through military transition theory Coverage of veterans of the wars in Iraq and Afghanistan in the U.S. media. Sociological Forum Drawing causal inferences using propensity scores: A practical guide for community psychologists Labour market outcomes of veterans Serving those who served: A wise giver's guide to assisting veterans and military families. The Philanthropy Roundtable How the media's narrow portrayal of service members does the military a disservice Common components analysis: An adapted approach for evaluating programs United States Department of Veterans Affairs Veterans' use of programs and services as they transition to civilian life: Baseline assessment for The Veteran Metrics Initiative Supporting United States veterans: A review of veteran-focused needs assessments from 2008-2017. Clearinghouse for Military Family Readiness at Penn State Views of post-9/11 military veterans. Pew Research Center's Social & Demographic Trends Project Contextual career counseling for transitioning military veterans Issues in defining and measuring veteran community reintegration: Proceedings of the Working Group on Community Reintegration, VA Rehabilitation Outcomes Conference Post-traumatic stress disorder across the adult lifespan: Findings from a nationally representative survey Constructing a control group using multivariate matched sampling methods that incorporate the propensity score Common factors in effective HIV prevention programs Virtual reality job interview training for veterans with posttraumatic stress disorder The 2016 annual homeless assessment report (AHAR) to Congress-Part 2: estimates of homelessness in the United States Factors affecting hiring decisions about veterans Undergraduate students' experiences of using information at the career fair: A phenomenographic study conducted by the libraries and career center Invisible wounds of war: Psychological and cognitive injuries, their consequences, and services to assist recovery Post-traumatic growth among veterans in the USA: Results from the National Health and Resilience in Veterans Study Employment situation of veterans-2016 Table A-5. Employment status of the civilian population 18 years and over by veteran status, period of service, and sex, not seasonally adjusted 10 key facts about veterans of the post-9/11 era 2015 Veteran economic opportunity report The Veterans Metrics Initiative study of US veterans' experiences during their transition from military service military veterans' health and well-being in the first year after service A meta-analytic review of components associated with parent training program effectiveness Employment status, employment functioning, and barriers to employment among VA primary care patients U.S. military veterans' difficult transitions back to civilian life and the VA's response. Watson International and Public Affairs Brown University Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations The Veterans Metrics Initiative (TVMI) research was managed by the Henry M.