Key PointsQuestion
Does group training to build cohesion, shared purpose, and healthy coping for classes of new US Air Force Airmen reduce suicidal thoughts, depression symptoms, and occupational problems?
Findings
In this cluster randomized clinical trial of 1485 personnel in 215 training classes, the Wingman-Connect program reduced suicidal ideation, depression symptoms, and occupational problems at 1 month by fostering cohesive, healthy classes. Reduced depression symptoms were maintained through 6 months, and the odds of having elevated depression symptoms were lower (odds ratio, 0.80) at either follow-up point.
Meaning
Wingman-Connect is the first universal prevention program to reduce suicidal ideation and depression in a general Air Force population.
Importance
Suicide has been a leading manner of death for US Air Force personnel in recent years. Universal prevention programs that reduce suicidal thoughts and behaviors in military populations have not been identified.
Objectives
To determine whether the Wingman-Connect program for Airmen-in-training reduces suicidal ideation, depression, and occupational problems compared with a stress management program and to test the underlying network health model positing that cohesive, healthy units are protective against suicidal ideation.
Design, Setting, and Participants
This cluster randomized clinical trial was conducted from October 2017 to October 2019 and compared classes of personnel followed up for 6 months. The setting was a US Air Force technical training school, with participants studied to their first base assignment, whether US or international. Participants in 216 classes were randomized, with an 84% retention rate. Data analysis was performed from November 2019 to May 2020.
Interventions
The Wingman-Connect program used group skill building for cohesion, shared purpose, and managing career and personal stressors (3 blocks of 2 hours each). Stress management training covered cognitive and behavioral strategies (2 hours). Both conditions had a 1-hour booster session, plus text messages.
Main Outcomes and Measures
The primary outcomes were scores on the suicidal ideation and depression scales of the Computerized Adaptive Test for Mental Health and self-reports of military occupational impairment. Class network protective factors hypothesized to mediate the effect of Wingman-Connect were assessed with 4 measures: cohesion assessed perceptions that classmates cooperate, work well together, and support each other; morale was measured with a single item used in other studies with military samples; healthy class norms assessed perceptions of behaviors supported by classmates; and bonds to classmates were assessed by asking each participant to name classmates whom they respect and would choose to spend time with.
Results
A total of 215 classes including 1485 individuals (1222 men [82.3%]; mean [SD] age, 20.9 [3.1] years) participated; 748 individuals were enrolled in the Wingman-Connect program and 737 individuals were enrolled in the stress management program. At 1 month, the Wingman-Connect group reported lower suicidal ideation severity (effect size [ES], −0.23; 95% CI, −0.39 to −0.09; P = .001) and depression symptoms (ES, −0.24; 95% CI, −0.41 to −0.08; P = .002) and fewer occupational problems (ES, −0.14; 95% CI, −0.31 to −0.02; P = .02). At 6 months, the Wingman-Connect group reported lower depression symptoms (ES, −0.16; 95% CI, −0.34 to −0.02; P = .03), whereas the difference in suicidal ideation severity was not significant (ES, −0.13; 95% CI, −0.29 to 0.01; P = .06). The number needed to treat to produce 1 fewer participant with elevated depression at either follow-up point was 21. The benefits of the training on occupational problems did not extend past 1 month. The Wingman-Connect program strengthened cohesive, healthy class units, which helped reduce suicidal ideation severity (estimate, −0.035; 95% CI, −0.07 to −0.01; P = .02) and depression symptom scores (estimate, −0.039; 95% CI, −0.07 to −0.01; P = .02) at 1 month.
Conclusions and Relevance
Wingman-Connect is the first universal prevention program to reduce suicidal ideation and depression symptoms in a general Air Force population. Group training that builds cohesive, healthy military units is promising for upstream suicide prevention and may be essential for ecological validity. Extension of the program to the operational Air Force is recommended for maintaining continuity and testing the prevention impact on suicidal behavior.
Trial Registration
ClinicalTrials.gov Identifier: NCT04067401
Active duty military suicide rates (24.8 events per 100 000 in 2018)1,2 are now comparable to those in the general population, after decades of being lower, prompting unprecedented expansion of suicide prevention activities.3-5 Military suicide prevention programming has focused on high-risk groups, primarily the detection and treatment of individuals with suicidal thoughts or behaviors.6-9 Yet targeting broad population groups with universal upstream prevention10 has similar or greater potential to achieve large reductions in suicide rates.11,12 The Department of Defense has prioritized promoting healthy populations to reduce suicides.2,13 The US Air Force implemented a multilayered strategy in 1996, which a trend analysis identified as reducing suicides for several years14; however, no single intervention was identified as reducing suicide risk.
Universal prevention programs have not been identified that reduce suicidal thoughts and behaviors in military populations. Cognitive skill training impacts physical performance,15 social cognition (eg, perspective taking),16 coping, and problem solving17,18 among US military personnel. Recent testing of coping and interpersonal skill training found no benefits on mental health for Canadian military19 or Royal Air Force enlistees20; investigators of the Royal Air Force study noted that cognitive training may lack ecological validity without addressing unit functioning.20
We developed and then tested Wingman-Connect, a network health suicide and depression prevention program for the US Air Force. Network health interventions21 target natural organizational groups to strengthen bonds, cohesion, and adaptive coping norms, all of which are logical targets for upstream military suicide prevention. Similar targets affected in school-based interventions show long-lasting outcomes regarding suicidal ideation and behavior.22 Strengthening peer relationships to prevent suicide is consistent with theoretical23,24 and empirical evidence showing that disrupted relationships commonly precede military suicides.2 Strong bonds reduce vulnerability to depression,25 and postenlistment depression is a specific factor associated with suicide attempts among military personnel.26 Unit-level influences are major factors associated with suicide risk. Units are foundational structures for military life and health.27 Unit cohesion is associated with lower likelihood of suicidal ideation.28,29 Data from the Army Study to Assess Risk and Resilience in Servicemembers27 showed that up to 20% of suicide attempts over 5 years were associated with membership in a unit in which a member had attempted suicide.
Suicide has been a leading manner of death for Airmen in recent years.30 We investigated the Wingman-Connect program as a strategy for strengthening cohesive, protective classes of Air Force personnel in training. Wingman-Connect used a universal prevention strategy31 targeting the full population of Air Force trainees across the continuum of risk. The highest suicide rates are among younger enlisted personnel32; hence, it was important to focus on personnel entering training. The primary hypothesis tested was that Wingman-Connect would reduce suicidal ideation, depression symptoms, and job-related problems. A secondary objective was testing the guiding network health theoretical model.
All participants provided written informed consent. Study procedures were approved by the institutional review boards of the US Department of Defense and the University of Rochester. Participants were compensated $50 for completing the final 6-month assessment. This study follows the Consolidated Standards of Reporting Trials (CONSORT) reporting guideline for cluster trials. Supplement 1 contains the trial protocol.
This cluster randomized clinical trial with head-to-head comparison of 2 conditions33 was conducted with new personnel in training assigned to classes at the Technical Training School, Sheppard Air Force Base, Wichita Falls, Texas, between October 2017 and October 2019. We paired similar class units from the same squadron and randomly assigned 1 class from each pair to Wingman-Connect and the other to stress management training (Figure 1). The design used an active comparison training to strengthen internal validity. Matching of classes is described in eAppendix 1 and eTable 1 in Supplement 2.
Classes with instructional length between 37 and 91 days were eligible (class size, 4-13 students) (Figure 1). Participants were informed their data would be deidentified at the earliest possible time and that no individual responses would be shared with the Air Force or used for crisis evaluation. All participants received information about mental health resources.
Wingman-Connect was developed between August 2015 and December 2016 at Sheppard Air Force Base by adapting a suicide prevention program used in public education settings (Sources of Strength).34,35 For content adaptation, Air Force topic experts identified protective factors essential to an Airman’s job success, supportive of mental health, and theoretically linked to reduced suicide risk. Group training for units was selected to align with Air Force culture, a departure from the Sources of Strength model of training selected opinion leaders.
Wingman-Connect classes participated in group skill building using active learning: high-energy activities and drawing out personal examples occurred in 3 90- to 120-minute blocks over 3 consecutive days. Skills focused on growing and sustaining 4 core protective values: kinship (belonging and accountability), purpose (goals and motivating values), guidance (mentors and institutional resources), and balance (activities for well-being). Each class completed group exercises emphasizing cohesion, shared purpose, and the value of a healthy unit. Participants created videos for class distribution. Peer-nominated participants (2-3 per class) were invited to a 1-hour lunch as training champions (with no formal role). After 1 month, classes were invited to a 1-hour booster review. Training was conducted by 2 trainers with varied backgrounds (educator and mental health clinician) and training (bachelor’s and master’s level) from the research group (1 trainer was L.M.-D.). All Wingman-Connect trainings were audio recorded. Using an established procedure,36 coders rated 8 of 22 modules for adherence (mean adherence, 97.7%) (eAppendix 2 in Supplement 2).
If randomized to stress management, participants received an overview of the stress response system and cognitive and behavioral strategies adapted from a cognitive behavioral therapy workbook (2 hours).37 Trainers used a slideshow to introduce concepts, show videos, and lead discussions. After 1 month, participants were invited for a 1-hour booster review. Training was conducted by 1 of the 2 trainers from the research team. Participants in both conditions were invited to receive training-specific informational and interactive text messages for 6 months.
After providing consent, participants completed baseline assessments using a tablet computer and then began their class’s designated training. One month later, after the 1-hour booster session, participants completed the second assessment. Participants provided contact information for the final 6-month assessment, sent via a URL, with up to 4 reminders.
Two of 3 prespecified primary outcomes were the suicide scale (CAT-SS) and depression scale (CAT-DI) of the Computerized Adaptive Test for Mental Health.38-41 The CAT-SS administers a statistically optimal subset of items from a bank of 111 items syndromally associated with suicidal thoughts and behaviors from validated scales (eg, “In last 2 weeks have you felt life is not worth living?”). There is a 52-fold increase in the likelihood of current suicidal ideation—validated against clinician assessment using the Columbia Suicide Rating Scale (C-SSRS)—across the range of CAT-SS scores (0-100, with higher scores indicating worse symptoms).39 CAT-SS also yields categorical scores (low, medium, and high); a 1-category change corresponds to a 16 times greater likelihood of an increase in C-SSRS’s ordinal scale, and contrasting high and low risk categories yielded sensitivity of 1.0 and specificity of 0.95 for C-SSRS–rated suicidal ideation.39 We combined medium and high categories for this nonclinical sample. CAT-DI uses the same adaptive technology to yield a dimensional measure of depression severity (score range, 0-100, with higher scores indicating worse symptoms); when thresholded (score >35), CAT-DI scores have high sensitivity and specificity for diagnosis of major depressive disorder. Elevated depression and suicidal ideation score dichotomous indicators were created at each follow-up and to indicate an individual scoring above threshold at any point after baseline. See eAppendix 3 in Supplement 2.
The third primary outcome was self-reported behaviorally based performance outcomes for military occupational impairment (eg, corrective training for substandard performance),42 summed for a total impairment score (0-5). To supplement this self-report, information on involuntary separations was collected from the squadrons.
Class network protective factors hypothesized to mediate Wingman-Connect impact were assessed with 4 measures. Cohesion assessed perceptions that classmates cooperate, work well together, and support each other (α = .85; 3 items).43 Morale was measured with a single item used in other studies with military samples.44 Healthy class norms assessed perceptions of behaviors supported by classmates (α = .88; 5 items). Bonds to classmates were assessed by asking each participant to name classmates (up to 5) whom they respect and would choose to spend time with.45
Individual factors posited as proximal targets of Wingman-Connect were measured by healthy career behaviors (α = .90; 5 items), help-seeking acceptability (α = .70; 4 items),35,46 maladaptive coping (α = .63; 4 items),47 personal (α = .63; 2 items) and social problem (α = .83; 3 items) subscales from a measure of military functional impairment,42 loneliness,48 the anxiety subscale of Computerized Adaptive Test for Mental Health (CAT-AX),49 anger intensity and frequency (α = .83; 5 items),50 and emotion regulation difficulties (α = .74; 8 items).51 Training satisfaction52 was assessed at 1 month (α = .91; 3 items).
The power and sample size estimates were focused on detecting change in the continuous CAT-SS measure. With 1550 participants in 200 classes, expecting 25% attrition, the power and sample size estimates using optimal design showed 80% power with an effect size of 0.15 when the intraclass correlation coefficient was 0.02 and an effect size of 0.17 when the intraclass correlation coefficient was 0.05.
All analyses used an intention to treat approach and included random effects to adjust for class heterogeneity.53 All tests used a 2-sided .05 type I error. Baseline equivalence of the randomly assigned groups was tested using multilevel analysis of variance and χ2 tests.
We used multilevel linear and logistic mixed-effects regression models in MPlus statistical software version 8 (Muthén and Muthén)54 and R statistical software version 4.0.0 (R Project for Statistical Computing)55 to test changes due to training separately on 1-month and 6-month outcomes using models controlling for the baseline version of the chosen dependent variable. Our primary analysis included a random intercept to adjust for the nesting of individuals within classes. We also added random effects (intercept and treatment) to account for the nesting of treated and control classes within pairs. Because all of these analyses yielded comparable statistical conclusions and the models with a single random intercept had lower bayesian information criteria, we report findings from that analysis. All models also included covariates of sex, age, race, ethnicity, and active duty vs nonactive duty, all of which have previously been associated with suicide risk.56 For CAT dimensional measures, the underlying Bayes estimate of severity was used. For dichotomized scales, 2-level binary models were used. To quantify impact, we calculated Cohen d effect sizes (ESs)57 for continuous measures and odds ratios (ORs) for dichotomous outcomes. To determine whether Wingman-Connect had a differential impact, we tested baseline by training condition interactions by comparing slopes using Wald type tests that assessed the coefficient’s size to its standard error. We also examined age and sex by training condition interactions. To test the theoretical model positing that a connected, healthy class would be associated with reduced suicidal ideation and depression, we conducted 2-level mediation models using the product of coefficients method58; mediators were treated both as individual-level (2-1-1 modeling) and as class contextual effects (2-2-1 modeling).59 Formal tests were based on model-based bootstrapped confidence intervals60 (see eAppendix 5 in Supplement 2), Data analysis was performed from November 2019 to May 2020.
Class and Participant Characteristics
Of 1897 Airmen in the 216 selected classes, 1732 (91.3%) were exposed to their class’s respective intervention, and 1485 participants (85.7%) from 215 classes were enrolled in the study (1222 men [82.3%]; mean [SD] age, 20.9 [3.1] years); 748 individuals were enrolled in the Wingman-Connect program and 737 individuals were enrolled in the stress management program. Exposure and enrollment did not vary by condition. Baseline comparisons accounting for random class effects showed baseline equivalence of the Wingman-Connect and stress management groups (Table 1 and eTable 2 in Supplement 2). A diagnostic P-P plot showed no baseline imbalance (eFigure 3 in Supplement 2). Attrition at 1 month (6%) and 6 months (16%) was not predicted by assigned condition; tests showed no differential attrition. A total of 629 of 748 individuals assigned to Wingman-Connect (84.1%) and 618 of 737 individuals assigned to stress management (83.9%) participated in the 6-month assessment. Training satisfaction scores (range, 0-3) were equivalent in the Wingman-Connect (mean [SD], 1.9 [0.89]) and stress management (mean [SD], 2.0 [0.85]) groups. Fidelity was high for the Wingman-Connect group (98%), and although it was not formally measured for the stress management group, it followed a structured lecture format that ensured high fidelity.
Impact of Wingman-Connect on Suicidal Ideation, Depression, and Occupational Problems
The findings showed that the Wingman-Connect program had a beneficial impact on all primary outcomes during technical training (Table 2). Figure 2 shows the mean suicidal ideation scale and depression scale scores for the Wingman-Connect and stress management groups at the 3 assessment points across the 6-month study period.
At the 1-month follow-up, participants in Wingman-Connect classes reported lower suicidal ideation severity (ES, −0.23; 95% CI, −39 to −0.09; P = .001) and depression symptoms (ES, −0.24; 95% CI, −0.41 to −0.08; P = .002) and fewer occupational problems (ES, −0.13; 95% CI, −0.31 to −0.02; P = .02). The odds of elevated depression were 22% lower for participants in the Wingman-Connect group compared with the stress management group (OR, 0.78; 95% CI, 0.64 to 0.97). Wingman-Connect participants were less likely to report corrective training (OR, 0.51; 95% CI, 0.31 to 0.82) or receiving a negative counseling statement (OR, 0.50; 95% CI, 0.29 to 0.86) compared with participants in the stress management group (eFigure 1 in Supplement 2). Squadron data were consistent with participants’ self-reports: 7 participants in the stress management group separated from the Air Force compared with 4 participants in the Wingman-Connect group.
At 6-month follow-up, Wingman-Connect participants reported significantly lower depression symptoms (ES, −0.16; 95% CI, −0.34 to −0.02; P = .03) (Table 2), whereas suicidal ideation severity scores were not significantly lower (ES, −0.13; 95% CI, −0.29 to 0.01; P = .06). A beneficial impact on occupational problems was not evident after 6 months. Wingman-Connect participants were 20% less likely than participants in the stress management group to report elevated depression at either follow-up point (OR, 0.80; 95% CI, 0.64 to 0.97; P = .01) and 19% less likely, on average, to report elevated suicidal ideation scores, although the difference was not significant for suicidal ideation scores (OR, 0.81; 95% CI, 0.51 to 1.07; P = .07) (Table 2). The number needed to treat to produce 1 fewer participant with elevated depression at either 1 or 6 months was 21.
The analyses showed no differential effects of Wingman-Connect on suicidal ideation severity (1 month) or depression symptoms (1 month and 6 months) by levels of those problems at baseline, or by sex or age (ie, no moderation). The Wingman-Connect reduction in occupational problems at 1 month was greater for trainees who had more problems at baseline (Table 2).
Impact of Wingman-Connect on Hypothesized Mediators
Wingman-Connect participants gained on all class protective factors: cohesion, morale, bonds to classmates, and perceptions that members support healthy behaviors (ES, 0.18 to 0.23) (Table 3). Wingman-Connect increased positive career behaviors (ES, 0.16; 95% CI, 0.02 to 0.28) and reduced anxiety (ES, −0.14; 95% CI, −0.29 to −0.01) and anger (ES, −0.18; 95% CI, −0.35 to −0.04). Social (ES, −0.23; 95% CI, −0.49 to −0.02) and personal (ES, −0.54; 95% CI, −0.93 to −0.23) impairments were reduced among participants with the highest third of problems at baseline. Training group differences were not found regarding coping attitudes, loneliness, or emotion dysregulation.
Testing Mediational Pathways: Connected Healthy Class to Reduced Suicidal Ideation and Depression at 1 Month
We constructed a latent factor—cohesive healthy class networks—using all class variables with excellent fit with the data (eAppendix 4 in Supplement 2). To test mediation, we ran models that separately estimated 1-month suicidal ideation and depression scores using all previously reported covariates, baseline outcome scores, and training conditions, and then added both the baseline and 1-month latent class factor. We did not find significant mediation using the class-level mediator for each individual. Detailed findings for the individual level mediation (2-1-1 model) are shown later. The formal test of mediation—based on the product of coefficients in the indirect paths from condition to class factor and from class factor to 1-month suicidal ideation and depression scale scores—showed significant mediation for suicidal ideation (estimate, −0.035; 95% CI, −0.07 to −0.01; P = .02) and for depression symptoms (estimate, −0.039; 95% CI, −0.07 to −0.01; P = .02) (see eFigure 2 in Supplement 2). Participants’ perceptions of being embedded in a more-cohesive, healthy class accounted for significant portions of Wingman-Connect’s impact on reducing suicidal ideation and depression symptoms.
Wingman-Connect is the first universal upstream prevention program tested through a randomized clinical trial to reduce suicidal ideation and depression symptoms in a general, nonclinical Air Force population. The magnitude of effects at 1 month (ES, −0.23 to −0.24) was equivalent to those of state-of-the-art prevention programs targeting broad adolescent and young adult populations where the majority are not at high risk.61 The beneficial impact on reduced depression symptoms was maintained at 6 months, including lower likelihood of elevated depression (OR, 0.80) over the full study period. The effects of Wingman-Connect in reducing suicidal ideation severity (1 month) and depression symptoms (1 and 6 months) were distributed across personnel with different levels of those problems at baseline. That diverse personnel benefited from the program illustrates a strength of a universal prevention strategy for military populations with members at low risk and others at higher risk who may not seek mental health services.
Wingman-Connect–trained personnel reported fewer occupational problems at 1 month (ie, negative counseling statement [OR, 0.50] or corrective training [OR, 0.51]). The dual benefits for occupational functioning and mental health underline a strength of upstream prevention implemented before the detection of serious suicidal behavior: skills that strengthened the trainee’s capability to meet job-related challenges also reduced depression and suicidal ideation. Universal prevention programs that support operational and suicide prevention objectives are more likely to be sustained.
The study’s findings validate the underlying network health model: stronger bonds within a more cohesive healthy class reduced suicidal ideation and depression symptoms.21 These findings suggest that Wingman-Connect classes became increasingly unified around healthy norms and encouraged classmates who were vulnerable to mental health or occupational problems at a key juncture of military training, in addition to meeting their needs for belonging.23,24 Work beginning with Durkheim plus recent social network modeling45 show that cohesive groups serve a protective regulatory function through norms and pressures to conform.62-64 Future studies should also test whether Wingman-Connect would be less effective with Air Force personnel who are minimally connected to their assigned class.
An innovation of Wingman-Connect was training in natural organizational units. The positive outcomes suggest that Wingman-Connect leveraged the influence that personnel have on each other daily. Half of the training was dedicated to class skill building. This peer-to-peer approach differs from most current suicide prevention trainings. Group training for units may be critical for ecological validity of military suicide prevention programs20 and for transfer of skills into the organizational culture.
Expansion of the Wingman-Connect program to active duty Air Force bases will likely be necessary to promote protective working units for continuity of its impact. A reduction in occupational problems was not sustained beyond technical training. Future studies are needed to determine whether the Wingman-Connect program is associated with prevention of suicidal behaviors, which personnel benefit most, and what degree of saturation of Wingman-Connect–trained personnel will optimize its impact.
Study limitations include the fact that participants and school leadership were not blinded to the intervention condition. Although training satisfaction ratings were comparable between the 2 conditions, the impact of awareness of the condition on self-ratings cannot be ruled out. Second, the outcomes relied on self-reports; however, these self-reported measures have been validated against structured clinical interviews with strong agreement. Third, trainers were research staff, and the findings may not generalize to training by military personnel.
In this cluster randomized clinical trial, the Wingman-Connect program reduced suicidal ideation, depression symptoms, and occupational problems for Airmen in technical training (at 1 month of follow-up), and the benefits on reduced depression symptoms were sustained for 6 months. Further research is recommended to test upward extension into operational Air Force and longer-term impact on preventing suicidal behaviors.
Accepted for Publication: August 30, 2020.
Published: October 21, 2020. doi:10.1001/jamanetworkopen.2020.22532
Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2020 Wyman PA et al. JAMA Network Open.
Corresponding Author: Peter A. Wyman, PhD, Department of Psychiatry, University of Rochester School of Medicine and Dentistry, 300 Crittenden Blvd, Rochester, NY 14620 (peter_wyman@urmc.rochester.edu).
Author Contributions: Dr Wyman had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Wyman, Pisani, Brown, Morgan-DeVelder, Caine, Petrova, Neal-Walden, Pflanz.
Acquisition, analysis, or interpretation of data: Wyman, Pisani, Brown, Yates, Morgan-DeVelder, Schmeelk-Cone, Gibbons, Linkh, Matteson, Simonson, Pflanz.
Drafting of the manuscript: Wyman, Pisani, Brown, Yates, Schmeelk-Cone, Caine, Simonson.
Critical revision of the manuscript for important intellectual content: Wyman, Pisani, Brown, Yates, Morgan-DeVelder, Schmeelk-Cone, Gibbons, Caine, Petrova, Neal-Walden, Linkh, Matteson, Pflanz.
Statistical analysis: Brown, Schmeelk-Cone, Gibbons.
Obtained funding: Wyman, Pisani.
Administrative, technical, or material support: Wyman, Yates, Morgan-DeVelder, Petrova, Neal-Walden, Linkh, Matteson, Simonson, Pflanz.
Supervision: Wyman, Morgan-DeVelder, Pflanz.
Conflict of Interest Disclosures: Dr Pisani reported receiving grants from the National Institute of Mental Health during the conduct of the study and speaking fees from SafeSide Prevention outside the submitted work. Dr Brown reported receiving grants from the Department of Defense and University of Rochester during the conduct of the study and personal fees from University of Chicago outside the submitted work. Dr Gibbons reported being an expert witness for the US Department of Justice, Merck, Glaxo-Smith-Kline, Pfizer, and Wyeth and being a founder of Adaptive Testing Technologies, which distributes the Computerized Adaptive Test for Mental Health battery of adaptive tests; the terms of this arrangement have been reviewed and approved by the University of Chicago in accordance with its conflict of interest policies. No other disclosures were reported.
Funding/Support: This work was supported by the Office of the Assistant Secretary of Defense for Health Affairs under Award No. W81XWH-14-1-0322. The US Army Medical Research Acquisition Activity is the awarding and administering acquisition office.
Role of the Funder/Sponsor: The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Disclaimer: The opinions, interpretations, conclusions and recommendations are those of the authors and are not necessarily endorsed by the Department of Defense.
Data Sharing Statement: See Supplement 3.
Additional Contributions: Mark LoMurray, BA (Sources of Strength, Inc), consulted on training process and content, and Timothy McGowan, MA (private contractor), worked as a Wingman-Connect trainer; they both received compensation for their activities. Chelsey Hartley, PhD (University of Rochester), provided training support, and Ian Cero, PhD (University of Rochester), provided comments on the analysis and manuscript; they were not compensated for their activities. We are also grateful for study support from Jessica Ditson, MSW, Lawrence Brown, BS, and other leaders and training cadre at the Technical Training School, Sheppard Air Force Base (82nd Training Wing).
4.Ramchand
R, Acosta
J, Burns
RM, Jaycox
LH, Pernin
CG. The war within: preventing suicide in the U.S. Military.
Rand Health Q. 2011;1(1):2. doi:
10.7249/RB9529PubMedGoogle Scholar 5.Ursano
RJ, Colpe
LJ, Heeringa
SG, Kessler
RC, Schoenbaum
M, Stein
MB; Army STARRS collaborators. The Army study to assess risk and resilience in servicemembers (Army STARRS).
Psychiatry. 2014;77(2):107-119. doi:
10.1521/psyc.2014.77.2.107PubMedGoogle Scholar 6.Bryan
CJ, Mintz
J, Clemans
TA,
et al. Effect of crisis response planning vs. contracts for safety on suicide risk in U.S. Army soldiers: a randomized clinical trial.
J Affect Disord. 2017;212:64-72. doi:
10.1016/j.jad.2017.01.028PubMedGoogle Scholar 7.Comtois
KA, Kerbrat
AH, DeCou
CR,
et al. Effect of augmenting standard care for military personnel with brief caring text messages for suicide prevention: a randomized clinical trial.
JAMA Psychiatry. 2019;76(5):474-483. doi:
10.1001/jamapsychiatry.2018.4530PubMedGoogle Scholar 8.Rudd
MD, Bryan
CJ, Wertenberger
EG,
et al. Brief cognitive-behavioral therapy effects on post-treatment suicide attempts in a military sample: results of a randomized clinical trial with 2-year follow-up.
Am J Psychiatry. 2015;172(5):441-449. doi:
10.1176/appi.ajp.2014.14070843PubMedGoogle Scholar 9.Stanley
B, Brown
GK, Brenner
LA,
et al. Comparison of the safety planning intervention with follow-up vs usual care of suicidal patients treated in the emergency department.
JAMA Psychiatry. 2018;75(9):894-900. doi:
10.1001/jamapsychiatry.2018.1776PubMedGoogle Scholar 14.Knox
KL, Litts
DA, Talcott
GW, Feig
JC, Caine
ED. Risk of suicide and related adverse outcomes after exposure to a suicide prevention programme in the US Air Force: cohort study.
BMJ. 2003;327(7428):1376-1378. doi:
10.1136/bmj.327.7428.1376PubMedGoogle Scholar 15.Adler
AB, Bliese
PD, Pickering
MA,
et al. Mental skills training with basic combat training soldiers: a group-randomized trial.
J Appl Psychol. 2015;100(6):1752-1764. doi:
10.1037/apl0000021PubMedGoogle Scholar 16.Cacioppo
JT, Adler
AB, Lester
PB,
et al. Building social resilience in soldiers: a double dissociative randomized controlled study.
J Pers Soc Psychol. 2015;109(1):90-105. doi:
10.1037/pspi0000022PubMedGoogle Scholar 19.Fikretoglu
D, Liu
A, Nazarov
A, Blackler
K. A group randomized control trial to test the efficacy of the Road to Mental Readiness (R2MR) program among Canadian military recruits.
BMC Psychiatry. 2019;19(1):326. doi:
10.1186/s12888-019-2287-0PubMedGoogle Scholar 20.Jones
N, Whelan
C, Harden
L, Macfarlane
A, Burdett
H, Greenberg
N. Resilience-based intervention for UK military recruits: a randomised controlled trial.
Occup Environ Med. 2019;76(2):90-96. doi:
10.1136/oemed-2018-105503PubMedGoogle Scholar 21.Wyman
PA, Pickering
TA, Pisani
AR,
et al. Peer-adult network structure and suicide attempts in 38 high schools: implications for network-informed suicide prevention.
J Child Psychol Psychiatry. 2019;60(10):1065-1075. doi:
10.1111/jcpp.13102PubMedGoogle Scholar 22.Wilcox
HC, Kellam
SG, Brown
CH,
et al. The impact of two universal randomized first- and second-grade classroom interventions on young adult suicide ideation and attempts.
Drug Alcohol Depend. 2008;95(1)(suppl):S60-S73. doi:
10.1016/j.drugalcdep.2008.01.005PubMedGoogle Scholar 23.Joiner
T. Why People Die by Suicide. Harvard University Press; 2005.
24.Van Orden
KA, Witte
TK, Cukrowicz
KC, Braithwaite
SR, Selby
EA, Joiner
TE
Jr. The interpersonal theory of suicide.
Psychol Rev. 2010;117(2):575-600. doi:
10.1037/a0018697PubMedGoogle Scholar 25.Lakey
B, Cronin
A. Low social support and major depression: research, theory and methodological issues. In: Dobson
KS, Dozois
DJA, eds.
Risk Factors in Depression. Elsevier Academic Press; 2008:385-408. doi:
10.1016/B978-0-08-045078-0.00017-4 26.Nock
MK, Stein
MB, Heeringa
SG,
et al; Army STARRS Collaborators. Prevalence and correlates of suicidal behavior among soldiers: results from the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS).
JAMA Psychiatry. 2014;71(5):514-522. doi:
10.1001/jamapsychiatry.2014.30PubMedGoogle Scholar 27.Ursano
RJ, Kessler
RC, Naifeh
JA,
et al; Army Study to Assess Risk and Resilience in Servicemembers (STARRS) Collaborators. Risk of suicide attempt among soldiers in army units with a history of suicide attempts.
JAMA Psychiatry. 2017;74(9):924-931. doi:
10.1001/jamapsychiatry.2017.1925PubMedGoogle Scholar 28.Mitchell
MM, Gallaway
MS, Millikan
AM, Bell
M. Interaction of combat exposure and unit cohesion in predicting suicide-related ideation among post-deployment soldiers.
Suicide Life Threat Behav. 2012;42(5):486-494. doi:
10.1111/j.1943-278X.2012.00106.xPubMedGoogle Scholar 29.Griffith
J. Cross (unit)-level effects of cohesion on relationships of suicide thoughts to combat exposure, postdeployment stressors, and postdeployment social support.
Behav Med. 2015;41(3):98-106. doi:
10.1080/08964289.2014.987719PubMedGoogle Scholar 31.Institute of Medicine. Reducing Risks for Mental Disorders: Frontiers for Preventive Intervention Research. National Academies Press; 1994.
32.Pruitt
LD, Smolenski
DJ, Bush
NE,
et al. Suicide in the military: understanding rates and risk factors across the United States’ armed forces.
Mil Med. 2019;184(1)(suppl):432-437. doi:
10.1093/milmed/usy296PubMedGoogle Scholar 34.LoMurray
M. Sources of Strength Facilitators Guide: Suicide Prevention Peer Gatekeeper Training. The North Dakota Suicide Prevention Project; 2005.
35.Wyman
PA, Brown
CH, LoMurray
M,
et al. An outcome evaluation of the Sources of Strength suicide prevention program delivered by adolescent peer leaders in high schools.
Am J Public Health. 2010;100(9):1653-1661. doi:
10.2105/AJPH.2009.190025PubMedGoogle Scholar 37.Leahy
RL. Cognitive Therapy Techniques: A Practitioner's Guide. 2nd ed. Guildford Press; 2018.
39.Gibbons
RD, Kupfer
D, Frank
E, Moore
T, Beiser
DG, Boudreaux
ED. Development of a computerized adaptive test suicide scale: the CAT-SS.
J Clin Psychiatry. 2017;78(9):1376-1382. doi:
10.4088/JCP.16m10922PubMedGoogle Scholar 41.Graham
AK, Minc
A, Staab
E, Beiser
DG, Gibbons
RD, Laiteerapong
N. Validation of a computerized adaptive test for mental health in primary care.
Ann Fam Med. 2019;17(1):23-30. doi:
10.1370/afm.2316PubMedGoogle Scholar 42.Herrell
RK, Edens
EN, Riviere
LA, Thomas
JL, Bliese
PD, Hoge
CW. Assessing functional impairment in a working military population: the Walter Reed functional impairment scale.
Psychol Serv. 2014;11(3):254-264. doi:
10.1037/a0037347PubMedGoogle Scholar 43.Podsakoff
PM, MacKenzie
SB. An examination of the psychometric properties and nomological validity of some revised and reduced substitutes for leadership scales.
J Appl Psychol. 1994;79(5):702-713. doi:
10.1037/0021-9010.79.5.702Google Scholar 44.Britt
TW, Dickinson
JM. Morale during military operations: a positive psychology approach. In: Britt
TW, Castro
CA, Adler
AB, eds. Military Performance: Military Life—The Psychology of Serving in Peace and Combat. Praeger Security International; 2006:157-184.
46.Schmeelk-Cone
K, Pisani
AR, Petrova
M, Wyman
PA. Three scales assessing high school students’ attitudes and perceived norms about seeking adult help for distress and suicide concerns.
Suicide Life Threat Behav. 2012;42(2):157-172. doi:
10.1111/j.1943-278X.2011.00079.xPubMedGoogle Scholar 50.Forbes
D, Alkemade
N, Mitchell
D,
et al. Utility of the Dimensions of Anger Reactions-5 (DAR-5) scale as a brief anger measure.
Depress Anxiety. 2014;31(2):166-173. doi:
10.1002/da.22148PubMedGoogle Scholar 51.Gratz
KL, Roemer
L. Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale.
J Psychopathol Behav Assess. 2004;26(1):41-54. doi:
10.1023/B:JOBA.0000007455.08539.94Google Scholar 53.Murray
D. Design and Analysis of Group-Randomized Trials. Oxford University Press; 1998.
55.R Project for Statistical Computing. R: a language and environment for statistical computing. Published 2020. Accessed September 25, 2020.
https://www.r-project.org/ 56.Kahan
BC, Jairath
V, Doré
CJ, Morris
TP. The risks and rewards of covariate adjustment in randomized trials: an assessment of 12 outcomes from 8 studies.
Trials. 2014;15(1):139. doi:
10.1186/1745-6215-15-139PubMedGoogle Scholar 57.Rosenthal
R, Cooper
H, Hedges
L. Parametric measures of effect size. In: Cooper
H, Hedges
LV, eds. The Handbook of Research Synthesis. Russell Sage Foundation; 1994:231-244.
62.Durkheim
E. Suicide: A Sociological Study. The Free Press; 1897.