[Skip to Navigation]
Sign In
Table 1. Demographic Information
Table 1. Demographic Information
Table 2. Prevalence of Mental Health Problems Reported on the PDHA vs the Anonymous Survey
Table 2. Prevalence of Mental Health Problems Reported on the PDHA vs the Anonymous Survey
Table 3. Association of Positive Screen for Depression or PTSD With Comfort in Reporting Honestly on Postdeployment Screening and With Willingness to Seek Care Among 1712 Soldiers Completing the Anonymous Survey
Table 3. Association of Positive Screen for Depression or PTSD With Comfort in Reporting Honestly on Postdeployment Screening and With Willingness to Seek Care Among 1712 Soldiers Completing the Anonymous Survey
Table 4. Association of Positive vs Negative Screen for Depression or PTSD With Perceived Stigma and Barriers to Care Among 1712 Soldiers Completing the Anonymous Surveya
Table 4. Association of Positive vs Negative Screen for Depression or PTSD With Perceived Stigma and Barriers to Care Among 1712 Soldiers Completing the Anonymous Surveya
1.
Hyams KC, Riddle J, Trump DH, Wallace MR. Protecting the health of United States military forces in Afghanistan: applying lessons learned since the Gulf War.  Clin Infect Dis. 2002;34:(suppl 5)  S208-S21412019466PubMedGoogle ScholarCrossref
2.
Wright KM, Thomas JL, Adler AB, Ness JW, Hoge CW, Castro CA. Psychological screening procedures for deploying U.S. Forces.  Mil Med. 2005;170(7):555-56216130632PubMedGoogle Scholar
3.
Hoge CW, Castro CA, Messer SC, McGurk D, Cotting DI, Koffman RL. Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care.  N Engl J Med. 2004;351(1):13-2215229303PubMedGoogle ScholarCrossref
4.
Hoge CW, Auchterlonie JL, Milliken CS. Mental health problems, use of mental health services, and attrition from military service after returning from deployment to Iraq or Afghanistan.  JAMA. 2006;295(9):1023-103216507803PubMedGoogle ScholarCrossref
5.
Smith TC, Ryan MA, Wingard DL, Slymen DJ, Sallis JF, Kritz-Silverstein D.Millennium Cohort Study Team.  New onset and persistent symptoms of post-traumatic stress disorder self reported after deployment and combat exposures: prospective population based US military cohort study.  BMJ. 2008;336(7640):366-37118198395PubMedGoogle ScholarCrossref
6.
Grieger TA, Cozza SJ, Ursano RJ, Hoge CW, Martinez PE, Engel CC, Wain HJ. Posttraumatic stress disorder and depression in battle-injured soldiers.  Am J Psychiatry. 2006;163(10):1777-1783, quiz 186017012689PubMedGoogle ScholarCrossref
7.
Thomas JL, Wilk JE, Riviere LA, McGurk D, Castro CA, Hoge CW. Prevalence of mental health problems and functional impairment among active component and National Guard soldiers 3 and 12 months following combat in Iraq.  Arch Gen Psychiatry. 2010;67(6):614-62320530011PubMedGoogle ScholarCrossref
8.
Warner CH, Appenzeller GN, Mullen K, Warner CM, Grieger T. Soldier attitudes toward mental health screening and seeking care upon return from combat.  Mil Med. 2008;173(6):563-56918595420PubMedGoogle Scholar
9.
Warner CH, Breitbach JE, Appenzeller GN, Yates V, Grieger T, Webster WG. Division mental health in the new brigade combat team structure: part II. Redeployment and postdeployment.  Mil Med. 2007;172(9):912-91717937352PubMedGoogle Scholar
10.
Appenzeller GN, Warner CH, Grieger T. Postdeployment Health Reassessment: a sustainable method for brigade combat teams.  Mil Med. 2007;172(10):1017-102317985759PubMedGoogle Scholar
11.
Fear NT, Jones M, Murphy D, Hull L, Iversen AC, Coker B, Machell L, Sundin J, Woodhead C, Jones N, Greenberg N, Landau S, Dandeker C, Rona RJ, Hotopf M, Wessely S. What are the consequences of deployment to Iraq and Afghanistan on the mental health of the UK armed forces? a cohort study.  Lancet. 2010;375(9728):1783-179720471076PubMedGoogle ScholarCrossref
12.
Milliken CS, Auchterlonie JL, Hoge CW. Longitudinal assessment of mental health problems among active and reserve component soldiers returning from the Iraq war.  JAMA. 2007;298(18):2141-214818000197PubMedGoogle ScholarCrossref
13.
Bray RM, Pemberton MR, Hourani LL, Witt M, Rae Olmsted KL, Brown JM, Weimer B, Lane ME, Marsden ME, Scheffler S, Vandermaas-Peeler R, Aspinwall KR, Anderson E, Spagnola K, Close K, Gratton JL, Calvin S, Bradshaw M.RTI International.  2008 Department of Defense Survey of Health Related Behaviors Among Active Duty Military Personnel: A Component of the Defense Lifestyle Assessment Program (DLAP). Research Triangle Park, NC: Research Triangle Institute; September 2009. http://www.tricare.mil/2008HealthBehaviors.pdf. Accessed January 10, 2011
14.
Lavender JM, Anderson DA. Effect of perceived anonymity in assessments of eating disordered behaviors and attitudes.  Int J Eat Disord. 2009;42(6):546-55119172594PubMedGoogle ScholarCrossref
15.
Anderson DA, Simmons AM, Milnes SM, Earleywine M. Effect of response format on endorsement of eating disordered attitudes and behaviors.  Int J Eat Disord. 2007;40(1):90-9317245846PubMedGoogle ScholarCrossref
16.
Matthey S, White T, Rice S. Women's responses to postnatal self-report mood and experience measures: does anonymity make a difference?  Arch Womens Ment Health. 2010;13(6):477-48420386941PubMedGoogle ScholarCrossref
17.
McLay RN, Deal WE, Murphy JA, Center KB, Kolkow TT, Grieger TA. On-the-record screenings versus anonymous surveys in reporting PTSD [letter].  Am J Psychiatry. 2008;165(6):775-77618519540PubMedGoogle ScholarCrossref
18.
Olson CB, Stander VA, Merrill LL. The influence of survey confidentiality and construct measurement in estimating rates of childhood victimization among Navy recruits.  Mil Psychol. 2004;16(1):53-69Google ScholarCrossref
19.
Prins A, Ouimette P, Kimerling R, Cameron RP, Hugelshofer DS, Shaw-Hegwer J, Thrailkill A, Gusman FD, Sheikh JI. The Primary Care PTSD Screen (PC-PTSD): development and operating characteristics.  Primary Care Psychiatry. 2004;9(1):9-14Google ScholarCrossref
20.
Kroenke K, Spitzer RL, Williams JB. The Patient Health Questionnaire-2: validity of a two-item depression screener.  Med Care. 2003;41(11):1284-129214583691PubMedGoogle ScholarCrossref
21.
Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure.  J Gen Intern Med. 2001;16(9):606-61311556941PubMedGoogle ScholarCrossref
22.
Bliese PD, Wright KM, Adler AB, Cabrera O, Castro CA, Hoge CW. Validating the primary care Posttraumatic Stress Disorder Screen and the Posttraumatic Stress Disorder Checklist with soldiers returning from combat.  J Consult Clin Psychol. 2008;76(2):272-28118377123PubMedGoogle ScholarCrossref
23.
Bliese P, Wright K, Adler A, Hoge C, Prayner R.US Army Medical Research Unit–Europe.  Post-Deployment Psychological Screening: Interpreting and Scoring DD Form 2900 Heidelberg, Germany: US Army Medical Research Unit–Europe; 2005. US Army Medical Research Unit–Europe research report 2005-003
24.
Dube P, Kurt K, Bair MJ, Theobald D, Williams LS. The P4 screener: evaluation of a brief measure for assessing potential suicide risk in 2 randomized effectiveness trials of primary care and oncology patients.  Prim Care Companion J Clin Psychiatry. 2010;12(6):e1-e8.http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3067996/?tool=pubmed. Accessed July 12, 201121494337PubMedGoogle Scholar
25.
Terhakopian A, Sinaii N, Engel CC, Schnurr PP, Hoge CW. Estimating population prevalence of posttraumatic stress disorder: an example using the PTSD Checklist.  J Trauma Stress. 2008;21(3):290-30018553416PubMedGoogle ScholarCrossref
26.
Blanchard EB, Jones-Alexander J, Buckley TC, Forneris CA. Psychometric properties of the PTSD Checklist (PCL).  Behav Res Ther. 1996;34(8):669-6738870294PubMedGoogle ScholarCrossref
27.
Weathers FW, Litz BT, Herman DS, Huska JA, Keane TM. The PTSD Checklist (PCL): reliability, validity, and diagnostic utility. Abstract presented at: 9th Annual Meeting of the International Society for Traumatic Stress Studies; October 1993; San Antonio, TX. http://www.pdhealth.mil/library/downloads/PCL_sychometrics.doc. Accessed September 13, 2007
28.
Smith TC, Zamorski M, Smith B, Riddle JR, Leardmann CA, Wells TS, Engel CC, Hoge CW, Adkins J, Blaze D.Millennium Cohort Study Team.  The physical and mental health of a large military cohort: baseline functional health status of the Millennium Cohort.  BMC Public Health. 2007;7:340http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2212642/?tool=pubmed. Accessed July 12, 201118039387PubMedGoogle ScholarCrossref
29.
US Army.  Army Health Promotion, Risk Reduction, Suicide Prevention: Report 2010 . Washington, DC: Dept of the Army; 2010. http://www.armygl.army.mil/hr/suicide/docs/Commanders%20Tool%20Kit/HPRRSP_Report_2010_v00.pdf. Accessed August 22, 2011
30.
Kim PY, Britt TW, Klocko RP, Riviere LA, Adler A. Stigma, negative attitudes about treatment, and utilization of mental health care among soldiers.  Mil Psychol. 2011;23(1):65-81Google ScholarCrossref
31.
American Psychiatric Association.  Employees report mixed feelings about seeking health care treatment [press release]. Arlington, VA: American Psychiatric Association; January 25, 2010. News release 10-03. http://www.psych.org/MainMenu/Newsroom/NewsReleases/2010-News-Releases/Employees-Report-.aspx. Accessed April 7, 2011
32.
Wester SR, Arndt D, Sedivy SK, Arndt L. Male police officers and stigma associated with counseling: the role of anticipated risks, anticipated benefits, and gender role conflict.  Psychol Men Masc. 2010;11(4):286-302Google ScholarCrossref
33.
Iversen AC, van Staden L, Hughes JH, Greenberg N, Hotopf M, Rona RJ, Thornicroft G, Wessely S, Fear NT. The stigma of mental health problems and other barriers to care in the UK Armed Forces.  BMC Health Serv Res. 2011;11:31.http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3048487/?tool=pubmed. Accessed July 12, 201121310027PubMedGoogle ScholarCrossref
34.
Gould M, Adler A, Zamorski M, Castro C, Hanily N, Steele N, Kearney S, Greenberg N. Do stigma and other perceived barriers to mental health care differ across Armed Forces?  J R Soc Med. 2010;103(4):148-15620382906PubMedGoogle ScholarCrossref
35.
Bliese PD, Wright KM, Adler AB, Thomas JL, Hoge CW. Timing of postcombat mental health assessments.  Psychol Serv. 2007;4(3):141-148Google ScholarCrossref
36.
US Government Accountability Office.  Post-Traumatic Stress Disorder: DOD Needs to Identify the Factors Its Providers Use to Make Mental Health Evaluation Referrals for Servicemembers. Washington, DC: Government Printing Office; May 11, 2006:1-34. GAO-06-397
37.
Warner CH, Appenzeller GN, Parker JR, Warner CM, Hoge CW. Effectiveness of mental health screening and coordination of in-theater care prior to deployment to Iraq: a cohort study.  Am J Psychiatry. 2011;168(4):378-38521245086PubMedGoogle ScholarCrossref
38.
Smith B, Smith TC, Gray GC, Ryan MAK.Millennium Cohort Study Team.  When epidemiology meets the Internet: Web-based surveys in the Millennium Cohort Study.  Am J Epidemiol. 2007;166(11):1345-135417728269PubMedGoogle ScholarCrossref
Original Article
Oct 2011

Importance of Anonymity to Encourage Honest Reporting in Mental Health Screening After Combat Deployment

Author Affiliations

Author Affiliations: Command and General Staff College (Dr Christopher C. Warner) and Munson Army Health Clinic (Dr Carolynn M. Warner), Ft Leavenworth, Kansas; US Army Medical Activity–Alaska, Ft Wainwright (Dr Appenzeller); Department of Psychiatry, Uniformed Services University of Health Sciences, Bethesda (Dr Grieger), and Center for Psychiatry and Neurosciences, Walter Reed Army Institute of Research, Silver Spring (Dr Hoge), Maryland; Brooke Army Medical Center, Ft Sam Houston, Texas (Dr Belenkiy); Behavioral Health Clinic, Evans Army Community Hospital, Ft Carson, Colorado (Dr Breitbach); and Warrior Restoration Center, Winn Army Community Hospital, Ft Stewart, Georgia (Dr Parker). Dr Christopher C. Warner is now with US Army Medical Activity–Alaska, Ft Wainwright. Dr Appenzeller is now with US Army Medical Activity, Alaska, Ft Wainwright. Dr Grieger is now with Uniformed Services University of Health Sciences. Dr Belenkiy is now with Brooke Army Medical Center, Ft Sam Houston. Dr Breitbach is now with the Department of Behavioral Medicine, Evans Army Community Hospital, Ft Carson. Dr Parker is now with the Department of Psychology, Walter Reed Army Medical Center, Bethesda, Maryland. Dr Carolynn M. Warner is now with the Department of Soldier Readiness, US Army Activity–Alaska, Ft Wainwright. Dr Hoge is now with the Department of Military Psychiatry, Walter Reed Army Institute of Research.

Arch Gen Psychiatry. 2011;68(10):1065-1071. doi:10.1001/archgenpsychiatry.2011.112
Abstract

Context US soldiers are required to undergo screening for depression, posttraumatic stress disorder (PTSD), and other mental health problems on return from service in Iraq or Afghanistan as part of routine postdeployment health assessments.

Objective To assess the influence of the anonymity of screening processes on willingness of soldiers to report mental health problems after combat deployment.

Design Anonymous and nonanonymous surveys.

Setting US military.

Patients US infantry soldiers' reporting of mental health problems on the routine Post-Deployment Health Assessment was compared with their reporting on an anonymous survey administered simultaneously.

Main Outcome Measures The Primary Care PTSD Screen, the Patient Health Questionnaire–2 (modified), the suicidal ideation question from the Patient Health Questionnaire–9, and several other questions related to mental health were used on both surveys. Soldiers were also asked on the anonymous survey about perceptions of stigma and willingness to report honestly.

Results Of 3502 US Army soldiers from one infantry brigade combat team undergoing the routine Post-Deployment Health Assessment in 2008, a total of 2500 were invited to complete the anonymous survey, and 1712 of these participated (response rate, 68.5%). Reporting of depression, PTSD, suicidal ideation, and interest in receiving care were 2-fold to 4-fold higher on the anonymous survey compared with the routine Post-Deployment Health Assessment. Overall, 20.3% of soldiers who screened positive for depression or PTSD reported that they were uncomfortable reporting their answers honestly on the routine postdeployment screening.

Conclusions Current postdeployment mental health screening tools are dependent on soldiers honestly reporting their symptoms. This study indicates that the Post-Deployment Health Assessment screening process misses most soldiers with significant mental health problems. Further efforts are required to reduce the stigma of reporting and improve willingness to receive care for mental health problems.

US soldiers are required to undergo screening for depression, posttraumatic stress disorder (PTSD), and other mental health problems on return from service in Iraq or Afghanistan as part of routine postdeployment health assessments. Postdeployment screening using standardized instruments was started in the mid-1990s and has been modified considerably since the start of the wars in Iraq and Afghanistan.1,2 At present, the screening is conducted at the following 2 time points: the Post-Deployment Health Assessment (PDHA) immediately at the end of deployment (just before leaving the country or after arrival in the United States) and the Post-Deployment Health Reassessment 90 to 180 days later. These postdeployment health assessments include validated screening questions for depression, PTSD, and other mental health problems combined with a brief evaluation by a primary care provider (physician, physician assistant, or nurse practitioner), who determines the need for referral for further mental health evaluation and treatment and documents this in the soldier's electronic medical record.

Studies3-6 of soldiers returning from combat tours in Iraq and Afghanistan have shown variability in reporting of depression and PTSD, based largely on differences in population samples and combat frequency and intensity, with rates ranging between 1% and 8% for depression and between 5% and 19% for PTSD. Some postdeployment assessments have produced lower-than-expected rates of mental health concerns, and investigators have suggested the possibility that nonanonymous unitwide assessments linked to health care might discourage some soldiers from honestly reporting their war-related mental health concerns.7-11

Despite the uniform nature of having all returning soldiers complete the screening measures, studies3,4 have found that the stigma of mental health treatment remains high in the military. Recent initiatives to overcome these barriers, including expansion of screening processes, method of screening, and education to reduce stigma, have been examined,8 but studies12,13 continue to show that a high percentage of at-risk soldiers do not follow through with needed mental health treatment.

There has been little research on the propensity for soldiers to report honestly during routine health screenings. Recent studies14,15 of civilian populations have shown that anonymous surveys resulted in clear increases in reporting eating disorder symptoms, while there were no significant differences between anonymous and nonanonymous surveys in evaluation of postpartum mood symptoms.16 In the military, studies3,7 based on anonymous surveys have consistently reported higher prevalence rates of postdeployment mental health problems than studies4,5,11 based on surveys involving identifiers or linkages to health care encounters, but there have been no direct comparisons. One retrospective study,17 reported as a letter to the editor, compared results of anonymous and nonanonymous postdeployment screenings and found significant differences; however, the screening tools were not administered at the same time point, and the study focused only on medical personnel. Results of a study18 among Navy recruits suggested that anonymity is important in reporting sensitive questions related to childhood sexual or physical abuse, which is not part of postdeployment mental health screening content. The objective of this study was to determine the potential effects that anonymity has on soldiers' reports of mental health issues during postdeployment screening.

Methods

After approval was obtained from the unit commanders and the Brooke Army Medical Center Institutional Review Board, one infantry brigade combat team of US soldiers returning from Iraq to Ft Stewart, Georgia, was selected for this study. This brigade was the first brigade in the division returning from deployment after study approval. This brigade was deployed to Iraq as part of the surge of forces in 2007-2008. This was the third deployment of 1 year or more for this brigade in 6 years and involved heavy brigadewide combat operations.

All members of the brigade (n = 3502) completed their PDHA within 30 days before departure from Iraq, as required by US Army medical policy, coordinated by unit medical personnel. The PDHA was completed electronically using computer interfaces. Immediately on completion of the electronic survey portion of the PDHA and before the face-to-face meeting with a primary care physician, 2500 of these soldiers were also invited to complete an additional voluntary anonymous paper survey. Soldiers were informed that the additional survey was for research purposes only and was not part of the electronic process they had just completed and that their participation was voluntary (without compensation). In addition, they were notified that the survey would remain completely anonymous and would not be reviewed by any of the on-site personnel and that they should not place any identifying information on the survey. No written consent was required owing to the minimal risk of the study; completion served as implied consent.

The additional survey included the same behavioral health screening items from the PDHA, as well as demographic information, a series of questions about commonly perceived barriers for obtaining mental health care, and a series of questions about whether participants felt comfortable honestly reporting their mental health concerns on the PDHA. It was impossible to invite all 3502 soldiers in the brigade to participate because of logistical and transportation considerations of survey administration, which would have required vehicle transportation and support that was unessential to the mission in this dangerous operational environment. The guaranteed anonymity made it impossible to link answers from the anonymous survey with the specific responses from the same soldiers who completed the PDHA. Comparability between groups was assessed by comparing the demographics (age, sex, rank, and number of deployments) from the anonymous survey group with those of the entire group that completed the PDHA.

Mental health measures on the pdha and anonymous survey

Both the PDHA and anonymous survey included screening questions for depression and PTSD from the Patient Health Questionnaire-2 (PHQ-2) and Primary Care PTSD Screen (PC-PTSD).19-21 These have been validated against the longer versions of these scales, as well as against structured diagnostic interviews in civilian and military populations.22,23 The response pattern for the PHQ-2 was modified slightly by the Department of Defense to make it simpler to use on a population-wide basis. The 2 questions (related to depressed mood and anhedonia) ask soldiers to report the frequency with which they have experienced these symptoms over the past 2 weeks, using the responses“none of the time,”“some of the time,” or“a lot of the time.” At the time of this study, the guidance provided to medical providers administering the PDHA was that referral for a mental health evaluation was recommended for all soldiers who marked“a lot of the time” on both of these questions; consequently, this was selected as the cutoff for both surveys.

Posttraumatic stress disorder was measured on both surveys using the 4-item PC-PTSD Screen. The 4 questions ask about nightmares or intrusive thoughts, avoidance of thoughts or situations, vigilance or startle, and numbness or detachment in the past month, using a yes or no format. Prior studies19,22 have shown that cutoffs of 2 or 3 positive responses are indicative of PTSD. A cutoff of 3 or more was selected as positive for this study based on the guidance to medical providers administering the PDHA at that time, which recommended this criterion as the cut point for referral.4,12

Suicidal ideation was measured in both the anonymous survey and routine PDHA using a question modified from the PHQ-9 that asks soldiers if in the last 2 weeks they thought that they“would be better off dead or hurting yourself in some way,” using the same response pattern of“none of the time,”“some of the time,” or“a lot of the time,”21,24 with either“some of the time” or“a lot of the time” scored as positive.

In addition, both surveys included 3 questions that are routinely asked on the PDHA pertaining to interpersonal relationships and interest in receiving care. Individuals were asked about the presence or absence of thoughts that they were (1)“interested in receiving help for a stress, emotional, alcohol, or family problem,” (2) having thoughts or concerns about“having serious conflicts with their spouse, family members, or a close friend,” or (3) having thoughts or concerns that they“might hurt or lose control with someone.”

Other instruments were used in addition to the PC-PTSD and 2-question depression screeners. The anonymous survey also included the full Posttraumatic Stress Disorder Checklist–Military Version and full PHQ-9 depression measure.21,22,25-27

Stigma and barriers to care

The findings of prior studies3,4,8 have reported several perceived barriers to soldiers seeking mental health care, and consequently the anonymous survey included questions concerning barriers to care (eg, difficulty with transport, lack of available services, and difficulty getting time off from work to attend appointments) and perceptions that care would result in stigma, using the same items described in previous research scored on a 5-point Likert-type scale.3 Examples of the stigma questions included“My unit leadership might have less confidence in me,”“Members of my unit might view me differently,” and“It would harm my career.” Two additional statements were added to assess a soldier's willingness to report honestly on the routine PDHA process and his or her willingness to receive care. The wording of these (scored on a 5-point Likert-type scale) were“I feel comfortable honestly reporting any behavioral health problems during the post-deployment screening” and“If screening results indicated or I believe I have an ongoing behavioral health issue, I will seek treatment.”

Statistical analysis

The primary focus was on descriptive statistics comparing the routine PDHA and anonymous survey, including the prevalence of screening positive for PTSD, prevalence of depression, willingness or interest in seeking care, and suicidal ideation. Secondary analysis was conducted using the anonymous survey to assess potential predictors of concerns over confidentiality and barriers to care. All analyses were performed using commercially available software (SPSS, version 12.02; SPSS Inc, Chicago, Illinois).

Results
Demographic comparison

Of 3502 US Army soldiers from the infantry brigade combat team undergoing the routine PDHA in 2008, a total of 2500 were invited to complete the anonymous survey, and 1712 of these participated (response rate, 68.5%). This response rate is higher than those seen in other voluntary mental health surveys of active-duty soldiers, which have ranged from 36% to 62%.7,28 The anonymous population comprised predominantly male (1571 [91.8%]) and enlisted (1570 [91.7%]) soldiers, who had completed 1 or more deployments before this current deployment (908 [53.0%]). No statistically significant differences were noted in demographics between the study group that completed the anonymous survey and the entire brigade that underwent the routine PDHA process (Table 1).

Comparison between surveys

Among 1712 soldiers who completed the anonymous survey, 120 (7.0%) screened positive for depression on the PHQ-2, and 132 (7.7%) screened positive for PTSD on the PC-PTSD. The prevalences based on these brief screening tools were comparable to the prevalences based on the full PHQ-9 and PTSD Checklist.25-27 Using moderately specific cutoffs for depression, 89 of 1712 soldiers (5.2%) had a PHQ-9 score of 15 or higher.21 Similarly, 143 (8.4%) had a PTSD Checklist score of 40 or higher (moderate-severe symptom cutoff levels), while 76 (4.4%) met the highly specific cutoff of a PTSD Checklist score of 50 or higher.25

Table 2 summarizes the comparisons of the soldiers' responses on the anonymous survey and nonanonymous PDHA based on the short screening instruments. Soldiers reported significantly higher rates for all mental health concerns on the anonymous survey compared with the routine PDHA. Of soldiers who completed the anonymous survey, 12.1% (n = 207) met criteria for either PTSD or depression compared with only 4.2% of all soldiers who completed the routine PDHA. When interest in seeking care was added to depression and PTSD screening, the overall rate of needing services or screening positive was 17.2% for the soldiers completing the anonymous survey compared with 6.3% for those completing the routine health assessment.

Honesty of reporting, willingness to seek care, and barriers to care

Based on the anonymous survey, soldiers who screened positive for depression or PTSD were more likely than soldiers who screened negative to report discomfort answering honestly on routine postdeployment screening (Table 3). Overall, 20.3% of soldiers who screened positive for depression or PTSD reported that they were uncomfortable reporting their answers honestly on the routine postdeployment screening (disagree and strongly disagree responses combined), and another 28.0% gave a neutral response; these values were 8.4% and 18.7%, respectively, for those who screened negative. Those who screened positive for depression or PTSD were also significantly less willing to seek care (disagree or strongly disagree responses) than those who screened negative. Levels of perceived stigma and barriers to care were significantly higher for those who screened positive for mental health problems (Table 4).

Comment

Congressionally mandated postdeployment screening is a hallmark health policy aimed to improve the care of service members returning from Iraq and Afghanistan. In addition, multiple education efforts have been initiated to decrease stigma.29 However, despite these efforts, stigma seems to remain pervasive in the military.30 The results of this study indicate that soldiers were significantly less willing to report mental health problems on a routine (nonanonymous) postdeployment health screening compared with an anonymous screening tool. Compared with those who screened negative, those who met criteria for PTSD or depression indicated greater discomfort with giving honest answers on routine postdeployment screening and were significantly less willing to seek care.

A recent poll by the American Psychiatric Association31 showed that, although 40% of civilian employees identified their employers as supportive of seeking treatment, many employees endorsed concerns about the loss of status at work or confidentiality as reasons for not seeking mental health care. In addition, like law enforcement personnel, who have also reported stigma and barriers to seeking mental health care,32 military personnel have ongoing perceptions of stigma and barriers to mental health care within the occupational military context, including how they are perceived by unit leadership or peers, or the effect that treatment might have on their career.3,30,33,34 This is of concern because of the ready access that members of these professions have to lethal means, as well as the potential risk of untreated mental health concerns, including suicide. Compounding this is that both stigma and perceived barriers have been shown to be greater in those with ongoing mental health issues.3,30 These findings reinforce the continued need for the military to develop effective strategies for encouraging personnel to seek assistance.

This study is the first to provide a direct measure of the level of discomfort with reporting honestly on the routine PDHA and the willingness to receive a mental health referral, particularly for those who screened positive for a mental health concern. This study indicates that the PDHA screening process misses most soldiers with significant mental health problems and adds to the growing literature suggesting that the initial PDHA is not optimal in identifying those most in need of services. Soldiers sometimes have concerns that identification of a problem during this screening might hinder their permission to take leave immediately on returning home, or they may consider that their symptoms will resolve on their return. Studies12,35 have shown that rates of reporting mental health concerns significantly increase at the time of the second postdeployment assessment 3 to 6 months later. Further research is needed to study the effect of anonymity on reporting months or years following deployment.

The lack of willingness to report symptoms may also indicate a lack of confidence in the mental health services that are available. A US Government Accountability Office36 report in 2006 noted that, although soldiers often reported their symptoms, fewer than one-quarter with significant PTSD symptoms went on to receive mental health care. In a study12 of the PDHA referral process Army-wide, almost half of the soldiers who were referred to mental health care for PTSD did not follow up with their referral. There is some evidence that soldiers with mental health problems lack trust or confidence in the mental health care system. Findings from a recent study30 suggest that negative perceptions about mental health care are more important than stigma perceptions in predicting willingness to seek care.

Strategies most effective in encouraging willingness to seek care will most likely involve coupling postdeployment screening initiatives with primary care–based care coordination programs. One study9 involving a returning infantry unit showed that all soldiers who reported mental health problems on their PDHA and were referred for mental health evaluation completed their initial evaluation and that 72% remained engaged in follow-up care. This high rate of continued engagement with mental health care was attributed to mental health professionals being available to immediately complete the initial referral evaluations at the primary care site where screenings were conducted (as distinct from referring soldiers for a subsequent appointment in a different location), coupled with aggressive care coordination, including outreach after returning home. This structured reintegration program was associated with decreased negative behaviors during the first 3 months after deployment.9 Similar mechanisms of embedded mental health personnel and care coordination in predeployment screening have shown improved mental health outcomes during deployment.37

Additional strategies to encourage soldiers to seek assistance outside of standard screening processes include online self-assessments with information about how to access mental health resources, the Military One Source program (which provides 12 sessions of confidential counseling in civilian settings outside of the military medical system), and the US Department of Defense TRICARE online mental health counseling program. However, these programs are limited in the scope of the services that they provide and lack effectiveness data. Further measures and study are needed to understand the factors that will best create a climate in which soldiers perceive their care as nonstigmatizing and are confident that mental health professionals have the knowledge and experience to address their unique war-related health concerns. This study adds to the growing body of literature that questions the effectiveness of self-report surveys. This study does not invalidate the postdeployment screening process but provides caution to policymakers that clinical screening alone cannot be expected to identify most service members in need of treatment. Postdeployment screening provides one of several routes to care. Further research is needed on the range of strategies to enhance clinical engagement.

The most important limitation of this study is that the anonymous group was a nonrandom sample involving approximately half of the entire brigade population. Ideally, data would have been available on the exact same individuals; this was impossible in this operational war environment while maintaining guaranteed anonymity. However, this study design is unlikely to have compromised the validity of the comparisons. This study involved a single infantry brigade combat team, in which all members were deployed to the same region of Iraq during the same period; battalions within this brigade experienced comparable combat experiences and casualty rates. The highly comparable demographics, including sex, age, rank, and number of prior deployments, supported the conclusion that the anonymous survey group was comparable to the larger brigade population. In addition, given the extremely large (2- to 4-fold) differences in survey results between the 2 groups and consistency across all comparisons, it is unlikely that selection bias would have changed the study conclusions. In terms of generalizability, the results of this study pertain to US infantry soldiers assessed at the end of their deployment and are not representative of all deploying forces from the United States and other countries or assessments conducted months or years after return home. However, the findings are consistent with another study17 involving military medical personnel.

Other limitations relate to the process of survey administration. The PDHA involved electronic data collection, whereas the additional anonymous survey was done on paper. It is also possible that the order of survey administration, in which the anonymous survey was always given after the electronic survey, may have influenced results. However, it is unlikely that either of these factors would have accounted for such large differences in results. The electronic method of survey administration is consistent with how PDHAs are administered throughout the Army, and other analyses in military populations have shown high comparability between electronic and paper surveys.38 Both surveys were completed before the encounter with the clinician, so the clinician's feedback on the PDHA results would not have biased reporting on the anonymous survey. In addition, even if there was an order effect in reporting that was truly independent of anonymity, it is unlikely to have accounted for such large differences, and this would not affect the overall concerns raised in this study about the lack of willingness to report on the existing PDHA screening process.

In conclusion, postdeployment mental health screening is an important tool in helping to identify returning soldiers with war-related depression or PTSD and link them to treatment resources. Although mental health services are likely to result in restored or improved functioning, soldiers often maintain the perception that this care will have a negative effect on their career. This study is the first direct comparison of soldiers' willingness to report mental health concerns on anonymous and nonanonymous screening measures in the immediate period before returning home. The study indicates that additional strategies are required, apart from the routine postdeployment screening, to encourage soldiers to seek assistance and facilitate access to care.

Back to top
Article Information

Correspondence: Christopher H. Warner, Clinical Services, US Army Medical Activity–Alaska, 1060 Gaffney Rd. Bldg No. 7400, Ft Wainwright, AK 99703 (Christopher.H.Warner@us.army.mil).

Submitted for Publication: January 25, 2011; final revision received April 20, 2011; accepted May 9, 2011.

Financial Disclosure: None reported.

Funding/Support: No industry grants or financial support were used in this project.

Disclaimer: The stated views are those of the authors and do not represent the views or the policy of the US Army or Department of Defense.

Additional Information: All authors are employees of the federal government; therefore, this work is in the public domain.

References
1.
Hyams KC, Riddle J, Trump DH, Wallace MR. Protecting the health of United States military forces in Afghanistan: applying lessons learned since the Gulf War.  Clin Infect Dis. 2002;34:(suppl 5)  S208-S21412019466PubMedGoogle ScholarCrossref
2.
Wright KM, Thomas JL, Adler AB, Ness JW, Hoge CW, Castro CA. Psychological screening procedures for deploying U.S. Forces.  Mil Med. 2005;170(7):555-56216130632PubMedGoogle Scholar
3.
Hoge CW, Castro CA, Messer SC, McGurk D, Cotting DI, Koffman RL. Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care.  N Engl J Med. 2004;351(1):13-2215229303PubMedGoogle ScholarCrossref
4.
Hoge CW, Auchterlonie JL, Milliken CS. Mental health problems, use of mental health services, and attrition from military service after returning from deployment to Iraq or Afghanistan.  JAMA. 2006;295(9):1023-103216507803PubMedGoogle ScholarCrossref
5.
Smith TC, Ryan MA, Wingard DL, Slymen DJ, Sallis JF, Kritz-Silverstein D.Millennium Cohort Study Team.  New onset and persistent symptoms of post-traumatic stress disorder self reported after deployment and combat exposures: prospective population based US military cohort study.  BMJ. 2008;336(7640):366-37118198395PubMedGoogle ScholarCrossref
6.
Grieger TA, Cozza SJ, Ursano RJ, Hoge CW, Martinez PE, Engel CC, Wain HJ. Posttraumatic stress disorder and depression in battle-injured soldiers.  Am J Psychiatry. 2006;163(10):1777-1783, quiz 186017012689PubMedGoogle ScholarCrossref
7.
Thomas JL, Wilk JE, Riviere LA, McGurk D, Castro CA, Hoge CW. Prevalence of mental health problems and functional impairment among active component and National Guard soldiers 3 and 12 months following combat in Iraq.  Arch Gen Psychiatry. 2010;67(6):614-62320530011PubMedGoogle ScholarCrossref
8.
Warner CH, Appenzeller GN, Mullen K, Warner CM, Grieger T. Soldier attitudes toward mental health screening and seeking care upon return from combat.  Mil Med. 2008;173(6):563-56918595420PubMedGoogle Scholar
9.
Warner CH, Breitbach JE, Appenzeller GN, Yates V, Grieger T, Webster WG. Division mental health in the new brigade combat team structure: part II. Redeployment and postdeployment.  Mil Med. 2007;172(9):912-91717937352PubMedGoogle Scholar
10.
Appenzeller GN, Warner CH, Grieger T. Postdeployment Health Reassessment: a sustainable method for brigade combat teams.  Mil Med. 2007;172(10):1017-102317985759PubMedGoogle Scholar
11.
Fear NT, Jones M, Murphy D, Hull L, Iversen AC, Coker B, Machell L, Sundin J, Woodhead C, Jones N, Greenberg N, Landau S, Dandeker C, Rona RJ, Hotopf M, Wessely S. What are the consequences of deployment to Iraq and Afghanistan on the mental health of the UK armed forces? a cohort study.  Lancet. 2010;375(9728):1783-179720471076PubMedGoogle ScholarCrossref
12.
Milliken CS, Auchterlonie JL, Hoge CW. Longitudinal assessment of mental health problems among active and reserve component soldiers returning from the Iraq war.  JAMA. 2007;298(18):2141-214818000197PubMedGoogle ScholarCrossref
13.
Bray RM, Pemberton MR, Hourani LL, Witt M, Rae Olmsted KL, Brown JM, Weimer B, Lane ME, Marsden ME, Scheffler S, Vandermaas-Peeler R, Aspinwall KR, Anderson E, Spagnola K, Close K, Gratton JL, Calvin S, Bradshaw M.RTI International.  2008 Department of Defense Survey of Health Related Behaviors Among Active Duty Military Personnel: A Component of the Defense Lifestyle Assessment Program (DLAP). Research Triangle Park, NC: Research Triangle Institute; September 2009. http://www.tricare.mil/2008HealthBehaviors.pdf. Accessed January 10, 2011
14.
Lavender JM, Anderson DA. Effect of perceived anonymity in assessments of eating disordered behaviors and attitudes.  Int J Eat Disord. 2009;42(6):546-55119172594PubMedGoogle ScholarCrossref
15.
Anderson DA, Simmons AM, Milnes SM, Earleywine M. Effect of response format on endorsement of eating disordered attitudes and behaviors.  Int J Eat Disord. 2007;40(1):90-9317245846PubMedGoogle ScholarCrossref
16.
Matthey S, White T, Rice S. Women's responses to postnatal self-report mood and experience measures: does anonymity make a difference?  Arch Womens Ment Health. 2010;13(6):477-48420386941PubMedGoogle ScholarCrossref
17.
McLay RN, Deal WE, Murphy JA, Center KB, Kolkow TT, Grieger TA. On-the-record screenings versus anonymous surveys in reporting PTSD [letter].  Am J Psychiatry. 2008;165(6):775-77618519540PubMedGoogle ScholarCrossref
18.
Olson CB, Stander VA, Merrill LL. The influence of survey confidentiality and construct measurement in estimating rates of childhood victimization among Navy recruits.  Mil Psychol. 2004;16(1):53-69Google ScholarCrossref
19.
Prins A, Ouimette P, Kimerling R, Cameron RP, Hugelshofer DS, Shaw-Hegwer J, Thrailkill A, Gusman FD, Sheikh JI. The Primary Care PTSD Screen (PC-PTSD): development and operating characteristics.  Primary Care Psychiatry. 2004;9(1):9-14Google ScholarCrossref
20.
Kroenke K, Spitzer RL, Williams JB. The Patient Health Questionnaire-2: validity of a two-item depression screener.  Med Care. 2003;41(11):1284-129214583691PubMedGoogle ScholarCrossref
21.
Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure.  J Gen Intern Med. 2001;16(9):606-61311556941PubMedGoogle ScholarCrossref
22.
Bliese PD, Wright KM, Adler AB, Cabrera O, Castro CA, Hoge CW. Validating the primary care Posttraumatic Stress Disorder Screen and the Posttraumatic Stress Disorder Checklist with soldiers returning from combat.  J Consult Clin Psychol. 2008;76(2):272-28118377123PubMedGoogle ScholarCrossref
23.
Bliese P, Wright K, Adler A, Hoge C, Prayner R.US Army Medical Research Unit–Europe.  Post-Deployment Psychological Screening: Interpreting and Scoring DD Form 2900 Heidelberg, Germany: US Army Medical Research Unit–Europe; 2005. US Army Medical Research Unit–Europe research report 2005-003
24.
Dube P, Kurt K, Bair MJ, Theobald D, Williams LS. The P4 screener: evaluation of a brief measure for assessing potential suicide risk in 2 randomized effectiveness trials of primary care and oncology patients.  Prim Care Companion J Clin Psychiatry. 2010;12(6):e1-e8.http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3067996/?tool=pubmed. Accessed July 12, 201121494337PubMedGoogle Scholar
25.
Terhakopian A, Sinaii N, Engel CC, Schnurr PP, Hoge CW. Estimating population prevalence of posttraumatic stress disorder: an example using the PTSD Checklist.  J Trauma Stress. 2008;21(3):290-30018553416PubMedGoogle ScholarCrossref
26.
Blanchard EB, Jones-Alexander J, Buckley TC, Forneris CA. Psychometric properties of the PTSD Checklist (PCL).  Behav Res Ther. 1996;34(8):669-6738870294PubMedGoogle ScholarCrossref
27.
Weathers FW, Litz BT, Herman DS, Huska JA, Keane TM. The PTSD Checklist (PCL): reliability, validity, and diagnostic utility. Abstract presented at: 9th Annual Meeting of the International Society for Traumatic Stress Studies; October 1993; San Antonio, TX. http://www.pdhealth.mil/library/downloads/PCL_sychometrics.doc. Accessed September 13, 2007
28.
Smith TC, Zamorski M, Smith B, Riddle JR, Leardmann CA, Wells TS, Engel CC, Hoge CW, Adkins J, Blaze D.Millennium Cohort Study Team.  The physical and mental health of a large military cohort: baseline functional health status of the Millennium Cohort.  BMC Public Health. 2007;7:340http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2212642/?tool=pubmed. Accessed July 12, 201118039387PubMedGoogle ScholarCrossref
29.
US Army.  Army Health Promotion, Risk Reduction, Suicide Prevention: Report 2010 . Washington, DC: Dept of the Army; 2010. http://www.armygl.army.mil/hr/suicide/docs/Commanders%20Tool%20Kit/HPRRSP_Report_2010_v00.pdf. Accessed August 22, 2011
30.
Kim PY, Britt TW, Klocko RP, Riviere LA, Adler A. Stigma, negative attitudes about treatment, and utilization of mental health care among soldiers.  Mil Psychol. 2011;23(1):65-81Google ScholarCrossref
31.
American Psychiatric Association.  Employees report mixed feelings about seeking health care treatment [press release]. Arlington, VA: American Psychiatric Association; January 25, 2010. News release 10-03. http://www.psych.org/MainMenu/Newsroom/NewsReleases/2010-News-Releases/Employees-Report-.aspx. Accessed April 7, 2011
32.
Wester SR, Arndt D, Sedivy SK, Arndt L. Male police officers and stigma associated with counseling: the role of anticipated risks, anticipated benefits, and gender role conflict.  Psychol Men Masc. 2010;11(4):286-302Google ScholarCrossref
33.
Iversen AC, van Staden L, Hughes JH, Greenberg N, Hotopf M, Rona RJ, Thornicroft G, Wessely S, Fear NT. The stigma of mental health problems and other barriers to care in the UK Armed Forces.  BMC Health Serv Res. 2011;11:31.http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3048487/?tool=pubmed. Accessed July 12, 201121310027PubMedGoogle ScholarCrossref
34.
Gould M, Adler A, Zamorski M, Castro C, Hanily N, Steele N, Kearney S, Greenberg N. Do stigma and other perceived barriers to mental health care differ across Armed Forces?  J R Soc Med. 2010;103(4):148-15620382906PubMedGoogle ScholarCrossref
35.
Bliese PD, Wright KM, Adler AB, Thomas JL, Hoge CW. Timing of postcombat mental health assessments.  Psychol Serv. 2007;4(3):141-148Google ScholarCrossref
36.
US Government Accountability Office.  Post-Traumatic Stress Disorder: DOD Needs to Identify the Factors Its Providers Use to Make Mental Health Evaluation Referrals for Servicemembers. Washington, DC: Government Printing Office; May 11, 2006:1-34. GAO-06-397
37.
Warner CH, Appenzeller GN, Parker JR, Warner CM, Hoge CW. Effectiveness of mental health screening and coordination of in-theater care prior to deployment to Iraq: a cohort study.  Am J Psychiatry. 2011;168(4):378-38521245086PubMedGoogle ScholarCrossref
38.
Smith B, Smith TC, Gray GC, Ryan MAK.Millennium Cohort Study Team.  When epidemiology meets the Internet: Web-based surveys in the Millennium Cohort Study.  Am J Epidemiol. 2007;166(11):1345-135417728269PubMedGoogle ScholarCrossref
×