Key PointsQuestion
Is reported concern about school violence or shootings associated with internalizing problems among adolescents?
Findings
In a cohort study of 2263 adolescents, greater concern about school violence or shootings was prospectively associated with increased odds of reporting generalized anxiety and panic symptoms 6 months later. There was no overall association between concern about school violence and depressive symptoms.
Meaning
These findings suggest that concerns about school violence or shootings might be a risk factor for internalizing problems among adolescents that may warrant public health attention.
Importance
The prevalence of internalizing problems among US adolescents has risen in the past decade. The extent to which concerns about school violence or shootings are associated with risk of internalizing problems is unknown.
Objective
To examine the prospective association of concern, worry, and stress related to school violence or shootings with internalizing problems and to examine sex and racial and ethnic differences in the magnitude of the associations.
Design, Setting, and Participants
This longitudinal cohort study involved 3 surveys administered 6 months apart (fall of grade 11 [prebaseline]; spring of grade 11 [baseline]; and fall of grade 12 [follow-up]) from 2015 to 2016. Participants included 2263 students from 10 high schools in Los Angeles, California. Analyses were performed from April 29, 2020, to April 8, 2021.
Exposures
Baseline self-reported level of concern, worry, and stress about shootings or violence at the student’s school or other schools, each rated on 5-point scales (ranging from not at all [0] to extremely [4]) with a mean score calculated as a 3-item composite index rescaled into z-score standard deviation units.
Main Outcomes and Measures
Surpassing clinically significant or borderline significant thresholds for major depressive disorder, generalized anxiety disorder, or panic disorder based on symptom ratings on the Revised Children’s Anxiety and Depression Scale at 6-month follow-up.
Results
Of the 2263 students included in the analyses (1250 [55.2%] girls; mean [SD] age, 16.5 [0.4] years), appreciable proportions reported being very or extremely concerned (850 0f 2226 [38.2%]), worried (703 of 2209 [31.8%]), or stressed (332 of 2183 [15.2%]) about shootings or violence at their school or other schools. After adjusting for prebaseline covariates, concerns about school violence or shootings were associated with clinically significant generalized anxiety symptoms (odds ratio [OR], 1.31; 95% CI, 1.15-1.50) and panic symptoms (OR, 1.18; 95% CI, 1.05-1.32), but not depressive symptoms (OR, 1.13; 95% CI, 0.99-1.30) at the 6-month follow-up. There was a significant association between concern with school violence or shootings and depressive symptoms for Black youth (OR, 3.15; 95% CI, 1.38-7.19) and non-Hispanic/Latinx White youth (OR, 1.62 [95% CI, 1.25-2.09]) but not for youth of other races and ethnicities (OR for Asian, 1.26 [95% CI, 0.86-1.85]; OR for Hispanic/Latinx, 0.94 [95% CI, 0.76-1.16]; OR for other, 0.93 [95% CI, 0.54-1.61]). Sex did not moderate these associations.
Conclusions and Relevance
The findings of this study suggest that concern, worry, and stress related to school violence or shootings may be risk factors for internalizing problems among adolescents, with variation in the strength of the association by race/ethnicity.
Since approximately 2011, the prevalence of major depressive disorder and depressive symptoms has increased among US adolescents.1-3 As of 2014, the 12-month prevalence of major depressive episodes was 11.3%, representing a significant increase from 8.7% in 2005.1 In 2018, 70% of youth reported anxiety and depression (collectively termed internalizing problems)4 to be major problems among their peers.5 Given the strong association between adolescent internalizing problems and subsequent adverse outcomes in adulthood,6 research is needed to identify factors with a high exposure prevalence that increase the risk of internalizing problems among adolescents and are contemporarily salient.
Explanations for increasing internalizing problem trends are largely speculative, and some hypotheses include increases in digital media use, exposure to cyberbullying, economic recessions, decreased sleep quantity and quality, concerns about the environment, and exposure to the consequences of the opioid epidemic.2,3,7 An emerging and increasingly salient stressor for youth is exposure to violence in school settings and concern about school shootings. In 2019, approximately 8.7% of students from 9th to 12th grade reported that they did not attend school owing to safety concerns at least once in the past 30 days—an increase of more than 2-fold since 1993.8 School shootings are often widely publicized, and mere knowledge about such shootings might influence youths’ perceptions of safety at their own school, even if gun violence in their own schools and communities has never occurred.9 For adolescent residents of communities affected by gun violence, the portrayal of school shootings in the media could be particularly distressing.
In 2018, more than half of US students reported feeling somewhat or very worried about the possibility of a shooting happening at their school.10 Of note, these worries were more common among female, Black, and Hispanic students10 and may contribute to disparities in adolescent mental health. Collectively, these findings raise the possibility that youths’ concern about violence and school shootings may be a contributing factor to internalizing problems and may differentially relate to internalizing problems by sex, race, and ethnicity.
In this longitudinal cohort study, we tested the hypothesis that adolescents who reported greater concern, worry, and stress associated with school violence or shootings would report greater odds of depressive, generalized anxiety, and panic symptoms at a 6-month follow-up. We also examined whether these associations differed by sex, race, and ethnicity. To our knowledge, this is the first study to examine the association between concern about school shootings and internalizing problems among US adolescents.
The data in this cohort study were drawn from the Happiness and Health Study, a longitudinal cohort of adolescents from 10 public high schools in Los Angeles, California.11 Participants who were in the 9th grade and their parents provided active assent and consent before enrolling in the study. Thereafter, assessments were administered every 6 months in classrooms. Students who were not present on the day of survey administration completed abbreviated surveys that omitted key measures and were therefore not included in this study. The University of Southern California institutional review board approved the study. This study followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guidelines.
Questions regarding concern with school violence or shootings were first introduced during the 11th grade survey assessment in spring of 2016, which represents the baseline wave for the current study; surveys 6 months before (fall of 2015 in 11th grade) and 6 months after (fall of 2016 in 12th grade) represent the prebaseline and follow-up waves, respectively. The sample included students who completed assessments at all 3 waves; had complete data for sex, race, and ethnicity; and had measurements for the concern about school violence or shootings scale and at least 1 of the internalizing problem outcomes. A participant flow diagram is presented in the eFigure in the Supplement. Of 4100 eligible 9th grade students, 3396 enrolled in the study, and data from 2263 participants were included in analyses. eTable 1 in the Supplement displays demographic comparisons between participants included in analyses and those excluded from the sample.
Baseline Concern, Worry, and Stress About School Violence or Shootings
In a survey section labeled “Issues in Society,” students were asked to rate their degree of “concern, worry, and stress towards the following issues in terms of their effect on [them] personally” (the eMethods in the Supplement provides a complete list of survey items). Three separate items measured the degree to which adolescents were concerned, worried, and stressed with regard to “shootings or violence at your school or other schools,” with response options of not at all (0), slightly (1), somewhat (2), very (3), and extremely (4). As in prior studies using similar measures of concern for other issues,12 we formed a composite index reflecting the level of concern about school violence or shootings by calculating the mean of the 3 items (range, 0-4). Composite scores are hereinafter referred to as concerns about school violence or shootings. This measure had high internal consistency as measured by both the Cronbach α (0.90) and item-total correlations (concern: 0.82, worry: 0.88, stress: 0.74). To assist with interpretability, we converted scores for this measure into SD unit z scores for regression models.
Internalizing Problems at Follow-up
The outcomes of interest included symptom ratings for major depressive disorder, generalized anxiety disorder, and panic disorder that surpassed the borderline clinically significant or clinically significant thresholds. These were measured using the respective subscales of the 47-item Revised Children’s Anxiety and Depression Scale (RCADS), which consisted of 10 items for major depressive disorder, 6 items for generalized anxiety disorder, and 9 items for panic disorder. Adolescents were asked to indicate how often certain things happened to them (eg, “I feel sad or empty,” “I worry that bad things will happen to me,” “When I have a problem, I feel shaky”). Response options were never (0), sometimes (1), often (2), or always (3). Total scores for each disorder were obtained by summing the item scores. The RCADS has age- and sex-specific normative samples in which symptom scores can be identified as borderline clinically significant (T score of 65-69) or clinically significant (T score of ≥70). We used these to create a binary outcome variable for each disorder (does vs does not surpass borderline or clinical threshold). The RCADS has been extensively validated in both clinical and school-based samples and has been found to accurately distinguish between diagnostic groups identified by semistructured interviews.13,14
Covariates were selected on the basis of existing literature on the association between perceived school safety and mental health.15,16 Covariates were assessed at a time before the primary regressor variable.17 For sociodemographic characteristics, we included age, sex (female or male), race and ethnicity (Asian, Black, Hispanic/Latinx, non-Hispanic/Latinx White, or other [American Indian or Alaska Native, Native Hawaiian or Pacific Islander, multiracial, and other race or ethnicity]) and eligibility for free or reduced-cost lunch (not eligible or eligible). Externalizing, disruptive behavioral problems included attention-deficit/hyperactivity symptoms, measured with the Current Symptoms Self-report Form,18 and delinquent behavior, measured with a scale assessing the frequency of 11 behaviors in the past 6 months (eg, lying to parents, skipping school),19 past 6-month use of alcohol (yes or no), and past 6-month use of nicotine, marijuana, and/or illicit drugs (yes or no). School-related covariates included past 30-day exposure to cyberbullying, measured with the 8-item Cyberbullying and Online Aggression Survey Instrument20 (summary scores dichotomized into yes or no), and subjective social status at school, measured with the MacArthur Scale of Subjective Social Status (scores range from 1-10, with higher scores indicating greater perceived status).21 Finally, we also adjusted for continuous scores from the prebaseline major depressive disorder, generalized anxiety disorder, and panic disorder subscales of the RCADS (described above).
Association of Concern About School Violence or Shootings With Internalizing Problems
Logistic regression was used to estimate the association of concern about school violence or shootings with depressive, generalized anxiety, and panic symptoms. Regression coefficients were exponentiated for interpretation as odds ratios (ORs) with associated 95% CIs; for the composite concern index, these represent the change in odds of reporting a borderline or clinically significant symptom per 1-SD increase in concern. We estimated unadjusted and adjusted models for each internalizing problem; the adjusted models included all 13 covariates listed above.
Moderation by Sex, Race, and Ethnicity
We examined whether the associations between concern about school violence or shootings with each outcome differed according to sex and to race and ethnicity by estimating separate adjusted models. These included omnibus interaction terms between concern about school violence or shootings and sex or all race and ethnicity categories.
Sensitivity Analyses and Missing Data
Sensitivity analyses, which were conducted to test modeling decisions and other assumptions, are described in the eMethods in the Supplement. To account for missing data on covariates in our sample, we performed multiple imputation using chained equations22 and generated 15 imputed data sets. Huber-White robust SEs were calculated to account for clustering by school.23 Statistical significance was assessed at 2-sided P < .05. All analyses were conducted using RStudio, version 1.2.5042, and R, version 4.0.0 (R Program for Statistical Computing). Analyses were preformed from April 29, 2020, to April 8, 2021.
Among the 2263 students included in the analytic sample, the mean (SD) age at the prebaseline survey was 16.5 (0.4) years; 1250 students (55.2%) were girls and 1013 students (44.8%) were boys. The sample was racially and ethnically diverse; 444 students (19.6%) were Asian, 89 (3.9%) were Black, 1001 (44.2%) were Hispanic/Latinx, 375 (16.6%) were non-Hispanic/Latinx White, and 354 (15.6%) reported another race or ethnicity. Complete descriptive statistics are reported in Table 1.
Table 2 shows the proportion of students selecting each response option for the survey items assessing concern, worry, and stress about school violence or shootings. A considerable proportion of students reported being very or extremely concerned (850 of 2226 [38.2%]), worried (703 of 2209 [31.8%]), or stressed (332 of 2183 [15.2%]) about shootings or violence at their school or other schools. Girls were significantly more likely than boys to report higher levels of concern (very or extremely, 556 of 1231 [45.2%] vs 294 of 1309 [22.5%]), worry (very or extremely, 473 of 1228 [38.5%] vs of 230 of 981 [23.4%]), and stress (very or extremely, 240 of 1209 [19.9%] vs 92 of 974 [9.4%]), as well as higher mean (SD) composite scores (1.84 [1.27] vs 1.27 [1.20]; P < .001 for all). No significant differences were observed by race/ethnicity in concern, worry, stress, or composite scores.
At follow-up, the proportion of adolescents surpassing the borderline/clinically significant threshold was 350 of 2204 (15.9%) for major depressive disorder, 273 of 2205 (12.4%) for generalized anxiety disorder, and 302 of 2202 (13.7%) for panic disorder. eTable 2 in the Supplement shows the proportions of adolescents surpassing the borderline/clinically significant thresholds for each internalizing problem at follow-up, stratified by their status at the prebaseline wave.
Association of Concerns About School Violence or Shootings With Internalizing Problems
In unadjusted analyses, concern about school violence or shootings at baseline was associated with surpassing the borderline/clinically significant threshold for each internalizing problem (OR for major depressive disorder, 1.19 [95% CI, 1.06-1.33]; OR for generalized anxiety disorder, 1.48 [95% CI, 1.34-1.65]; OR for panic disorder 1.20 [95% CI, 1.08-1.33]). These ORs indicated that each 1-SD unit increase in level of concern about shootings was associated with 19% greater odds of surpassing the symptom level clinical/borderline threshold for major depressive disorder, 48% for generalized anxiety disorder, and 20% for panic disorder. In adjusted analyses, which included adjustment for various mental health problems such as internalizing symptoms, concern about school violence or shootings was associated with surpassing the borderline/clinically significant threshold for generalized anxiety disorder (OR, 1.31; 95% CI, 1.15-1.50) and panic disorder (OR, 1.18; 95% CI, 1.05-1.32), but not major depressive disorder (OR, 1.13; 95% CI, 0.99-1.30). Complete results, including covariate estimates, are shown in Table 3.
Moderation by Sex and Race/Ethnicity
Interaction terms for sex were not significant for any of the internalizing problem outcomes (major depressive disorder, P = .93; generalized anxiety disorder, P = .055; panic disorder, P = .27). Interaction terms for race and ethnicity were significant for major depressive disorder (P < .001) and panic disorder (P < .001), but not generalized anxiety disorder (P = .81). Concern about school violence or shootings was associated with major depressive disorder among Black youth (OR, 3.15; 95% CI, 1.38-7.19) and non-Hispanic/Latinx White youth (OR, 1.62; 95% CI, 1.25-2.09) but not among youth of other races and ethnicities (OR for Asian, 1.26 [95% CI, 0.86-1.85]; OR for Hispanic/Latinx, 0.94 [95% CI, 0.76-1.16]; OR for other, 0.93 [95% CI, 0.54-1.61]). There was an association between concern about school violence or shootings and panic disorder among non-Hispanic/Latinx White youth (OR, 1.78; 95% CI, 1.13-2.78) youth but not among youth of other races and ethnicities. Odds ratios and 95% CIs for surpassing the borderline/clinically significant threshold for major depressive disorder, generalized anxiety disorder, or panic disorder, stratified by sex or race and ethnicity, are shown in Figure 1 and Figure 2, respectively. The sensitivity analyses produced results that were broadly consistent with the main analyses (eMethods and eTables 3 to 5 in the Supplement).
In this prospective study, we found that approximately one-third of adolescents in our sample reported feeling very or extremely concerned, worried, and stressed about shootings and violence at their own school or other schools in 2016. Higher levels of concern about school violence or shootings were associated with heightened odds of meeting borderline/clinical criteria for generalized anxiety disorder and panic disorder 6 months later, even after adjusting for previous level of internalizing problems and 10 additional demographic and externalizing covariates. The strength of some of these associations varied by race and ethnicity; among Black adolescents, the magnitude of the association between concern about school violence or shootings with subsequent major depressive disorder was particularly high compared with the association for adolescents of other races and ethnicities. Against a backdrop of an increase in the prevalence of internalizing problems in US youth1-3 and concerns over racial and ethnic disparities in youth mental health,24 these findings warrant public health attention.
Numerous prior studies have found that exposure to violence in school settings (both direct involvement and witnessing), as well as perceptions of safety at school, are associated with adverse mental health outcomes.16,25-29 Our study connects to emerging literature highlighting vicarious effects of school-based violence in that we did not study exposure to violence directly, but rather a concern about violence or shootings both at students’ own schools and at other schools as an overarching societal problem and possible widespread threat. In addition, our results suggest that these concerns could represent a new possible explanation for upward trends in the prevalence of internalizing problems among adolescents, adding to a mounting list of potential causes that includes environmental concerns, digital media use, declining sleep duration, and increasing wealth inequality, among others.2,3,7 Together these factors reflect a constellation of social, political, economic, and environmental concerns that may contribute to a perception of “social fracture” among youth.6
Unlike other studies,10,15 we found no evidence that racial and ethnic groups differed in likelihood of reporting concern about school violence or shootings. However, we did observe a stronger association between these concerns and major depressive disorder among Black students, compared with other students, raising the possibility that concerns with this violence may be a particularly potent risk factor for major depressive disorder among Black youth specifically. Our measure of concern about school violence or shootings did not ask specifically about the source of this violence; for Black youth, the sources of violence in school settings may be more varied than for other youth, including school resource officer programs that place police in schools.30 Other scholars have written about how “anticipatory trauma” is a racialized experience that may result in hypervigilant behavior and symptoms of chronic stress, which are common antecedents of internalizing problems.31,32 In addition, given the modestly stronger association between concerns about school violence or shootings and panic disorder among non-Hispanic/Latinx White students, an alternative explanation is that youth of different races and ethnicities express internalizing problems through different phenotypes in response to these concerns.
The high proportion of adolescents who reported concern about school violence or shootings may warrant population-based intervention strategies. Tiered, school-based services can provide universal mental health promotion programs to all students, as well as targeted interventions and counseling for students with increased perceived need.33 A recent systematic review34 suggests, however, that more research is needed on the adaptation of these programs to best meet the needs of students of color. Upstream approaches may also be successful in simultaneously addressing gun violence, perceptions of safety, and internalizing problems. Although more research is needed on long-term efficacy, interventions that include social-emotional learning components and prevent earlier, more minor instances of violence seem especially promising.28,35 Finally, beyond the school setting, policies that directly address gun violence (eg, child access prevention laws)28 or increase access to mental health services may also be helpful for promoting well-being among youth.
This study has some limitations. The scale measuring concern about school violence or shootings has not been psychometrically validated; however, the items had high internal reliability in this sample. In a related vein, our scale measured concern about shootings and violence at the students’ school and other schools together using a single item stem, and it was not possible to disentangle concerns related to violence vs shootings in particular and at a student’s own vs other schools. The extent to which these results with a regional urban/suburban sample generalize to adolescents across other regions is unknown. We assessed internalizing problems with a self-report inventory of depressive and anxiety symptoms instead of a diagnostic interview. Data collection for this study occurred from the fall of 2015 to fall of 2016, and it is likely that the nature of concerns about school violence has changed since this period, especially given the high school shootings in 2018 in Parkland, Florida, and Santa Fe, Texas, both of which were highly publicized and motivated protests across the country. We included a wide variety of confounders, but other variables of interest, such as neighborhood-level exposure to violence and mental health treatment, were not assessed, and thus residual or unmeasured confounding remains a possibility. We observed some demographic differences between study participants and those not surveyed at baseline, lost to follow-up, or excluded due to missing data, which may affect the generalizability of the results.
In this longitudinal cohort study, concern about school violence or shootings was associated with anxiety and panic symptoms among adolescents, with variation by race and ethnicity. This study highlights the need for research on interventions that can foster perceptions of safety at schools, prevent downstream violent behaviors, and improve the mental health of youth.
Accepted for Publication: August 31, 2021.
Published: November 1, 2021. doi:10.1001/jamanetworkopen.2021.32131
Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2021 Riehm KE et al. JAMA Network Open.
Corresponding Author: Kira E. Riehm, MSc, Department of Mental Health, Bloomberg School of Public Health, The Johns Hopkins University, 624 N Broadway, Baltimore, MD 21205 (kriehm@jhu.edu).
Author Contributions: Ms Riehm had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Riehm, Mojtabai, Leventhal.
Acquisition, analysis, or interpretation of data: Riehm, Adams, Krueger, Mattingly, Nestadt, Leventhal.
Drafting of the manuscript: Riehm, Leventhal.
Critical revision of the manuscript for important intellectual content: All authors.
Statistical analysis: Riehm, Mojtabai, Leventhal.
Obtained funding: Leventhal.
Administrative, technical, or material support: Leventhal.
Supervision: Mojtabai, Adams, Nestadt.
Conflict of Interest Disclosures: Dr Krueger reported receiving grants from the University of Southern California during the conduct of the study. No other disclosures were reported.
Funding/Support: This study was supported by grants K24DA042950 and R01DA033296 from the National Institute for Drug Abuse; a Ruth L. Kirschstein National Research Service Award 1F31MH124330-01 from the National Institute of Mental Health (Ms Riehm); and a Doctoral Foreign Study Award from the Canadian Institutes of Health Research (Ms Riehm).
Role of the Funder/Sponsor: The sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
3.Twenge
JM, Cooper
AB, Joiner
TE, Duffy
ME, Binau
SG. Age, period, and cohort trends in mood disorder indicators and suicide-related outcomes in a nationally representative dataset, 2005-2017.
J Abnorm Psychol. 2019;128(3):185-199. doi:
10.1037/abn0000410
PubMedGoogle ScholarCrossref 4.Achenbach
TM, Ivanova
MY, Rescorla
LA, Turner
LV, Althoff
RR. Internalizing/externalizing problems: review and recommendations for clinical and research applications.
J Am Acad Child Adolesc Psychiatry. 2016;55(8):647-656. doi:
10.1016/j.jaac.2016.05.012
PubMedGoogle ScholarCrossref 15.Akiba
M. What predicts fear of school violence among US adolescents.
Teachers College Record. 2010;112(1):68-102.
Google Scholar 16.Flannery
DJ, Wester
KL, Singer
MI. Impact of exposure to violence in school on child and adolescent mental health and behavior.
J Commun Psychol. 2004;32(5):559-573. doi:
10.1002/jcop.20019
Google ScholarCrossref 18.Barkley
RA, Murphy
KR. Attention-Deficit Hyperactivity Disorder: A Clinical Workbook. Guilford Press; 2006.
20.Hinduja
S, Patchin
JW. Bullying Beyond the Schoolyard: Preventing and Responding to Cyberbullying. Corwin Press; 2014.
21.Goodman
E, Adler
NE, Kawachi
I, Frazier
AL, Huang
B, Colditz
GA. Adolescents’ perceptions of social status: development and evaluation of a new indicator.
Pediatrics. 2001;108(2):E31. doi:
10.1542/peds.108.2.e31
PubMedGoogle Scholar 23.Huber
PJ. The behavior of maximum likelihood estimates under nonstandard conditions. In: Le Cam LM, Neyman J, eds. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability. University of California Press; 1967:221-233.
31.Trent
M, Dooley
DG, Dougé
J; Section on Adolescent Health; Council on Community Pediatrics; Committee on Adolescence. The impact of racism on child and adolescent health.
Pediatrics. 2019;144(2):e20191765. doi:
10.1542/peds.2019-1765
PubMedGoogle Scholar 34.Brown
C, Maggin
DM, Buren
M. Systematic review of cultural adaptations of school-based social, emotional, and behavioral interventions for students of color.
Educ Treatment Child. 2018;41(4):431-456. doi:
10.1353/etc.2018.0024
Google ScholarCrossref