RCT indicates randomized clinical trial; TAU, treatment as usual.
Error bars indicate 95% CI. CBT indicates cognitive-behavioral therapy; TBI, traumatic brain injury. Because this figure breaks studies into finer categories than those in the overall moderator analyses, summary effect sizes may differ slightly.
eTable. Included Studies: Demographic and Descriptive Characteristics
Customize your JAMA Network experience by selecting one or more topics from the list below.
Asarnow JR, Rozenman M, Wiblin J, Zeltzer L. Integrated Medical-Behavioral Care Compared With Usual Primary Care for Child and Adolescent Behavioral HealthA Meta-analysis. JAMA Pediatr. 2015;169(10):929–937. doi:10.1001/jamapediatrics.2015.1141
Copyright 2015 American Medical Association. All Rights Reserved. Applicable FARS/DFARS Restrictions Apply to Government Use.
Recent health care legislation and shifting health care financing strategies are transforming health and behavioral health care in the United States and incentivizing integrated medical-behavioral health care as a strategy for improving access to high-quality care for behavioral health conditions, enhancing patient outcomes, and containing costs.
To conduct a systematic meta-analysis of randomized clinical trials to evaluate whether integrated medical-behavioral health care for children and adolescents leads to improved behavioral health outcomes compared with usual primary care.
Search of the PubMed, MEDLINE, PsycINFO, and Cochrane Library databases from January 1, 1960, through December 31, 2014, yielded 6792 studies, of which 31 studies with 35 intervention-control comparisons and 13 129 participants met the study eligibility criteria.
We included randomized clinical trials that evaluated integrated behavioral health and primary medical care in children and adolescents compared with usual care in primary care settings that met prespecified methodologic quality criteria.
Data Extraction and Synthesis
Two independent reviewers screened citations and extracted data, with raw data used when possible. Magnitude and direction of effect sizes were calculated.
Main Outcomes and Measures
Meta-analysis with a random effects model were conducted to examine an overall effect across all trials, and within intervention and prevention trials. Subsequent moderator analyses for intervention trials explored the relative effects of integrated care type on behavioral health outcomes.
Meta-analysis with a random-effects model indicated a significant advantage for integrated care interventions relative to usual care on behavioral health outcomes (d = 0.32; 95% CI, 0.21-0.44; P < .001). Moderator analyses indicated larger effects for treatment trials that targeted diagnoses and/or elevated symptoms (d = 0.42; 95% CI, 0.29-0.55; P < .001) relative to prevention trials (d = 0.07; 95% CI, −0.13 to 0.28; P = .49). The probability was 66% that a randomly selected youth would have a better outcome after receiving integrated medical-behavioral treatment than a randomly selected youth after receiving usual care. The strongest effects were seen for treatment interventions that targeted mental health problems and those that used collaborative care models.
Conclusions and Relevance
Our results, demonstrating the benefits of integrated medical-behavioral primary care for improving youth behavioral health outcomes, enhance confidence that the increased incentives for integrated health and behavioral health care in the US health care system will yield improvements in the health of children and adolescents.
Recent health care legislation and shifts in health care financing strategies are transforming medical and mental health care in the United States. Stimulated by statistics indicating that the United States ranks near the top on health care expenditures and the bottom among developed nations on indicators of health system access and quality,1 the federal Patient Protection and Affordable Care Act offers both expanded coverage for uninsured populations and disease prevention and incentivizes integrated behavioral health (a broad term referring to mental health and substance abuse) and primary medical care.2 The Patient Protection and Affordable Care Act identifies behavioral health treatment as an “essential health benefit,” promoting improved care coordination among practitioners, models such as health homes, and the use of multidisciplinary practitioner teams to address whole-person needs in an efficient and cost-effective manner.3 By providing increased insurance coverage for behavioral health, the Mental Health Parity and Addiction Equity Act (2008) further encourages innovation to enhance behavioral health.2,4
Effective behavioral health care is particularly critical for pediatric populations, with potentially large benefits over a lifetime. The leading causes of death in children and adolescents include unintentional injuries and suicide, both of which are all-too-frequent outcomes of risky behavior and behavioral health problems (eg, depression and substance use).4,5 Moreover, many health behaviors that contribute to morbidity and mortality are established in childhood and adolescence (eg, obesity, depression, anxiety, and substance use),2,4,6,7 underscoring the need for identification of and effective intervention for behavioral health to reduce current and long-term problems.
Because most US youth have access to primary care and see primary care practitioners (PCPs) annually,8 integrated primary medical-behavioral health care models have a strong potential for improving access to and rates of care for behavioral health problems.2,9,10 The term integrated care is used here to refer broadly to behavioral health care through primary care services.11,12 This definition includes a range of diverse models aimed at unifying behavioral health and primary care,11 such as integrating behavioral health expertise into primary care settings using consultation, web-based, telephone, and/or other resources; colocating behavioral health care in primary care clinics; and team-based collaborative care models.12,13 There is strong evidence that supports the effectiveness of integrated primary medical and behavioral health care for adults, particularly for collaborative care models that emphasize behavioral health practitioners and PCPs working together to improve health and behavioral health.13-16 This issue, however, has only begun to be explored in children and adolescents. To our knowledge, no systematic review has been conducted on the effectiveness of integrating behavioral health into primary care for youth populations.
We conducted a systematic review and meta-analysis of the literature to address the empirical question, “Does integrated behavioral health and primary medical care for children and adolescents lead to improved behavioral health outcomes compared with usual care?” Given the current emphasis on population health and increasing incentives for integrated care models, this question has major policy, clinical, and practical implications. Aims of this article are to (1) report findings of a meta-analysis of randomized clinical trials (RCTs) comparing integrated care models for pediatric populations and usual care and (2) explore candidate moderator variables. Moderators examined included the following: youth age (1-21 years, defining adolescence broadly, which is consistent with many adolescent and pediatric programs and National Institutes of Health guidelines17,18), treatment of behavioral health problems vs prevention in general pediatric populations, mental health or substance use treatment, and whether the intervention used a collaborative care model or other less integrated care provision model. We predicted larger effects for treatment rather than prevention trials because prevention effects are typically more difficult to detect and for collaborative care interventions based on findings with adults.14-16
The roots of many mental health, substance use, and behavioral problems that contribute to morbidity and premature death develop during childhood and adolescence.
Results of this systematic meta-analysis of existing randomized clinical trials indicate that integrating care for mental health problems into primary medical care for children and adolescents leads to significant improvements in child and adolescent mental health.
There were larger effects for treatment trials focused on diagnoses and/or elevated symptoms compared with prevention trials and for trials using collaborative care models.
Results enhance confidence that current policies encouraging integrated medical-behavioral health care in the United States will yield improvements in the health and well-being of children and adolescents.
We aimed to include all RCTs that evaluated integrated behavioral health and primary care medical treatment for youth. Inclusion criteria were as follows: (1) evaluation of integrated care for behavioral health conditions relative to usual care (defined as primary care treatment as usual) or a comparator modeled after usual care (eg, referral to specialty services), allowing for some enhancements (eg, PCP education, screening feedback, recommendations for treatment, access to written or Internet materials, and medication treatment as usual); (2) collection of one or more behavioral health outcome measures; (3) recruitment through primary care; and (4) targeting of children and adolescents, defining adolescence broadly (through the age of 21 years), which is consistent with many adolescent and pediatric programs and National Institutes of Health guidelines.17,18 Exclusion criteria were as follows: (1) study that targeted a chronic medical condition (eg, cancer and diabetes mellitus)19 and (2) study did not meet prespecified methodologic quality standards, as indexed by a score less than 2 on the Jadad Scale for Reporting Clinical Trials.20,21
We searched MEDLINE, PsycINFO, PubMed, and the Cochrane Central Register of Controlled Trials for data sources (January 1, 1960, through December 31, 2014). Keywords included primary care, integrated care, collaborative care, and colocated care and were searched in combination with the keywords child/children, adolescent/adolescence, youth/youths, pediatric, randomized controlled trial, intervention, prevention, and treatment. We reviewed reference lists, articles that cited included studies, and review articles to identify studies that may have been missed in database searches. The search was limited by study type (RCT) comparing integrated primary medical-behavioral health care with usual care or comparisons that approximated usual care, publication in English, publication in peer-reviewed journals, and age (1-21 years).
Titles and abstracts of all identified articles were independently reviewed by 1 author (M.R.) and 1 of 2 trained reviewers (including J.W.), with a final assessment by 2 reviewers (J.R.A. and M.R.). This review eliminated duplicates, review articles, target participants older than 21 years, studies not involving primary care, and non-RCTs. Two authors (J.A. and M.R.) reviewed full texts of all remaining articles, with excellent interrater agreement (98.5%) on inclusion and exclusion; differences or concerns about inclusion were resolved through consensus with both authors. One study22 was excluded for containing 2 active evidence-informed interventions and no usual care. Two others23,24 were excluded because substantial subgroups of participants were recruited from settings other than primary care. Two studies25,26 were excluded for a quasi-experimental design and another27 for a Jadad score less than 2 (Figure 1). When study characteristics and/or data were not sufficiently reported, study investigators were contacted to obtain this information.
Data were extracted and coded for study, sample, and treatment characteristics as follows: age, sex, ethnicity, integrated care model, targeted diagnoses and problems, and methodologic rigor. Interventions were coded as treatment (youths were selected for a behavioral health diagnosis, parent-identified problem, and/or elevated symptoms) or prevention (universal intervention, screened for no or minimal substance use, or screened for elevated symptoms with exclusion for diagnosis and high symptoms) and collaborative care (team of behavioral health care professionals and PCPs worked collaboratively in fully or partly integrated system) vs other intervention models (eg, consultation and colocated care). Targeted behavioral health problems were coded as mental health or substance use, with mental health problems further categorized as emotional and internalizing problems (eg, depression and anxiety) or behavioral and externalizing problems (eg, conduct, attention, and hyperactivity).
Methodologic rigor was coded using 2 indicators: the Jadad score, a commonly used indicator of bias risk based on elements that correlate with bias,28 and allocation concealment, which is whether the study explicitly described procedures for protecting knowledge of randomization and treatment allocation at enrollment.29,30 Jadad scores (range, 0-5) are calculated by summing ratings of the adequacy of (1) randomization, (2) blinding, and (3) accounting for all participants, including withdrawals and dropouts. Total scores of 3 or greater are considered indicators of good methodologic quality. Allocation concealment was rated on a 3-point scale, with 1 indicating adequate (eg, computer-generated masked algorithm and opaque sealed envelopes); 2, unclear (ie, study authors did not clearly specify); and 3, inadequate (eg, open random number tables). Two authors (J.R.A. and M.R.) independently coded each study. Interrater agreement for study codes was excellent (range, 97%-100%); intraclass correlation coefficient for Jadad ratings was 0.990 (95% CI, 0.988-0.997). Disagreements were resolved through querying study authors when needed and consensus ratings by both raters.
We used the primary outcome identified in each study when stated. A mean effect size was calculated for studies with more than one designated primary outcome or when primary outcomes were not specified. When studies provided data for more than one posttreatment or follow-up time point, we used the specified primary acute treatment end point. When no end point was specified, we used the time point that immediately followed the end of treatment in the active intervention group. We calculated separate effect sizes for studies that targeted substance use and reported outcomes individually (eg, smoking vs alcohol or prevention vs cessation).
Data were analyzed using Comprehensive Meta-Analysis software, version 2.2.31 Effect sizes were indexed using Cohen d, the standardized mean difference between intervention and comparator conditions ([Intervention Group Mean − Comparator Group Mean]/Pooled SD). Whenever possible, effect size calculations were made with raw data. When data reported used frequencies, significance tests, or other effect size measures, data were transformed to d values. Because most studies did not provide correlations between baseline and posttreatment outcomes, a moderate to large association between baseline and posttreatment scores on outcomes (r = 0.50) was assumed.32,33 Five studies34-38 provided sufficient information to impute correlations between baseline and posttreatment outcomes (range, 0.40-0.66). Sensitivity analyses substituting r = 0.40, r = 0.60, and r = 0.66 yielded similar results with no change in conclusions. Heterogeneity across studies was examined with the forest plot and Q and I2 statistics. We chose a random-effects model given the heterogeneity of the included studies (eTable in the Supplement describes the individual studies).
An overall summary effect was calculated for all trials. Moderators39-41 were also explored. For categorical variables, we estimated models analogous to analysis of variance comparing mean effect sizes for intervention vs usual care grouped by study classification on the potential moderator (treatment vs prevention, mental health vs substance use treatment, collaborative care vs other intervention type, emotional vs behavior problems, and children vs adolescents). For continuous variables (age), we used method-of-moments meta-regression, an approach analogous to regression analysis but using calculated effect sizes for each study as outcomes and continuous moderators as predictors. Because moderator analyses were exploratory and included few studies in some subgroups, we used a full random-effects model (pooling τ within groups with random effects to combine subgroups). In addition, because one study34 provided some intervention in the control condition, sensitivity analyses were conducted excluding this study. Results were similar with no change in conclusions. Consequently, we include all studies in reported results.
Publication bias31 was examined with the funnel plot and Egger test for bias. The Duval and Tweedie trim-and-fill method was used to account for potential unpublished studies and provided an adjusted summary effect for interventions. The Rosenthal fail-safe N and the Orwin fail-safe N were used for sensitivity analyses.
Of the 6792 citations identified, 31 RCTs comparing interventions to usual care were included in the final analyses (Figure 1 and eTable in the Supplement).34-38,42-67 One trial57 separated effects for smoking abstinence and cessation groups; 3 other trials54,65,66 included 2 intervention groups against a single usual care, yielding 35 intervention vs usual care comparisons and effect size calculations based on 13 129 participants. Within-study sample sizes ranged from 28 to 3111. Youth age varied, including children and adolescents.
Twenty-five of the 35 intervention-usual care comparisons were classified as treatment: 20 treatments for mental health and 5 for substance use. Five treatment comparisons evaluated collaborative care interventions; the others evaluated a range of different models (ie, enhancing primary care resources through PCP training, consultation, and/or computer-assisted support tools; colocated care with minimal integration; bibliotherapy; telephone coaching; and motivational interviewing). Intervention duration varied in the length of intervention period and number of sessions (range, 1-16). The acute follow-up period ranged from 1 to 20 months. Seventeen treatment trials were conducted in the United States, 2 in Australia, and 4 in Europe (eTable in the Supplement lists the trial details).
All treatment trials used interventions with some empirical support. The 5 collaborative care trials all used evidence-based cognitive-behavioral therapy (CBT) for depression (n = 3)35,42,60 or behavior problems (n = 2)50,52 and evidence-based medication algorithms. Among the other 18 treatment trials, evidence-based approaches included parenting (n = 8),36,44,54,56,58,59,61,63 interpersonal psychotherapy for depression (n = 1),38 CBT for anxiety or somatic concerns (n = 1),37 CBT for behavior problems plus support for PCP medication management (n = 1),51 and PCP communication training (n = 1).67 Two other trials evaluated psychiatric consultation to support PCP-provided medication treatment for attention-deficit/hyperactivity disorder.47,53 All 4 substance use treatment trials used motivational interviewing. One included PCP counseling with telephone follow-up by a peer counselor,57 and the others involved brief interventions provided by others43,46,65; 3 had telephone follow-up,43,46,57 and 1 had a computer-delivered component.65
Ten comparisons (from 9 trials) evaluated prevention effects (1 trial57 examined both prevention and treatment). Three prevention comparisons targeted mental health outcomes: 2 evaluated depression-prevention CBT,34,48 1 used Internet-provided CBT after brief PCP-provided motivational interviewing,34 and 1 examined a parenting intervention for preventing behavior problems.49 The other 6 trials (7 comparisons) targeted substance use through motivational interviewing and/or counseling.45,55,57,62,64,66
Across trials, control conditions varied in intensity and length, ranging from usual care without enhancements to enhanced usual care with referral to specialty services, brief advice from PCPs, and educational materials. Methodologic rigor varied across studies: a Jadad score of 3 or higher for 25 studies, Jadad score of 2 for 6 studies, and evidence of some allocation concealment for all studies.
The overall summary effect comparing all interventions vs usual care resulted in a small and statistically significant effect (d = 0.32; 95% CI, 0.21-0.44; P < .001). The forest plot and Q and I2 statistics indicated significant heterogeneity (Q = 152.64, P < .001, I2 = 77.73%), with the effect size for individual studies ranging from a d of −0.1866 to 2.76.37 See Figure 2 for a summary of individual study effects and summary effects for categories of studies.
The Table details the analyses exploring candidate categorical moderators. Trial type was a statistically significant moderator of treatment outcome (Qb = 7.93, P = .005; Table). Treatment trials had a small to medium statistically significant effect (d = 0.42; 95% CI, 0.29-0.55; P < .001), whereas the effect for prevention trials was weak and not statistically significant (d = 0.07; 95% CI, −0.13 to 0.28; P = .49). The forest plot and Q and I2 statistics indicated significant heterogeneity among effect sizes across treatment trials (Qw = 119.12, I2 = 79.85%, P < .001). Prevention trials exhibited less heterogeneity (Qw = 7.53, I2 = 0%, P = .59). Indeed, only one of the prevention trials57 had a small and statistically significant effect. Therefore, subsequent analyses examined moderators for treatment trials only.
Integrated care model (collaborative care vs other) was not a statistically significant moderator (Qb = 1.37, P = .24; Table). Collaborative care yielded a medium and statistically significant effect (d = 0.63, P < .001); other care models yielded a small and statistically significant effect (d = 0.40, P < .001). Qw and I2 statistics indicated significant heterogeneity within both collaborative care (Qw = 19.02, I2 = 78.97%, P < .001) and other trials (Qw = 95.34, I2 = 80.07%, P < .001).
Type of behavioral health problem targeted was not statistically significant as a moderator (Qb = 2.94, P = .09, I2 = 74.34%; Table). Treatments that targeted substance use had a weak effect (d = 0.17, P = .35) (Figure 2). Alternatively, treatments that targeted mental health problems had a medium statistically significant effect (d = 0.51, P < .001). There were statistically significant effects for treatment studies that targeted emotional (depression and anxiety: d = 0.71, P < .001) and behavioral (disruptive behavior and/or attention-deficit/hyperactivity disorder: d = 0.51, P < .001) problems; these effects did not differ significantly (Qb = 0.62, P = .43, I2 = 79.85%). One study67 that targeted both emotional and behavior problems was excluded from these subgroup analyses.
Age was not a significant continuous (QM = 0.003, P = .96) or categorical moderator (children ≤12 years old vs adolescents ≥13 years old, Qb = 0.65, P = .42, I2 = 79.20%). Two studies were excluded from categorical37,67 and continuous43,56 moderator analyses because of missing data.
Methodologic rigor indexed by the Jadad score (QM = 1.12, P = .29, I2 = 73.01%) and allocation concealment (QM = 0.01, P = .95, I2 = 79.22%) were not statistically significant moderators.
Publication bias, or effects associated with a greater likelihood of publication with significant outcomes, was examined for treatment trials. Visual inspection of the funnel plot and Egger test suggested that publication bias was significant (t = 3.34, P = .003). The Duval and Tweedie trim-and-fill method suggested that 3 studies were likely missing that would increase the effect (from d = 0.32 to imputed estimate of 0.39). The Rosenthal fail-safe N suggested that 803 studies with null findings would reduce the overall-effect P value to become nonsignificant. The Orwin fail-safe N suggested that 18 null studies would reduce the effect of d to less than 0.20. We did not examine publication bias for prevention trials because the summary effect was not statistically significant.
This meta-analysis provides the first cross-study demonstration, to our knowledge, of the value of integrating behavioral health care within primary medical care for children and adolescents. Analyses across studies indicated a small and significant effect. Effects for treatment trials were stronger than those for prevention trials: the effect size for treatment trials fell in the small to medium range (d = 0.42), with a 66% probability that a randomly selected youth would experience better outcomes after receiving an integrated behavioral health intervention than a randomly selected youth receiving usual care.68,69 Benefits of integrated medical-behavioral treatment were observed for interventions that target diverse mental health problems (depression, anxiety, and behavior). Although there was variability in effects across studies, these overall results enhance confidence that integrated medical-behavioral primary health care will lead to improved youth outcomes. Results were weaker and not statistically significant for substance use treatment trials, with only one large trial (N = 2709) indicating a significant effect.57 This trial included a practice-based intervention using the 5 A’s model (ask, advise, assess, assist, arrange) recommended by the US Public Health Service clinical practice guideline and the American Academy of Pediatrics70,71 that was provided by pediatric clinicians and followed by 1 visit and 4 telephone calls by older (18- to 21-year-old) peer counselors.
The summary effect for prevention trials was weak and not statistically significant. Only the prevention arm of the substance use intervention described above yielded a small significant effect,57 underscoring the need for large samples and sufficient statistical power to detect prevention effects. Of note, some prevention trials revealed significant effects on key intermediate outcomes,34,48,49 such as improved parenting. Over time, such outcomes might affect behavioral health outcomes. Adequately powered prevention trials with longer follow-up might clarify potential preventive effects of integrated medical-behavioral care.
As predicted, our results indicate the strongest effects for collaborative care interventions, with a mean d = 0.63, reflecting a 73% probability that a randomly selected youth would experience better outcomes after receiving collaborative care than a randomly selected youth receiving usual care.68,69 Collaborative care programs provide team-based care in which PCPs, care managers, and mental health specialists work together to evaluate, treat, and monitor patient progress. Although a meta-analysis14 of more than 79 RCTS, including 24 308 patients, supports the clinical effectiveness of collaborative care for adult depression and anxiety relative to usual care, the current meta-analysis is the first to extend these findings to youth and highlights the applicability and benefits of collaborative care across the developmental spectrum. These findings are likely to enhance implementation feasibility because similar approaches with developmental adaptation can be applied across age groups.
Overall, collaborative care had strong effects, with trials including evidence-based medication algorithms plus evidence-based psychotherapy. The other mental health treatment trials with significant individual effects used interventions with empirical support, such as Triple P,61,63 Incredible Years,54,58 interpersonal psychotherapy,38 guideline medication protocols,53 and CBT for anxiety and somatic concerns.37 This is a critical issue because integrating ineffective care may lead to minimal or no improvements in patient outcomes, and there is a need to both change organizational systems to support medical-behavioral health integration and improve care quality by integrating treatments with demonstrated efficacy and effectiveness and monitoring patient outcomes through registries, clinical dashboards, and/or other quality improvement strategies.
A limitation of this meta-analysis is the relatively small number of studies in pediatric samples that met methodologic standards for inclusion, highlighting a need for additional research to guide practice. Interventions were diverse, as were comparator usual care conditions. Effect sizes varied substantially across studies from nonsignificant to substantial and significant (d = 2.76).37 Several factors likely contributed to variation in effects, including statistical power; intervention type, quality, and dose (substance use interventions were generally briefer than mental health interventions); and strength of usual care comparators (eTable in the Supplement). Statistical power was weak for moderator analyses because of the small number of RCTs integrating behavioral health into primary care. The meta-analysis results differed from some individual study reports because of differences in analytic approach (eg, meta-analysis weighted by sample sizes and pooled SDs, with no covariate adjustments). Moderator analyses depended on our category definitions, underscoring the need to review primary study articles for more detailed information.
Given the current transformation in the US health care system and increased incentives for integrated medical-behavioral health care, these data documenting the benefits of integrated care enhance confidence that we are on a course that will yield improvements in the lives of youth and families. These data also underscore the critical need to strengthen our research base, learn from the real-world experiments happening within our medical and behavioral health care systems, and achieve the triple aims of health care reform: to improve care and patient experience and outcomes of care while reducing per capita costs.
Accepted for Publication: April 16, 2015.
Corresponding Author: Joan Rosenbaum Asarnow, PhD, Semel Institute for Neuroscience and Human Behavior, Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, 300 Medical Plaza, Ste 3310, Los Angeles, CA 90095 (email@example.com).
Published Online: August 10, 2015. doi:10.1001/jamapediatrics.2015.1141.
Author Contributions: Drs Asarnow and Rozenman had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Study concept and design: Asarnow, Rozenman.
Acquisition, analysis, or interpretation of data: All authors.
Drafting of the manuscript: Asarnow, Rozenman, Zeltzer.
Critical revision of the manuscript for important intellectual content: Asarnow, Rozenman, Wiblin.
Statistical analysis: Rozenman.
Obtained funding: Asarnow.
Administrative, technical, or material support: Asarnow, Rozenman, Wiblin.
Study supervision: Asarnow.
Conflict of Interest Disclosures: Dr Asarnow reported receiving grant funding from the National Institute of Mental Health, American Foundation for Suicide Prevention, the American Psychological Association (APA) Committee on Division/APA Relations, and the Society of Clinical Child & Adolescent Psychology (Division 53 of the APA) and consulting on quality improvement interventions for depression and suicidal/self-harm behavior. Dr Rozenman reported receiving grant funding from the National Institute of Mental Health, the International Obsessive Compulsive Disorder Foundation, and the Society of Clinical Child & Adolescent Psychology (Division 53 of the APA). No other disclosures were reported.
Funding/Support: This work was partially supported by grant MH078596 from the National Institute of Mental Health and funds from the Society for Clinical Child and Adolescent Psychology (Division 53 of the APA).
Role of the Funder/Sponsor: The funding sources had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and the decision to submit the manuscript for publication.
Previous Presentation: Portions of this work were presented at the 2014 Annual Meeting of the APA; August 9, 2014; Washington, DC; the 2015 Annual Meeting of the Society for Adolescent Health and Medicine; March 19, 2015; Los Angeles, California; and an Institute of Medicine workshop, “Opportunities to Promote Children’s Behavioral Health: Health Care Reform and Beyond”; April 2, 2015; Washington, DC.
Additional Contributions: Catherine Sugar, PhD, provided statistical consultation; Brooke Rowland, JD, helped with the literature search and data entry and management; and anonymous reviewers provided helpful comments that strengthened this article.