Importance
Recent health care legislation and shifting health care financing strategies are transforming health and behavioral health care in the United States and incentivizing integrated medical-behavioral health care as a strategy for improving access to high-quality care for behavioral health conditions, enhancing patient outcomes, and containing costs.
Objective
To conduct a systematic meta-analysis of randomized clinical trials to evaluate whether integrated medical-behavioral health care for children and adolescents leads to improved behavioral health outcomes compared with usual primary care.
Data Sources
Search of the PubMed, MEDLINE, PsycINFO, and Cochrane Library databases from January 1, 1960, through December 31, 2014, yielded 6792 studies, of which 31 studies with 35 intervention-control comparisons and 13 129 participants met the study eligibility criteria.
Study Selection
We included randomized clinical trials that evaluated integrated behavioral health and primary medical care in children and adolescents compared with usual care in primary care settings that met prespecified methodologic quality criteria.
Data Extraction and Synthesis
Two independent reviewers screened citations and extracted data, with raw data used when possible. Magnitude and direction of effect sizes were calculated.
Main Outcomes and Measures
Meta-analysis with a random effects model were conducted to examine an overall effect across all trials, and within intervention and prevention trials. Subsequent moderator analyses for intervention trials explored the relative effects of integrated care type on behavioral health outcomes.
Results
Meta-analysis with a random-effects model indicated a significant advantage for integrated care interventions relative to usual care on behavioral health outcomes (d = 0.32; 95% CI, 0.21-0.44; P < .001). Moderator analyses indicated larger effects for treatment trials that targeted diagnoses and/or elevated symptoms (d = 0.42; 95% CI, 0.29-0.55; P < .001) relative to prevention trials (d = 0.07; 95% CI, −0.13 to 0.28; P = .49). The probability was 66% that a randomly selected youth would have a better outcome after receiving integrated medical-behavioral treatment than a randomly selected youth after receiving usual care. The strongest effects were seen for treatment interventions that targeted mental health problems and those that used collaborative care models.
Conclusions and Relevance
Our results, demonstrating the benefits of integrated medical-behavioral primary care for improving youth behavioral health outcomes, enhance confidence that the increased incentives for integrated health and behavioral health care in the US health care system will yield improvements in the health of children and adolescents.
Recent health care legislation and shifts in health care financing strategies are transforming medical and mental health care in the United States. Stimulated by statistics indicating that the United States ranks near the top on health care expenditures and the bottom among developed nations on indicators of health system access and quality,1 the federal Patient Protection and Affordable Care Act offers both expanded coverage for uninsured populations and disease prevention and incentivizes integrated behavioral health (a broad term referring to mental health and substance abuse) and primary medical care.2 The Patient Protection and Affordable Care Act identifies behavioral health treatment as an “essential health benefit,” promoting improved care coordination among practitioners, models such as health homes, and the use of multidisciplinary practitioner teams to address whole-person needs in an efficient and cost-effective manner.3 By providing increased insurance coverage for behavioral health, the Mental Health Parity and Addiction Equity Act (2008) further encourages innovation to enhance behavioral health.2,4
Effective behavioral health care is particularly critical for pediatric populations, with potentially large benefits over a lifetime. The leading causes of death in children and adolescents include unintentional injuries and suicide, both of which are all-too-frequent outcomes of risky behavior and behavioral health problems (eg, depression and substance use).4,5 Moreover, many health behaviors that contribute to morbidity and mortality are established in childhood and adolescence (eg, obesity, depression, anxiety, and substance use),2,4,6,7 underscoring the need for identification of and effective intervention for behavioral health to reduce current and long-term problems.
Because most US youth have access to primary care and see primary care practitioners (PCPs) annually,8 integrated primary medical-behavioral health care models have a strong potential for improving access to and rates of care for behavioral health problems.2,9,10 The term integrated care is used here to refer broadly to behavioral health care through primary care services.11,12 This definition includes a range of diverse models aimed at unifying behavioral health and primary care,11 such as integrating behavioral health expertise into primary care settings using consultation, web-based, telephone, and/or other resources; colocating behavioral health care in primary care clinics; and team-based collaborative care models.12,13 There is strong evidence that supports the effectiveness of integrated primary medical and behavioral health care for adults, particularly for collaborative care models that emphasize behavioral health practitioners and PCPs working together to improve health and behavioral health.13-16 This issue, however, has only begun to be explored in children and adolescents. To our knowledge, no systematic review has been conducted on the effectiveness of integrating behavioral health into primary care for youth populations.
We conducted a systematic review and meta-analysis of the literature to address the empirical question, “Does integrated behavioral health and primary medical care for children and adolescents lead to improved behavioral health outcomes compared with usual care?” Given the current emphasis on population health and increasing incentives for integrated care models, this question has major policy, clinical, and practical implications. Aims of this article are to (1) report findings of a meta-analysis of randomized clinical trials (RCTs) comparing integrated care models for pediatric populations and usual care and (2) explore candidate moderator variables. Moderators examined included the following: youth age (1-21 years, defining adolescence broadly, which is consistent with many adolescent and pediatric programs and National Institutes of Health guidelines17,18), treatment of behavioral health problems vs prevention in general pediatric populations, mental health or substance use treatment, and whether the intervention used a collaborative care model or other less integrated care provision model. We predicted larger effects for treatment rather than prevention trials because prevention effects are typically more difficult to detect and for collaborative care interventions based on findings with adults.14-16
Box Section Ref IDAt a Glance
The roots of many mental health, substance use, and behavioral problems that contribute to morbidity and premature death develop during childhood and adolescence.
Results of this systematic meta-analysis of existing randomized clinical trials indicate that integrating care for mental health problems into primary medical care for children and adolescents leads to significant improvements in child and adolescent mental health.
There were larger effects for treatment trials focused on diagnoses and/or elevated symptoms compared with prevention trials and for trials using collaborative care models.
Results enhance confidence that current policies encouraging integrated medical-behavioral health care in the United States will yield improvements in the health and well-being of children and adolescents.
We aimed to include all RCTs that evaluated integrated behavioral health and primary care medical treatment for youth. Inclusion criteria were as follows: (1) evaluation of integrated care for behavioral health conditions relative to usual care (defined as primary care treatment as usual) or a comparator modeled after usual care (eg, referral to specialty services), allowing for some enhancements (eg, PCP education, screening feedback, recommendations for treatment, access to written or Internet materials, and medication treatment as usual); (2) collection of one or more behavioral health outcome measures; (3) recruitment through primary care; and (4) targeting of children and adolescents, defining adolescence broadly (through the age of 21 years), which is consistent with many adolescent and pediatric programs and National Institutes of Health guidelines.17,18 Exclusion criteria were as follows: (1) study that targeted a chronic medical condition (eg, cancer and diabetes mellitus)19 and (2) study did not meet prespecified methodologic quality standards, as indexed by a score less than 2 on the Jadad Scale for Reporting Clinical Trials.20,21
We searched MEDLINE, PsycINFO, PubMed, and the Cochrane Central Register of Controlled Trials for data sources (January 1, 1960, through December 31, 2014). Keywords included primary care, integrated care, collaborative care, and colocated care and were searched in combination with the keywords child/children, adolescent/adolescence, youth/youths, pediatric, randomized controlled trial, intervention, prevention, and treatment. We reviewed reference lists, articles that cited included studies, and review articles to identify studies that may have been missed in database searches. The search was limited by study type (RCT) comparing integrated primary medical-behavioral health care with usual care or comparisons that approximated usual care, publication in English, publication in peer-reviewed journals, and age (1-21 years).
Titles and abstracts of all identified articles were independently reviewed by 1 author (M.R.) and 1 of 2 trained reviewers (including J.W.), with a final assessment by 2 reviewers (J.R.A. and M.R.). This review eliminated duplicates, review articles, target participants older than 21 years, studies not involving primary care, and non-RCTs. Two authors (J.A. and M.R.) reviewed full texts of all remaining articles, with excellent interrater agreement (98.5%) on inclusion and exclusion; differences or concerns about inclusion were resolved through consensus with both authors. One study22 was excluded for containing 2 active evidence-informed interventions and no usual care. Two others23,24 were excluded because substantial subgroups of participants were recruited from settings other than primary care. Two studies25,26 were excluded for a quasi-experimental design and another27 for a Jadad score less than 2 (Figure 1). When study characteristics and/or data were not sufficiently reported, study investigators were contacted to obtain this information.
Data Extraction and Management
Data were extracted and coded for study, sample, and treatment characteristics as follows: age, sex, ethnicity, integrated care model, targeted diagnoses and problems, and methodologic rigor. Interventions were coded as treatment (youths were selected for a behavioral health diagnosis, parent-identified problem, and/or elevated symptoms) or prevention (universal intervention, screened for no or minimal substance use, or screened for elevated symptoms with exclusion for diagnosis and high symptoms) and collaborative care (team of behavioral health care professionals and PCPs worked collaboratively in fully or partly integrated system) vs other intervention models (eg, consultation and colocated care). Targeted behavioral health problems were coded as mental health or substance use, with mental health problems further categorized as emotional and internalizing problems (eg, depression and anxiety) or behavioral and externalizing problems (eg, conduct, attention, and hyperactivity).
Methodologic rigor was coded using 2 indicators: the Jadad score, a commonly used indicator of bias risk based on elements that correlate with bias,28 and allocation concealment, which is whether the study explicitly described procedures for protecting knowledge of randomization and treatment allocation at enrollment.29,30 Jadad scores (range, 0-5) are calculated by summing ratings of the adequacy of (1) randomization, (2) blinding, and (3) accounting for all participants, including withdrawals and dropouts. Total scores of 3 or greater are considered indicators of good methodologic quality. Allocation concealment was rated on a 3-point scale, with 1 indicating adequate (eg, computer-generated masked algorithm and opaque sealed envelopes); 2, unclear (ie, study authors did not clearly specify); and 3, inadequate (eg, open random number tables). Two authors (J.R.A. and M.R.) independently coded each study. Interrater agreement for study codes was excellent (range, 97%-100%); intraclass correlation coefficient for Jadad ratings was 0.990 (95% CI, 0.988-0.997). Disagreements were resolved through querying study authors when needed and consensus ratings by both raters.
We used the primary outcome identified in each study when stated. A mean effect size was calculated for studies with more than one designated primary outcome or when primary outcomes were not specified. When studies provided data for more than one posttreatment or follow-up time point, we used the specified primary acute treatment end point. When no end point was specified, we used the time point that immediately followed the end of treatment in the active intervention group. We calculated separate effect sizes for studies that targeted substance use and reported outcomes individually (eg, smoking vs alcohol or prevention vs cessation).
Data were analyzed using Comprehensive Meta-Analysis software, version 2.2.31 Effect sizes were indexed using Cohen d, the standardized mean difference between intervention and comparator conditions ([Intervention Group Mean − Comparator Group Mean]/Pooled SD). Whenever possible, effect size calculations were made with raw data. When data reported used frequencies, significance tests, or other effect size measures, data were transformed to d values. Because most studies did not provide correlations between baseline and posttreatment outcomes, a moderate to large association between baseline and posttreatment scores on outcomes (r = 0.50) was assumed.32,33 Five studies34-38 provided sufficient information to impute correlations between baseline and posttreatment outcomes (range, 0.40-0.66). Sensitivity analyses substituting r = 0.40, r = 0.60, and r = 0.66 yielded similar results with no change in conclusions. Heterogeneity across studies was examined with the forest plot and Q and I2 statistics. We chose a random-effects model given the heterogeneity of the included studies (eTable in the Supplement describes the individual studies).
An overall summary effect was calculated for all trials. Moderators39-41 were also explored. For categorical variables, we estimated models analogous to analysis of variance comparing mean effect sizes for intervention vs usual care grouped by study classification on the potential moderator (treatment vs prevention, mental health vs substance use treatment, collaborative care vs other intervention type, emotional vs behavior problems, and children vs adolescents). For continuous variables (age), we used method-of-moments meta-regression, an approach analogous to regression analysis but using calculated effect sizes for each study as outcomes and continuous moderators as predictors. Because moderator analyses were exploratory and included few studies in some subgroups, we used a full random-effects model (pooling τ within groups with random effects to combine subgroups). In addition, because one study34 provided some intervention in the control condition, sensitivity analyses were conducted excluding this study. Results were similar with no change in conclusions. Consequently, we include all studies in reported results.
Publication bias31 was examined with the funnel plot and Egger test for bias. The Duval and Tweedie trim-and-fill method was used to account for potential unpublished studies and provided an adjusted summary effect for interventions. The Rosenthal fail-safe N and the Orwin fail-safe N were used for sensitivity analyses.
Included Studies and Study Characteristics
Of the 6792 citations identified, 31 RCTs comparing interventions to usual care were included in the final analyses (Figure 1 and eTable in the Supplement).34-38,42-67 One trial57 separated effects for smoking abstinence and cessation groups; 3 other trials54,65,66 included 2 intervention groups against a single usual care, yielding 35 intervention vs usual care comparisons and effect size calculations based on 13 129 participants. Within-study sample sizes ranged from 28 to 3111. Youth age varied, including children and adolescents.
Twenty-five of the 35 intervention-usual care comparisons were classified as treatment: 20 treatments for mental health and 5 for substance use. Five treatment comparisons evaluated collaborative care interventions; the others evaluated a range of different models (ie, enhancing primary care resources through PCP training, consultation, and/or computer-assisted support tools; colocated care with minimal integration; bibliotherapy; telephone coaching; and motivational interviewing). Intervention duration varied in the length of intervention period and number of sessions (range, 1-16). The acute follow-up period ranged from 1 to 20 months. Seventeen treatment trials were conducted in the United States, 2 in Australia, and 4 in Europe (eTable in the Supplement lists the trial details).
All treatment trials used interventions with some empirical support. The 5 collaborative care trials all used evidence-based cognitive-behavioral therapy (CBT) for depression (n = 3)35,42,60 or behavior problems (n = 2)50,52 and evidence-based medication algorithms. Among the other 18 treatment trials, evidence-based approaches included parenting (n = 8),36,44,54,56,58,59,61,63 interpersonal psychotherapy for depression (n = 1),38 CBT for anxiety or somatic concerns (n = 1),37 CBT for behavior problems plus support for PCP medication management (n = 1),51 and PCP communication training (n = 1).67 Two other trials evaluated psychiatric consultation to support PCP-provided medication treatment for attention-deficit/hyperactivity disorder.47,53 All 4 substance use treatment trials used motivational interviewing. One included PCP counseling with telephone follow-up by a peer counselor,57 and the others involved brief interventions provided by others43,46,65; 3 had telephone follow-up,43,46,57 and 1 had a computer-delivered component.65
Ten comparisons (from 9 trials) evaluated prevention effects (1 trial57 examined both prevention and treatment). Three prevention comparisons targeted mental health outcomes: 2 evaluated depression-prevention CBT,34,48 1 used Internet-provided CBT after brief PCP-provided motivational interviewing,34 and 1 examined a parenting intervention for preventing behavior problems.49 The other 6 trials (7 comparisons) targeted substance use through motivational interviewing and/or counseling.45,55,57,62,64,66
Across trials, control conditions varied in intensity and length, ranging from usual care without enhancements to enhanced usual care with referral to specialty services, brief advice from PCPs, and educational materials. Methodologic rigor varied across studies: a Jadad score of 3 or higher for 25 studies, Jadad score of 2 for 6 studies, and evidence of some allocation concealment for all studies.
Overall Effect Size Calculations
The overall summary effect comparing all interventions vs usual care resulted in a small and statistically significant effect (d = 0.32; 95% CI, 0.21-0.44; P < .001). The forest plot and Q and I2 statistics indicated significant heterogeneity (Q = 152.64, P < .001, I2 = 77.73%), with the effect size for individual studies ranging from a d of −0.1866 to 2.76.37 See Figure 2 for a summary of individual study effects and summary effects for categories of studies.
Moderators of Treatment Response
The Table details the analyses exploring candidate categorical moderators. Trial type was a statistically significant moderator of treatment outcome (Qb = 7.93, P = .005; Table). Treatment trials had a small to medium statistically significant effect (d = 0.42; 95% CI, 0.29-0.55; P < .001), whereas the effect for prevention trials was weak and not statistically significant (d = 0.07; 95% CI, −0.13 to 0.28; P = .49). The forest plot and Q and I2 statistics indicated significant heterogeneity among effect sizes across treatment trials (Qw = 119.12, I2 = 79.85%, P < .001). Prevention trials exhibited less heterogeneity (Qw = 7.53, I2 = 0%, P = .59). Indeed, only one of the prevention trials57 had a small and statistically significant effect. Therefore, subsequent analyses examined moderators for treatment trials only.
Integrated care model (collaborative care vs other) was not a statistically significant moderator (Qb = 1.37, P = .24; Table). Collaborative care yielded a medium and statistically significant effect (d = 0.63, P < .001); other care models yielded a small and statistically significant effect (d = 0.40, P < .001). Qw and I2 statistics indicated significant heterogeneity within both collaborative care (Qw = 19.02, I2 = 78.97%, P < .001) and other trials (Qw = 95.34, I2 = 80.07%, P < .001).
Type of behavioral health problem targeted was not statistically significant as a moderator (Qb = 2.94, P = .09, I2 = 74.34%; Table). Treatments that targeted substance use had a weak effect (d = 0.17, P = .35) (Figure 2). Alternatively, treatments that targeted mental health problems had a medium statistically significant effect (d = 0.51, P < .001). There were statistically significant effects for treatment studies that targeted emotional (depression and anxiety: d = 0.71, P < .001) and behavioral (disruptive behavior and/or attention-deficit/hyperactivity disorder: d = 0.51, P < .001) problems; these effects did not differ significantly (Qb = 0.62, P = .43, I2 = 79.85%). One study67 that targeted both emotional and behavior problems was excluded from these subgroup analyses.
Age was not a significant continuous (QM = 0.003, P = .96) or categorical moderator (children ≤12 years old vs adolescents ≥13 years old, Qb = 0.65, P = .42, I2 = 79.20%). Two studies were excluded from categorical37,67 and continuous43,56 moderator analyses because of missing data.
Methodologic rigor indexed by the Jadad score (QM = 1.12, P = .29, I2 = 73.01%) and allocation concealment (QM = 0.01, P = .95, I2 = 79.22%) were not statistically significant moderators.
Publication bias, or effects associated with a greater likelihood of publication with significant outcomes, was examined for treatment trials. Visual inspection of the funnel plot and Egger test suggested that publication bias was significant (t = 3.34, P = .003). The Duval and Tweedie trim-and-fill method suggested that 3 studies were likely missing that would increase the effect (from d = 0.32 to imputed estimate of 0.39). The Rosenthal fail-safe N suggested that 803 studies with null findings would reduce the overall-effect P value to become nonsignificant. The Orwin fail-safe N suggested that 18 null studies would reduce the effect of d to less than 0.20. We did not examine publication bias for prevention trials because the summary effect was not statistically significant.
This meta-analysis provides the first cross-study demonstration, to our knowledge, of the value of integrating behavioral health care within primary medical care for children and adolescents. Analyses across studies indicated a small and significant effect. Effects for treatment trials were stronger than those for prevention trials: the effect size for treatment trials fell in the small to medium range (d = 0.42), with a 66% probability that a randomly selected youth would experience better outcomes after receiving an integrated behavioral health intervention than a randomly selected youth receiving usual care.68,69 Benefits of integrated medical-behavioral treatment were observed for interventions that target diverse mental health problems (depression, anxiety, and behavior). Although there was variability in effects across studies, these overall results enhance confidence that integrated medical-behavioral primary health care will lead to improved youth outcomes. Results were weaker and not statistically significant for substance use treatment trials, with only one large trial (N = 2709) indicating a significant effect.57 This trial included a practice-based intervention using the 5 A’s model (ask, advise, assess, assist, arrange) recommended by the US Public Health Service clinical practice guideline and the American Academy of Pediatrics70,71 that was provided by pediatric clinicians and followed by 1 visit and 4 telephone calls by older (18- to 21-year-old) peer counselors.
The summary effect for prevention trials was weak and not statistically significant. Only the prevention arm of the substance use intervention described above yielded a small significant effect,57 underscoring the need for large samples and sufficient statistical power to detect prevention effects. Of note, some prevention trials revealed significant effects on key intermediate outcomes,34,48,49 such as improved parenting. Over time, such outcomes might affect behavioral health outcomes. Adequately powered prevention trials with longer follow-up might clarify potential preventive effects of integrated medical-behavioral care.
As predicted, our results indicate the strongest effects for collaborative care interventions, with a mean d = 0.63, reflecting a 73% probability that a randomly selected youth would experience better outcomes after receiving collaborative care than a randomly selected youth receiving usual care.68,69 Collaborative care programs provide team-based care in which PCPs, care managers, and mental health specialists work together to evaluate, treat, and monitor patient progress. Although a meta-analysis14 of more than 79 RCTS, including 24 308 patients, supports the clinical effectiveness of collaborative care for adult depression and anxiety relative to usual care, the current meta-analysis is the first to extend these findings to youth and highlights the applicability and benefits of collaborative care across the developmental spectrum. These findings are likely to enhance implementation feasibility because similar approaches with developmental adaptation can be applied across age groups.
Overall, collaborative care had strong effects, with trials including evidence-based medication algorithms plus evidence-based psychotherapy. The other mental health treatment trials with significant individual effects used interventions with empirical support, such as Triple P,61,63 Incredible Years,54,58 interpersonal psychotherapy,38 guideline medication protocols,53 and CBT for anxiety and somatic concerns.37 This is a critical issue because integrating ineffective care may lead to minimal or no improvements in patient outcomes, and there is a need to both change organizational systems to support medical-behavioral health integration and improve care quality by integrating treatments with demonstrated efficacy and effectiveness and monitoring patient outcomes through registries, clinical dashboards, and/or other quality improvement strategies.
A limitation of this meta-analysis is the relatively small number of studies in pediatric samples that met methodologic standards for inclusion, highlighting a need for additional research to guide practice. Interventions were diverse, as were comparator usual care conditions. Effect sizes varied substantially across studies from nonsignificant to substantial and significant (d = 2.76).37 Several factors likely contributed to variation in effects, including statistical power; intervention type, quality, and dose (substance use interventions were generally briefer than mental health interventions); and strength of usual care comparators (eTable in the Supplement). Statistical power was weak for moderator analyses because of the small number of RCTs integrating behavioral health into primary care. The meta-analysis results differed from some individual study reports because of differences in analytic approach (eg, meta-analysis weighted by sample sizes and pooled SDs, with no covariate adjustments). Moderator analyses depended on our category definitions, underscoring the need to review primary study articles for more detailed information.
Given the current transformation in the US health care system and increased incentives for integrated medical-behavioral health care, these data documenting the benefits of integrated care enhance confidence that we are on a course that will yield improvements in the lives of youth and families. These data also underscore the critical need to strengthen our research base, learn from the real-world experiments happening within our medical and behavioral health care systems, and achieve the triple aims of health care reform: to improve care and patient experience and outcomes of care while reducing per capita costs.
Accepted for Publication: April 16, 2015.
Corresponding Author: Joan Rosenbaum Asarnow, PhD, Semel Institute for Neuroscience and Human Behavior, Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, 300 Medical Plaza, Ste 3310, Los Angeles, CA 90095 (jasarnow@mednet.ucla.edu).
Published Online: August 10, 2015. doi:10.1001/jamapediatrics.2015.1141.
Author Contributions: Drs Asarnow and Rozenman had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Study concept and design: Asarnow, Rozenman.
Acquisition, analysis, or interpretation of data: All authors.
Drafting of the manuscript: Asarnow, Rozenman, Zeltzer.
Critical revision of the manuscript for important intellectual content: Asarnow, Rozenman, Wiblin.
Statistical analysis: Rozenman.
Obtained funding: Asarnow.
Administrative, technical, or material support: Asarnow, Rozenman, Wiblin.
Study supervision: Asarnow.
Conflict of Interest Disclosures: Dr Asarnow reported receiving grant funding from the National Institute of Mental Health, American Foundation for Suicide Prevention, the American Psychological Association (APA) Committee on Division/APA Relations, and the Society of Clinical Child & Adolescent Psychology (Division 53 of the APA) and consulting on quality improvement interventions for depression and suicidal/self-harm behavior. Dr Rozenman reported receiving grant funding from the National Institute of Mental Health, the International Obsessive Compulsive Disorder Foundation, and the Society of Clinical Child & Adolescent Psychology (Division 53 of the APA). No other disclosures were reported.
Funding/Support: This work was partially supported by grant MH078596 from the National Institute of Mental Health and funds from the Society for Clinical Child and Adolescent Psychology (Division 53 of the APA).
Role of the Funder/Sponsor: The funding sources had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and the decision to submit the manuscript for publication.
Previous Presentation: Portions of this work were presented at the 2014 Annual Meeting of the APA; August 9, 2014; Washington, DC; the 2015 Annual Meeting of the Society for Adolescent Health and Medicine; March 19, 2015; Los Angeles, California; and an Institute of Medicine workshop, “Opportunities to Promote Children’s Behavioral Health: Health Care Reform and Beyond”; April 2, 2015; Washington, DC.
Additional Contributions: Catherine Sugar, PhD, provided statistical consultation; Brooke Rowland, JD, helped with the literature search and data entry and management; and anonymous reviewers provided helpful comments that strengthened this article.
1.Davis
K, Stremikis
K, Squires
D, Schoen
C. Mirror, Mirror on the Wall, 2014 Update: How the US Health Care System Compares Internationally. New York, NY: The Commonwealth Fund; 2014.
2.Asarnow
JR, Miranda
J. Improving care for depression and suicide risk in adolescents: innovative strategies for bringing treatments to community settings.
Annu Rev Clin Psychol. 2014;10:275-303.
PubMedGoogle ScholarCrossref 3.Croft
B, Parish
SL. Care integration in the Patient Protection and Affordable Care Act: implications for behavioral health.
Adm Policy Ment Health. 2013;40(4):258-263.
PubMedGoogle ScholarCrossref 4.US Department of Health and Human Services. National Prevention Strategy. Rockville, MD: Office of the Surgeon General; 2011.
5.Bridge
JA, Horowitz
LM, Fontanella
CA, Grupp-Phelan
J, Campo
JV. Prioritizing research to reduce youth suicide and suicidal behavior.
Am J Prev Med. 2014;47(3)(suppl 2):S229-S234.
PubMedGoogle ScholarCrossref 6.Campo
JV. Annual research review: functional somatic symptoms and associated anxiety and depression: developmental psychopathology in pediatric practice.
J Child Psychol Psychiatry. 2012;53(5):575-592.
PubMedGoogle ScholarCrossref 8.Chevarley
F. Statistical Brief #12: Children’s Access to Necessary Health Care, Fall 2001. Rockville, MD: Agency for Healthcare Research and Quality; 2003.
10.Kolko
DJ, Perrin
E. The integration of behavioral health interventions in children’s health care: services, science, and suggestions.
J Clin Child Adolesc Psychol. 2014;43(2):216-228.
PubMedGoogle ScholarCrossref 11.Butler
M, Kane
RL, McAlpine
D, Kathol
RG, Fu
SS, Hagedorn
H. Integration of Mental Health/Substance Abuse and Primary Care. Rockville, MD: Agency for Healthcare Research and Quality; 2008. AHRQ publication 09- E003.
12.Collins
C, Hewson
DL, Munger
R. Evolving Models of Behavioral Health Integration in Primary Care (Millbank Fund Report). New York: New York Milbank Memorial Fund; 2010.
13.Katon
W, Unützer
J, Wells
K, Jones
L. Collaborative depression care: history, evolution and ways to enhance dissemination and sustainability.
Gen Hosp Psychiatry. 2010;32(5):456-464.
PubMedGoogle ScholarCrossref 14.Archer
J, Bower
P, Gilbody
S,
et al. Collaborative care for depression and anxiety problems.
Cochrane Database Syst Rev. 2012;10:CD006525.
PubMedGoogle Scholar 15.Huffman
JC, Niazi
SK, Rundell
JR, Sharpe
M, Katon
WJ. Essential articles on collaborative care models for the treatment of psychiatric disorders in medical settings: a publication by the Academy of Psychosomatic Medicine Research and Evidence-Based Practice Committee.
Psychosomatics. 2014;55(2):109-122.
PubMedGoogle ScholarCrossref 17.Geiger
AM, Castellino
SM. Delineating the age ranges used to define adolescents and young adults.
J Clin Oncol. 2011;29(16):e492-e493.
PubMedGoogle ScholarCrossref 19.Law
EF, Fisher
E, Fales
J, Noel
M, Eccleston
C. Systematic review and meta-analysis of parent and family-based interventions for children and adolescents with chronic medical conditions.
J Pediatr Psychol. 2014;39(8):866-886.
PubMedGoogle ScholarCrossref 20.Jadad
AR, Moore
RA, Carroll
D,
et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary?
Control Clin Trials. 1996;17(1):1-12.
PubMedGoogle ScholarCrossref 21.Ougrin
D, Tranah
T, Stahl
D, Moran
P, Asarnow
JR. Therapeutic interventions for suicide attempts and self-harm in adolescents: systematic review and meta-analysis.
J Am Acad Child Adolesc Psychiatry. 2015;54(2):97-107.e2.
PubMedGoogle ScholarCrossref 22.Chavira
DA, Drahota
A, Garland
AF, Roesch
S, Garcia
M, Stein
MB. Feasibility of two modes of treatment delivery for child anxiety in primary care.
Behav Res Ther. 2014;60:60-66.
PubMedGoogle ScholarCrossref 23.Diamond
GS, Wintersteen
MB, Brown
GK,
et al. Attachment-based family therapy for adolescents with suicidal ideation: a randomized controlled trial.
J Am Acad Child Adolesc Psychiatry. 2010;49(2):122-131.
PubMedGoogle Scholar 24.Merry
SN, Stasiak
K, Shepherd
M, Frampton
C, Fleming
T, Lucassen
MFG. The effectiveness of SPARX, a computerised self help intervention for adolescents seeking help for depression: randomised controlled non-inferiority trial.
BMJ. 2012;344:e2598.
Google ScholarCrossref 25.Harris
SK, Csémy
L, Sherritt
L,
et al. Computer-facilitated substance use screening and brief advice for teens in primary care: an international trial.
Pediatrics. 2012;129(6):1072-1082.
PubMedGoogle ScholarCrossref 26.McConnell
D, Breitkreuz
R, Savage
A. Independent evaluation of the Triple P Positive Parenting Program in family support service settings.
Child Fam Soc Work. 2012;17:43-54.
Google ScholarCrossref 27.Berkovits
MD, O’Brien
KA, Carter
CG, Eyberg
SM. Early identification and intervention for behavior problems in primary care: a comparison of two abbreviated versions of parent-child interaction therapy.
Behav Ther. 2010;41(3):375-387.
PubMedGoogle ScholarCrossref 28.Moja
LP, Telaro
E, D’Amico
R, Moschetti
I, Coe
L, Liberati
A. Assessment of methodological quality of primary studies by systematic reviews: results of the metaquality cross sectional study.
BMJ. 2005;330(7499):1053.
PubMedGoogle ScholarCrossref 29.Schulz
KF, Chalmers
I, Hayes
RJ, Altman
DG. Empirical evidence of bias: dimensions of methodological quality associated with estimates of treatment effects in controlled trials.
JAMA. 1995;273(5):408-412.
PubMedGoogle ScholarCrossref 30.Wood
L, Egger
M, Gluud
LL,
et al. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study.
BMJ. 2008;336(7644):601-605.
PubMedGoogle ScholarCrossref 31.Borenstein
M, Hedges
L, Higgins
J. Comprehensive Meta-Analysis Software (CMA). Engelwood, NJ: Biostat; 2005.
32.Borenstein
M, Hedges
LV, Higgins
JPT, Rothstein
HR. Introduction to Meta-Analysis. Hoboken, NJ: John Wiley & Sons; 2009.
33.Morris
SB, DeShon
RP. Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs.
Psychol Methods. 2002;7(1):105-125.
PubMedGoogle ScholarCrossref 34.Van Voorhees
BW, Vanderplough-Booth
K, Fogel
J,
et al. Integrative Internet-based depression prevention for adolescents: a randomized clinical trial in primary care for vulnerability and protective factors.
J Can Acad Child Adolesc Psychiatry. 2008;17(4):184-196.
PubMedGoogle Scholar 35.Clarke
G, Debar
L, Lynch
F,
et al. A randomized effectiveness trial of brief cognitive-behavioral therapy for depressed adolescents receiving antidepressant medication.
J Am Acad Child Adolesc Psychiatry. 2005;44(9):888-898.
PubMedGoogle ScholarCrossref 36.Kjøbli
J, Ogden
T. A randomized effectiveness trial of brief parent training in primary care settings.
Prev Sci. 2012;13(6):616-626.
PubMedGoogle ScholarCrossref 37.Warner
CM, Colognori
D, Kim
RE,
et al. Cognitive-behavioral treatment of persistent functional somatic complaints and pediatric anxiety: an initial controlled trial.
Depress Anxiety. 2011;28(7):551-559.
PubMedGoogle ScholarCrossref 38.Mufson
LH, Dorta
KP, Wickramaratne
P, Nomura
Y, Olfson
M, Weissman
MM. A randomized effectiveness trial of interpersonal psychotherapy for depressed adolescents.
Arch Gen Psychiatry. 2004;61(6):577-584.
Google ScholarCrossref 41.Lipsey
MW, Wilson
DB. Practical Meta-Analysis. Thousand Oaks, CA: Sage Publications; 2001.
42.Asarnow
JR, Jaycox
LH, Duan
N,
et al. Effectiveness of a quality improvement intervention for adolescent depression in primary care clinics: a randomized controlled trial.
JAMA. 2005;293(3):311-319.
PubMedGoogle ScholarCrossref 43.Audrain-McGovern
J, Stevens
S, Murray
PJ,
et al. The efficacy of motivational interviewing versus brief advice for adolescent smoking behavior change.
Pediatrics. 2011;128(1):e101-e111.
PubMedGoogle ScholarCrossref 44.Borowsky
IW, Mozayeny
S, Stuenkel
K, Ireland
M. Effects of a primary care-based intervention on violent behavior and injury in children.
Pediatrics. 2004;114(4):e392-e399.
PubMedGoogle ScholarCrossref 45.Curry
SJ, Hollis
J, Bush
T,
et al. A randomized trial of a family-based smoking prevention intervention in managed care.
Prev Med. 2003;37(6, pt 1):617-626.
PubMedGoogle ScholarCrossref 46.D’Amico
EJ, Miles
JNV, Stern
SA, Meredith
LS. Brief motivational interviewing for teens at risk of substance use consequences: a randomized pilot study in a primary care clinic.
J Subst Abuse Treat. 2008;35(1):53-61.
PubMedGoogle ScholarCrossref 47.Epstein
JN, Rabiner
D, Johnson
DE,
et al. Improving attention-deficit/hyperactivity disorder treatment outcomes through use of a collaborative consultation treatment service by community-based pediatricians: a cluster randomized trial.
Arch Pediatr Adolesc Med. 2007;161(9):835-840.
PubMedGoogle ScholarCrossref 48.Gillham
JE, Hamilton
J, Freres
DR, Patton
K, Gallop
R. Preventing depression among early adolescents in the primary care setting: a randomized controlled study of the Penn Resiliency Program.
J Abnorm Child Psychol. 2006;34(2):203-219.
PubMedGoogle ScholarCrossref 49.Hiscock
H, Bayer
JK, Price
A, Ukoumunne
OC, Rogers
S, Wake
M. Universal parenting programme to prevent early childhood behavioural problems: cluster randomised trial.
BMJ. 2008;336(7639):318-321.
Google ScholarCrossref 50.Kolko
DJ, Campo
J, Kilbourne
AM, Hart
J, Sakolsky
D, Wisniewski
S. Collaborative care outcomes for pediatric behavioral health problems: a cluster randomized trial.
Pediatrics. 2014;133(4):e981-e992.
PubMedGoogle ScholarCrossref 51.Kolko
DJ, Campo
JV, Kelleher
K, Cheng
Y. Improving access to care and clinical outcome for pediatric behavioral problems: a randomized trial of a nurse-administered intervention in primary care.
J Dev Behav Pediatr. 2010;31(5):393-404.
PubMedGoogle ScholarCrossref 52.Kolko
DJ, Campo
JV, Kilbourne
AM, Kelleher
K. Doctor-office collaborative care for pediatric behavioral problems: a preliminary clinical trial.
Arch Pediatr Adolesc Med. 2012;166(3):224-231.
PubMedGoogle ScholarCrossref 53.Lavigne
JV, Dulcan
MK, LeBailly
SA, Binns
HJ, Cummins
TK, Jha
P. Computer-assisted management of attention-deficit/hyperactivity disorder.
Pediatrics. 2011;128(1):e46-e53.
PubMedGoogle ScholarCrossref 54.Lavigne
JV, Lebailly
SA, Gouze
KR,
et al. Treating oppositional defiant disorder in primary care: a comparison of three models.
J Pediatr Psychol. 2008;33(5):449-461.
PubMedGoogle ScholarCrossref 55.Mason
M, Pate
P, Drapkin
M, Sozinho
K. Motivational interviewing integrated with social network counseling for female adolescents: a randomized pilot study in urban primary care.
J Subst Abuse Treat. 2011;41(2):148-155.
PubMedGoogle ScholarCrossref 56.Patterson
J, Barlow
J, Mockford
C, Klimes
I, Pyper
C, Stewart-Brown
S. Improving mental health through parenting programmes: block randomised controlled trial.
Arch Dis Child. 2002;87(6):472-477.
PubMedGoogle ScholarCrossref 57.Pbert
L, Flint
AJ, Fletcher
KE, Young
MH, Druker
S, DiFranza
JR. Effect of a pediatric practice-based smoking prevention and cessation intervention for adolescents: a randomized, controlled trial.
Pediatrics. 2008;121(4):e738-e747.
PubMedGoogle ScholarCrossref 58.Perrin
EC, Sheldrick
RC, McMenamy
JM, Henson
BS, Carter
AS. Improving parenting skills for families of young children in pediatric settings: a randomized clinical trial.
JAMA Pediatr. 2014;168(1):16-24.
PubMedGoogle ScholarCrossref 59.Reid
GJ, Stewart
M, Vingilis
E,
et al. Randomized trial of distance-based treatment for young children with discipline problems seen in primary health care.
Fam Pract. 2013;30(1):14-24.
PubMedGoogle ScholarCrossref 60.Richardson
LP, Ludman
E, McCauley
E,
et al. Collaborative care for adolescents with depression in primary care: a randomized clinical trial.
JAMA. 2014;312(8):809-816.
PubMedGoogle ScholarCrossref 61.Spijkers
W, Jansen
DE, Reijneveld
SA. Effectiveness of Primary Care Triple P on child psychosocial problems in preventive child healthcare: a randomized controlled trial.
BMC Med. 2013;11(1):240.
PubMedGoogle ScholarCrossref 62.Stevens
MM, Olson
AL, Gaffney
CA, Tosteson
TD, Mott
LA, Starr
P. A pediatric, practice-based, randomized trial of drinking and smoking prevention and bicycle helmet, gun, and seatbelt safety promotion.
Pediatrics. 2002;109(3):490-497.
PubMedGoogle ScholarCrossref 63.Turner
KMT, Sanders
MR. Help when it’s needed first: a controlled evaluation of brief, preventive behavioral family intervention in a primary care setting.
Behav Ther. 2006;37(2):131-142.
PubMedGoogle ScholarCrossref 64.Walker
Z, Townsend
J, Oakley
L,
et al. Health promotion for adolescents in primary care: randomised controlled trial.
BMJ. 2002;325(7363):524.
PubMedGoogle ScholarCrossref 65.Walton
MA, Bohnert
K, Resko
S,
et al. Computer and therapist based brief interventions among cannabis-using adolescents presenting to primary care: one year outcomes.
Drug Alcohol Depend. 2013;132(3):646-653.
PubMedGoogle ScholarCrossref 66.Walton
MA, Resko
S, Barry
KL,
et al. A randomized controlled trial testing the efficacy of a brief cannabis universal prevention program among adolescents in primary care.
Addiction. 2014;109(5):786-797.
PubMedGoogle ScholarCrossref 67.Wissow
LS, Gadomski
A, Roter
D,
et al. Improving child and parent mental health in primary care: a cluster-randomized trial of communication skills training.
Pediatrics. 2008;121(2):266-275.
PubMedGoogle ScholarCrossref 68.Coe
R.
It’s the effect size, stupid: what effect size is and why it is important. Paper presented at: Annual Conference of the British Educational Research Association; September 12-14, 2002; Exeter, England.
http://www.leeds.ac.uk/educol/documents/00002182.htm. Accessed December 1, 2014.
70.Committee on Substance Abuse, American Academy of Pediatric. Tobacco’s toll: implications for the pediatrician.
Pediatrics. 2001;107(4):794-798.
PubMedGoogle Scholar 71.Anderson
JE, Jorenby
DE, Scott
WJ, Fiore
MC. Treating tobacco use and dependence: an evidence-based clinical practice guideline for tobacco cessation.
Chest. 2002;121(3):932-941.
PubMedGoogle ScholarCrossref