IPA indicates International Pharmaceutical Abstracts; TEP, technical expert panel.
Three low or medium risk-of-bias randomized clinical trials of MTM versus control groups without MTM using the basic arm of the Touchette et al25 study. Our meta-analysis found no significant difference in the number of outpatient visits between patients receiving MTM interventions and those receiving usual care (standardized mean difference, 0.05; 95% CI, −0.03 to 0.13; P = .25). IMPROVE indicates Impact of Managed Pharmaceutical care on Resource utilization and Outcomes in Veterans Affairs Medical Center.
Three low or medium risk-of-bias randomized clinical trials of MTM versus control groups without MTM, using the basic arm of the Touchette et al25 study. Our meta-analysis found no significant difference in the number of hospitalizations between patients receiving MTM and those receiving usual care (WMD, 0.04; 95% CI, −0.01 to 0.08; P = .09). IMPROVE indicates Impact of Managed Pharmaceutical care on Resource utilization and Outcomes in Veterans Affairs Medical Center; WMD, weighted mean difference.
eTable 1. Sources, Search Terms, and Limits for Medication Therapy Management
eTable 2. Populations, Interventions, Comparators, Outcomes, Timing, and Settings: Inclusion/Exclusion Criteria for MTM Studies
eTable 3. Characteristics of Included Studies
eTable 4. Characteristics of MTM Studies by Type of Patient Population (Broad Focus or Narrow Focus on Conditions or Diagnoses)
eTable 5. Sensitivity Analyses for Meta-analyses
eTable 6. Effectiveness of MTM by Intervention Features
eFigure 1. Effect of MTM on SF-36 Physical Functioning Domain
eFigure 2. Effect of MTM on SF-36 Role Physical Domain
eFigure 3. Effect of MTM on SF-36 Bodily Pain Domain
eFigure 4. Effect of MTM on SF-36 General Health Perception Domain
eFigure 5. Effect of MTM on SF-36 Vitality Domain
eFigure 6. Effect of MTM on SF-36 Social Functioning Domain
eFigure 7. Effect of MTM on SF-36 Role Emotional Domain
eFigure 8. Effect of MTM on SF-36 Mental Health Domain
Viswanathan M, Kahwati LC, Golin CE, Blalock SJ, Coker-Schwimmer E, Posey R, Lohr KN. Medication Therapy Management Interventions in Outpatient SettingsA Systematic Review and Meta-analysis. JAMA Intern Med. 2015;175(1):76-87. doi:10.1001/jamainternmed.2014.5841
Medication therapy management (MTM) services (also called clinical pharmacy services) aim to reduce medication-related problems and their downstream outcomes.
To assess the effect of MTM interventions among outpatients with chronic illnesses.
MEDLINE, Cochrane Library, and International Pharmaceutical Abstracts through January 9, 2014.
Two reviewers selected studies with comparators and eligible outcomes of ambulatory adults.
Data Extraction and Synthesis
Dual review of titles, abstracts, full-text, extractions, risk of bias, and strength of evidence grading. We conducted meta-analyses using random-effects models.
Main Outcomes and Measures
Medication-related problems, morbidity, mortality, quality of life, health care use, costs, and harms.
Forty-four studies met the inclusion criteria. The evidence was insufficient to determine the effect of MTM interventions on most evaluated outcomes (eg, drug therapy problems, adverse drug events, disease-specific morbidity, disease-specific or all-cause mortality, and harms). The interventions improved a few measures of medication-related problems and health care use and costs (low strength of evidence) when compared with usual care. Specifically, MTM interventions improved medication appropriateness (4.9 vs 0.9 points on the medication appropriateness index, P < .001), adherence (approximately 4.6%), and percentage of patients achieving a threshold adherence level (odds ratios [ORs] ranged from 0.99 to 5.98) and reduced medication dosing (mean difference, −2.2 doses; 95% CI, −3.738 to −0.662). Medication therapy management interventions reduced health plan expenditures on medication costs, although the studies reported wide CIs. For patients with diabetes mellitus or heart failure, MTM interventions lowered the odds of hospitalization (diabetes: OR, 0.91 to 0.93 based on type of insurance; adjusted hazard rate for heart failure: 0.55; 95% CI, 0.39 to 0.77) and hospitalization costs (mean differences ranged from −$363.45 to −$398.98). The interventions conferred no benefit for patient satisfaction and most measures of health-related quality of life (low strength).
Conclusions and Relevance
We graded the evidence as insufficient for most outcomes because of inconsistency and imprecision that stem in part from underlying heterogeneity in populations and interventions. Medication therapy management interventions may reduce the frequency of some medication-related problems, including nonadherence, and lower some health care use and costs, but the evidence is insufficient with respect to improvement in health outcomes.
Used appropriately, medications can alleviate distressing symptoms, prevent many acute and chronic illnesses, and improve patients’ health. However, medications often are used inappropriately.1- 3 In the United States, adverse drug events led to an estimated 4.5 million ambulatory care visits per year during 2005 to 2007.4 In addition to problems involving adverse drug events, many patients experience drug therapy problems related to appropriateness (eg, unwarranted polypharmacy, suboptimal regimens), effectiveness (eg, subtherapeutic doses, therapeutic response not achieved at an adequate dose), safety (eg, adverse drug effects, drug-drug interactions, and supratherapeutic doses), and adherence.5
Medication therapy management (MTM) is a strategy for delivering a variety of nondispensing clinical pharmacy services to patients and their clinicians; it is a structure for providing what pharmacists referred to in the early 1990s as pharmaceutical care.6 Medication therapy management services aim to optimize therapeutic outcomes by identifying and resolving drug therapy problems.7 The Medicare Prescription Drug, Improvement, and Modernization Act of 2003 (Public Law 108-173)8 expanded access to MTM services for patients with certain chronic conditions through Medicare Part D prescription drug benefits. In 2005, 11 national pharmacy organizations established a consensus definition for MTM9; in 2008, a subset of these organizations established 5 core elements for an MTM service model.10 These elements include a medication therapy review, a personal medication record, a medication action plan, intervention and/or referral for drug therapy problems, and documentation and follow-up.7 Also by 2008, Current Procedural Terminology for MTM services (codes 99605, 99606, and 99607) became available and further defined MTM service-level expectations to include an assessment of drug-related needs, identification of drug therapy problems, and care planning and follow-up.11- 13
Medication therapy management can be viewed as a professionally delivered service with common core features and goals; specific intervention components may vary based on the scope and setting of each MTM program. Recent widespread implementation of MTM services, stemming from perceived clinical need and access to billing codes, drives an urgent need for actionable, evidence-based information on its effectiveness and harms. Our study assessed the effectiveness and harms of outpatient-based MTM compared with usual care; we focus on the effect of MTM on drug-therapy problems and their sequelae, including biomarkers of morbidity, health outcomes, mortality, patient-centered functioning, quality of life, satisfaction, and health care use and costs. This article is based on a systematic evidence report commissioned by the US Agency for Healthcare Research and Quality (AHRQ) to determine the effectiveness of outpatient MTM.14
We developed a protocol for this review.15 A trained librarian, in consultation with investigators, used numerous terms to identify MTM-related studies in MEDLINE, the Cochrane Library, and the International Pharmaceutical Abstracts database (inception through January 9, 2014) (eTable 1 in the Supplement). We limited searches to English-language and human-only studies. We manually searched the reference lists of landmark and background articles for additional relevant citations. We also searched numerous sources for unpublished literature described in eTable 1 in the Supplement. Finally, the AHRQ placed a request for unpublished studies in the Federal Register.
We prespecified required intervention characteristics to reduce underlying heterogeneity. We required MTM interventions to include a comprehensive (rather than condition-specific) medication review, patient-directed education, care coordination, and opportunity for follow-up. When articles included insufficient detail for us to decide on inclusion or exclusion, we contacted the authors for additional information. We limited our review to ambulatory settings. We anticipated modest randomized clinical trial (RCT) evidence and therefore also included nonrandomized clinical trials (NRCTs), cohort studies, and case-control studies. We excluded studies of MTM services provided within inpatient settings or shortly after hospital discharge; the goals of therapy and severity of illness are likely to differ markedly between outpatients and patients experiencing or recovering from an acute hospital stay.
Two trained members of the research team (M.V., L.C.K., C.E.G., S.J.B, E.C.-S., and R.P. performed all functions discussed) independently reviewed each of the titles, abstracts, and articles against the inclusion/exclusion criteria (eTable 2 in the Supplement). Studies marked for possible inclusion by either reviewer underwent dual, independent full-text review.
A trained reviewer abstracted information from eligible studies into structured evidence tables; a second team member reviewed all data abstractions for completeness and accuracy. Reviewers rated the risk of bias independently against prespecified criteria.16 For RCTs, we relied on the risk-of-bias tool developed by the Cochrane Collaboration.17 We assessed the risk of bias of NRCTs using an item bank developed by RTI International.18
We evaluated RCTs on the adequacy of randomization, allocation concealment, similarity of groups at baseline, blinding of outcome assessment, attrition, use of intention-to-treat analysis, method of handling dropouts and missing data, validity and reliability of outcome measures, and treatment fidelity. For NRCTs, we assessed for confounding rather than adequacy of randomization and allocation concealment. We also evaluated RCTs for confounding attributable to randomization failure through biased selection or attrition. We rated the studies as low, medium, high, or unclear risk of bias.16 Two independent reviewers assessed the risk of bias for each study and resolved disagreements by consensus or by consulting a third member of the team.
We excluded studies that we deemed at high risk of bias from our main data analyses, but we included them in sensitivity analyses. When we had no other evidence, we included high risk-of-bias studies in the main analyses.
We conducted meta-analysis when appropriate (≥3 studies with similar populations, interventions, comparators, outcomes, and design) using Comprehensive Meta-Analysis software (Biostat Inc). For all pooled analyses, we used random-effects models. To determine whether quantitative analyses were appropriate, we assessed the clinical and methodologic heterogeneity of the studies under consideration.19 For all quantitative syntheses, we assessed statistical heterogeneity in effects between studies by calculating the χ2 statistic and the I2 statistic (the percentage of total variation across studies attributable to heterogeneity rather than chance).20 When relevant, we examined potential sources of heterogeneity from the risk of bias using sensitivity analysis.
When quantitative analyses were inappropriate, we synthesized the data qualitatively, considering issues of consistency, precision, directness, and risk of bias. Whenever possible, we computed 95% CIs for outcomes reported in single studies, but numerous articles did not provide sufficient information for such computations.
Two reviewers assessed strength of evidence domains for each outcome and resolved differences by consensus or referral to a third senior member of the team. We based our grades on low or medium risk-of-bias RCTs or observational studies (unless none was available) based on guidance established by the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group.21- 23 We considered one of the following grades for each outcome: (1) high (high confidence that the evidence reflects the true effect), (2) moderate (moderate confidence that the evidence reflects the true effect; future research may change the estimate), (3) low (low confidence that the evidence reflects the true effect; further research is likely to change the estimate), or (4) insufficient evidence.24
We identified 61 articles (representing 44 studies) that met the inclusion criteria (Figure 1). The evidence base consisted of 21 RCTs, 4 NRCTs, and 19 cohort studies. Most studies compared an MTM intervention with usual care (no MTM intervention).
Methodologic problems in numerous studies led us to rate them as having a medium or high risk of bias. Of the 44 studies, we rated 16 as high risk of bias overall; in these studies, concerns about randomization failure, confounding, or overall attrition increased the risk of bias for all outcomes. In a few instances, we rated studies that were otherwise of low or medium risk of bias as high risk for individual outcomes chiefly because of measurement or detection biases related to the specific outcome. Because of the underlying heterogeneity of the populations, settings, and outcomes and the limited number of studies on any single outcome, we could use only 4 low or medium risk-of-bias studies in the meta-analysis25- 30 (Figure 2 and Figure 3 and eFigures 1-8 in the Supplement)25- 33 and 2 additional high risk-of-bias studies for sensitivity analysis (eTable 5).34- 36
Characteristics of included studies are provided in eTable 3 and eTable 4 in the Supplement. The numbers of participants analyzed in each study ranged from 10 to 200 722. All studies used pharmacists to deliver MTM services, specifically medication review, patient-directed education, care coordination, and opportunity for follow-up. Despite these 4 common features, MTM interventions differed considerably across the studies. Of the 44 included studies, 34 were broadly focused (ie, included a patient population not defined by any specific clinical condition), and 10 were relatively narrowly focused on specific patient populations (eg, chronic heart failure, hypertension, diabetes mellitus, human immunodeficiency virus, glucocorticoid-induced osteoporosis, or hemodialysis) who then received comprehensive medication review. Services were provided face to face in half of the included studies. Included studies provided interventions in a variety of settings including community pharmacies, centralized pharmacies or pharmacy call centers, outpatient medical clinics, and patients’ homes.
Thirty-two studies reported on 1 or more intermediate outcomes (Table 1). We were unable to pool the results because too few studies within each design stratum (ie, RCT or cohort) were of low or medium risk of bias.
Medication therapy management interventions significantly improved medication appropriateness (measured with a reliable and valid 10-item index of medication appropriateness measuring improved prescribing quality53; 4.9 vs 0.9 points, P < .001).32 For some medications, MTM improved adherence as the percentage of prescribed doses taken (mean improvement, approximately 4.6%)41 or percentage of patients achieving a threshold adherence level (odds ratio [ORs], 0.99 to 5.98)41 and reduced medication dosing (mean difference, −2.2 doses; 95% CI, −3.738 to −0.662)48 (Table 1). We had enough consistency and precision across the body of evidence to assign a low strength-of-evidence grade for these outcomes. Evidence was insufficient to draw any conclusions about effectiveness for the number of drug therapy problems identified and resolved.
Evidence was insufficient to draw any conclusions about effectiveness for other intermediate outcomes, including the effect on anticoagulation, blood pressure, hemoglobin A1c, and low-density lipoprotein cholesterol. We identified no studies that addressed the effect of MTM on meeting the goals of therapy.
Twenty-one studies reported 1 or more patient-centered outcomes; we were able to synthesize some outcomes quantitatively. Specifically, MTM interventions did not improve measures of health-related quality of life26,31,32 (Table 2 and eTable 5 and eFigures 1-8 in the Supplement), yielding low strength of evidence for no benefit. For general health-related quality of life outcomes, meta-analyses of 7 of 8 domains and the 2 component scores (physical health and mental health) showed no significant benefit from MTM interventions. However, the vitality domain of the SF-36 showed benefit in meta-analysis estimates that did not adjust for multiple comparisons. We graded this outcome as imprecise after correcting for multiple comparisons and the evidence on vitality as insufficient (eFigure 5 in the Supplement). The various patient satisfaction outcomes used by studies26,28- 30,32,44,58 also showed no effect from MTM programs (low strength of evidence for no benefit), although we were unable to pool results because of the heterogeneity of measures. Evidence was insufficient to draw conclusions about the effect of MTM on adverse drug events, gastrointestinal bleeding, mortality, and cognitive and affective function. No studies evaluated the effect of MTM on activities of daily living, work or school absenteeism, or patient and caregiver participation in medical care and decision making.
Thirty-three studies reported 1 or more outcomes related to the use of health care, such as the number of emergency department visits, number of hospitalizations, costs of laboratory tests, and total expenditures on medications. In addition to qualitative syntheses on all outcomes, we were able to pool the results on the number of outpatient and hospital visits.
Medication therapy management improved health plan expenditures on medications, but studies had wide CIs.27,48,59 The MTM interventions also reduced the risk of hospitalization (2 studies): the adjusted OR for diabetes ranged from 0.91 (95% CI, 0.87 to 0.95) to 0.93 (95% CI, 0.88 to 0.98),41 and the adjusted hazard rate for heart failure was 0.55 (95% CI, 0.39 to 0.77).60 Medication therapy management also reduced the costs of diabetes-specific hospitalization (1 study41) (mean difference, −$363.45 [95% CI, −$562.00 to −$164.91]) (Table 3). These results are imprecise or come from cohort studies with inherent limitations, leading to a judgment of low strength of evidence.
Three RCTs did not reduce the number of hospitalizations,25- 30 although a single cohort study43 found a lower mean number of inpatient visits for patients accepting MTM (compared with patients refusing MTM). Overall, we judged the strength of evidence for mean number of hospitalizations to be insufficient because of the lack of consistency across studies.
Evidence was insufficient on the effect of MTM interventions on the use of generic medications; measures of medication costs other than health plan expenditures; number (Figure 2) and costs of outpatient visits; number and costs of laboratory tests; number and costs of emergency department visits; and the number (Figure 3), percentage, and costs of hospitalization for unspecified conditions, congestive heart failure, or chronic obstructive pulmonary disease. Frequently, the results were inconsistent for the same outcome; that is, MTM may have raised the use of health care services in one study and lowered it in another. We could not interpret these results as either benefits or harms because studies uniformly evaluated overall change in health care use rather than whether the increase or decrease in use met the goal of MTM for individual patients.
Only 1 cohort study (high risk of bias) reported harms, specifically on inconvenience resulting from monthly appointments.66,67 The evidence was insufficient to judge the effect of MTM on inconvenience. We found no evidence on other prespecified harms including care fragmentation, patient decisional conflict, patient anxiety, increased adverse drug events, prescriber confusion, and prescriber dissatisfaction.
We found information from only 1 study for each of 5 intervention features: (1) access of pharmacists to patient records,25 (2) intensity of care coordination and follow-up after comprehensive medication review,68 (3) community pharmacy vs call center,69 (4) level of intensity of intervention,70 and (5) type of payer (private vs Medicaid) (eTable 6 in the Supplement).71 Evidence was insufficient for most outcomes for the first 2 intervention features, with 2 exceptions. First, MTM delivered by community pharmacists when compared with call center pharmacists increased the proportion of generics dispensed (low strength of evidence). Second, enhanced MTM with pharmacists’ access to patient records reduced the mean number of adverse drug events; this finding suggested benefit when compared with basic MTM (low strength of evidence). Evidence was insufficient for all outcomes for the intensity of intervention and type of payer.
Evidence was insufficient to draw conclusions about the effect of MTM on most of the outcomes that we evaluated. We assigned grades of low strength of evidence for either a benefit (some measures of drug-therapy problems and health care use) or a lack of benefit (patient satisfaction and health-related quality of life) to few evaluation outcomes. The degree to which identifying and resolving drug therapy problems translate into consistent, detectable improvements in biomarkers of morbidity, health, patient experience, use, and costs cannot be determined from this body of evidence.
Although we tried to capture a range of contexts and settings and fill gaps by including observational studies, we did not find credible, consistent evidence that MTM improved outcomes globally regardless of study design. We included a very large retrospective cohort study of Medicare Part D MTM programs operating in 2010.41 This evaluation focused on beneficiaries with congestive heart failure, chronic obstructive pulmonary disease, and diabetes. The authors reported that, although uptake of and adherence to evidence-based medication improved for patients with congestive heart failure or diabetes, these improvements did not consistently translate to fewer condition-specific hospitalizations and emergency department visits.41
Overall, we rated the MTM evidence base as insufficient, even though some studies evaluated important outcomes and had low or moderate risk of bias. Our assessment was often based on inconsistency in the magnitude or direction of effect. Inconsistent effects of the intervention, as well as poor measures, could explain inconsistent results.
For example, clinically effective MTM can either increase or decrease health care use and expenditures based on the needs of the patient. The goal of MTM overall is to optimize pharmacotherapy and reduce unnecessary health care use, but for patients who need more care, MTM could optimize pharmacotherapy while increasing necessary health care use.
Future studies will benefit from better outcome measures. In addition, analyses should take into account whether increases in health care use are appropriate and whether identified inappropriate use can be attributed to overuse or underuse. Studies often used nonstandardized measures for outcomes, such as adverse events, adherence, and expenditures or costs; this tendency limited our ability to meta-analyze results.
Included MTM studies were largely practice based; they varied substantially in usual-care comparators, specific intervention elements, and patient populations. Standard medical care usually involves varying degrees of MTM-like services from the patient’s prescribing providers and health care teams. This reality is problematic for systematic reviews because MTM effectiveness in relationship to usual care can be adequately characterized only by controlling for the variation in the active intervention components that might also be present in the usual-care group.72
For MTM, this variation in practice likely reflects the evolution of the professional practice of pharmacy. Most studies were not designed to capitalize on variants in MTM program elements for a rigorous, prospective evaluation of outcomes by those variants. In addition, most studies did not report patient characteristics beyond age and sex, thus limiting our ability to address the underlying heterogeneity in our review. Finally, most studies did not measure fidelity to intended MTM intervention elements; thus, whether studies demonstrating no effect of MTM were actually failures of implementation is difficult to determine.
Our findings emphasize several important needs for future efforts to review MTM programs systematically. The first is for researchers and program evaluators to specify and design MTM interventions based on existing definitions, taxonomies, and service models. The second is to use the appropriate consensus guidelines for study reporting based on design,73- 76 giving particular attention to reporting intervention features, usual care practices, and fidelity of intervention delivery.77 Progress on these steps would enable systematic reviews of MTM services to better differentiate between various types of services, different levels of intervention fidelity, and heterogeneous comparison groups.
Medication therapy management is already in widespread practice, which presents both challenges and opportunities for researchers and policy makers. The MTM programs of the future may contribute to coordinated and improved care through delivery within accountable-care organizations or patient-centered medical homes. However, as MTM becomes more integrated into routine health care, the more difficult it is to attribute change to MTM alone. Furthermore, secular trends in related quality-improvement initiatives (eg, medication adherence interventions; practice-based, medication-related patient safety initiatives or requirements; and meaningful use requirements for electronic health records) might obscure the effects of MTM efforts. Positive deviance analyses78 with rigorous measurement of implementation features or stepped wedge trial designs79 may be useful, since they provide rigorous approaches to evaluating real-world implementation. Finally, the population effect of MTM may depend on higher rates of patient participation; future studies and evaluations should consider including measures of reach and examine alternative ways of enrolling patients and keeping them engaged.
Because MTM services vary substantially, any constraints applied by a systematic review to establish scope necessarily limit the applicability of the review findings. Our review did not address MTM interventions conducted in inpatient settings or single-episode types of interventions (eg, medication reconciliation, which some view as a specific type of MTM service). Although we tried to distinguish MTM from disease or case management interventions, making this distinction was challenging. We allowed MTM interventions that targeted patients with a single condition, such as diabetes or hypertension, as long as the MTM services included a comprehensive review of all medications rather than just medications for the single condition. Despite these limitations, the range of included study designs enhanced the applicability of findings for real-world settings when evidence was sufficient.24
We included interventions labeled pharmaceutical care or medicinesmanagement to ensure that the evidence base included studies before the Medicare Part D MTM era and non-US studies. Although our approach made results more challenging to interpret because of the resultant heterogeneity, it ensured that we captured interventions that had MTM components but lacked the descriptor phrase medication therapy management. We attempted to stratify findings by whether the study was a Part D program, but we did not have enough studies that used the same outcomes to be able to draw conclusions.
New research should be based on national priorities. Studies designed to identify causal relationships between MTM interventions and their outcomes (including cost-effectiveness analyses) must control for confounding, but they may offer limited information on the elements that explain program success or failure. Studies designed to explore the reasons for program success or failure using qualitative or single-arm designs may offer hypotheses-generating rather than hypotheses-confirming insights on MTM effectiveness. New research, regardless of specific focus, will likely continue to find inconsistent results until studies account for underlying sources of variability in populations, interventions, and outcome measures.
We found a low strength of evidence of benefit for a limited number of intermediate and health care use and cost outcomes. Evidence was insufficient for most outcomes because of inconsistency in direction and magnitude and also because of imprecision. Wide variations in populations and MTM interventions likely explain these inconsistencies.
Accepted for Publication: August 27, 2014.
Corresponding Author: Meera Viswanathan, PhD, RTI International, 3040 E Cornwallis Rd, PO Box 12194, Research Triangle Park, NC 27709 (firstname.lastname@example.org).
Published Online: November 17, 2014. doi:10.1001/jamainternmed.2014.5841.
Author Contributions: Drs Viswanathan and Kahwati had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Study concept and design: Viswanathan, Kahwati, Golin, Blalock, Coker-Schwimmer.
Acquisition, analysis, or interpretation of data: All authors.
Drafting of the manuscript: All authors.
Critical revision of the manuscript for important intellectual content: Viswanathan, Kahwati, Golin, Blalock, Coker-Schwimmer, Lohr.
Statistical analysis: Viswanathan, Kahwati, Blalock, Coker-Schwimmer.
Obtained funding: Viswanathan, Lohr.
Administrative, technical, or material support: All authors.
Study supervision: Viswanathan.
Conflict of Interest Disclosures: None reported.
Funding/Support: This project was funded under contract No. HHSA290201200008I from the Agency for Healthcare Research and Quality (AHRQ), US Department of Health and Human Services, to RTI International.
Role of the Funder/Sponsor: The AHRQ staff participated in development of the scope of work and reviewed drafts of the manuscript. Approval from the AHRQ was required before the manuscript could be submitted for publication, but the authors are solely responsible for its content and the decision to submit it for publication. The AHRQ staff did not participate in the conduct of the review, data collection, data management, data analysis, interpretation of the data, or preparation of the manuscript. Statements in the report should not be construed as endorsement by the AHRQ or the US Department of Health and Human Services.