Context
Depression strongly predicts nonadherence to human immunodeficiency virus (HIV) antiretroviral therapy, and adherence is essential to maintaining viral suppression. This suggests that pharmacologic treatment of depression may improve virologic outcomes. However, previous longitudinal observational analyses have inadequately adjusted for time-varying confounding by depression severity, which could yield biased estimates of treatment effect. Application of marginal structural modeling to longitudinal observation data can, under certain assumptions, approximate the findings of a randomized controlled trial.
Objective
To determine whether antidepressant medication treatment increases the probability of HIV viral suppression.
Design
Community-based prospective cohort study with assessments conducted every 3 months.
Setting
Community-based research field site in San Francisco, California.
Participants
One hundred fifty-eight homeless and marginally housed persons with HIV who met baseline immunologic (CD4+ T-lymphocyte count, <350/μL) and psychiatric (Beck Depression Inventory II score, >13) inclusion criteria, observed from April 2002 through August 2007.
Main Outcome Measures
Probability of achieving viral suppression to less than 50 copies/mL. Secondary outcomes of interest were probability of being on an antiretroviral therapy regimen, 7-day self-reported percentage adherence to antiretroviral therapy, and probability of reporting complete (100%) adherence.
Results
Marginal structural models estimated a 2.03 greater odds of achieving viral suppression (95% confidence interval [CI], 1.15-3.58; P = .02) resulting from antidepressant medication treatment. In addition, antidepressant medication use increased the probability of antiretroviral uptake (weighted odds ratio, 3.87; 95% CI, 1.98-7.58; P < .001). Self-reported adherence to antiretroviral therapy increased by 25 percentage points (95% CI, 14-36; P < .001), and the odds of reporting complete adherence nearly doubled (weighted odds ratio, 1.94; 95% CI, 1.20-3.13; P = .006).
Conclusions
Antidepressant medication treatment increases viral suppression among persons with HIV. This effect is likely attributable to improved adherence to a continuum of HIV care, including increased uptake and adherence to antiretroviral therapy.
Depression is common among people living with human immunodeficiency virus (HIV)/AIDS. In a nationally representative probability sample of adults receiving care for HIV in the United States, the 12-month prevalence of major depressive disorder according to the Composite International Diagnostic Interview Short Form was 36%.1 This finding exceeds the 5% to 7% 12-month prevalence of major depressive disorder in the general population.2-4
Among persons living with HIV, depression has been associated with reduced uptake of5,6 and adherence to7-9 antiretroviral therapy (ART), as well as decline in CD4+ T-lymphocyte count10 and progression to AIDS.11 However, little research exists on whether pharmacologic treatment of depressed mood can improve HIV outcomes.12 One analysis of electronic medical record data from persons with HIV enrolled in 2 large health maintenance organizations showed that depression was associated with reduced odds of achieving HIV-1 RNA suppression to less than 500 copies/mL and that treatment with selective serotonin reuptake inhibitor (SSRI) medications was associated with improved ART adherence and viral suppression.8 This analysis, however, did not adjust for depression severity, which could have confounded the observed relationship between treatment and outcome. Specifically, patients with more severe symptoms of depression are more likely to be prescribed treatment with antidepressant medication, and antidepressant medication treatment may improve subsequent depression severity (Figure). Confounding arises because depression severity is associated with the outcome.
Although observational studies using conventional statistical methods can adjust for baseline confounding by indication (to the extent that confounders are measured without error), they are unable to adjust for time-dependent confounding that arises in longitudinal treatment settings. Conventional statistical adjustment, ie, including depression severity as a time-dependent variable in a regression model, may bias the estimated treatment effect by conditioning on part of the effect of interest. The statistical method of marginal structural models provides a means to account for this time-dependent confounding by indication. Under certain assumptions (the validity of which are examined in this article), marginal structural modeling aims to use observational data to approximate the findings of a randomized controlled trial.13-16 Therefore, we fit a marginal structural model to data from a longitudinal cohort of homeless and marginally housed persons with HIV to estimate the effect of treatment with antidepressant medications on ART adherence and viral suppression.
Data for this analysis were drawn from participants observed from April 2002 through August 2007 in the Research on Access to Care in the Homeless (REACH) study, which is an observational prospective cohort of homeless and marginally housed adults with HIV in San Francisco, California.17,18 In brief, study participants in the parent cohort were recruited from homeless shelters, free-lunch programs, and low-income, single-room-occupancy hotels. Participants signed a written consent form on entry into the study and were reimbursed $10 to $15 per assessment, which occurred approximately every 3 months at the University of California at San Francisco (UCSF) Clinical and Translational Science Institute Tenderloin Clinical Research Center and included a structured interview and blood collection. This recruitment method yielded information updated quarterly on sociodemographics, depression severity, alcohol and other drug use, health services utilization, overall health status, and medications. Depression severity was measured with the Beck Depression Inventory II (BDI-II).19 The Committee on Human Research at UCSF approved all study procedures.
Participants were eligible for inclusion in this analysis if they had (1) a CD4+ T-lymphocyte count less than 350/μL at baseline and (2) symptoms of depression at baseline, defined as a BDI-II score greater than 13. Our choice of a CD4+ count less than 350/μL was based on a threshold, widely used at the time of the study, for deciding when to initiate ART in asymptomatic HIV-infected patients.20 The psychiatric inclusion criterion represents a reasonable clinical threshold at which many psychiatrists would choose to recommend starting psychopharmacologic or psychotherapeutic treatment for depressed mood. We decided not to limit the sample to participants with formal DSM diagnoses because subsyndromal symptoms are commonly experienced during the course of mood disorders and are associated with significant psychosocial impairment.21-23
For this study, the primary outcome of interest was probability of HIV-1 RNA viral suppression to less than 50 copies/mL. Plasma was processed and stored at −40°C within 6 hours of collection. Determinations of HIV-1 viral load were made by means of an ultrasensitive assay (HIV-1 Amplicor Monitor, Version 1.5; Roche Molecular Systems, Alameda, California), with a lower detection limit of 20 copies/mL. Secondary outcomes of interest were (1) probability of being on an ART regimen; (2) self-reported ART adherence, defined as the percentage of prescribed ART doses taken within a 7-day recall period24,25; and (3) probability of reporting complete (ie, 100%) ART adherence. Zero adherence was assigned to participants who were eligible for but were not taking ART, consistent with an expanded concept of adherence to a continuum of HIV care including ART uptake, persistence, and dose-taking adherence (or execution)26,27 that has been used in previous research.28
We used weighted regression modeling to estimate the parameters of a marginal structural model.13-16 That is, rather than adjust for time-dependent confounding by including depression severity as a covariate in the regression model, each patient received a weight inversely proportional to the estimated probability of having his or her own observed antidepressant medication treatment history. Intuitively, this approach corrects for the nonrandom assignment of antidepressant medication treatment by up-weighting individuals whose treatment and covariate histories are underrepresented compared with what would have been observed if treatment had been randomized. This approach accounts for confounding without stratifying or conditioning on factors in the postulated causal pathway and has been successfully applied in the field of HIV medicine, yielding results that have more closely approximated the findings from randomized controlled trials than have other statistical adjustment methods.13,15 Marginal structural modeling has also been used to estimate the effects of other time-varying exposures, such as methotrexate in patients with rheumatoid arthritis29 and aspirin among middle-aged men.30
The model used to estimate the denominator of the weights was a pooled logistic regression model31 for the probability of receipt of antidepressant medication at a given visit. Included in this logistic model were variables, measured at baseline, that have been previously studied as potential correlates of psychotropic medication use among persons with HIV32,33: age (years), sex, education (high school graduate and some college vs no diploma), self-identified race (white, black, or other), presence of 1 of 5 chronic medical conditions (heart disease, hypertension, diabetes, emphysema, and asthma), CD4+ count nadir, substance use (alcohol, crack cocaine, methamphetamines, heroin, or any injection drug) in the 30 days before baseline, and BDI-II score. We also included time-varying BDI-II score, measured at the previous visit, and cumulative number of days of follow-up, modeled as a restricted cubic spline with knots at the 5th, 25th, 50th, 75th, and 95th percentiles. The model used to estimate the numerator of the weights was similar except that terms depending on the time-varying covariates were eliminated.
Each person-visit was treated as an observation, and the model was fit on the subsample of person-visits for which no exposure to antidepressant medication had yet occurred through the previous visit. We conducted the analysis using a conservative “intention-to-treat” assumption,15,34 which is necessary to avoid generating overinflated estimates of treatment effect.35,36 In the context of our study, the observational analog of this assumption meant that once participants started on an antidepressant medication regimen, they were assumed to remain on it thereafter (ie, probability weights were unaffected by subsequent depression severity scores or weights). To adjust for potential selection bias by measured factors due to loss to follow-up, a second set of censoring weights was obtained by a similar procedure, whereby participants who died were designated treatment failures and censoring was defined as loss to follow-up for any other reason.13,14 The overall inverse probability of treatment and censoring (IPTC) weights were computed as the product of the treatment and censoring weights and then stabilized to increase efficiency.13,14
To estimate the effect of antidepressant medication treatment on viral suppression, the IPTC weights were used in a weighted pooled logistic regression model with viral suppression to less than 50 copies/mL as the outcome. We reassessed the statistical significance of the treatment estimate when self-reported ART adherence was included in the regression model. We interpreted an attenuated treatment estimate as suggestive that the effect was mediated by adherence, although additional assumptions would be necessary to make a definitive conclusion. For the secondary outcomes, we estimated the effect of antidepressant medication treatment on self-reported adherence by using the same IPTC weights in a weighted pooled linear regression model with self-reported adherence as the outcome and in weighted pooled logistic regression models with being on an ART regimen and complete adherence as the outcomes. These regression models included the same baseline covariates as were used in estimation of the weights but did not include the time-varying covariate. The primary regressor of interest was receipt of antidepressant medication treatment at or before the previous (quarterly) visit. We used a 12-week lag period because this has been considered a duration of antidepressant medication treatment sufficient to produce a robust therapeutic effect.37,38 All analyses were censored at the last time the participant remained under follow-up. Standard errors were based on robust variance estimates to account for clustering of observations within participants over time.39-42
We undertook a number of sensitivity analyses to assess the robustness of our findings.43 First, in light of previous research showing that the efficacy of antidepressant medication in improving mood is greater among those with more severe depression,44-46 we stratified our analyses by baseline depression severity. We compared the effect of antidepressant medication treatment on viral suppression among those with minimal or mild depression at baseline (BDI-II score, <20) vs moderate to severe depression at baseline (BDI-II score, ≥20). Second, we examined the sensitivity of our estimates to different model specifications. We included different configurations of additional baseline and time-varying covariates, including alcohol and other substance use (previous 30 days), 36-Item Short Form Health Survey mental component summary and physical component summary scores, self-reported overall health, emergency department and hospital utilization (previous 90 days), homelessness status (previous 90 days), and representative payeeship (previous 90 days). Third, to explore bias-variance tradeoffs, we progressively trimmed47 the IPTC weights at the 1st and 99th percentiles, the 5th and 95th percentiles, and the 10th and 90th percentiles. Fourth, we refit all models using treatment with SSRI medication (vs no SSRI) as the exposure. We examined the effect of this specific class of antidepressant medication because SSRIs are generally regarded, owing to safety and tolerability considerations,48 as first-line agents for pharmacologic treatment of depression in patients with a substance abuse comorbidity profile similar to that of the participants in the REACH cohort. Furthermore, SSRIs are the class of antidepressant medication most commonly prescribed to HIV-infected persons with mood disorders.33
Characteristics of the sample
A total of 158 participants (of 551 in the parent cohort) met inclusion criteria and contributed a total of 1782 person-quarters of observation. The average length of follow-up was 2.9 years (median, 3.0 years; range, 0.2-5.3 years). During the follow-up period, 38 participants died (24.1%) and 17 were lost to follow-up (10.8%). An additional 8 completed 12 months of follow-up according to a prespecified protocol for a related randomized controlled trial (but then exited the cohort) (5.1%), and 1 left the study because of incarceration (0.6%).
At baseline, 92 participants (58.2%) were on an ART regimen. There were 750 person-quarters of observation contributed before antidepressant medication initiation, with SSRI medications being the most frequently prescribed type of antidepressant medication (84.3%). Among the 119 participants who ultimately received antidepressant medication treatment at some point during follow-up, the average percentage of the time that subjects were actually taking antidepressant medication after initiation was 67% (median, 73%; interquartile range, 42%-100%). In terms of total treatment time, 763 of 1259 (60.6%) person-quarters of observation after antidepressant medication initiation were spent on treatment. Many subjects experienced 1 or more subsequent interruptions of antidepressant medication treatment, suggesting that our intention-to-treat assumption would yield conservative estimates of treatment effect.35,36 The median duration of uninterrupted antidepressant medication treatment was 251 days (interquartile range, 85-432 days).
Baseline summary statistics for the sample are displayed in Table 1. One-third to one-half of the sample reported alcohol or other drug use. Participants who had ever been treated with antidepressant medications appeared to have greater severity of illness at baseline. The ever-treated group had a lower mean baseline 36-Item Short Form Health Survey mental component summary score, and a higher proportion had a chronic medical condition. The ever-treated and never-treated groups were relatively balanced with regard to other baseline characteristics, such as CD4+ count, log viral load, self-reported overall health, alcohol use, and socioeconomic indicators.
Mean depression severity as measured by the BDI-II was greater among those who had ever initiated treatment with antidepressant medications (23.9 vs 20.2; P = .06). This finding was consistent with what was observed in the multivariable probability-of-treatment model used to construct the weights (Table 2): each 1-point increase in the BDI-II at the previous visit was associated with a 4% increased odds of initiating treatment with antidepressant medication (adjusted odds ratio [OR], 1.04; 95% confidence interval [CI], 1.01-1.08; P = .02), even after adjusting for baseline severity of depression. Participants were also more likely to start antidepressant medication treatment if they were male or chronically ill. Stabilized IPTC weights based on the resulting model fit had a mean (SD) of 1.001 (0.12). Further details on the distribution of both stabilized and unstabilized weights are shown in the eFigure.
Effect of antidepressant medication treatment
Without any adjustment for confounding, antidepressant medication treatment was associated with a 1.55 greater odds (95% CI, 1.03-2.31; P = .03) of achieving viral suppression (Table 3). By means of a conventional multivariable logistic regression adjustment strategy for confounding, antidepressant medication treatment was associated with a 1.58 greater odds (95% CI, 1.07-2.31; P = .02) of achieving viral suppression. However, because depression severity is affected by past treatment with antidepressant medication, these estimates may not carry a causal interpretation as the overall effect of antidepressant medication treatment. Marginal structural models estimated a 2.03 greater odds (95% CI, 1.15-3.58; P = .02) of achieving viral suppression. When self-reported ART adherence was included in the regression model, the estimated effect declined in magnitude and statistical significance (weighted OR, 1.32; 95% CI, 0.73-2.40; P = .36).
Antidepressant medication treatment seemed to have larger effects among participants with more severely depressed mood. Among those with minimal or mild depression severity at baseline (BDI-II score, <20), antidepressant medication treatment did not result in a statistically significantly increased odds of achieving viral suppression (weighted OR, 1.75; 95% CI, 0.71-4.33; P = .23). However, the CI does not rule out the possibility of a reasonably large benefit in this subgroup. Among those with moderate to severe depression at baseline (BDI-II score, ≥20), the effect on viral suppression was statistically significant (weighted OR, 2.77; 95% CI, 1.26-6.09; P = .01).
In supplemental analyses, we sought to determine whether the effect of antidepressant medication treatment on viral suppression could be attributable to its effects on adherence to a continuum of HIV care. Weighted regression showed that antidepressant medication use resulted in a 3.87 greater odds of being on an ART regimen (95% CI, 1.98-7.58; P < .001). In addition, antidepressant medication treatment increased self-reported adherence by 25% (95% CI, 14%-36%; P < .001) and nearly doubled the odds of achieving complete adherence (weighted OR, 1.94; 95% CI, 1.20-3.13; P = .006).
To explore the sensitivity of our estimates to alternative model specifications, we added more baseline and time-varying covariates to the regression models in different configurations (eTable 1). Under these alternate specifications, the estimated OR for achieving viral suppression ranged from 1.52 to 2.19 (with P values from .19 to .01). Because these alternate specifications did not produce qualitatively dissimilar estimates, we reported the results of the original model as our primary findings. Next, we progressively truncated the IPTC weights at the 1st and 99th, 5th and 95th, and 10th and 90th percentiles (eTable 2). The estimated ORs were qualitatively similar to (ie, within ±2% of) the original estimates, indicating that, despite relatively larger weights, outlier participants did not exert overt influence on the results. Finally, we refit all models to determine the effect of SSRI medication treatment on viral suppression. Marginal structural models estimated qualitatively similar effects of SSRIs on probability of achieving viral suppression (weighted OR, 1.73; 95% CI, 0.84-3.55; P = .14).
Using a marginal structural model to account for time-varying confounding by depression severity, we found that antidepressant medication treatment increased the probability of achieving viral suppression among a cohort of homeless and marginally housed persons with HIV. In supplemental analyses, we found evidence of improved adherence along a continuum of HIV care: antidepressant medication treatment increased the probability of ART uptake nearly 4-fold and also resulted in a 25–percentage point increase in self-reported ART adherence and a nearly 2-fold–increased probability of achieving complete adherence. These results are consistent with previous studies linking depressive symptoms to reduced uptake5,6 and adherence7-9 to ART.
Although changes in behavior are the most plausible explanation for our findings,49,50 some researchers have hypothesized that biological pathways may directly link depression to poorer HIV outcomes.51 This hypothesis is consistent with previous studies showing that, even after adjusting for ART adherence, depression is associated with worsened HIV outcomes, including CD4+ count decline,52 incident AIDS-defining illness,53 and AIDS-related mortality.54 One study showed that resolution of a major depressive episode was associated with increased natural killer cell activity.55 More recently, a cross-sectional analysis of data from 658 HIV-positive men and women showed that participants taking SSRIs were less likely to have detectable cerebrospinal fluid HIV-1 RNA levels.56 This relationship held even among those not concurrently taking ART, suggestive of a biological effect and leading some to suggest that psychotropic medications could be useful as adjunctive treatment for persons with HIV.57 In our marginal structural model analysis, the estimated effect of antidepressant medication treatment became statistically nonsignificant when adjusted for ART adherence, suggesting that the effect of antidepressants on HIV treatment response is at least partially mediated by adherence. However, the attenuation of the treatment effect once adherence was added to the model could also have been due to the limitations of our relatively small sample size. Additional assumptions would be required to fully interpret the adjusted effect as a direct (nonmediated) effect of antidepressant medication treatment.58,59 In particular, we would need to assume that the baseline covariates alone capture all the confounding from the effect of adherence on viral suppression, which is unlikely to be the case. Distinguishing the relative contributions of the 2 mechanisms, direct vs indirect (biological vs behavioral), through which antidepressant medication treatment could affect virologic outcomes was beyond the scope of our study and remains an important area for future work.
We observed greater effects of antidepressant medication on viral suppression among participants with more severe depressive symptoms at baseline. This finding is potentially analogous to results from recently published meta-analyses of randomized controlled trials showing that the efficacy of antidepressant medication on mood is greater among those with more severe depressive symptoms at baseline.44-46 In other clinical contexts, marginal structural models have also estimated treatment effects that closely approximate the findings from randomized controlled trials.16,60-62 Even though our estimates have a causal interpretation under certain assumptions, randomized controlled trial evidence is needed to definitively conclude that pharmacologic treatment of depression has beneficial effects on HIV treatment adherence and HIV treatment outcomes.
Despite these caveats, our study contributes to a sparse literature on how treatment of depression can result in improved HIV outcomes. To our knowledge, no randomized controlled trials of antidepressant medication treatment alone have shown improvements in virologic outcomes. Safren et al63 studied the effect of individual cognitive behavioral therapy among persons living with HIV who were also diagnosed as having a depressive mood disorder. The cognitive behavioral therapy intervention explicitly incorporated adherence training and improved ART adherence by more than 20 percentage points at 12-month follow-up, but the small sample size limited the investigators' ability to detect differences in viral load. Two randomized studies of group-based cognitive behavioral stress management for persons with HIV have yielded mixed results, one positive64 and one negative,65 but those studies enrolled participants with minimal depressive symptoms (ie, mean BDI of <14 at baseline). Our study is notable in that it suggests that antidepressant medication treatment can improve HIV care and HIV treatment outcomes among persons with significant depressive symptoms.
Also in contrast to these studies, the participants in the REACH cohort are drawn from a population whose frequently changing living situations and medical and psychiatric comorbidities can make controlled study difficult. All REACH participants were either homeless or marginally housed, approximately one-half reported alcohol or illicit drug use, and more than one-third had been assigned to representative payeeship. Because of these complex comorbidities, many of our study participants would have been excluded from most randomized controlled trials of antidepressant efficacy.66,67 The clinical and public health importance of our work is further underscored by nationally representative evidence of underdiagnosis68 and undertreatment32 of depression among persons living with HIV/AIDS, as well as the fact that even incremental (eg, 10%) increases in ART adherence can improve virologic69,70 and immunologic71 outcomes in this population.
Despite these strengths, interpretation of our findings is subject to a number of limitations. Most participants in our study were female, which limits generalizability to the HIV epidemic in the United States.68,72 However, while not formally a random sample of HIV-infected homeless and marginally housed persons, the parent cohort (REACH) was drawn from a systematic and reproducible venue-based sample73 of homeless and marginally housed persons with HIV. The REACH cohort was composed of mostly men with a high prevalence of drug use, alcohol use, and mental illness and is roughly generalizable to the HIV-infected urban poor.17,18 The preponderance of females in our analytic sample may reflect the overall epidemiology of major depressive disorder in the general population.3,74 Although our sample may not represent patients seen in most clinical settings, it does reflect a population that has variable access to medical and mental health care services and that remains an important part of the national HIV epidemic.75,76
A second limitation is that our statistical analyses group antidepressant medications together into a single category, implicitly assuming equivalent treatment effects across medication classes. However, there is recent meta-analytic evidence to support this simplifying assumption.77-79 Lack of power prevented us from studying individual drugs, but we conducted a sensitivity analysis for the most frequently prescribed medication class in our study (SSRIs) and observed qualitatively similar effects on viral suppression.
Finally, our data did not permit us to account for dose escalation. Drug metabolism and clearance vary widely between individuals, and psychiatrists frequently compensate for this pharmacokinetic variability by tailoring antidepressant medication dosage on their patients' responses. Our marginal structural model analysis can be conceptualized as analogous to a flexible randomized controlled trial in which subjects are randomized to receive antidepressant medication treatment (or not), but the drug and dose are left up to physician and patient discretion.
As noted previously, marginal structural models require several assumptions. First, consistency implies that each participant's potential outcome under his or her observed antidepressant medication exposure history is precisely his or her observed outcome.80 Although consistency may be problematic when the exposure is a feature such as obesity, it is plausible (although not empirically verifiable) in observational studies of medical treatments. Second, with regard to positivity, or the experimental treatment assumption,14 there were no structural zeroes43 in the setting of our data, ie, factors that would be deterministic of either treatment or nontreatment with antidepressant medication. We were able to identify exposed and unexposed participants at each level of depressive severity as measured by the BDI-II, thereby ruling out the presence of potential random zeroes. In addition, we fitted a regression model using all the baseline covariates and the time-varying covariate to compute predicted probabilities of treatment. We then visually inspected a plot of the log odds of treatment against both the observed treatment and predicted probabilities of treatment to ensure that there was an acceptable degree of variation of observed values across all levels of the predicted.81,82 Third, we assumed that conditioning on several baseline covariates and recent values of depression severity was sufficient to achieve exchangeability between those who did and did not initiate treatment with antidepressant medication during the follow-up period.83,84 This is not an empirically verifiable assumption, but we relied on previous studies to guide our inclusion of the most important confounders. Furthermore, we included a broad range of other covariates in an exhaustive sensitivity analysis, and our findings remained robust to these alternate specifications. Nonetheless, some unmeasured confounding could remain, eg, receipt of adherence counseling. Subjects who received adherence counseling may be more likely to initiate antidepressant medication treatment because of greater interaction with the care team and greater awareness of depression severity, and they may also be more likely to adhere to ART. Fourth, we made the conservative intent-to-treat assumption, long recognized as the preferred approach to analysis of data from randomized controlled trials.35,36,85 Thus, we anticipate some bias toward the null in our treatment estimates. Participants in the study cohort remained on antidepressant medication regimens an average of 67% (median, 73%) of the time after treatment initiation, which compares favorably with completion rates observed in long-term (ie, 6-8 months in duration) randomized controlled trials of SSRIs86 and is similar to completion rates observed in short-term trials of both SSRIs87 and tricyclic antidepressant medications.88
In summary, we introduced the method of marginal structural modeling to the psychiatric literature to estimate the causal effect of antidepressant medication treatment on viral suppression among a longitudinal cohort of homeless and marginally housed persons with HIV. Antidepressant medication treatment resulted in a 2-fold greater probability of achieving viral suppression, and this effect was likely due to improved adherence along a continuum of HIV care. The estimated effects are clinically meaningful and (under certain assumptions) have a causal interpretation, yet randomized controlled trials are needed to conclude definitively that antidepressant medication increases viral suppression in this population. Given the relatively high prevalence of underdiagnosed and undertreated depressive mood disorders among persons with HIV, our findings suggest that improved diagnosis and treatment of depression may have an important contribution to improving HIV treatment outcomes.
Correspondence: David R. Bangsberg, MD, MPH, Harvard Initiative for Global Health, 104 Mt Auburn St, Cambridge, MA 02138 (dbangsberg@partners.org).
Submitted for Publication: December 15, 2009; final revision received April 21, 2010; accepted May 17, 2010.
Author Contributions: All authors had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Financial Disclosure: None reported.
Funding/Support: The REACH study was funded by National Institute of Mental Health (NIMH) grant R01 MH-054907. Members of the research team also received funding from the following sources: NIMH Institutional Training Award R25 MH-060482 (Dr Tsai); National Institutes of Health/National Center for Research Resources UCSF-Clinical and Translational Science Institute grant UL1 RR-024131 (Dr Tsai); NIMH grant K23 MH-079713-01 (Dr Weiser); and NIMH grant K24 MH-087227 (Dr Bangsberg). The HIV RNA kits were donated by Roche Molecular Systems.
Disclaimer: The study contents are solely the responsibility of the authors and do not necessarily represent the official views of the sponsors.
Additional Contributions: We thank the REACH participants who made this study possible by sharing their experiences, as well as the REACH staff who conducted the interviews. Robert B. Daroff Jr, MD, provided helpful comments. While these individuals are acknowledged for their assistance, no endorsement of manuscript contents or conclusions should be inferred.
1.Bing
EGBurnam
MALongshore
DFleishman
JASherbourne
CDLondon
ASTurner
BJEggan
FBeckman
RVitiello
BMorton
SCOrlando
MBozzette
SAOrtiz-Barron
LShapiro
M Psychiatric disorders and drug use among human immunodeficiency virus–infected adults in the United States.
Arch Gen Psychiatry 2001;58
(8)
721- 728
PubMedGoogle Scholar 2.Hasin
DSGoodwin
RDStinson
FSGrant
BF Epidemiology of major depressive disorder: results from the National Epidemiologic Survey on Alcoholism and Related Conditions.
Arch Gen Psychiatry 2005;62
(10)
1097- 1106
PubMedGoogle Scholar 3.Kessler
RCBerglund
PDemler
OJin
RKoretz
DMerikangas
KRRush
AJWalters
EEWang
PSNational Comorbidity Survey Replication, The epidemiology of major depressive disorder: results from the National Comorbidity Survey Replication (NCS-R).
JAMA 2003;289
(23)
3095- 3105
PubMedGoogle Scholar 4.Kessler
RCChiu
WTDemler
OMerikangas
KRWalters
EE Prevalence, severity, and comorbidity of 12-month
DSM-IV disorders in the National Comorbidity Survey Replication [published correction appears in
Arch Gen Psychiatry. 2005;62(7):709].
Arch Gen Psychiatry 2005;62
(6)
617- 627
PubMedGoogle Scholar 5.Fairfield
KMLibman
HDavis
RBEisenberg
DM Delays in protease inhibitor use in clinical practice.
J Gen Intern Med 1999;14
(7)
395- 401
PubMedGoogle Scholar 6.Tegger
MKCrane
HMTapia
KAUldall
KKHolte
SEKitahata
MM The effect of mental illness, substance use, and treatment for depression on the initiation of highly active antiretroviral therapy among HIV-infected individuals.
AIDS Patient Care STDS 2008;22
(3)
233- 243
PubMedGoogle Scholar 8.Horberg
MASilverberg
MJHurley
LBTowner
WJKlein
DBBersoff-Matcha
SWeinberg
WGAntoniskis
DMogyoros
MDodge
WTDobrinich
RQuesenberry
CPKovach
DA Effects of depression and selective serotonin reuptake inhibitor use on adherence to highly active antiretroviral therapy and on clinical outcomes in HIV-infected patients.
J Acquir Immune Defic Syndr 2008;47
(3)
384- 390
PubMedGoogle Scholar 9.Kacanek
DJacobson
DLSpiegelman
DWanke
CIsaac
RWilson
IB Incident depression symptoms are associated with poorer HAART adherence: a longitudinal analysis from the Nutrition for Healthy Living Study.
J Acquir Immune Defic Syndr 2010;53
(2)
266- 272
PubMedGoogle Scholar 10.Burack
JHBarrett
DCStall
RDChesney
MAEkstrand
MLCoates
TJ Depressive symptoms and CD4 lymphocyte decline among HIV-infected men.
JAMA 1993;270
(21)
2568- 2573
PubMedGoogle Scholar 11.Page-Shafer
KDelorenze
GNSatariano
WAWinkelstein
W
Jr Comorbidity and survival in HIV-infected men in the San Francisco Men's Health Survey.
Ann Epidemiol 1996;6
(5)
420- 430
PubMedGoogle Scholar 12.Ferrando
SJFreyberg
Z Treatment of depression in HIV positive individuals: a critical review.
Int Rev Psychiatry 2008;20
(1)
61- 71
PubMedGoogle Scholar 13.Hernán
MABrumback
BRobins
JM Marginal structural models to estimate the causal effect of zidovudine on the survival of HIV-positive men.
Epidemiology 2000;11
(5)
561- 570
PubMedGoogle Scholar 14.Robins
JMHernán
MABrumback
B Marginal structural models and causal inference in epidemiology.
Epidemiology 2000;11
(5)
550- 560
PubMedGoogle Scholar 15.Hernán
MABrumback
BRobins
JM Marginal structural models to estimate the joint causal effect of nonrandomized treatments.
J Am Stat Assoc 2001;96
(454)
440- 448
Google Scholar 16.Hernán
MABrumback
BARobins
JM Estimating the causal effect of zidovudine on CD4 count with a marginal structural model for repeated measures.
Stat Med 2002;21
(12)
1689- 1709
PubMedGoogle Scholar 17.Zolopa
ARHahn
JAGorter
RMiranda
JWlodarczyk
DPeterson
JPilote
LMoss
AR HIV and tuberculosis infection in San Francisco's homeless adults: prevalence and risk factors in a representative sample.
JAMA 1994;272
(6)
455- 461
PubMedGoogle Scholar 18.Robertson
MJClark
RACharlebois
EDTulsky
JLong
HLBangsberg
DRMoss
AR HIV seroprevalence among homeless and marginally housed adults in San Francisco.
Am J Public Health 2004;94
(7)
1207- 1217
PubMedGoogle Scholar 19.Beck
ASteer
RBrown
G Manual for Beck Depression Inventory II (BDI-II). San Antonio, TX: Psychology Corp; 1996
20.Hammer
SMEron
JJ
JrReiss
PSchooley
RTThompson
MAWalmsley
SCahn
PFischl
MAGatell
JMHirsch
MSJacobsen
DMMontaner
JSRichman
DDYeni
PGVolberding
PAInternational AIDS Society-USA, Antiretroviral treatment of adult HIV infection: 2008 recommendations of the International AIDS Society-USA panel.
JAMA 2008;300
(5)
555- 570
PubMedGoogle Scholar 21.Wells
KBBurnam
MARogers
WHays
RCamp
P The course of depression in adult outpatients: results from the Medical Outcomes Study.
Arch Gen Psychiatry 1992;49
(10)
788- 794
PubMedGoogle Scholar 22.Judd
LLAkiskal
HSZeller
PJPaulus
MLeon
ACMaser
JDEndicott
JCoryell
WKunovac
JLMueller
TIRice
JPKeller
MB Psychosocial disability during the long-term course of unipolar major depressive disorder.
Arch Gen Psychiatry 2000;57
(4)
375- 380
PubMedGoogle Scholar 23.Judd
LLAkiskal
HSMaser
JDZeller
PJEndicott
JCoryell
WPaulus
MPKunovac
JLLeon
ACMueller
TIRice
JAKeller
MB A prospective 12-year study of subsyndromal and syndromal depressive symptoms in unipolar major depressive disorders.
Arch Gen Psychiatry 1998;55
(8)
694- 700
PubMedGoogle Scholar 24.Chesney
MAIckovics
JRChambers
DBGifford
ALNeidig
JZwickl
BWu
AWPatient Care Committee & Adherence Working Group of the Outcomes Committee of the Adult AIDS Clinical Trials Group (AACTG), Self-reported adherence to antiretroviral medications among participants in HIV clinical trials: the AACTG adherence instruments.
AIDS Care 2000;12
(3)
255- 266
PubMedGoogle Scholar 25.Moss
ARHahn
JAPerry
SCharlebois
EDGuzman
DClark
RABangsberg
DR Adherence to highly active antiretroviral therapy in the homeless population in San Francisco: a prospective study.
Clin Infect Dis 2004;39
(8)
1190- 1198
PubMedGoogle Scholar 26.Urquhart
J Pharmionics: research on what patients do with prescription drugs.
Pharmacoepidemiol Drug Saf 2004;13
(9)
587- 590
PubMedGoogle Scholar 27.Giordano
TPSuarez-Almazor
MEGrimes
RM The population effectiveness of highly active antiretroviral therapy: are good drugs good enough?
Curr HIV/AIDS Rep 2005;2
(4)
177- 183
PubMedGoogle Scholar 28.Kushel
MBColfax
GRagland
KHeineman
APalacio
HBangsberg
DR Case management is associated with improved antiretroviral adherence and CD4+ cell counts in homeless and marginally housed individuals with HIV infection.
Clin Infect Dis 2006;43
(2)
234- 242
PubMedGoogle Scholar 29.Choi
HKHernán
MASeeger
JDRobins
JMWolfe
F Methotrexate and mortality in patients with rheumatoid arthritis: a prospective study.
Lancet 2002;359
(9313)
1173- 1177
PubMedGoogle Scholar 30.Cook
NRCole
SRHennekens
CH Use of a marginal structural model to determine the effect of aspirin on cardiovascular mortality in the Physicians' Health Study.
Am J Epidemiol 2002;155
(11)
1045- 1053
PubMedGoogle Scholar 31.D’Agostino
RBLee
MLBelanger
AJCupples
LAAnderson
KKannel
WB Relation of pooled logistic regression to time dependent Cox regression analysis: the Framingham Heart Study.
Stat Med 1990;9
(12)
1501- 1515
PubMedGoogle Scholar 32.Burnam
MABing
EGMorton
SCSherbourne
CFleishman
JALondon
ASVitiello
BStein
MBozzette
SAShapiro
MF Use of mental health and substance abuse treatment services among adults with HIV in the United States.
Arch Gen Psychiatry 2001;58
(8)
729- 736
PubMedGoogle Scholar 33.Vitiello
BBurnam
MABing
EGBeckman
RShapiro
MF Use of psychotropic medications among HIV-infected patients in the United States.
Am J Psychiatry 2003;160
(3)
547- 554
PubMedGoogle Scholar 34.Hotopf
MLewis
GNormand
C Putting trials on trial—the costs and consequences of small trials in depression: a systematic review of methodology.
J Epidemiol Community Health 1997;51
(4)
354- 358
PubMedGoogle Scholar 35.Bollini
PPampallona
STibaldi
GKupelnick
BMunizza
C Effectiveness of antidepressants: meta-analysis of dose-effect relationships in randomised clinical trials.
Br J Psychiatry 1999;174297- 303
PubMedGoogle Scholar 36.Newell
DJ Intention-to-treat analysis: implications for quantitative and qualitative research.
Int J Epidemiol 1992;21
(5)
837- 841
PubMedGoogle Scholar 37.Quitkin
FMRabkin
JGStewart
JW McGrath
PJHarrison
W Study duration in antidepressant research: advantages of a 12-week trial.
J Psychiatr Res 1986;20
(3)
211- 216
PubMedGoogle Scholar 38.Rush
AJFava
MWisniewski
SRLavori
PWTrivedi
MHSackeim
HAThase
MENierenberg
AAQuitkin
FMKashner
TMKupfer
DJRosenbaum
JFAlpert
JStewart
JW McGrath
PJBiggs
MMShores-Wilson
KLebowitz
BDRitz
LNiederehe
GSTAR*D Investigators Group, Sequenced Treatment Alternatives to Relieve Depression (STAR*D): rationale and design.
Control Clin Trials 2004;25
(1)
119- 142
PubMedGoogle Scholar 39.Froot
KA Consistent covariance matrix estimation with cross-sectional dependence and heteroskedasticity in financial data.
J Financ Quant Anal 1989;24
(3)
333- 355
Google Scholar 40.Williams
RL A note on robust variance estimation for cluster-correlated data.
Biometrics 2000;56
(2)
645- 646
PubMedGoogle Scholar 41.Rogers
WH Regression standard errors in clustered samples.
Stata Tech Bull 1993;1319- 23
Google Scholar 42.Wooldridge
JM Econometric Analysis of Cross Section and Panel Data. Cambridge, MA: MIT Press; 2002
43.Cole
SRHernán
MA Constructing inverse probability weights for marginal structural models.
Am J Epidemiol 2008;168
(6)
656- 664
PubMedGoogle Scholar 44.Khan
AWarner
HABrown
WA Symptom reduction and suicide risk in patients treated with placebo in antidepressant clinical trials: an analysis of the Food and Drug Administration database.
Arch Gen Psychiatry 2000;57
(4)
311- 317
PubMedGoogle Scholar 45.Kirsch
IDeacon
BJHuedo-Medina
TBScoboria
AMoore
TJJohnson
BT Initial severity and antidepressant benefits: a meta-analysis of data submitted to the Food and Drug Administration.
PLoS Med 2008;5
(2)
e45
PubMedGoogle Scholar 46.Fournier
JCDeRubeis
RJHollon
SDDimidjian
SAmsterdam
JDShelton
RCFawcett
J Antidepressant drug effects and depression severity: a patient-level meta-analysis.
JAMA 2010;303
(1)
47- 53
PubMedGoogle Scholar 47.Kish
L Weighting for unequal
Pi.
J Official Stat 1992;8
(2)
183- 200
Google Scholar 48.Thase
MESalloum
IMCornelius
JD Comorbid alcoholism and depression: treatment issues.
J Clin Psychiatry 2001;62
((suppl 20))
32- 41
PubMedGoogle Scholar 49.Paterson
DLSwindells
SMohr
JBrester
MVergis
ENSquier
CWagener
MMSingh
N Adherence to protease inhibitor therapy and outcomes in patients with HIV infection.
Ann Intern Med 2000;133
(1)
21- 30
PubMedGoogle Scholar 50.Bangsberg
DR Less than 95% adherence to nonnucleoside reverse-transcriptase inhibitor therapy can lead to viral suppression.
Clin Infect Dis 2006;43
(7)
939- 941
PubMedGoogle Scholar 51.Leserman
J HIV disease progression: depression, stress, and possible mechanisms.
Biol Psychiatry 2003;54
(3)
295- 306
PubMedGoogle Scholar 52.Ironson
GO’Cleirigh
CFletcher
MALaurenceau
JPBalbin
EKlimas
NSchneiderman
NSolomon
G Psychosocial factors predict CD4 and viral load change in men and women with human immunodeficiency virus in the era of highly active antiretroviral treatment.
Psychosom Med 2005;67
(6)
1013- 1021
PubMedGoogle Scholar 53.Anastos
KSchneider
MFGange
SJMinkoff
HGreenblatt
RMFeldman
JLevine
ADelapenha
RCohen
Mfor the Women's Interagency HIV Study Collaborative Group, The association of race, sociodemographic, and behavioral characteristics with response to highly active antiretroviral therapy in women.
J Acquir Immune Defic Syndr 2005;39
(5)
537- 544
PubMedGoogle Scholar 54.Cook
JAGrey
DBurke
JCohen
MHGurtman
ACRichardson
JLWilson
TEYoung
MAHessol
NA Depressive symptoms and AIDS-related mortality among a multisite cohort of HIV-positive women.
Am J Public Health 2004;94
(7)
1133- 1140
PubMedGoogle Scholar 55.Cruess
DGDouglas
SDPetitto
JMHave
TTGettes
DDubé
BCary
MEvans
DL Association of resolution of major depression with increased natural killer cell activity among HIV-seropositive women.
Am J Psychiatry 2005;162
(11)
2125- 2130
PubMedGoogle Scholar 56.Letendre
SLMarquie-Beck
JEllis
RJWoods
SPBest
BClifford
DBCollier
ACGelman
BBMarra
C McArthur
JC McCutchan
JAMorgello
SSimpson
DAlexander
TJDurelle
JHeaton
RGrant
ICHARTER Group, The role of cohort studies in drug development: clinical evidence of antiviral activity of serotonin reuptake inhibitors and HMG-CoA reductase inhibitors in the central nervous system.
J Neuroimmune Pharmacol 2007;2
(1)
120- 127
PubMedGoogle Scholar 57.Ances
BMLetendre
SLAlexander
TEllis
RJ Role of psychiatric medications as adjunct therapy in the treatment of HIV associated neurocognitive disorders.
Int Rev Psychiatry 2008;20
(1)
89- 93
PubMedGoogle Scholar 58.Robins
JMGreenland
S Identifiability and exchangeability for direct and indirect effects.
Epidemiology 1992;3
(2)
143- 155
PubMedGoogle Scholar 59.Pearl
J Direct and indirect effects. In:
Proceedings of the American Statistical Association Joint Statistical Meetings. Minneapolis, MN: MIRA Digital Publishing; 2005:1572-1581
Google Scholar 60.Cole
SRHernán
MARobins
JMAnastos
KChmiel
JDetels
RErvin
CFeldman
JGreenblatt
RKingsley
LLai
SYoung
MCohen
MMuñoz
A Effect of highly active antiretroviral therapy on time to acquired immunodeficiency syndrome or death using marginal structural models.
Am J Epidemiol 2003;158
(7)
687- 694
PubMedGoogle Scholar 61.Sterne
JAHernán
MALedergerber
BTilling
KWeber
RSendi
PRickenbach
MRobins
JMEgger
MSwiss HIV Cohort Study, Long-term effectiveness of potent antiretroviral therapy in preventing AIDS and death: a prospective cohort study.
Lancet 2005;366
(9483)
378- 384
PubMedGoogle Scholar 62.Delaney
JADaskalopoulou
SSSuissa
S Traditional versus marginal structural models to estimate the effectiveness of β-blocker use on mortality after myocardial infarction.
Pharmacoepidemiol Drug Saf 2009;18
(1)
1- 6
PubMedGoogle Scholar 63.Safren
SAO’Cleirigh
CTan
JYRaminani
SRReilly
LCOtto
MWMayer
KH A randomized controlled trial of cognitive behavioral therapy for adherence and depression (CBT-AD) in HIV-infected individuals.
Health Psychol 2009;28
(1)
1- 10
PubMedGoogle Scholar 64.Ironson
GWeiss
SLydston
DIshii
MJones
DAsthana
DTobin
JLechner
SLaperriere
ASchneiderman
NAntoni
M The impact of improved self-efficacy on HIV viral load and distress in culturally diverse women living with AIDS: the SMART/EST Women's Project.
AIDS Care 2005;17
(2)
222- 236
PubMedGoogle Scholar 65.Antoni
MHCarrico
AWDurán
RESpitzer
SPenedo
FIronson
GFletcher
MAKlimas
NSchneiderman
N Randomized clinical trial of cognitive behavioral stress management on human immunodeficiency virus viral load in gay men treated with highly active antiretroviral therapy.
Psychosom Med 2006;68
(1)
143- 151
PubMedGoogle Scholar 66.Posternak
MAZimmerman
MKeitner
GIMiller
IW A reevaluation of the exclusion criteria used in antidepressant efficacy trials.
Am J Psychiatry 2002;159
(2)
191- 200
PubMedGoogle Scholar 67.Zimmerman
MChelminski
IPosternak
MA Exclusion criteria used in antidepressant efficacy trials: consistency across studies and representativeness of samples included.
J Nerv Ment Dis 2004;192
(2)
87- 94
PubMedGoogle Scholar 68.Asch
SMKilbourne
AMGifford
ALBurnam
MATurner
BShapiro
MFBozzette
SAHCSUS Consortium, Underdiagnosis of depression in HIV: who are we missing?
J Gen Intern Med 2003;18
(6)
450- 460
PubMedGoogle Scholar 69.Liu
HMiller
LGHays
RDGolin
CEWu
TWenger
NSKaplan
AH Repeated measures longitudinal analyses of HIV virologic response as a function of percent adherence, dose timing, genotypic sensitivity, and other factors.
J Acquir Immune Defic Syndr 2006;41
(3)
315- 322
PubMedGoogle Scholar 70.Petersen
MLWang
Yvan der Laan
MJGuzman
DRiley
EBangsberg
DR Pillbox organizers are associated with improved adherence to HIV antiretroviral therapy and viral suppression: a marginal structural model analysis.
Clin Infect Dis 2007;45
(7)
908- 915
PubMedGoogle Scholar 71.Bangsberg
DRPerry
SCharlebois
EDClark
RARoberston
MZolopa
ARMoss
A Non-adherence to highly active antiretroviral therapy predicts progression to AIDS.
AIDS 2001;15
(9)
1181- 1183
PubMedGoogle Scholar 72.Bozzette
SABerry
SHDuan
NFrankel
MRLeibowitz
AALefkowitz
DEmmons
CASenterfitt
JWBerk
MLMorton
SCShapiro
MFHIV Cost and Services Utilization Study Consortium, The care of HIV-infected adults in the United States.
N Engl J Med 1998;339
(26)
1897- 1904
PubMedGoogle Scholar 73.Burnam
MAKoegel
P Methodology for obtaining a representative sample of homeless persons: the Los Angeles Skid Row Study.
Eval Rev 1988;12
(2)
117- 152
Google Scholar 74.Hirschfeld
RMCross
CK Epidemiology of affective disorders.
Arch Gen Psychiatry 1982;39
(1)
35- 46
PubMedGoogle Scholar 75.Weiser
SDWolfe
WRBangsberg
DR The HIV epidemic among individuals with mental illness in the United States.
Curr HIV/AIDS Rep 2004;1
(4)
186- 192
PubMedGoogle Scholar 76.Fischer
PJBreakey
WR The epidemiology of alcohol, drug, and mental disorders among homeless persons.
Am Psychol 1991;46
(11)
1115- 1128
PubMedGoogle Scholar 77.MacGillivray
SArroll
BHatcher
SOgston
SReid
ISullivan
FWilliams
BCrombie
I Efficacy and tolerability of selective serotonin reuptake inhibitors compared with tricyclic antidepressants in depression treated in primary care: systematic review and meta-analysis.
BMJ 2003;326
(7397)
1014
PubMedGoogle Scholar 78.Hansen
RAGartlehner
GLohr
KNGaynes
BNCarey
TS Efficacy and safety of second-generation antidepressants in the treatment of major depressive disorder.
Ann Intern Med 2005;143
(6)
415- 426
PubMedGoogle Scholar 79.Gartlehner
GGaynes
BNHansen
RAThieda
PDeVeaugh-Geiss
AKrebs
EEMoore
CGMorgan
LLohr
KN Comparative benefits and harms of second-generation antidepressants: background paper for the American College of Physicians.
Ann Intern Med 2008;149
(10)
734- 750
PubMedGoogle Scholar 80.Cole
SRFrangakis
CE The consistency statement in causal inference: a definition or an assumption?
Epidemiology 2009;20
(1)
3- 5
PubMedGoogle Scholar 81.Mortimer
KMNeugebauer
Rvan der Laan
MTager
IB An application of model-fitting procedures for marginal structural models.
Am J Epidemiol 2005;162
(4)
382- 388
PubMedGoogle Scholar 82.Tager
IBHaight
TSternfeld
BYu
Zvan Der Laan
M Effects of physical activity and body composition on functional limitation in the elderly: application of the marginal structural model.
Epidemiology 2004;15
(4)
479- 493
PubMedGoogle Scholar 83.Robins
JM A new approach to causal inference in mortality studies with a sustained exposure period: application to control of the healthy worker survivor effect.
Math Model 1986;7
(9-12)
1393- 1512doi:10.1016/0270-0255(86)90088-6
Google Scholar 84.Robins
JM Addendum to “A new approach to causal inference in mortality studies with a sustained exposure period: application to control of the healthy worker survivor effect.”
Comput Math Appl 1987;14
(9-12)
923- 945
Google Scholar 85.Peto
RPike
MCArmitage
PBreslow
NECox
DRHoward
SVMantel
N McPherson
KPeto
JSmith
PG Design and analysis of randomized clinical trials requiring prolonged observation of each patient, I: introduction and design.
Br J Cancer 1976;34
(6)
585- 612
PubMedGoogle Scholar 86.Deshauer
DMoher
DFergusson
DMoher
ESampson
MGrimshaw
J Selective serotonin reuptake inhibitors for unipolar depression: a systematic review of classic long-term randomized controlled trials.
CMAJ 2008;178
(10)
1293- 1301
PubMedGoogle Scholar 87.Gartlehner
GHansen
RACarey
TSLohr
KNGaynes
BNRandolph
LC Discontinuation rates for selective serotonin reuptake inhibitors and other second-generation antidepressants in outpatients with major depressive disorder: a systematic review and meta-analysis.
Int Clin Psychopharmacol 2005;20
(2)
59- 69
PubMedGoogle Scholar 88.Storosum
JGElferink
AJvan Zwieten
BJvan den Brink
WGersons
BPvan Strik
RBroekmans
AW Short-term efficacy of tricyclic antidepressants revisited: a meta-analytic study.
Eur Neuropsychopharmacol 2001;11
(2)
173- 180
PubMedGoogle Scholar